Development and Content Validation of a Socioscientific Problem-Solving Skills Instrument in Biology Education: an Animal Conservation Context

Anwari Adi Nugroho; Suwarto Suwarto; Agus Purwanto; Hemalia Susanti; Tyas Indriasari; Alem Abdildauly

doi:10.32502/ycxbq839

Authors

Anwari Adi Nugroho Universitas Veteran Bangun Nusantara
Suwarto Suwarto Universitas Veteran Bangun Nusantara
Agus Purwanto Universitas Veteran Bangun Nusantara
Hemalia Susanti Universitas Veteran Bangun Nusantara
Tyas Indriasari Universitas Veteran Bangun Nusantara
Alem Abdildauly Zhetysu University named after Ilyas Zhansugurov

DOI:

https://doi.org/10.32502/ycxbq839

Keywords:

animal conservation, instrument, socioscientific, validity, problem solving

Abstract

This study aimed to develop and establish the content validity of a Socioscientific Problem-Solving Skills (SSPS) instrument for biology education in the context of animal conservation. A research and development design was employed using a modified Delphi method. The instrument integrates four socioscientific issue (SSI) components scientific evidence, moral reasoning, stakeholder perspectives, and uncertainty with four problem-solving dimensions. Ten experts evaluated the instrument, and data were analyzed using Aiken’s V coefficient. The instrument comprises eight open-ended essay items representing four SSPS dimensions. After one round of expert evaluation and refinement, all items met acceptable content validity criteria, with Aiken’s V coefficients ranging from 0.78 to 1.00 across five validation aspects. Minor revisions were made to construct alignment and contextual representation based on qualitative expert feedback. These findings indicate that the instrument is conceptually grounded and multidimensional, with adequate content validity for assessing cognitive and socio-ethical aspects of problem solving in animal conservation contexts. The study was limited to expert-based content validation and did not include empirical testing with students. Further empirical validation is needed to examine its construct validity and reliability, particularly among pre-service biology teachers. The instrument provides a framework for integrating SSI and problem-solving in biology education.

References

Agustian, H. Y. (2025). The Critical Role of Understanding Epistemic Practices in Science Teaching Using Wicked Problems. Science & Education, 34(1), 485–510. https://doi.org/10.1007/s11191-023-00471-2

Almanasreh, E., Moles, R. J., & Chen, T. F. (2022). A practical approach to the assessment and quantification of content validity. In Contemporary Research Methods in Pharmacy and Health Services (pp. 583–599). Elsevier Inc. https://doi.org/10.1016/B978-0-323-91888-6.00013-2

Ariza, M. R., Christodoulou, A., Harskamp, M. Van, Knippels, M. P. J., Kyza, E. A., Levinson, R., & Agesilaou, A. (2021). Socio-Scientific Inquiry-Based Learning as a Means toward Environmental Citizenship. Sustainability, 13, 11509. https://doi.org/10.3390/ su132011509

Arroyavea, F. J., Goyenechea, O. Y. R., Meredith Gore, Heimeriks, G., Jenkins, J., & Petersen, A. M. (2021). On the social and cognitive dimensions of wicked environmental problems characterized by conceptual and solution uncertainty. Advances in Complex Systems, 24(03n04), 2150005. https://doi.org/10.48550/arXiv.2104.10279

Arslan, G., & Tüysüz, M. (2023). Investigation of the Effects of Socio-Scientific Topics Taught in the Scope of Argumentation-Based Education Supported by the Storytelling Technique on the Development of 8th Grade Students’ Critical Thinking Skills, Attitudes towards Science and Argument. Cumhuriyet International Journal of Education, 12(1), 1170029. https://doi.org/10.30703/cije.1170029

Arthamena, V. D., Ayubi, M., Atun, S., & Putri, S. E. (2025). Effectiveness of a Problem-Based Learning Model Integrated with Socio- Scientific Issues to Improve Science Process Skills of High School Students. JKPK (JURNAL KIMIA DAN PENDIDIKAN KIMIA), 10(1), 203–219. https://doi.org/10.20961/jkpk.v10i1.92581

Atabey, N., & Topçu, M. S. (2025). Analyzing socioscientific issues-based instruction studies focusing on character and value development: A systematic review. Journal of Moral Education, 54(3), 485–503. https://doi.org/10.1080/03057240.2024.2324781

Bächtold, M., & Pallarès, G. (2022). Combining debates and reflective activities to develop students ’ argumentation on socioscientific issues. Journal OfResearch in Science Teaching, 60, 761–806. https://doi.org/10.1002/tea.21816

Badenes-ribera, L., Silver, N. C., Pedroli, E., & Badenes-ribera, L. (2020). Editorial : Scale Development and Score Validation. Front in Psychologysychology, 11(April), 1–4. https://doi.org/10.3389/fpsyg.2020.00799

Ben-horin, H., Kali, Y., & Tal, T. (2023). The Fifth Dimension in Socio-Scientific Reasoning : Promoting Decision-Making about Socio-Scientific Issues in a Community. Sustainability, 15, 9708. https://doi.org/10.3390/su15129708

Bernhardt, V., & Wilde, M. (2026). Between Action and Reflection — Development and Factorial Validation of a Questionnaire on Pre-Service Biology Teachers ’ Beliefs About Instrumental and Reflective ESD Approaches. Sustainability, 18(6), 3110. https://doi.org/10.3390/su18063110

Bhakti, Y. B., Arthur, R., & Supriyati, Y. (2025). Development and validation of a complex true- false multiple-choice test for assessing critical thinking skills in physics. Cogent Education, 12(1). https://doi.org/10.1080/2331186X.2025.2553008

Boateng, G. O., Neilands, T. B., & Frongillo, E. A. (2018). Best Practices for Developing and Validating Scales for Health , Social , and Behavioral Research : A Primer. Front in Public Health, 6(149), 1–18. https://doi.org/10.3389/fpubh.2018.00149

Brady, S. R. (2015). Utilizing and Adapting the Delphi Method for Use in Qualitative Research. International Journal of Qualitative Methods, 1–6. https://doi.org/10.1177/1609406915621381

Budiyono. (2017). Pengantar Metodologi Penelitian Pendidikan. UNS Pres.

Ceyhan, G. D., Lombardi, D., Saribas, D., & Lombardi, D. (2021). Probing into Pre-Service Science Teachers ’ Practices of Scientific Evaluation and Decision- Making on Socio-scientific Issues Probing into Pre-Service Science Teachers ’ Practices of Scientific Evaluation and Decision-Making on Socio-scientific Issues. Journal of Science Teacher Education, 32(8), 865–889. https://doi.org/10.1080/1046560X.2021.1894762

Chen, L., & Xiao, S. (2021). Perceptions , challenges and coping strategies of science teachers in teaching socioscientific issues : A systematic review. Educational Research Review, 32, 100377. https://doi.org/10.1016/j.edurev.2020.100377

Christenson, N., Chang Rundgren, S. N., & Höglund, H. O. (2012). Using the SEE-SEP Model to Analyze Upper Secondary Students’ Use of Supporting Reasons in Arguing Socioscientific Issues. Journal of Science Education and Technology, 21(3), 342–352. https://doi.org/10.1007/s10956-011-9328-x

Christenson, N., & Walan, S. (2023). Developing Pre-service Teachers’ Competence in Assessing Socioscientific Argumentation. Journal of Science Teacher Education, 34(1), 1–23. https://doi.org/10.1080/1046560X.2021.2018103

Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). In Lawrence Earlbaum Associates. Routledge. https://doi.org/10.4324/9780203771587

Dejanovikj, J., & Höttecke, D. (2024). Promoting Reflections on Decision‐Making in Socio‐Scientific Issues. Research in Subject-Matter Teaching and Learning (RISTAL, 7(1), 40–60. https://doi.org/10.2478/ristal-2024-0004

Durak, B., & Sami, M. (2025). Exploring Teachers ’ Professional Development on Socioscientific Issues and Model ‑ Based Learning : A Multiple Case Study. Science & Education, 34(6), 4451–4490. https://doi.org/10.1007/s11191-025-00628-191-025-00628-1

Dusturia, N., Nurohman, S., & Wilujeng, I. (2024). Socio-Scientific Issues ( SSI ) Approach Implementation in Science Learning to Improve Students ’ Critical Thinking Skills : Systematic Literature Review. Jurnal Penelitian Pendidikan IPA, 10(3), 149–157. https://doi.org/https://doi.org/10.29303/jppipa.v10i3.6012

Edelblutte, É., Krithivasan, R., & Hayek, M. N. (2022). Animal agency in wildlife conservation and management. Conservation Biology, 37(1), e13853. https://doi.org/10.1111/cobi.13853

Ehrich, J. F., Howard, S. J., Bokosmaty, S., Woodcock, S., & Martin, A. J. (2021). An Item Response Modeling Approach to Cognitive Load Measurement. Frontiers in Education, 6(April), 1–11. https://doi.org/10.3389/feduc.2021.648324

Eryan, A. (2024). Review on Illegal Wildlife Trade Provisions in Indonesia : Cost- Benefit Analysis and Law Enforcement. Indonesian Journal of International Law (2024), 21(5), 35–66. https://doi.org/10.17304/ijil.vol21.5.1877

Evagorou, M., Mauriz, B. P., Mauriz, P., Engaging, B., Evagorou, M., & Mauriz, B. P. (2017). Engaging Elementary School Pre-service Teachers in Modeling a Socioscientific Issue as a Way to Help Them Appreciate the Social Aspects of Science To cite this article : Engaging Elementary School Pre-service Teachers in Modeling a Socioscientific Issue a. International Journal of Education in Mathematics, Science and Technology (IJEMST), 5(2), 113–123. https://doi.org/10.18404/ijemst.99074

Facione, P. A. (2015). Critical Thinking : What It Is and Why It Counts. Insight Assessment, 1(1), 1–30.

Faisal, & Martin, S. N. (2022). Exploring Indonesian Biology Teachers ’ Perceptions and Attitudes Towards Socio- Scientific Issues-Based Instruction. Asia-Pacific Science Education, 8(1), 256–291. https://doi.org/10.1163/23641177-bja10042

Faisal, Nurhayati, B., Arifin, A. N., & Martin, S. N. (2025). Challenges and Strategies in Teaching Socioscientific Issue s : A Study of Indonesian Pre-Service Biology Teachers. ASIA-PACIFIC SCIENCE EDUCATION (2025), 11(2), 1–34. https://doi.org/10.1163/23641177-bja10098

Fang, S. C., Hsu, Y. S., & Lin, S. S. (2019). Conceptualizing socioscientific decision making from a review of research in science education. International Journal of Science and Mathematics Education, 17(3), 427–448. https://doi.org/10.1007/s10763-018-9890-2

Folger, T. D., & Bostic, J. (2023). Defining Test-Score Interpretation , Use , and Claims : Delphi Study for the Validity Argument. Educational Measurement: Issues and Practice, 42(3), 22–38. https://doi.org/10.1111/emip.12569

Friedrichsen, P. J., Ke, L., Sadler, T. D., Zangori, L., Friedrichsen, P. J., Ke, L., Sadler, T. D., Zangori, L., Friedrichsen, P. J., & Sadler, T. D. (2020). Enacting Co-Designed Socio-Scientific Issues-Based Curriculum Units : A Case of Secondary Science Teacher Learning Enacting Co-Designed Socio-Scientific Issues-Based Curriculum Units : A Case of Secondary Science Teacher Learning ABSTRACT. Journal of Science Teacher Education ISSN:, 32(1), 85–106. https://doi.org/10.1080/1046560X.2020.1795576

Friedrichsen, P. J., Sadler, T. D., Graham, K., & Brown, P. (2016). Design Of A Socio-Scientific Issue Curriculum Unit : Antibiotic Resistance , Natural Selection, And Modeling. International Journal of Designs for Learning, 7(1), 1–18. https://doi.org/10.14434/ijdl.v7i1.19325

Grace, M., & Grace, M. (2009). Developing High Quality Decision ‐ Making Discussions About Biological Conservation in a Normal Classroom Setting Developing High Quality Decision- Making Discussions About Biological Conservation in a Normal Classroom. International Journal of Science Education, 31(4), 551–570. https://doi.org/10.1080/09500690701744595

Graesser, A., Kuo, B., & Liao, C. (2017). Complex Problem Solving in Assessments of Collaborative Problem Solving. Journal of Intelligence Review, 5(10), 1–14. https://doi.org/10.3390/jintelligence5020010

GÜLER, O., & ŞENGÜL, A. A. (2023). Argumentation-Based Learning and P4C Approach: A Seventh-Grade Study on Socio-Scientific Issues. Kaygı, 22(3), 457–481. https://doi.org/10.20981/kaygi.1334782

Guo, S., Shi, L., & Zhai, X. (2024). Validating an Instrument for Teachers ’ Acceptance of Artificial Intelligence in Education. ArXiv Preprint ArXiv, 2406, 10506. https://doi.org/10.48550/arXiv.2406.10506

Habibi, A., Sarafrazi, A., & Izadyar, S. (2014). Delphi Technique Theoretical Framework in Qualitative. The International Journal Of Engineering And Science (IJES), 3(4), 8–13. Retrieved from https://www.researchgate.net/publication/272177606_Delphi_Technique_Theoretical_Framework_in_Qualitative

Han, C., & Lu, X. (2021). Interpreting quality assessment re-imagined : The synergy between human and machine scoring. Interpreting and Society: An Interdisciplinary Journal, 1(1), 70–90. https://doi.org/10.1177/27523810211033670

Hartelt, T., & Martens, H. (2025). Development and validation of an instrument measuring students ’ self-efficacy regarding explaining evolutionary changes changes. Journal of Biological Education, 1–35. https://doi.org/10.1080/00219266.2025.2546795

Högström, P., Gericke, N., Wallin, J., & Bergman, E. (2024). Teaching socioscientific issues: A systematic review. Science and Education, 1–44. https://doi.org/10.1007/s11191-024-00542-y

Hsu, C., & Ohio, T. (2007). The Delphi Technique : Practical Assessment, Research & Evaluation, 12(10), 1–8. https://doi.org/10.7275/pdz9-th90

Ilyana, N., Tajuddin, I., Abas, U., Aziz, K. A., Nor, R., Nor, H., & Izni, N. A. (2025). Content Valid ity Assessment Using Aiken ’ s V : Knowledge Integration Model for Blockchain in Higher Learning Institutions. (IJACSA) International Journal of Advanced Computer Science and Applications, 16(6), 601–608. https://doi.org/10.15294/jere.v12i2.76451

Irwanto, Rubini, B., & Pursitasari, I. D. (2022). Socio Scientific Issues-Based Argumentation Assessment for Middle School Students. Jurnal Penelitian Pendidikan IPA, 8(2), 1034–1041. https://doi.org/10.29303/jppipa.v8i2.844

Jackson, W. M., Binding, M. K., Grindstaff, K., Hariani, M., & Koo, B. W. (2023). Addressing Sustainability in the High School Biology Classroom through Socioscientific Issues. Sustainability, 15(7), 5766. https://doi.org/10.3390/su15075766

Jacobs, D. B., Evagorou, M., Shwartz, Y., & Akaygun, S. (2022). Editorial : Science education for citizenship through Socio-Scientific Issues. Frontiers in Education, 7, 1011576. https://doi.org/10.3389/feduc.2022.1011576

Jafari, M., & Meisert, A. (2023). Potential of Group ‑ Based Negotiation to Promote Learner ‑ Based Reasoning and Weighting of Arguments on Socioscientific Issues. Research in Science Education, 53, 377–403. https://doi.org/10.1007/s11165-022-10059-5

Jandhyala, R. (2020). Delphi , non-RAND modified Delphi , RAND / UCLA appropriateness method and a novel group awareness and consensus methodology for consensus measurement : a systematic literature review measurement : a systematic literature review. Current Medical Research and Opinion, 36(11), 1873–1887. https://doi.org/10.1080/03007995.2020.1816946

Jimenez, P. C., Alred, A. R., & Dauer, J. M. (2024). Describing undergraduate students ’ reasoning and use of evidence during argumentation about socioscientific issues systems. Frontiers in Education, 9, 1371095. https://doi.org/10.3389/feduc.2024.1371095

Kania, N., Kusumah, Y. S., Dahlan, J. A., Nurlaelah, E., & Gürbüz, F. (2024). Constructing and providing content validity evidence through the Aiken ’ s V index based on the experts ’ judgments of the instrument to measure mathematical problem-solving skills. REID (Research and Evaluation in Education), 10(1), 64–79. https://doi.org/10.21831/reid.v10i1.71032

Kansky, R., Kidd, M., & Knight, A. T. (2016). A wildlife tolerance model and case study for understanding human wildlife con fl icts. BIOC, 201, 137–145. https://doi.org/10.1016/j.biocon.2016.07.002

Karaman, C., & Aylin, T. (2025). The Effect of Argumentation on Middle School Students ’ Scientific Literacy as well as their Views , Attitudes and Knowledge About Socioscientific Issues. Science & Education, 34(3), 1363–1388. https://doi.org/10.1007/s11191-023-00489-6

Karışan, D., & Eilks, I. (2023). Sources of knowledge and trust in authorities as prerequisites of pre-s ervice teachers ’ reflective judgment skills in the context of socioscientific issues. Journal of Pedagogical Research, 7(5), 1–17. https://doi.org/10.33902/JPR.202322416 Research

Khasanah, R. N., Kusumadani, A. I., & Mulyono, Y. (2025). The Effect of the SSPBLS Model Using Quizizz Media on the Learning Outcomes of High School Students on Digestive System Materials. Journal of Biology Learning, 7(2), 64–70. https://doi.org/10.32585/jbl.v7i2.6489

Khodi, A. (2021). The affectability of writing assessment scores : a G-theory analysis of rater , task , and scoring method contribution. Language Testing in Asia, 11(30), 1–27. https://doi.org/10.1186/s40468-021-00134-5

Kinslow, A. T., Sadler, T. D., Nguyen, H. T., Kinslow, A. T., Sadler, T. D., & Socio-scientific, H. T. N. (2018). Socio-scientific reasoning and environmental literacy in a field-based ecology class. Environmental Education Research, 4622, 1–22. https://doi.org/10.1080/13504622.2018.1442418

Kumar, V., Choudhary, S. K., & Singh, R. (2024). Environmental socio-scientific issues as contexts in developing scientific literacy in science education: A systematic literature review. Social Sciences and Humanities Open, 9(November 2023), 100765. https://doi.org/10.1016/j.ssaho.2023.100765

Kusumadani, A. I., Agustina, L., Astuti, R., Agustina, P., & Affandy, H. (2026). The Effectiveness of the Socioscientific Blended Project-Based Learning ( PjBL ) Model in Improving Higher-Order Thinking Skills. Journal of Biology Learning, 8(1), 28–34. https://doi.org/10.32585/jbl.v8i1.8044

Kusumadewi, P. D. A., Wening, S., Budiastuti, E., & Widihastuti. (2025). Development and Validation of a Higher-Order Thinking Skills-Based Test on Citizen Participation in Consumer Education Using Item Response Theory. JISAE (Journal of Indonesian Student Assessment and Evaluation), 11(1), 35–45. https://doi.org/10.21009/jisae.v11i1.55820

Lacorte, J. H. S. (2025). Characteristics of Knowledge in Socioscientific Decision Making. Journal of Social Sciences and Management Studies, 4(1), 58–80. https://doi.org/10.56556/jssms.v4i1.1135

Ladachart, L., & Ladachart, L. (2022). Preservice biology teachers ’ decision-making on , and informal reasoning about , an agriculture- based socioscientific issue. Journal of Biological Education, 00(00), 1–17. https://doi.org/10.1080/00219266.2022.2058587

Lee, Y. C., & Grace, M. (2012). Students ’ Reasoning and Decision Making About a Socioscientific Issue : A Cross-Context Comparison. Science Education, 96(5), 787–807. https://doi.org/10.1002/sce.21021

Leij, T. Van Der, Goedhart, M., Avraamidou, L., & Wals, A. (2024). Designing a module for supporting secondary biology students ’ morality through socioscientific issues in the human-nature context. Journal of Biological Education, 58(5), 1186–1203. https://doi.org/10.1080/00219266.2023.2174160

Leung, J. S. C., Cheng, M. M. W., & Chik, P. Y. Y. (2025). Fostering systems thinking about socioscientific issues. International Journal of Science Education, 47(9), 1150–1168. https://doi.org/10.1080/09500693.2024.2360707

Lewis, A. (1985). Three coefficients for analysing Reliability and Validity of rating. Educational and Psychological Measurement, 45. https://doi.org/10.1177/07399863870092005

Luan, X., Wu, P., Sun, S., Wang, Y., & Gao, X. (2018). Quantitative study of the crop production water footprint using the SWAT model. Ecological Indicators, 89, 1–10. https://doi.org/10.1016/j.ecolind.2018.01.046

Mansur, F. A., & Manaf, A. (2023). Analysis of The Aiken Index to Measure The Content Validity of The Wolio Language and Culture Preservation Model Instrument. ELS Journal on Interdisciplinary Studies in Humanities, 6(3), 567–573. https://doi.org/10.34050/elsjish.v6i3.29667

Marlina, R., Yuenyong, C., Hamdani, H., & Saefi, M. (2025). Development and validation of Biology Interest Instrument ( BII ) for sustainability of professional teacher education. JPBI (Jurnal Pendidikan Biologi Indonesia), 11(2), 460–471. https://doi.org/10.22219/jpbi.v11i 2.40496

Mokkink, L. B., Boers, M., Vleuten, C. P. M. Van Der, Bouter, L. M., Alonso, J., & Patrick, D. L. (2020). COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments : a Delphi study. MC Medical Research Methodology, 20(293), 1–13. https://doi.org/10.1186/s12874-020-01179-5

Murgado-Armenteros, E. M., Torres-Ruiz, F. J., & Vega-Zamora, M. (2012). Differences between online and face to face focus groups, viewed through two approaches. Journal of Theoretical and Applied Electronic Commerce Research, 7(2), 73–86. https://doi.org/10.4067/S0718-18762012000200008

Mustika, R. A., Fadly, W., & David, M. (2025). Students ’ Socio-scientific Reasoning to Measure Decision-Making Ability Related to Sustainable Energy Issues. Journal of Innovation in Educational and Cultural Research, 6(1), 220–228. https://doi.org/10.46843/jiecr.v6i1.2185

Nasir, M., Ibrohim, I., & Susilo, H. (2026). Integrating Indigenous science into environmental education for sustainability: Evidence from pre-service biology teachers in South Sulawesi, Indonesia. The Journal of Environmental Education, 1–11. https://doi.org/10.1080/00958964.2026.2631976

Navarro-perez, M., & Tidball, K. G. (2012). Challenges of Biodiversity Education : A Review of Education Strategies for Biodiversity Education. International Electronic Journal of Environmental Education, 2(1), 13-30. Retrieved from https://www.researchgate.net/publication/235624755_Challenges_of_Biodiversity_Education_A_Review_of_Education_Strategies_for_Biodiversity_Education

Nida, S., Rahayu, S., & Eilks, I. (2020). A survey of Indonesian science teachers’ experience and perceptions toward socio-scientific issues-based science education. Education Sciences, 10(2), 1–15. https://doi.org/10.3390/educsci10020039

Noroozi, S., & Karami, H. (2022). A scrutiny of the relationship between cognitive load and difficulty estimates of language test items. Language Testing in Asia, 8(12), 13. https://doi.org/10.1186/s40468-022-00163-8

Nugroho, A. A., Purwanto, A., Armania, V., & Yulia, P. (2024). Konstruksi dan Validasi Instrumen Tes Socioscientific Argumentation Skills Pada Topik Hutan Mangrove : Sebuah Metode Delphi Construction And Validation Of Socioscientific Argumentation Skills Test Instrument On Mangrove Forest Topic : A Delphi Method. Didaktika Biologi: Jurnal Penelitian Pendidikan Biologi (2024), 8(2), 67–77. https://doi.org/10.32502/didaktikabiologi.v8i2.244

Nugroho, A. A., Sajidan, Suranto, & Masykuri, M. (2025). The Effects Of Socio- Scientific Inquiry Based Learning On Students ’ Problem-Solving Skills. Journal of Baltic Science Education, 24(1), 149–168. https://doi.org/10.33225/jbse/25.24.149

Nurjanah, S., Istiyono, E., Widihastuti, W., & Iqbal, M. (2023). The Application of Aiken ’ s V Method for Evaluating the Content Validity of Instruments that Measure the Implementation of Formative Assessments. Journal of Research and Educational Research Evaluation, 12(2), 125–133. https://doi.org/10.15294/jere.v12i2.76451

OECD. (2019). OECD learning compass 2030: A series of concept notes. the Secretary-General of the OECD. Retrieved from https://www.oecd.org/content/dam/oecd/en/about/projects/edu/education-2040/concept-notes/OECD_Learning_Compass_2030_concept_note.pdf

Oxley, E., Nash, H. M., Weighall, A. R., Oxley, E., Nash, H. M., Consensus, A. R. W., & Oxley, E. (2025). Consensus building using the Delphi method in educational research : a case study with educational professionals research : a case study with educational professionals. International Journal of Research & Method in Education, 48(1), 29–43. https://doi.org/10.1080/1743727X.2024.2317851

Palermo, C. (2022). Rater characteristics , response content , and scoring contexts : Decomposing the determinates of scoring accuracy. Front in Psychology, 13, 937097. https://doi.org/10.3389/fpsyg.2022.937097

Parejo, J. (2022). An analysis of educational innovation culture by a Delphi expert panel. Frontiers in Education, 7, 991263. https://doi.org/10.3389/feduc.2022.991263

Polit, D. F., Beck, T., & Owen, S. V. (2007). Focus on Research Methods Is the CVI an Acceptable Indicator of Content Validity ? Appraisal and Recommendations. ResearchinNursing&Health, 30, 459–467. https://doi.org/10.1002/nur

Pooley, S., Bhatia, S., & Vasava, A. (2020). Rethinking the study of human – wildlife coexistence. Conservation Biology, 35(3), 784–793. https://doi.org/10.1111/cobi.13653

Pratiwi, D., & Yamtinah, S. (2025). Content Validity Analysis of AKM Reading Literacy Test Instruments on Acid – Base Theory and Equilibrium Using the Aiken ’ s V Method. Jurnal Inovasi Pendidikan Kimia, 19(2), 120–124. https://doi.org/10.15294/jipk.v19i2.6046

Presley, M. L., Sickel, A. J., Muslu, N., & Merle-Johnson, D. (2013). A framework for socio-scientific issues based education. Science Educator, 22(1), 26–32. Retrieved from https://eric.ed.gov/?id=EJ1062183

Purnamasari, A. P., Suma, K., & Rapi, N. K. (2025). The Effect of Problem-Based Learning within Socioscientific Contexts on Students ’ Scientific Literacy and Argumentation Skills. Jurnal Penelitian Pendidikan IPA, 11(10), 707–716. https://doi.org/10.29303/jppipa.v11i10.11970

Qamariyah, S. N., Rahayu, S., Fajaroh, F., & Alsulami, N. M. (2021). The effect of implementation of inquiry-based learning with socio-scientific issues on students’ higher-order thinking skills. Journal of Science Learning, 4(3), 210–218. https://doi.org/10.17509/jsl.v4i3.30863

Rasis, R., Paidi, Suhartini, Kuswanto, H., & Hartanti, R. D. (2023). The Effect of Environmental Education Open Inquiry Learning Kits on the Environmental Literacy of Pre-service Biology Teachers. Journal of Teacher Education for Sustainability, 25(1), 40–63. https://doi.org/10.2478/jtes-2023-0004

Rifa’i, R. M., & Subiantoro, A. W. (2022). Kelayakan Web Pembelajaran Biologi Berbasis Socio- Scientific Issues Topik Sistem Pernapasan Untuk Pengembangan Literasi Kesehatan Siswa Feasibility Of Socio-Scientific Issues-Based Biology Learning Web On Respiratory System Topic For Students’ Health. Didaktika Biologi: Jurnal Penelitian Pendidikan Biologi, 6(1), 31–41. https://doi.org/10.32502/dikbio.v6i1.3690

Rohmah, S. N., Iswari, R. S., Saptono, S., & Semarang, U. N. (2022). The Development of Biodiversity Teaching Materials Based on Socio Scientific Issues to Improve Students ’ Science Literacy. Journal of Innovative Science Education, 11(37), 177–186. https://doi.org/10.15294/jise.v10i1.51531

Romine, W. L., Sadler, T. D., & Kinslow, A. T. (2016). Assessment of Scientific Literacy : Development and Validation of the Quantitative Assessment of Socio-Scientific Reasoning ( QuASSR ). Journal Of Research In Science Teaching, 54(2), 274–295. https://doi.org/10.1002/tea.21368

Sablatzky, T. (2022). Peer Reviewed Article Methods Moment : The Delphi Method Peer Reviewed Article. Hypothesis, 34(1), 1–6. https://doi.org/10.18060/26224

Sadler, T. D. (2011). Socio-scientific issues-based education: What we know about science education in the context of SSI. In Socio-scientific Issues in the Classroom: Teaching, Learning 355 and Research (pp. 355–369). Springer Science+Business Media B.V. https://doi.org/10.1007/978-94-007-1159-4_20

Sadler, T. D., Romine, W. L., & Topçu, M. S. (2016). Learning science content through socio-scientific issues-based instruction: a multi-level assessment study. International Journal of Science Education, 38(10), 1622–1635. https://doi.org/10.1080/09500693.2016.1204481

Sakamoto, M., Yamaguchi, E., Yamamoto, T., & Wakabayashi, K. (2021). An intervention study on students ’ decision- making towards consensus building on socio- scientific issues. International Journal of Science Education, 43(12), 1965–1983. https://doi.org/10.1080/09500693.2021.1947541

Sari, D. R., Saputro, S., Maret, U. S., & Maret, U. S. (2024). A Systematic Review on Integrating SSI into Science Education: Educational Studies and Research Journal, 2(1), 1–14. https://doi.org/10.60036/sa6n0870

Sarkity, D., Fernando, A., Eka, N., & Hindrasti, K. (2023). Designing and Content Validity of Instrument for Measuring Marine Environmental Care Attitude Through Integrated Science Learning. BIO Web of Conferences, 70, 02011. https://doi.org/10.1051/bioconf/20237002011

Schmäing, T., Assaraf, O. B., Bielik, T., & Krell, M. (2026). Exploring Correlations Between Pre-service Biology Teachers ’ Systems Thinking Skills and Environmental Awareness. Research in Science Education. https://doi.org/10.1007/s11165-026-10333-w

Setiawan, R., Wagiran, W., & Alsamiri, Y. (2024). Construction of an instrument for evaluating the teaching process in higher education: Content and construct validity. REID (Research and Evaluation in Education), 10(1), 50–63. https://doi.org/10.21831/reid.v10i1.63483

Sireci, S., & Benítez, I. (2023). Psicothema Evidence for Test Validation : A Guide for Practitioners. Psicothema, 35(3), 217–226. https://doi.org/10.7334/psicothema2022.477

Smit, R., Rietz, F., & Büchel, D. (2025). Using the socioscientific issue approach to foster secondary students ’ argumentation skills , science self-efficacy beliefs and science interest. International Journal of Science Education, 0693, 1–17. https://doi.org/https://doi.org/10.1080/09500693.2025.2460050

Smith, T. I., Eaton, P., & Boudreaux, A. (2020). Toward a valid instrument for measuring physics quantitative literacy. Paper presented at Physics Education Research Conference 2020, Virtual Conference. https://doi.org/10.1119/perc.2020.pr.Smith_T

Sparks, R. A., Jimenez, P. C., Kirby, C. K., & Dauer, J. M. (2022). Using critical integrative argumentation to assess socioscientific argumentation across decision-making contexts. Education Sciences, 12(10), 1–31. https://doi.org/10.3390/educsci12100644

Susantini, E., Sari, Y. M., Asteria, P. V., & Marzuqi, M. I. (2025). Proving content validity of android-based higher order thinking skill assessment for science and mathematics preservice teacher. Journal of Education and Learning (EduLearn), 19(1), 551–560. https://doi.org/10.11591/edulearn.v19i1.21207

Taherdoost, H. (2016). Validity and Reliability of the Research Instrument ; How to Test the Validation of a Questionnaire / Survey in a Research. International Journal of Academic Research in Management (IJARM), 5(3), 02546799. https://doi.org/10.2139/ssrn.3205040

Tidemand, S., & Nielsen, J. A. (2017). The role of socioscientific issues in biology teaching: from the perspective of teachers. International Journal of Science Education, 39(1), 44–61. https://doi.org/10.1080/09500693.2016.1264644

Tracey, M. W., & Richey, R. C. (2007). ID model construction and validation: A multiple intelligences case. Educational Technology Research and Development, 55(4), 369–390. https://doi.org/10.1007/s11423-006-9015-4

Ulfah, A. A., Kartono, K., & Susilaningsih, E. (2020). Validity of Content and Reliability of Inter-Rater Instruments Assessing Ability of Problem Solving. Journal of Educational Research and Evaluation, 9(1), 1–7. https://doi.org/10.15294/jere.v9i1.40423

Utami, R., Prodjosantoso, A. K., Rohaeti, E., & Kamari, A. (2024). How do Students Deal with Socio- scientific Issues : A Development of Students ’ Decision-Making Skills Instrument. Jurnal Pendidikan Matematika Dan Sains, 12(1), 93–98. https://doi.org/10.21831/jpms.v12i1.75002

Vattanavanit, V., Ngudgratoke, S., & Khaninphasut, P. (2022). Validation of response processes in medical assessment using an explanatory item response model. BMC Medical Education, 22(855), 1–8. https://doi.org/10.1186/s12909-022-03942-2

Veugelers, R., Gaakeer, M. I., Patka, P., & Huijsman, R. (2020). Improving design choices in Delphi studies in medicine : the case of an exemplary physician multi-round panel study with 100 % response. BMC Medical Research Methodology, 20(156), 1–15. https://doi.org/10.1186/s12874-020-01029-4

Viehmann, C., Fernández Cárdenas, J. M., & Reynaga Peña, C. G. (2024). The use of socioscientific issues in science lessons: A scoping review. Sustainability, 16(14), 2–29. https://doi.org/10.3390/su16145827

Vo, D. Van, & Simmie, G. M. (2025). Assessing Scientific Inquiry : A Systematic Literature Review of Tasks , Tools and Techniques. International Journal of Science and Mathematics Education, 23(4), 871–906. https://doi.org/10.1007/s10763-024-10498-8

Wahyuni, L. D., Gumela, G., & Maulana, H. (2021). Interrater Reliability : Comparison of essay ’ s tests and scoring rubrics. Journal of Physics: Conference Series, 012081. https://doi.org/10.1088/1742-6596/1933/1/012081

Worthington, D., Graham, B., Gilliard, H., & Kelp, N. C. (2024). Development of a Scale to Measure Planned Behavior in Inclusive Science Communication : Validity Evidence in Undergraduate STEM Students. Life Sciences Education, 23(4), 1–14. https://doi.org/10.1187/cbe.24-01-0012

Yacoubian, H. A., & Khishfe, R. (2018). Argumentation , critical thinking , nature of science and socioscientific issues : a dialogue between two researchers. International Journal of Science Education, 40(7), 796–807. https://doi.org/10.1080/09500693.2018.1449986

Yoon, S. A., & Park, M. (2017). Teaching and Learning About Complex Systems in K – 12 Science Education: A Review of Empirical Studies 1995 – 2015. XX(X), 1–41. https://doi.org/10.3102/0034654317746090

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., & Alavi-, H. (2015). Design and Implementation Content Validity Study: Development of an instrument for measuring Patient-Centered Communication. Journal of Caring Sciences, 4(5), 165–178. https://doi.org/10.15171/jcs.2015.017

Zeidler, D. L., Herman, B. C., & Sadler, T. D. (2019). New directions in socioscientific issues research. Disciplinary and Interdisciplinary Science Education Research, 1(1), 1–9. https://doi.org/10.1186/s43031-019-0008-7

Zo`bi, A. S. (2014). The Effect of Using Socio-Scientific Issues Approach in Teaching Environmental Issues on Improving the Students ’ Ability of Making Appropriate Decisions Towards These Issues. International Education Studies, 7(8), 113–123. https://doi.org/10.5539/ies.v7n8p113