Development of Ill-Structured Problem-Solving Skills Instrument Based on Local Socio-Scientific Issues (SSI) on the Topic of Environmental Pollution

Citra Ayu  Dewi; Maryone Saija

doi:10.36312/e-saintika.v9i2.2791

Authors

Citra Ayu Dewi Universitas Pendidikan Mandalika https://orcid.org/0000-0001-9381-9645
Maryone Saija STIKES Pasapua Ambon

DOI:

https://doi.org/10.36312/e-saintika.v9i2.2791

Keywords:

Assessment Instrument, Ill-Structured, Problem Solving, Socio-Scientific Issues

Abstract

This study aimed to develop an assessment instrument to measure students’ ill-structured problem-solving skills using local socio-scientific issues (SSI) on environmental pollution. The research employed a Research and Development (R&D) model with four stages: (1) preliminary study, (2) item development, (3) expert validation, and (4) trial. The instrument was piloted with 120 chemistry education students from UIN Mataram and Universitas Pendidikan Mandalika in Indonesia. The final instrument consisted of 27 essay-based items mapped to four stages of ill-structured problem solving: 8 items for problem representation, 6 for solution generation and selection, 5 for justification, and 7 for solution monitoring and evaluation. Expert validation yielded a high construct validity index (CVI = 0.93). Readability analysis indicated that 75% of students found the language clear, 78% understood the visuals, and 70% were familiar with the chemical terminology. Results indicated that 17 items were of moderate difficulty, 7 were easy, and 3 were difficult. The instrument demonstrated high internal consistency, with a Cronbach’s Alpha value of 0.805. This instrument offers a valid and reliable tool for evaluating students’ engagement in authentic, context-rich chemistry problems. It supports chemistry educators in fostering critical thinking and scientific literacy by embedding local socio-scientific issues into semester-long instruction cycles.

Downloads

Download data is not yet available.

Author Biography

Maryone Saija, STIKES Pasapua Ambon

Chemistry Education

References

Aiken, L. R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40(4), 955–959.

Aiken, L. R. (1985). Three Coefficients for Analyzing the Reliability and Validity of Ratings.

Almulla, M. A., & Al-Rahmi, W. M. (2023). Integrated social cognitive theory with learning input factors: The effects of problem-solving skills and critical thinking skills on learning performance sustainability. Sustainability, 15(5), 3978.

Badeo, J. M., & Duque, D. A. (2022). The Effect of Socio-Scientific Issues (SSI) in Teaching Science: A Meta-Analysis Study. Journal of Technology and Science Education, 12(2), 291–302.

Broman, K., & Parchmann, I. (2014). Students’ application of chemical concepts when solving chemistry problems in different contexts. Chemistry Education Research and Practice, 15(4), 516–529. https://doi.org/10.1039/c4rp00051j

Burkholder, E., Hwang, L., & Wieman, C. (2021). Evaluating the problem-solving skills of graduating chemical engineering students. Education for Chemical Engineers, 34, 68–77.

Cahyani, V. P., Fadly, D., Islawati, I., & Ahmad, F. (2024). The Attitude of Chemistry Education Students to Socio-Scientific Issues (SSI) in Chemistry Learning. INSECTA: Integrative Science Education and Teaching Activity Journal, 5(2), 212–223. https://doi.org/10.21154/insecta.v5i2.9812

Chi, S., Wang, Z., & Liu, X. (2023). Assessment of Context-Based Chemistry Problem-Solving Skills: Test Design and Results from Ninth-Grade Students. Research in Science Education, 53(2), 295–318. https://doi.org/10.1007/s11165-022-10056-8

da Silva Júnior, C. A., Morais, C., Jesus, D. P. de, & Girotto Júnior, G. (2024). The Role of the Periodic Table of the Elements of Green and Sustainable Chemistry in a High School Educational Context. Sustainability, 16(6), Article 6. https://doi.org/10.3390/su16062504

Dewi, C. A., Rahayu, S., Muntholib, M., & Parlan, P. (2024). The importance of problem solving skills in chemistry learning as a demand in the 21st century. AIP Conference Proceedings, 3098(1).

Dewi, C. A., & Yahdi, Y. (2025). Research Trends on Socio-Scientific Issues in Chemistry Learning: A Systematic Review. Jurnal Pendidikan MIPA, 26(1), 457–475.

Dewi, C. A., Yahdi, Y., & Sanova, A. (2024). Ethnochemistry-Based E-Module: Does it Effect on Improving Students’ Chemical Literacy. Journal of Innovation in Educational and Cultural Research, 5(4), 568–577.

Elhadary, T., & Elhaty, I. A. (2021). The difficultiesposed by teaching chemistry in English language: With special reference to health sciences students in Turkish Universities. Psychology and Education Journal, 58(1), Article 1. https://doi.org/10.17762/pae.v58i1.1210

Ge, X., & Land, S. M. (2003). Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions. Educational Technology Research and Development, 51(1), 21–38.

Ge, X., & Land, S. M. (2004). A Conceptual Framework for Scaffolding Ill-Structured Problem-Solving Processes Using Question Prompts and Peer Interactions. Educational Technology Research and Development, 52(2), 5–22. https://doi.org/10.1007/BF02504836

Ge, X., Muftuoglu, A. C., & Brickell, S. (2022). Instructional Design from the Lens of Self-Regulated Ill-Structured Problem Solving: Research and Practical Applications. In The Instructional Design Trainer’s Guide (pp. 77–89). Routledge.

George, A., Zowada, C., Eilks, I., & Gulacar, O. (2021). Exploring Chemistry Professors’ Methods of Highlighting the Relevancy of Chemistry: Opportunities, Obstacles, and Suggestions to Improve Students’ Motivation in Science Classrooms. Education Sciences, 11(1), Article 1. https://doi.org/10.3390/educsci11010013

Grieger, K., & Leontyev, A. (2021). Student-Generated Infographics for Learning Green Chemistry and Developing Professional Skills. Journal of Chemical Education, 98(9), 2881–2891. https://doi.org/10.1021/acs.jchemed.1c00446

Hadi, W. P., Raya, M. J., Box, T. P., & Bangkalan, K. (2019). Identifikasi Kemampuan Pemecahan Masalah Mahasiswa Calon Guru IPA pada Penyelesaian Soal Titrasi. Jurnal Pembelajaran Kimia, 4(2), 100–105. https://doi.org/10.17977/um026v4i22019p100

Haryati, S. (2012). Research and Development (R&D) sebagai salah satu model penelitian dalam bidang pendidikan. Majalah Ilmiah Dinamika, 37(1), 15.

Hernández-Ramos, J., Pernaa, J., Cáceres-Jensen, L., & Rodríguez-Becerra, J. (2021). The effects of using socio-scientific issues and technology in problem-based learning: A systematic review. Education Sciences, 11(10), 640.

Jonassen, D. H. (1997). Instructional design models for well-structured and III-structured problem-solving learning outcomes. Educational Technology Research and Development, 45(1), 65–94.

Kim, J. Y., & Lim, K. Y. (2019). Promoting learning in online, ill-structured problem solving: The effects of scaffolding type and metacognition level. Computers & Education, 138, 116–129.

Koehler, A. A., & Vilarinho-Pereira, D. R. (2023). Using social media affordances to support Ill-structured problem-solving skills: Considering possibilities and challenges. Educational Technology Research and Development, 71(2), 199–235. https://doi.org/10.1007/s11423-021-10060-1

Kumi-Yeboah, A., & Amponsah, S. (2023). An exploratory study of instructors’ perceptions on inclusion of culturally responsive pedagogy in online education. British Journal of Educational Technology, 54(4), 878–897. https://doi.org/10.1111/bjet.13299

Law, V., Ge, X., & Huang, K. (2020). Understanding learners’ challenges and scaffolding their ill-structured problem solving in a technology-supported self-regulated learning environment. Handbook of Research in Educational Communications and Technology: Learning Design, 321–343.

Li, Y., & Guo, M. (2021). Scientific literacy in communicating science and socio-scientific issues: Prospects and challenges. Frontiers in Psychology, 12, 758000.

Muhariyansah, J., Rahmawati, A., & Fibonacci, A. (2021). Exploring Scientific Literacy of Chemistry Education Pre-Service Teachers Through Socio-Scientific Issues Approach. JTK (Jurnal Tadris Kimiya), 6(2), 243–253. https://doi.org/10.15575/jtk.v6i2.15145

Owens, D. C., Sadler, T. D., & Friedrichsen, P. (2021). Teaching practices for enactment of socio-scientific issues instruction: An instrumental case study of an experienced biology teacher. Research in Science Education, 51(2), 375–398.

Pereira Pessoa, M. V. (2023). Guidelines for teaching with ill-structured real-world engineering problems: Insights from a redesigned engineering project management course. European Journal of Engineering Education, 1–18.

Picardal, M. T., & Sanchez, J. M. P. (2022). Effectiveness of Contextualization in Science Instruction to Enhance Science Literacy in the Philippines: A Meta-Analysis. International Journal of Learning, Teaching and Educational Research, 21(1), 140–156. https://doi.org/10.26803/ijlter.21.1.9

Podschuweit, S., & Bernholt, S. (2018). Composition-Effects of Context-based Learning Opportunities on Students’ Understanding of Energy. Research in Science Education, 48(4), 717–752. https://doi.org/10.1007/s11165-016-9585-z

Redhana, I. W. (2019). Mengembangkan keterampilan abad ke-21 dalam pembelajaran kimia. Jurnal Inovasi Pendidikan Kimia, 13(1).

Renkl, A. (2023). Using worked examples for ill-structured learning content. Their Own Words: What Scholars and Teachers Want You To KNow About Why and How To Apply the Science of Learning in Your Academic Setting, 207–224.

Shin, N., Jonassen, D. H., & McGee, S. (2003). Predictors of well?structured and ill?structured problem solving in an astronomy simulation. Journal of Research in Science Teaching, 40(1), 6–33.

Wahono, B., Chang, C.-Y., & Khuyen, N. T. T. (2021). Teaching socio-scientific issues through integrated STEM education: An effective practical averment from Indonesian science lessons. International Journal of Science Education, 43(16), 2663–2683. https://doi.org/10.1080/09500693.2021.1983226

Zamakhsyari, & Rahayu, S. (2020). Fostering ill-structured problem-solving skills of chemistry students using socioscientific issues as learning contexts. AIP Conference Proceedings, 2215(1), 20027.