Psychometric Validation of a Two-Factor Self-Report Instrument for Science Process Skills-Related Behaviors in Indonesian High School Students
Share article
- Published
- 2026-07-31
- Pages
- 868-902
- Section
- Original Research Article
Abstract
Science process skills (SPS) are central to scientific inquiry, yet instruments designed to assess SPS-related constructs require empirical evidence that their measurement structure corresponds to their intended interpretation. In Indonesia, SPS instruments have often emphasized expert-based content validation, while evidence concerning the latent structure of self-reported SPS-related behaviors remains limited. This study developed and psychometrically evaluated a two-dimensional self-report instrument assessing senior high school students’ reported engagement in behaviors associated with Basic Science Process Skills (BSPS) and Integrated Science Process Skills (ISPS). A total of 830 tenth-grade students from East Java, Indonesia, were allocated to three independent samples: preliminary analysis (n = 166), exploratory factor analysis (EFA; n = 339), and confirmatory factor analysis (CFA; n = 325). The EFA data were suitable for factor analysis (KMO = 0.964; Bartlett’s χ²(595) = 7,345.301, p < .001). Parallel analysis, eigenvalue examination, scree-plot inspection, and theoretical interpretability supported a two-factor solution. Seven items were removed, yielding a 28-item instrument that explained 49.8% of the total variance. Because Mardia’s tests indicated multivariate nonnormality, CFA was estimated using robust maximum likelihood. The correlated two-factor model demonstrated acceptable fit, χ²(349) = 768.321, p < .001, CFI = 0.925, TLI = 0.919, RMSEA = 0.061, 90% CI [0.055, 0.067], and SRMR = 0.045. AVE values were 0.510 for BSPS and 0.540 for ISPS, while HTMT was 0.805. Cronbach’s alpha and McDonald’s omega ranged from 0.928 to 0.962, with composite reliability ranging from 0.979 to 0.993. The findings support two closely related yet empirically distinguishable dimensions of self-reported SPS-related behavior. The instrument should therefore be interpreted as assessing reported behavioral engagement rather than demonstrated SPS competence. Generalization beyond comparable student populations should remain cautious because participants were recruited purposively from East Java.
Keywords
How to Cite
Yuli Astutik, Siti Zubaidah, Bagus Priambodo. (2026). Psychometric Validation of a Two-Factor Self-Report Instrument for Science Process Skills-Related Behaviors in Indonesian High School Students. Jurnal Penelitian dan Pengkajian Ilmu Pendidikan: e-Saintika, 10(2), 868-902. https://journal-center.litpam.com/index.php/e-Saintika/article/view/6140
References
Amina, I. Y., Zubaidah, S., Gofur, A., & Wicaksono, A. G. C. (2022). Remap-GI: A learning model to enhance students’ science process skills and biology cognitive learning outcomes. Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan, 7(11), 515–525. https://doi.org/10.17977/2502-471X.2486
Angco, R. J. N., Cortes, S. T., Castañeda, W. D. Jr., & Selle, J. D. (2026). Psychometric validation of the student assessment survey for teachers scale (SAST) for higher education institutions. Frontiers in Education, 11, 1768305. https://doi.org/10.3389/feduc.2026.1768305
Asmaningrum, H. P., Sathasivam, R. V., & Shahali, E. H. M. (2025). Development and validation of cultural intelligence, cultural diversity climate, and intention to implement Ethno-STEM scales for Indonesian novice science teachers: An exploratory factor analysis approach. Journal of Cultural Analysis and Social Change, 10(4), 2902–2911. https://doi.org/10.64753/jcasc.v10i4.3360
Avan, Ç., & Aydınlı, B. (2026). Developing and implementing a STEM-based assessment tool to measure higher-order cognitive skills in science education. Research in Science & Technological Education.
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, Article 149. https://doi.org/10.3389/fpubh.2018.00149
Borgonovi, F., Ferrara, A., & Piacentini, M. (2023). From asking to observing: Behavioural measures of socio-emotional and motivational skills in large-scale assessments. Social Science Research, 112, 102874.
Borgonovi, F., Pokropek, A., & Jakubowski, M. (2023). The relationship between self-reported and performance-based measures of students’ skills: Evidence from large-scale assessments. Educational Assessment, Evaluation and Accountability, 35, 1–25.
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.
Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2nd ed.). Routledge.
Chao, C.-T., & Liang, J.-C. (2025). The development and validation of a multi-dimensional medical students' learning self-efficacy questionnaire for clinical education. Medical Education Online, 30(1), 2534053. https://doi.org/10.1080/10872981.2025.2534053
Chen, C., & Zhang, L. J. (2025). Development and validation of a scale for metacognitive regulation of interactive metadiscourse strategies in L2 argumentative writing. Metacognition and Learning, 20(1). https://doi.org/10.1007/s11409-025-09435-z
Chengere, A. M., Bono, B. D., Zinabu, S. A., & Jilo, K. W. (2025). Enhancing secondary school students' science process skills through guided inquiry-based laboratory activities in biology. PLOS ONE, 20(4), e0320692. https://doi.org/10.1371/journal.pone.0320692
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024). Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations. Asia Pacific Journal of Management, 41(2), 745–783.
DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). SAGE Publications.
Dolapcioglu, S., & Subasi, M. (2022). The relationship between scientific process skills and science achievement: A meta-analysis study. Journal of Science Learning, 5(2), 363–372.
Elfeky, A. I. M., Najmi, A. H., & Elbyaly, M. Y. H. (2024). The impact of advance organizers in virtual classrooms on the development of integrated science process skills. PeerJ Computer Science, 10, e1989. https://doi.org/10.7717/peerj-cs.1989
Fitriyana, S., Farhan, A., Susanna, Hamid, A., & Mahzum, E. (2025). The effect of guided inquiry learning model on students' science process skills and learning outcomes in physics science lessons. Jurnal Pendidikan Fisika, 13(3), 555–571. https://doi.org/10.26618/0m4ny850
Flora, D. B., & Flake, J. K. (2017). The purpose and practice of exploratory and confirmatory factor analysis in psychological research: Decisions for scale development and validation. Canadian Journal of Behavioural Science, 49(2), 78–88. https://doi.org/10.1037/cbs0000069
Furtak, E. M., & Penuel, W. R. (2023). Learning through scientific practices: Connecting classroom inquiry with scientific reasoning. Science Education, 107(5), 1125–1147.
García-Carmona, A. (2025). Scientific thinking and critical thinking in science education: Two distinct but symbiotically related intellectual processes. Science & Education, 34, 227–245. https://doi.org/10.1007/s11191-023-00460-5
García-Carmona, A., Muñoz-Franco, G., Criado, A. M., & Cruz-Guzmán, M. (2024). Validation of an instrument for assessing basic science process skills in initial elementary teacher education. International Journal of Science Education, 46(4), 362–381. https://doi.org/10.1080/09500693.2023.2232936
Gizaw, G. G., & Sota, S. S. (2023). Improving science process skills of students: A review of literature. Science Education International, 34(3), 216–224. https://doi.org/10.33828/sei.v34.i3.5
Gültekin, S. B., & Altun, T. (2022). Investigating the impact of activities based on scientific process skills on 4th grade students' problem-solving skills. International Electronic Journal of Elementary Education, 14(4), 491–500. https://doi.org/10.26822/iejee.2022.258
Habibah, S. N., & Fuadiyah, S. (2025). Validitas instrumen tes keterampilan proses sains pada pembelajaran biologi materi sistem pencernaan kelas XI SMA/MA. Jurnal Jendela Pendidikan, 5(2), 353–360. https://doi.org/10.57008/jjp.v5i02.1359
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A primer on partial least squares structural equation modeling (PLS-SEM) (3rd ed.). SAGE Publications.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
Idris, N., Talib, O., & Razali, F. (2022). Strategies in mastering science process skills in science experiments: A systematic literature review. Jurnal Pendidikan IPA Indonesia, 11(1), 155–170. https://doi.org/10.15294/jpii.v11i1.32969
Jardinico III, E. C., & Linaugo, J. D. (2023). Acquired basic and integrated science process skills and academic performance in Earth Science of Grade 11 students in a Philippine public high school. Philippine Social Science Journal, 6(1), 63–73.
Junianda, W., & Fuadiyah, S. (2025). Validitas instrumen tes keterampilan proses sains pada materi sistem peredaran darah kelas XI SMA/MA [Validity of a science process skills test instrument on the circulatory system topic for Grade XI senior high school students]. Afeksi: Jurnal Penelitian dan Evaluasi Pendidikan, 6(4), 737–748. https://doi.org/10.59698/afeksi.v6i4.517
Kalkbrenner, M. T. (2024). Choosing between Cronbach’s coefficient alpha, McDonald’s coefficient omega, and coefficient H: Confidence intervals and the advantages and drawbacks of interpretive guidelines. Measurement and Evaluation in Counseling and Development, 57(2), 93–105. https://doi.org/10.1080/07481756.2023.2283637
Kamarudin, N., Wahida, M., & Ahrari, S. (2022). Exploring basic and integrated science process skills and their impact on science achievement among university students. Journal of Public Administration and Governance, 12(4S), 74–90. https://doi.org/10.5296/jpag.v12i4S.20572
Karim, E., Ibrahim, S. I., Rasit, H. H., & Sumintono, B. (2024). Development and validation of students’ competency instrument on science process skills. Proceedings of the Pacific-Rim Objective Measurement Symposium (PROMS 2023), 311–325. https://doi.org/10.2991/978-94-6463-494-5_20
Kline, R. B. (2023). Principles and practice of structural equation modeling (5th ed.). Guilford Press.
Komisia, F., Tukan, M. B., Fallo, D. Y. A., Hale, G. J. P., Meta, G. B., Lanmai, P. O., Eflani, F., & Leba, M. A. U. (2025). Validity analysis of a science process skills assessment instrument for high school students in chemistry. Jurnal Penelitian Pendidikan IPA, 11(12). https://doi.org/10.29303/jppipa.v11i12.1286
Krell, M., Vorholzer, A., & Nehring, A. (2022). Scientific reasoning in science education: From global measures to fine-grained descriptions of students’ competencies. Education Sciences, 12(2), 97. https://doi.org/10.3390/educsci12020097
Küçükaydın, M. A., & Ayaz, E. (2025). Validation of the Scientific Reasoning Competencies Instrument: Relationships with epistemological beliefs and analytical thinking. International Journal of Science and Mathematics Education, 23, 343–363. https://doi.org/10.1007/s10763-024-10482-2
Li, C., & Zhang, L. (2022). Confirmatory factor analysis and construct validity evaluation in educational measurement. Educational Measurement: Issues and Practice, 41(4), 25–36.
Lim, W. M., Khatri, P., Shiva, A., & Dabas, V. (2026). Guidelines for scale development and validation. Journal of Consumer Behaviour, 25(2), 953–973. https://doi.org/10.1002/cb.70096
Liu, R., Jong, C., & Fan, M. (2024). Reciprocal relationship between self-efficacy and achievement in mathematics among high school students. Large-scale Assessments in Education, 12, Article 14.
Lorenzo-Seva, U., & Ferrando, P. J. (2024). Determining sample size requirements in EFA solutions: A simple empirical proposal. Multivariate Behavioral Research, 59(5), 899–912. https://doi.org/10.1080/00273171.2024.2342324
Marar, S., Hamza, M. A., Ayyash, M., & Abu-Shaheen, A. (2023). Development and validation of an instrument to assess the knowledge and perceptions of predatory journals. Heliyon, 9(11), e22270. https://doi.org/10.1016/j.heliyon.2023.e22270
Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s findings. Structural Equation Modeling: A Multidisciplinary Journal, 11(3), 320–341. https://doi.org/10.1207/s15328007sem1103_2
McChesney, E. T., Schunn, C. D., Dorvè-Lewis, G., Godwin, A., & DeAngelo, L. (2025). Reconceptualizing learning engagement: Evidence for a context-sensitive structure in STEM education. Frontiers in Psychology, 16, Article 1649744.
McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
Mohammadi, M. M., Sohrabi, P., & Mohammadi, M. (2025). Development and psychometric properties of Ethical Competence Questionnaire for Nursing Students. Health Science Reports, 8, e70750. https://doi.org/10.1002/hsr2.70750
Molefe, L., & Aubin, J.-B. (2023). A nexus of scientific investigations, science process skills, and sustainable development goals: Pre-service teachers' views concerning mangroves fieldwork. Journal of Baltic Science Education, 22(4), 682–700. https://doi.org/10.33225/jbse/23.22.682
Molefe, L., & O'Donoghue, R. (2026). Science process skills and education for sustainable development competences: A review through the lens of critical realism. Eurasia Journal of Mathematics, Science and Technology Education, 22(5), em2835. https://doi.org/10.29333/ejmste/18519
Mustofa, A., Zubaidah, S., & Kuswantoro, H. (2021). Pengembangan modul berbasis proyek berdasarkan analisis lintas karakter agronomi dan morfologi kedelai untuk meningkatkan keterampilan proses sains. Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan, 6(1), 24–34. https://doi.org/10.17977/jptpp.v6i1.14373
Negerie, D., Habtamu, T., & Tafesse, T. (2026). Effects of the 5E guided inquiry-based learning model on science process skills of secondary school biology students in Mattu town, Ethiopia. Discover Education, 5, Article 320. https://doi.org/10.1007/s44217-026-01351-x
Ngo, H. M., Nguyen, T. T., & Tran, T. H. (2025). Assessment of convergent validity and measurement model evaluation in structural equation modeling. Heliyon.
Obilor, E. I., & Miwari, G. U. (2022). Content validity in educational assessment. International Journal of Innovative Education Research, 10(2), 57–69.
Ocy, D. R., Sarifah, I., & Riyadi. (2025). EFA and CFA analysis: Development and validation of a test instrument for mathematical abstraction skills. Journal of Research and Advances in Mathematics Education, 10(2).
OECD. (2023). PISA 2022 assessment and analytical framework: Mathematics, reading, science and financial literacy. OECD Publishing.
Pertiwi, N., & Aini, F. Q. (2025). Development of scientific process skill assessment instrument on stoichiometry using Rasch model in the Merdeka Curriculum. Journal of Educational Sciences, 9(1), 241–255.
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Pujiyanto, Nuroso, H., & Sumarno. (2025). Profil keterampilan proses sains (KPS) siswa kelas XI SMA Negeri 1 Ngawen pada konsep gelombang bunyi [Profile of science process skills (SPS) among Grade XI students of SMA Negeri 1 Ngawen on the concept of sound waves]. Jurnal Inovasi Pembelajaran di Sekolah, 6(2), 61–65. https://doi.org/10.51874/jips.v6i2.317
Rattanachaithada, R., Kwangmuang, P., Vongtathum, P., Gamlunglert, R., & Srikoon, S. (2025). A confirmatory factor analysis of scientific critical thinking in secondary school. Cogent Education, 12(1), 2467508. https://doi.org/10.1080/2331186X.2025.2467508
Rezba, R. J., Sprague, C., McDonnough, J. T., & Matkins, J. J. (2022). Learning and assessing science process skills (5th ed.). Kendall/Hunt Publishing Company.
Roco-Videla, Á., Aguilera-Eguía, R., & Olguin-Barraza, M. (2024). Ventajas del uso del coeficiente de omega de McDonald frente al alfa de Cronbach. Nutrición Hospitalaria, 41(1), 233–234. https://doi.org/10.20960/nh.04879
Roemer, E., Schuberth, F., & Henseler, J. (2021). HTMT2—an improved criterion for assessing discriminant validity in structural equation modeling. Industrial Management & Data Systems.
Romine, W., Reed, E., Mahajan, R., & Todd, A. (2025). What is the Inventory of Student Evolution Acceptance (I-SEA) measuring? A factor analytic comparison of multiple competing hypotheses in practicing science teachers and undergraduate science non-majors. International Journal of Science and Mathematics Education, 23(7), 3047–3067. https://doi.org/10.1007/s10763-025-10570-x
Rönkkö, M., & Cho, E. (2022). An updated guideline for assessing discriminant validity. Organizational Research Methods, 25(1), 6–14. https://doi.org/10.1177/1094428120968614
Sadykova, B., Yesnazarova, U., & Tokbergenova, A. (2023). The geographic inquiry process skills scale: A validation study. Eurasia Journal of Mathematics, Science and Technology Education, 19(9), em2319. https://doi.org/10.29333/ejmste/13471
Schwichow, M., Croker, S., Zimmerman, C., Höffler, T., & Härtig, H. (2016). Teaching the control-of-variables strategy: A meta-analysis. Developmental Review, 39, 37–63. https://doi.org/10.1016/j.dr.2015.12.001
Šmida, D., Drozdíková, A., & Nechajová, R. (2026). A new perspective on the evaluation of pupils' inquiry skills using four-tier test. Science & Education. Advance online publication. https://doi.org/10.1007/s11191-026-00747-3
Stefana, A., Damiani, S., Granziol, U., Provenzani, U., Solmi, M., Youngstrom, E. A., & Fusar-Poli, P. (2025). Psychological, psychiatric, and behavioral sciences measurement scales: Best practice guidelines for their development and validation. Frontiers in Psychology, 15, 1494261. https://doi.org/10.3389/fpsyg.2024.1494261
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Pearson.
Tauhidah, D., & Rofi’ah, N. L. (2023). Validation of undergraduate science process skills tests: Rasch model analysis. Research and Development in Education (RaDEn), 3(1), 51–57. https://doi.org/10.22219/raden.v3i1.24585
Tondong, H. I., Apriyanto, A., Kusumastuti, S. Y., & Wahyuningsih, M. (2024). Buku referensi pengantar statistik. PT. Sonpedia Publishing Indonesia.
Ulfah, A. H., & Supahar. (2026). Validity of performance assessment of Science Process Skills in senior high school biology subject. Jurnal BIOEDUIN, 16(1), 51–63. https://doi.org/10.15575/bioeduin.v16i1.44745
Vo, D. V., & Simmie, G. M. (2025). Assessing scientific inquiry: A systematic literature review of tasks, tools and techniques. International Journal of Science and Mathematics Education, 23, 871–906. https://doi.org/10.1007/s10763-024-10498-8
Wan Hussain, W. N. H., Shahali, E. H. M., & Fadzil, H. M. (2026). Assessing science process skills through conceptual frameworks: A scoping review. International Journal on Studies in Education, 8, 599–622. https://doi.org/10.46328/ijonse.6545
Wan, Z. H., Zhan, Y., & Zhang, Y. (2024). Positive or negative? The effects of scientific inquiry on science achievement via attitudes toward science. Science Education, 108(1), 3–24. https://doi.org/10.1002/sce.21825
Wang, S., Hu, A., Yuan, L., Tian, W., & Xin, T. (2026). Macro- and micro-level behavioral patterns in simulation-based scientific inquiry: Linking processes to performance among elementary students. Journal of Intelligence, 14(1), 6. https://doi.org/10.3390/jintelligence14010006
Wang, T., Zhou, Q., Yin, K., Hu, H., Xu, H., Huang, J., & Chen, S. (2026). Microsystem components and EFL achievement in adolescence: A network analysis. Acta Psychologica, 263, Article 106379. https://doi.org/10.1016/j.actpsy.2026.106379
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127
Yang, K.-L., Fang, S.-C., & Fan, S.-C. (2025). Development and validation of an instrument for assessing secondary students' transdisciplinary STEM practices. International Journal of STEM Education, 12, Article 5. https://doi.org/10.1186/s40594-025-00529-3
Yanti, S. R., & Fuadiyah, S. (2025). Validitas instrumen tes keterampilan proses sains pada materi sistem pernapasan kelas XI SMA/MA [Validity of a science process skills test instrument on the respiratory system topic for Grade XI senior high school students]. Jurnal Pengabdian Masyarakat dan Riset Pendidikan, 3(4), 4590–4597. https://doi.org/10.31004/jerkin.v3i4.1039