Confirmatory Factor Analysis of a 21st-Century Skills Instrument in Audiovisual-Assisted Problem-Based Learning

Authors

  • Hendrik Setiawan Universitas Pancasakti Tegal, Indonesia
  • Dewi Amaliah Nafiati Universitas Pancasakti Tegal, Indonesia
  • Munadi Munadi Universitas Pancasakti Tegal, Indonesia

DOI:

https://doi.org/10.33394/jp.v13i1.18801

Keywords:

instrument development, construct validity, 21st-century skills, Problem-Based Learning

Abstract

This study aims to develop and validate a performance-based assessment instrument for measuring 21st-century skills in Ilmu Pengetahuan Alam dan Sosial (IPAS) learning through audiovisual-assisted Problem-Based Learning. The instrument comprises 16 essay items designed to assess four dimensions of the 4C framework—critical thinking, creativity, communication, and collaboration—with four items allocated to each dimension. Responses were scored using a 1–4 analytic rubric. An instrument development approach was employed, with construct validation conducted through a pilot test involving 30 sixth-grade students from SDN Brebes 10. Data were analyzed using Confirmatory Factor Analysis (CFA). The results indicate that all items are valid, with standardized factor loadings ranging from 0.897 to 0.967 (CR > 22.62; p < 0.001). The measurement model demonstrates excellent goodness-of-fit indices (χ² = 93.997; df = 98; p = 0.596; CFI = 1.000; TLI = 1.007; RMSEA = 0.000; SRMR = 0.023). All items exhibit very strong factor loadings (λ ≥ 0.80) and coefficients of determination (R²) ranging from 0.805 to 0.935. In addition, inter-factor correlations (–0.686 to 0.193) confirm adequate discriminant validity. Overall, these findings indicate that the developed instrument satisfies construct validity requirements and demonstrates excellent psychometric quality for assessing elementary students’ 21st-century skills in audiovisual-assisted IPAS learning.

References

Boomsma, A., & Hoogland, J. J. (2001). The robustness of LISREL modeling revisited. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural equation modeling: Present and future (pp. 139-168). Scientific Software International.

Bujang, M. A., Omar, E. D., & Baharum, N. A. (2024). A review on sample size determination for Cronbach's alpha test: A simple guide for researchers. The Malaysian Journal of Medical Sciences, 25(6), 85-99.

Creswell, J. W., & Creswell, J. D. (2023). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). SAGE Publications.

Facione, P. A. (1990). Critical Thinking: A statement of expert consensus for purposes of educational assessment and instruction. California Academic Press.

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2022). Multivariate data analysis (8th ed.). Cengage Learning.

Hadiyanti, H., Susongko, P., & Munadi, M. (2020). Pengembangan instrumen higher order thinking skill mata pelajaran matematika dengan Rasch model. Journal of Education Research, 5(1), 399-407.

Hmelo-Silver, C. E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235-266.

Muminu, M., Nugraha, R. A., & Munadi, M. (2020). The influence of mathematical creative thinking ability in terms of learning styles on the learning of compound interest and annuities among students. Journal of English Language and Education, 10(1), 389-397.

Mullis, I. V. S., Martin, M. O., Foy, P., Kelly, D. L., & Fishbein, B. (2020). TIMSS 2019 international results in mathematics and science. Boston College, TIMSS & PIRLS International Study Center.

Mulyana, D. (2023). Komunikasi efektif: Suatu pendekikan lintas budaya (4th ed.). Remaja Rosdakarya.

Munandar, U. (2021). Kreativitas dan keberbakatan: Strategi mewujudkan potensi kreatif dan bakat (5th ed.). Gramedia Pustaka Utama.

Nafiati, D. A. (2021). Revisi taksonomi Bloom: Kognitif, afektif, dan psikomotorik. Humanika: Kajian Ilmiah Mata Kuliah Umum, 21(2), 151-172. https://doi.org/10.21831/hum.v21i2.29252

Nafiati, D. A., Rismawati, N., Azami, T., & Hendaryati, N. (2024). Cooperative learning: Alternatif untuk meningkatkan Communication skill pada sekolah berbasis boarding. Jurnal Pendidikan Ekonomi (JURKAMI), 9(2), 1-12.

Ningtias, D. R., Nurhayati, S., & Suranto, S. (2024). Pengaruh model Problem Based Learning berbantuan media audiovisual terhadap keterampilan berpikir kritis siswa sekolah dasar. Jurnal Basicedu, 8(2), 567-578.

Paivio, A. (2021). Mental representations: A dual coding approach (2nd ed.). Oxford University Press.

Rahayu, D. A., Supriyadi, S., & Ardhian, T. (2023). Sample size determination in nursing instrument development: A comprehensive review. Journal of Nursing Science Update, 11(1), 45-58.

Shi, D., Lee, T., & Maydeu-Olivares, A. (2019). Understanding the model size effect on SEM fit indices. Educational and Psychological Measurement, 79(2), 310-334.

Trianto. (2021). Mendesain model pembelajaran inovatif-progresif (5th ed.). Kencana.

Voogt, J., & Pareja Roblin, N. (2022). 21st century skills: From theory to practice in education. In International handbook of research on teachers and teaching (pp. 1-15). Springer.

Wahroni, W., Munadi, M., & Nasukha, M. (2020). Pengembangan modul pemrograman dasar algoritma dengan PBL siswa menjadi paham. Journal of Education Research, 5(4), 6503-6511.

Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample size requirements for structural equation models: An evaluation of power, bias, and solution propriety. Educational and Psychological Measurement, 73(6), 913-934.

Wulanjani, A. N., Pratama, R. A., & Susanti, V. D. (2024). Efektivitas model Problem Based Learning berbantuan e-modul dalam mata pelajaran IPAS untuk meningkatkan keterampilan berpikir kritis dan komunikasi siswa. Jurnal Basicedu, 8(3), 1789-1801.

Zuryanty, Kenedi, A. K., Chandra, F. H., Hamimah, & Fitria, Y. (2019). Problem Based Learning: A way to improve Critical Thinking ability of elementary school students on science learning. Journal of Physics: Conference Series, 1321, 022107.

Published

2026-01-06

How to Cite

Setiawan, H., Nafiati, D. A., & Munadi, M. (2026). Confirmatory Factor Analysis of a 21st-Century Skills Instrument in Audiovisual-Assisted Problem-Based Learning. Jurnal Paedagogy, 13(1). https://doi.org/10.33394/jp.v13i1.18801

Issue

Vol. 13 No. 1 (2026): January (IN PROGRESS)

Section

Articles

Citation Check

License

Copyright (c) 2026 The Author(s)

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:

  • They are authorized by their co-authors to enter into these arrangements.
  • The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
  • That it is not under consideration for publication elsewhere,
  • That its publication has been approved by all the author(s) and by the responsible authorities tacitly or explicitly of the institutes where the work has been carried out.
  • They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
  • They agree to the following license and publishing agreement.

Copyright
Authors who publish with Jurnal Paedagogy agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal. 
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.

Licensing for Data Publication

Jurnal Paedagogy use a variety of waivers and licenses, that are specifically designed for and appropriate for the treatment of data:
Other data publishing licenses may be allowed as exceptions (subject to approval by the editor on a case-by-case basis) and should be justified with a written statement from the author, which will be published with the article.