Validation of Ethnochemistry-Integrated Two-Tier Items for Chemical Literacy among Pre-service Chemistry Teachers
DOI:
https://doi.org/10.33394/hjkk.v14i1.19581Keywords:
chemical literacy, Ethnochemistry, Instrumen Validation, Pre-service Chemistry Teachers, Two-tier validationAbstract
Chemical literacy is an essential competency for preservice chemistry teachers because it supports the ability to understand chemical concepts, interpret chemical information, and apply chemistry in daily and socio-scientific contexts. However, chemical literacy assessment is often limited to conventional multiple-choice tests that do not adequately measure reasoning or contextual application. This study aimed to validate ethnochemistry-integrated two-tier multiple-choice with 10 items test for measuring chemical literacy among preservice chemistry teachers. A quantitative survey design was employed with 35 participants from a public university in West Nusa Tenggara selected through convenience sampling. This approach allowed the researchers to obtain initial empirical evidence on the psychometric quality of the ethnochemistry-integrated two-tier instrument for measuring chemical literacy among pre-service chemistry teachers. The instrument was developed by adapting chemical literacy indicators and integrating local ethnochemical contexts into two-tier items, followed by expert judgment validation. Data were collected through face-to-face, paper-based administration and analyzed using the Rasch measurement model to examine item difficulty calibration, item fit statistics, reliability, separation indices, and unidim The Wright map shows that most pre-service chemistry teachers were clustered around the mean ability range (−1 to +1 logits), indicating moderate chemical literacy, while the items were well distributed in difficulty with more challenging tasks such as Item 8 and Item 4 located at higher logits. Rasch analysis further confirmed acceptable measurement quality, with person reliability of 0.71 and Cronbach’s alpha of 0.74, item fit statistics mostly within the acceptable range (Infit MNSQ 0.78–1.43), and strong unidimensionality evidenced by 40.9% variance explained by the measures.ensionality through residual analysis. This study is novel in validating an ethnochemistry-integrated two-tier multiple-choice instrument using Rasch analysis to provide a culturally responsive and reasoning-based assessment of chemical literacy among pre-service chemistry teachers by connecting chemical concepts with local wisdom and real-life contexts.
References
Adam, W., Qudratuddarsi, H., Ningthias, D. P., Rahmadhani, A., & Noviana, E. (2025). Validation of Pre-Service Science Teacher Artificial Intelligence Competence Self-Efficacy (AICS): Rasch Model Analysis. Jurnal Ilmiah Profesi Pendidikan, 10(2), 1985-1995.
Adi, N. R. M., Amaruddin, H., Adi, H. M. M., A’yun, I. L. Q. (2022). Validity and Reliability Analysis Using the Rasch Model to Measure the Quality of Mathematics Test Items of Vocational High Schools. Journal of Educational Research and Evaluation, 11(1), 103-113.
Alnahdi, A. H., Alsubiheen, A. M., & Aldaihan, M. M. (2025). Rasch Measurement Model Supports the Unidimensionality and Internal Structure of the Arabic Oswestry Disability Index. Journal of Clinical Medicine, 14(4), 1259.
Alwathoni, M., Saputro, S., Yamtinah, S., Masykuri, M., & Suwahono, S. (2024). MOOC-Based PBL Model to Improve Chemical Literacy Skills In Content, P rocedural and Epistemic Knowledge Aspects. International Journal of Pedagogy and Teacher Education, 8(2), 253-268.
Ashari, A., & Munawwarah (2025). Ethnochemistry Supports 21st Century Skills: Systematic Literature Review. Hydrogen: Jurnal Kependidikan Kimia, 13(5), 1044-1049.
Aziz, A. A., Rahman, N. A., & Khalid, F. (2022). Rasch analysis of an educational assessment instrument: Evidence from item fit and person–item targeting. Education Sciences, 12(9), 612.
Bond, T. G., & Fox, C.M. (2021). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. Routledge.
Boone, W. J., Staver, J., & Yale, M. (2021). Rasch analysis in the human sciences. Springer.
Dewi, C. A., Yahdi, Y., & Sanova, A. (2024). Ethnochemistry-Based E-Module: Does it Effect on Improving Students' Chemical Literacy. Journal of Innovation in Educational and Cultural Research, 5(4), 568-577.
Dwi, A., Yamtinah, S., Mahardiani, L., & Sauptro, S. (2021). A Rasch Analysis of Item Quality of the Chemical Literacy Assessment for Investigasting Student’s Chemical Literacy on Chemical Rate Concepts. European Journal of Educational Research, 10(4), 1769-1779.
Fischer, H. E., Boone, W. J., & Neumann, K. (2023). Quantitative research designs and approaches. In Handbook of research on science education (pp. 28-59). Routledge.
Golzar, J., Noor, S., & Tajik, O. (2022). Convenience sampling. International Journal of Education & Language Studies, 1(2), 72-77.
Hany, N. C., & Purwaningsih, D. (2025). Collaborative Learning Strategies in Improving High School Students' Chemistry Literacy: A Systematic Literature Review. Jurnal Pendidikan Kimia Indonesia, 9(1), 42-52.
Hasanah, S. M., Rahayu, S., Sulistina, O., Alsulami, N. M. (2025). Creating and Validating a Chemical Literacy Instrument Aligned Sustainability Contexts: Construct and Rasch Measurement Analysis. Indonesian Journal of Science Education, 13(2), 408-425.
Hidayat, R., Qudratuddarsi, H., Ayub, A. F. M., & Latif, I. N. A. (2025). Psychometric Properties Of The Perma-Profiler For Indonesian College Students: A Rasch Modelling Analysis. Journal of Institutional Research South East Asia, 23(1).
Hidayat, R., Qudratuddarsi, H., Mazlan, N. H., & Zeki, M. Z. M. (2021). Evaluation of a test measuring mathematical modelling competency for Indonesian college students. Journal of Nusantara Studies (JONUS), 6(2), 133-155.
Ismail, M. S., Din, M. H., & Jusoh, M. S. (2021, July). Predictive modelling using Rasch’s person-item map: Intrepreting and assessing in Malaysia manufacturing firms. In AIP Conference Proceedings (Vol. 2347, No. 1, p. 020288). AIP Publishing LLC.Jamieson, M. K., Govaart, G. H., & Pownall, M. (2023). Reflexivity in quantitative research: A rationale and beginner's guide. Social and Personality Psychology Compass, 17(4), e12735.
Jumriani, J., Qudratuddarsi, H., Rahmah, N., Ningthias, D. P., & Indriyanti, N. (2025). Validation Of Instrument to Measure Gen-Z Pre-Service Teacher Chemistry Virtual Lab Acceptance and Use. Chemistry Education Practice, 8(1), 128-136.
Junaidi, E., Sudatha, I. G. W., Suartama, I. K., & Santosa, M. H. (2025). Ethnochemistry In Chemistry Learning: Insights from Indonesian Local Wisdom. Jurnal Pendidikan MIPA, 26(3), 1642-1658.
Kassiavera, S., Suparmi, A., Cari, C., & Sukarmin, S. (2024). Application of Rasch model in two-tier test for assessing students’ reasoning in physics education. Journal of Baltic Science Education, 23(6), 1228–1245.
Lamb, K. N., Boedeker, P., & Kettler, T. (2025). Measuring creative self-efficacy: Instrument development and validation. Thinking Skills and Creativity, 56, 101738.
Manik, A. (2024). Analysis of Science Literacy and Chemical Literacy Content on Green Chemistry Materials in Chemistry Textbooks Class X High School in Palangka Raya City. Chemistry in Education, 13(1), 31-41.
Medvedev, O. N., & Krägeloh, C. U. (2025). Rasch measurement model. In Handbook of assessment in mindfulness research (pp. 131-147). Cham: Springer Nature Switzerland.
Marfuatun, M., Nahadi, N., Yuliani, G., & Hernani, H. (2024). Assessing Chemical Literacy of Pre-service Chemistry Teacher: Rasch Analysis. In SHS Web of Conferences (Vol. 205, p. 06001). EDP Sciences.
Murashko, T., Kolesovs, A., & Ruza, A. (2025). Imagining the Future: Instrument Development and Initial Validation. World Futures, 1-21.
Nash, R., & Bradley, S. (2021). Using Rasch analysis to evaluate science assessment instruments. Research in Science Education, 51(6), 1521–1543.
Natania, A., Subarkah, C. Z., & Sundari, C. D. D. (2025). Ethnochemistry of Kampung Naga: Local Wisdom as Green Chemistry Learning in E-Book Form. Orbital: Jurnal Pendidikan Kimia, 9(2), 174-188.
Ningroom, R. A. A, N., Yamtinah, S., & Riyadi. (2025) A two-tier multiple choice diagnostic test to find student misconceptions about the change of matter. Journal of Education and Learning, 19(2), 1144-1156.
Ningtyas, A. I., Yamtinah, S., Saputro, S., Shidiq, A. S., & Rahayu, S. (2025). Content Validity Analysis of a Virtual Reality Based Two-Tier Multiple Choice Assessment Instrument with Ethnochemistry to Early Detect Misconceptions in Reaction Rate Topics. Jurnal Penelitian Pendidikan IPA, 11(5), 960-969.
Nugraheni, A. R. E., & Srisawasdi, N. (2025). Development of pre-service chemistry teachers’ knowledge of technological integration in inquiry-based learning to promote chemistry core competencies. Chemistry Education Research and Practice, 26(2), 398-419.
Pamungkas, Y. P., Yamtinah, S., Saputro, S., & Shidiq, A. S. (2024). Detection Student Misconception in Chemical Bonding using a Virtual Reality-Integrated Two-Tier Multiple-Choice Instrument with Ethnochemistry Context. Jurnal Pendidikan MIPA, 25(3), 1498-1517.
Pebriani, N. I., & Aini, F. Q. (2025). The Relationship Between Prior Knowledge and Students’ Chemical Literacy. Jurnal Pijar Mipa, 20(5), 970-975.
Peeters, M. J., & Augustine, J. M. (2023). Using Rasch measurement for instrument rating scale refinement. Currents in Pharmacy Teaching and Learning, 15(2), 110–118.
Post, M. W. M., Fellinghauer, C. S., Charlifue, S., New, P. W., Forchheimer, M. B., & Tate, D. G. (2022). Rasch analysis of the International Quality of Life Basic Data Set Version 2.0. Archives of Physical Medicine and Rehabilitation, 103(11), 2120–2130.
Pratama, F. I., Joronavalona, R., Annisa, D., Saputri, F., Afikah, A., Wijayanti, P., ... & Naqsyahbandi, F. (2025, September). Differences in chemical literacy of chemistry education students based on study year level. In AIP Conference Proceedings (Vol. 3354, No. 1, p. 040027). AIP Publishing LLC.
Qudratuddarsi, H., Meivawati, E., & Saputra, R. (2024). Pelatihan Penelitian Metode Kuantitatif dan Systematic Literature Review bagi Dosen dan Mahasiswa. Beru'-beru': Jurnal Pengabdian kepada Masyarakat, 3(1), 22-32.
Qudratuddarsi, H., Rahmah, N., & Indriyanti, N. (2025). Analysis of the attitudes of generation z prospective science teachers toward the chemistry virtual laboratory. Arfak Chem: Chemistry Education Journal, 8(1), 651-665.
Schoonenboom, J. (2023). The fundamental difference between qualitative and quantitative data in mixed methods research. In Forum Qualitative Sozialforschung/Forum: Qualitative Social Research (Vol. 24, No. 1). DEU.
Sjöström, J., Yavuzkaya, M., Guerrero, G., & Eilks, I. (2024). Critical chemical literacy as a main goal of chemistry education aiming for climate empowerment and agency. Journal of Chemical Education, 101(10), 4189-4195.
Smith, R. M. (2019). Fit analysis in latent trait measurement models. Journal of Applied Measurement, 20(3), 287–300.
Sutrisno, Manuharawati, & Masriyah. (2025, November). Assessing beliefs about statistics of prospective mathematics teachers using the rasch wright map. In AIP Conference Proceedings (Vol. 3333, No. 1, p. 020007). AIP Publishing LLC.
Tennant, A., & Conaghan, P. (2023). Application of the Rasch measurement model in rehabilitation research and practice: Early developments, current practice, and future challenges. Frontiers in Rehabilitation Sciences, 4, 1208670.
Wang, W., & Lin, Y. (2020). Rasch validation of an assessment instrument: Item fit, reliability, and unidimensionality. Frontiers in Psychology, 11, 569.
Wardani, S. F., Yamtinah, S., Mulyani, B., Susilowati, E., Ulfa, M., Masykuri, M., & Shidiq, A. S. (2024). Differentiated learning: analysis of students’ chemical literacy on chemical bonding material through culturally responsive teaching approach integrated with ethnochemistry. Jurnal Penelitian Pendidikan IPA, 10(4), 1747-1759.
Yuendita, D., & Rohaeti, E. (2025). Research Trends on the Integration of Ethnoscience in the Learning of Chemistry as the Development of Chemical Literacy: A Systematic Review. Indonesian Journal of Educational Research and Review, 8(1), 210-222.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Dyah Puspitasari Ningthias, Ermia Hidayanti, Yunita Arian Sani Anwar, Nora Listantia, Dodiy Firmansyah, Baiq Viona Olganita Sugondo
This work is licensed under a Creative Commons Attribution 4.0 International License.
License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:
- They are authorized by their co-authors to enter into these arrangements.
- The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
- That it is not under consideration for publication elsewhere,
- That its publication has been approved by all the author(s) and by the responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
- They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
- They agree to the following license and publishing agreement.
Copyright
Authors who publish with Hydrogen: Jurnal Kependidikan Kimia agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
Licensing for Data Publication
Hydrogen: Jurnal Kependidikan Kimia uses a variety of waivers and licenses, that are specifically designed for and appropriate for the treatment of data: Open Data Commons Attribution License, http://www.opendatacommons.org/licenses/by/1.0/ (default) Other data publishing licenses may be allowed as exceptions (subject to approval by the editor on a case-by-case basis) and should be justified with a written statement from the author, which will be published with the article.
