Profiling Critical Thinking Disposition and Preliminary Psychometric Evidence among Early-Year Science Education Students

Ni Nyoman Sri Putu Verawati; Wahyudi Wahyudi; Nina Nisrina

doi:10.33394/j-ps.v14i2.20786

Authors

Ni Nyoman Sri Putu Verawati University of Mataram
Wahyudi Wahyudi University of Mataram
Nina Nisrina University of Mataram

DOI:

https://doi.org/10.33394/j-ps.v14i2.20786

Keywords:

Critical thinking disposition, Early-year students, Science education, Psychometric evidence, Exploratory factor analysis

Abstract

This study profiled the critical thinking disposition of early-year science education students and examined preliminary psychometric evidence of an Ennis-based questionnaire. A quantitative descriptive survey with preliminary psychometric analysis was conducted with 90 second-semester science education students from three universities in West Nusa Tenggara Province, Indonesia. Data were collected using a 36-item questionnaire organized into 12 indicators of critical thinking disposition. Negatively worded items were reverse-scored before analysis. Descriptive statistics, category distribution, indicator-based profiling, Cronbach’s alpha, corrected item-total correlation, and exploratory factor analysis based on 12 indicator scores were applied. The results showed that students’ critical thinking disposition was generally moderate, with nearly all participants located in the moderate category. The highest indicator scores were found in precision required by situation, total situation, and employing critical thinking abilities, while the lowest scores were found in clear reasons, credible sources and observations, and being well-informed. The corrected internal consistency was modest, and several negatively worded items showed weak item-total correlations. The exploratory factor analysis suggested a tentative three-factor structure: evidence-based reasoning disposition, contextual and reflective judgment, and self-regulated critical engagement. These findings indicate that students’ critical thinking disposition is still developing and that the questionnaire requires further refinement.

Author Biography

Ni Nyoman Sri Putu Verawati, University of Mataram

Scopus ID: 57193126887

References

Abrami, P. C., Bernard, R., Borokhovski, E., Wade, A., Surkes, M. A., Tamim, R., & Zhang, D. (2008). Instructional interventions affecting critical thinking skills and dispositions: A stage 1 meta-analysis. Review of Educational Research, 78(4), 1102–1134. https://doi.org/10.3102/0034654308326084

Allchin, D. (2022). Ten competencies for the science misinformation crisis. Science Education, 107(2), 261–274. https://doi.org/10.1002/sce.21746

Anders, P. L., Davis, E., & McCall, W. D. (2020). Psychometric properties of an instrument to assess critical thinking disposition and metacognition in dental students. Journal of Dental Education, 84(5), 559–565. https://doi.org/10.1002/jdd.12038

Anders, P. L., Stellrecht, E., Davis, E., & McCall, W. D. (2019). A systematic review of critical thinking instruments for use in dental education. Journal of Dental Education, 83(4), 381–397. https://doi.org/10.21815/jde.019.043

Bakhtiari-Dovvombaygi, H., Pourhasan, K., Rahmaty, Z., Zare‐Kaseb, A., Abbaszadeh, A., Rashtbarzadeh, A., & Borhani, F. (2024). Evaluation of cross-cultural adaptation and validation of the Persian version of the critical thinking disposition scale: Methodological study. BMC Nursing, 23(1). https://doi.org/10.1186/s12912-024-02129-y

Chae, D., Kang, K. H., Benkert, R., & Doorenbos, A. Z. (2017). Evaluation of the psychometric properties of the Korean version of the Cultural Competence Assessment. Japan Journal of Nursing Science, 15(1), 56–66. https://doi.org/10.1111/jjns.12169

Chen, S., & Fan, J. (2022). Validation of the psychometric properties of the Self‐Directed Learning Readiness Scale. Nursing Open, 10(3), 1639–1646. https://doi.org/10.1002/nop2.1418

Cui, L., Zhu, Y., Qu, J., Tie, L., Wang, Z., & Qu, B. (2020). Psychometric properties of the Critical Thinking Disposition Assessment Test amongst medical students in China: A cross-sectional study. Research Square. https://doi.org/10.21203/rs.3.rs-16612/v1

Ennis, R. H. (2015). Critical thinking: A streamlined conception. In M. Davies & R. Barnett (Eds.), The Palgrave handbook of critical thinking in higher education (pp. 31–47). Palgrave Macmillan US. https://doi.org/10.1057/9781137378057_2

Greene, J. A., & Yu, S. B. (2015). Educating critical thinkers. Policy Insights From the Behavioral and Brain Sciences, 3(1), 45–53. https://doi.org/10.1177/2372732215622223

Hendriks, F., Mayweg-Paus, E., Felton, M., Iordanou, K., Jucks, R., & Zimmermann, M. (2020). Constraints and affordances of online engagement with scientific information: A literature review. Frontiers in Psychology, 11. https://doi.org/10.3389/fpsyg.2020.572744

İskifoğlu, G. (2013). Cross-cultural equivalency of the California Critical Thinking Disposition Inventory. Educational Sciences: Theory & Practice, 14(1), 159–178. https://doi.org/10.12738/estp.2014.1.1840

Khan, S., & Krell, M. (2019). Scientific reasoning competencies: A case of preservice teacher education. Canadian Journal of Science, Mathematics and Technology Education, 19(4), 446–464. https://doi.org/10.1007/s42330-019-00063-9

Kortum, P., Acemyan, C. Z., & Oswald, F. L. (2020). Is it time to go positive? Assessing the positively worded System Usability Scale (SUS). Human Factors, 63(6), 987–998. https://doi.org/10.1177/0018720819881556

Liu, O. L., Frankel, L., & Roohr, K. C. (2014). Assessing critical thinking in higher education: Current state and directions for next‐generation assessment. ETS Research Report Series, 2014(1), 1–23. https://doi.org/10.1002/ets2.12009

Mauriz, B. P., Blanco-Anaya, P., & Maceira, J. J. P. (2021). “Fake news” or real science? Critical thinking to assess information on COVID-19. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.646909

Oxman, A. D., & García, L. M. (2020). Comparison of the Informed Health Choices Key Concepts Framework to other frameworks relevant to teaching and learning how to think critically about health claims and choices: A systematic review. F1000Research, 9, 164. https://doi.org/10.12688/f1000research.21858.1

Rammstedt, B., Goldberg, L. R., & Borg, I. (2010). The measurement equivalence of Big-Five factor markers for persons with different levels of education. Journal of Research in Personality, 44(1), 53–61. https://doi.org/10.1016/j.jrp.2009.10.005

Sinatra, G. M., & Hofer, B. K. (2016). Public understanding of science: Policy and educational implications. Policy Insights From the Behavioral and Brain Sciences, 3(2), 245–253. https://doi.org/10.1177/2372732216656870

Song, Y., Luzzi, L., Chrisopoulos, S., & Brennan, D. S. (2020). Are trust and satisfaction similar in dental care settings? Community Dentistry and Oral Epidemiology, 48(6), 480–486. https://doi.org/10.1111/cdoe.12559

Venta, A., Bailey, C., Walker, J., Mercado, A., Colunga-Rodríguez, C., Ángel-González, M., & Dávalos-Picazo, G. (2022). Reverse-coded items do not work in Spanish: Data from four samples using established measures. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.828037

Wang, X., Sun, X., Huang, T., He, R., Hao, W., & Zhang, L. (2019). Development and validation of the critical thinking disposition inventory for Chinese medical college students (CTDI-M). BMC Medical Education, 19(1). https://doi.org/10.1186/s12909-019-1593-z