Evidence-Based Predictors of the Japanese Language Proficiency Test Succes: The Role of Kanji, Grammar, Reading, and Listening Skills

Authors

  • Andy Moorad Oesman Universitas Negeri Semarang, Indonesia
  • Dany Buyung Yudha Prasetya Universitas Negeri Semarang, Indonesia
  • Setiyani Wardhaningtyas Universitas Negeri Semarang, Indonesia
  • Chiara Manno Université Jean Moulin Lyon III, France

DOI:

https://doi.org/10.33394/jollt.v14i1.17552

Keywords:

Japanese Language Assessment, Japanese Language, Proficiency Test, Second Language Acquisiton, Language Learning

Abstract

This study examined the relationship between core Japanese language competencies Kanji, Bunpou (grammar), Dokkai (reading comprehension), and Choukai (listening comprehension) and success on the Japanese Language Proficiency Test (JLPT). This quantitative, predictive correlational research involved 60 students enrolled in Universitas Negeri Semarang Japanese language program. Based on the structural equation modelling and binary logistic regression analysis, the combined effects of Kanji, Bunpou (grammar), Dokkai (reading), and Choukai (listening) on JLPT outcomes were highly significant (χ² (4) = 42.957, p < 0.001), accounting for 73.4% of the variance (Nagelkerke R2.734). The model correctly classified 95% of cases, has an 88% accuracy for failures, and has a 98% accuracy for passes, indicating its robust predictive power. All four competencies were also significantly related to JLPT performance when considered separately (all p < 0.001). However, only Kanji (p = 0.041, odds ratio ≈ 1.69) and Bunpou (p = 0.046, odds ratio ≈ 1.77) were significantly associated with JLPT performance in the simultaneous model, as the impacts of Dokkai and Choukai were not significant. These findings imply that grammar, vocabulary and Kanji are fundamental elements for Japanese language learning, with reading and listening comprehension being heavily reliant on these skills. Therefore, because mastery of both lexical and syntactic skills appears to be a prerequisite for other abilities to meaningfully influence JLPT performance, this study recommends refining the integrative linguistic threshold concept and adopting a more comprehensive ‘Foundational-First’ pedagogical framework. It further suggests structuring weekly learning cycles to prioritize intensive lexico-syntactic automatization as the essential gateway to developing higher-order reading and listening proficiency.

Author Biographies

Andy Moorad Oesman, Universitas Negeri Semarang

Japanese Language Education Program, Faculty of Languages and Arts, Universitas Negeri Semarang, Kampus Sekaran, Gunungpati, Semarang, Central Java, Indonesia

Dany Buyung Yudha Prasetya, Universitas Negeri Semarang

Japanese Language Education Program, Faculty of Languages and Arts, Universitas Negeri Semarang, Kampus Sekaran, Gunungpati, Semarang, Central Java, Indonesia

Setiyani Wardhaningtyas, Universitas Negeri Semarang

Japanese Language Education Program, Faculty of Languages and Arts, Universitas Negeri Semarang, Kampus Sekaran, Gunungpati, Semarang, Central Java, Indonesia

Chiara Manno , Université Jean Moulin Lyon III

Japanese Studies, Faculty of Languages, Université Jean Moulin Lyon III, Lyon, France

References

Abe, H., Misochko, G. O., & Fedyanina, V. A. (2023). The Levels of Japanese Language Proficiency: A Description Model Designed by The Japan Foundation. Вестник МГПУ. Серия Филология. Теория Языка. Языковое Образование, 3(47). https://doi.org/10.25688/2076-913X.2022.47.3.11

Alam, A., & Ahmad, A. I. (2025). Integrated Language Skills and its Assessment: A Literature Review. Asian Journal of Education and Social Studies, 51(8), 304–316. https://doi.org/10.9734/ajess/2025/v51i82242

Ames, H., Glenton, C., & Lewin, S. (2019). Purposive sampling in a qualitative evidence synthesis: a worked example from a synthesis on parental perceptions of vaccination communication. BMC Medical Research Methodology, 19(1), 26. https://doi.org/10.1186/s12874-019-0665-4

Bailey, F., & Kadhum Fahad, A. (2021). Krashen Revisited: Case Study of the Role of Input, Motivation and Identity in Second Language Learning. Arab World English Journal, 12(2), 540–550. https://doi.org/10.24093/awej/vol12no2.36

Benito Durán, J. A., Rivero Gutiérrez, K. S., & Rodríguez Ramírez, Y. A. (2022). Learning Strategies and their Influence on Foreign Language Skills: A Literature Review from the Oxford Taxonomy. Mextesol Journal, 46(2), 1–18. https://doi.org/10.61871/mj.v46n2-4

Budianto, F. (2023). Welcoming The Opportunities: Deciphering Contemporary Mobility of Indonesian Professionals to Japan. Intermestic: Journal of International Studies, 7(2), 656. https://doi.org/10.24198/intermestic.v7n2.13

Cai, H., & Min, S. (2024). Listening And Grammatical Knowledge. In The Routledge Handbook of Second Language Acquisition and Listening (pp. 161–173). Routledge. https://doi.org/10.4324/9781003219552-14

Carson, L. (2017). Second Language Use as a Threshold Concept: Reconceptualising Language Learning Journeys. International Journal of Education, 9(2), 34. https://doi.org/10.5296/ije.v9i2.11315

Charli, M. S., Eshete, S. K., & Debela, K. L. (2022). Learning How Research Design Methods Work: A Review of Creswell’s Research Design: Qualitative, Quantitative and Mixed Methods Approaches. The Qualitative Report. https://doi.org/10.46743/2160-3715/2022.5901

Chen, Y. (2024). Quantitative Analysis of the Teaching Effectiveness of the Language Acquisition Model in Japanese Language and Culture Education. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns-2024-2603

Choi, Y., & Zhang, D. (2021). The relative role of vocabulary and grammatical knowledge in L2 reading comprehension: a systematic review of literature. International Review of Applied Linguistics in Language Teaching, 59(1), 1–30. https://doi.org/10.1515/iral-2017-0033

Córdova, A., Caballero-García, A., Drobnic, F., Roche, E., & Noriega, D. C. (2023). Influence of Stress and Emotions in the Learning Process: The Example of COVID-19 on University Students: A Narrative Review. Healthcare, 11(12), 1787. https://doi.org/10.3390/healthcare11121787

Dalal, D. K. (2023). (Multi)Collinearity in Behavioral Sciences Research. In Oxford Research Encyclopedia of Business and Management. Oxford University Press. https://doi.org/10.1093/acrefore/9780190224851.013.410

Djafri, F., & Wahidati, L. (2020). Study in Japan and the Motivation of Japanese Language Learners in Higher Educational Institutions in Indonesia. IZUMI, 9(2), 112–120. https://doi.org/10.14710/izumi.9.2.112-120

Enferad, R., Amirian, S. M. R., Azari Noughabi, M., MacIntyre, P., & Ringeisen, T. (2025). A holistic perspective on the contribution of foreign language peace of mind, enjoyment, anxiety, and boredom to EFL learners’ willingness to communicate: The mediating role of engagement. Language Teaching Research. https://doi.org/10.1177/13621688251352279

Esfandiari, M. (2018). Task-based Learning Applied: Satisfactory Grammar Coverage. International Journal of English and Cultural Studies, 1(1), 68. https://doi.org/10.11114/ijecs.v1i1.3104

Fan, T., Song, J., & Guan, Z. (2021). Integrating diagnostic assessment into curriculum: a theoretical framework and teaching practices. Language Testing in Asia, 11(1), 2. https://doi.org/10.1186/s40468-020-00117-y

Goh, C. C. M. (2023). Learners’ cognitive processing problems during comprehension as a basis for L2 listening research. System, 119, 103164. https://doi.org/10.1016/j.system.2023.103164

Hannon, B., & Dunlop, D. (2016). The Influences of Day of the Week on Cognitive Performance. British Journal of Education, Society & Behavioural Science, 16(4), 1–11. https://doi.org/10.9734/BJESBS/2016/26784

Hatasa, Y., & Watanabe, T. (2017). Japanese as a Second Language Assessment in Japan: Current Issues and Future Directions. Language Assessment Quarterly, 14(3), 192–212. https://doi.org/10.1080/15434303.2017.1351565

Hermalin, N. (2018). The Processing and Structure of Kanji and their Implications for Kanji Acquisition: a Theoretical Approach to Kanji Literacy. Carnegei Mellon University.

Hino, Y., Kusunose, Y., Miyamura, S., & Lupker, S. J. (2017). Phonological-orthographic consistency for Japanese words and its impact on visual and auditory word recognition. Journal of Experimental Psychology: Human Perception and Performance, 43(1), 126–146. https://doi.org/10.1037/xhp0000281

Ito, H. (2022). Correlations Between Proposed Orthoepic Competence Descriptors and Japanese Language Ability. Acta Linguistica Asiatica, 12(1), 19–35. https://doi.org/10.4312/ala.12.1.19-35

Iwasaki, N. (2016). Grammar for Reading Japanese as a Second Language: Variation of Stance Expressions Using to omou in Different Written Registers. In Theory, Research and Pedagogy in Learning and Teaching Japanese Grammar (pp. 157–186). Palgrave Macmillan UK. https://doi.org/10.1057/978-1-137-49892-2_7

Izzatillayevna, J. S. (2023). The relationship between emotional intelligence and success in integrated language skills in SLA. American Journal Of Philological Sciences, 03(03), 43–52. https://doi.org/10.37547/ajps/Volume03Issue03-08

Japan Educational Exchanges and Services. (2009). The official JLPT framework lends credence to this claim, as it explicitly identifies Vocabulary and Grammar, which are language knowledge as a core element for measuring communicative competence . The Japan Foundation. https://www.jlpt.jp/e/reference/pdf/guidebook_s_e.pdf

Japan Foundation. (2017). JF Standard for Japanese-Language Education Guidebook for Users [New Edition] (New Edition). Japan Foundation.

Jeon, E. H., & Yamashita, J. (2014). L2 Reading Comprehension and Its Correlates: A Meta‐Analysis. Language Learning, 64(1), 160–212. https://doi.org/10.1111/lang.12034

Jiang, X., Peters, R., Plonsky, L., & Pajak, B. (2024). The Effectiveness of Duolingo English Courses in Developing Reading and Listening Proficiency. CALICO Journal, 41(3), 249–272. https://doi.org/10.1558/cj.26704

Kakihana, S. (2024). Factors Relating to Kanji Reading Accuracy in Kun‐readings: An Item‐Level Analysis. Japanese Psychological Research. https://doi.org/10.1111/jpr.12504

Kamble, T. S., Kashid, D. N., & Sakate, D. M. (2019). Consistent and robust variable selection in regression based on Wald test. Communications in Statistics - Theory and Methods, 48(8), 1981–2000. https://doi.org/10.1080/03610926.2018.1440598

Kang, X., Matthews, S., Yip, V., & Wong, P. C. M. (2021). Language and nonlanguage factors in foreign language learning: evidence for the learning condition hypothesis. Npj Science of Learning, 6(1), 28. https://doi.org/10.1038/s41539-021-00104-9

Kawakami, A., Hatta, T., & Kogure, T. (2001). Differential Cognitive Processing of Kanji and Kana Words: Do Orthographic and Semantic Codes Function in Parallel in Word Matching Task. Perceptual and Motor Skills, 93(3), 719–726. https://doi.org/10.2466/pms.2001.93.3.719

Liu, M., Chano, J., & Luo, M. (2023). Enhancing Japanese Reading Comprehension Skills among Students: An Instructional Model Perspective. Journal of Curriculum and Teaching, 12(6), 318. https://doi.org/10.5430/jct.v12n6p318

Liyuan, H. (2023). Students’ Learning Autonomy: A Case Study of Undergraduate Course of Japanese Language Program. Journal of Psycholinguistic Research, 52(6), 2211–2228. https://doi.org/10.1007/s10936-023-09992-x

Lu, Y., & Morgan, J. L. (2020). Homophone auditory processing in cross-linguistic perspective. Proceedings of the Linguistic Society of America, 5(1), 529. https://doi.org/10.3765/plsa.v5i1.4733

Masrai, A. (2020). Exploring the impact of individual differences in aural vocabulary knowledge, written vocabulary knowledge and working memory capacity on explaining L2 learners’ listening comprehension. Applied Linguistics Review, 11(3), 423–447. https://doi.org/10.1515/applirev-2018-0106

Mitsugi, S. (2017). Syntactic prediction in L2 comprehension: evidence from Japanese adverbials (M. LaMendola & J. Scott, Eds.; pp. 509–521). Cascadilla Press.

Nishida, R., & Yashima, T. (2017). Language Proficiency, Motivation and Affect among Japanese University EFL Learners Focusing on Early Language Learning Experience. Zenkoku Eigo Kyouiku Gakkai, 28, 1–16.

Nishimura, A. (2024). Developing Communicative Competence through Strategy Training. JALT Postconference Publication, 2023(1), 15–25. https://doi.org/10.37546/JALTPCP2023-03

Nishizawa, H., Isbell, D. R., & Suzuki, Y. (2022). Review of the Japanese-Language Proficiency Test. Language Testing, 39(3), 494–503. https://doi.org/10.1177/02655322221080898

Niveri, R. L., & Rojas-Lizana, S. (2019). ‘Changes’ to the new Japanese-Language Proficiency Test: Newly emerged language policies for non-Japanese and Japanese citizens. The Electronic Journal of Contemporary Japanese Studies, 19(3).

Otsuka, S., & Murai, T. (2021). Cognitive underpinnings of multidimensional Japanese literacy and its impact on higher-level language skills. Scientific Reports, 11(1), 2190. https://doi.org/10.1038/s41598-021-81909-x

Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-y

Pandey, S. (2020). Principles of Correlation and Regression Analysis. Journal of the Practice of Cardiovascular Sciences, 6(1), 7–11. https://doi.org/10.4103/jpcs.jpcs_2_20

Paxton, S., & Svetanant, C. (2013). Tackling the Kanji hurdle: Investigation of Kanji learning in Non-Kanji background learners. International Journal of Research Studies in Language Learning, 3(3). https://doi.org/10.5861/ijrsll.2013.519

Prasetya, D. B. Y., Setiawati, A. S., Asrini, D. P., & Puspitosari, D. (2025). Improving Students Dokkai (Reading Comprehension) Performance Through Correlation Analysis of Cognitive Anxiety and Japanese Reading Understanding. Jurnal Pendidikan Dan Pengajaran, 58(1), 12–26. https://doi.org/10.23887/jpp.v58i1.85459

Qasserras, L. (2023). Systematic Review of Communicative Language Teaching (CLT) in Language Education: A Balanced Perspective. European Journal of Education and Pedagogy, 4(6), 17–23. https://doi.org/10.24018/ejedu.2023.4.6.763

Ratna, M., Saputri, L., & Latifa, C. (2022). Mapping Japanese Language Proficiency Test Needs for Vocational Students Based on Industrial World Demand. Journal of Learning and Development Studies, 2(3), 01–05. https://doi.org/10.32996/jlds.2022.2.3.1

Risda, D., Syihabuddin, S., Nurdin, E. S., & Malihah, E. (2025). The Impact of Intercultural Japanese Language Teaching Based on Gen-AI and Multimedia on Intercultural Communication Adaptation, Learning Motivation (L2), and Japanese Language Proficiency. International Journal of Learning, Teaching and Educational Research, 24(7), 256–277. https://doi.org/10.26803/ijlter.24.7.13

Rosiah, R., Savana, A. F., & Warisman, R. N. (2021). Correlation Study of Motivation and Habits to Learn Japanese Language With Result of Japanese Language Proficiency Test. Proceedings of the 4th International Conference on Sustainable Innovation 2020–Social, Humanity, and Education (ICoSIHESS 2020). https://doi.org/10.2991/assehr.k.210120.131

Sadiqzade, Z. (2024). The Foundational Role of Auditory Skills in Language Mastery. Acta Globalis Humanitatis et Linguarum, 1(1), 82–87. https://doi.org/10.69760/aghel.024054

Setyowati, Ohno, S., Hirano, Y., & Yetti, K. (2012). Indonesian Nurses’ Challenges for Passing the National Board Examination for Registered Nurse in Japanese. South East Asian Research, 49(4), 629–642. https://doi.org/10.20495/tak.49.4_629

Shinagawa, N., Inada, T., Gomi, H., Akatsu, H., Yoshida, M., & Kawakami, Y. (2022). Challenges and experiences to develop a Japanese language course for international medical students in Japan: Maximising acquisition of Japanese language by applying adult learning theories. The Asia Pacific Scholar, 7(1), 3–8. https://doi.org/10.29060/TAPS.2022-7-1/GP2655

Shiotsu, T., & Weir, C. J. (2007). The relative significance of syntactic knowledge and vocabulary breadth in the prediction of reading comprehension test performance. Language Testing, 24(1), 99–128. https://doi.org/10.1177/0265532207071513

Taele, P., Koh, J. I., & Hammond, T. (2020). Kanji Workbook: A Writing-Based Intelligent Tutoring System for Learning Proper Japanese Kanji Writing Technique with Instructor-Emulated Assessment. Proceedings of the AAAI Conference on Artificial Intelligence, 34(08), 13382–13389. https://doi.org/10.1609/aaai.v34i08.7053

Takagi, H., Xi, S., Kuwahara, M., Ueki, K., & Yabuki, M. (2021). A study on practical communication application for beginners of Japanese. 2021 IEEE 10th Global Conference on Consumer Electronics (GCCE), 215–217. https://doi.org/10.1109/GCCE53005.2021.9621941

Tateba, A., Hashimoto, K., Nagatoshi, A., & Uno, A. (2025). Double dissociation between lexical decision and comprehension in a Japanese patient with semantic dementia: based on the characteristic processing of Kanji. Neurocase, 31(2), 74–81. https://doi.org/10.1080/13554794.2024.2446318

Terasawa, T., & Segawa, H. (2025). A critical review of L2 teaching and learning research in Japan (2019–2023). Language Teaching, 58(3), 329–358. https://doi.org/10.1017/S0261444825000072

The Japan Foundation. (2024). The Japanese-Language Proficiency Test Summary of the Results July 2024. https://www.jlpt.jp/statistics/pdf/2024_1_9.pdf

The Japan Foundation. (2025). Guide to Japanese-Language Proficiency Test (JLPT) in 2025 . The Japan Foundation. https://www.jlpt.jp/reference/pdf/guide_2025.pdf

Tran, H.-N., Phan, N.-Q., Pham, T.-D., Le, Q.-H., & Nguyen, T.-P.-T. (2024). Correlation of Factors Influencing Japanese Proficiency Among Undergraduates at Two Sites in Vietnam. 405–415. https://doi.org/10.22492/issn.2186-2303.2024.35

Tsao, M. (2023). Group least squares regression for linear models with strongly correlated predictor variables. Annals of the Institute of Statistical Mathematics, 75(2), 233–250. https://doi.org/10.1007/s10463-022-00841-7

Uchihara, T., & Clenton, J. (2023). The role of spoken vocabulary knowledge in second language speaking proficiency. The Language Learning Journal, 51(3), 376–393. https://doi.org/10.1080/09571736.2022.2080856

Usami, Y. (2012). What is the “communicative language competence required to perform tasks” that is to be measured in the New Japanese-Language Proficiency Test? Thammasat Journal of Japanese Studies, 29(1), 1–15.

Ward, R., Nakamura, T., & Clark, L. E. (2024). What Motivates Students to Study Intermediate and Advanced Level Japanese at Australian Universities? Japanese Studies, 44(3), 263–287. https://doi.org/10.1080/10371397.2024.2416201

Weyant, E. (2022). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 5th Edition. Journal of Electronic Resources in Medical Libraries, 19(1–2), 54–55. https://doi.org/10.1080/15424065.2022.2046231

Yalin, S., & Wei, T. (2011). The Relative Significance of Vocabulary Breadth and Syntactic Knowledge in the Prediction of Reading Comprehension Test Performance. Chinese Journal of Applied Linguistics, 34(3). https://doi.org/10.1515/cjal.2011.028

Zhao, Y. (2024). Exploring the Balance between Fluency and Accuracy in Language Teaching Methodologies: A Comparative Analysis of PPP, TBL, CLT, and GTM. Journal of Education and Educational Research, 8(1), 127–130. https://doi.org/10.54097/19jkmq18

Downloads

Published

2026-01-22

How to Cite

Oesman, A. M., Prasetya, D. B. Y., Wardhaningtyas, S., & Manno , C. (2026). Evidence-Based Predictors of the Japanese Language Proficiency Test Succes: The Role of Kanji, Grammar, Reading, and Listening Skills. JOLLT Journal of Languages and Language Teaching, 14(1), 169–182. https://doi.org/10.33394/jollt.v14i1.17552

Issue

Section

Articles

Citation Check