Artificial Intelligence (AI) for Automated Writing Evaluation in TESOL: Effectiveness and Challenges
DOI:
https://doi.org/10.33394/jollt.v14i1.18165Keywords:
Artificial Intelligence, TESOL, Personalized Learning, Ethical Concern, Writing FeedbackAbstract
Artificial Intelligence (AI) is having a significant influence on language learning, primarily through Automated Writing Evaluation (AWE), which gives quick and personalized feedback to learners. However, there is not enough research on the effectiveness and challenges in establishing higher-order writing abilities in the TESOL context. This study reviews the available research on how AI-based AWE supports TESOL writing and what problems it might have. This research follows Braun and Clarke's (2006) thematic analysis of 55 peer-reviewed studies from academic sources (e.g., Scopus, Google Scholar, JSTORE, ERIC) published between 2018 and 2025 reporting findings on the effect of AWE on pedagogy in TESOL teaching. The findings focus on both the effectiveness and the challenges of AWE tools. The analysis highlights themes such as improved linguistic accuracy, enhanced learner motivation, and personalized learning experiences, which contrast with challenges like academic dishonesty, ethical concerns, over-reliance on AI, and limitations in addressing higher-order cognitive skills. These findings indicate that while AWE tools significantly improve grammar, vocabulary, and writing fluency, these are less effective in developing critical thinking and argumentation. The study suggests the need for blended feedback models that combine AI feedback and teacher guidance, the implementation of ethical guidelines, and the conduct of long-term research to see how AWE affects advanced writing skills over time.
References
Ali, S. T., Rahman, S. H., Najeeb, D. D., & Ameen, S. T. (2025). Ali, S. S., Rahman, S. H., Najeeb, D. D., & Ameen, S. T. Artificial Intelligence In Tesol: A Review Of Current Applications In Language Education And Assessment. Forum for Linguistic Studies, 7(1), 384-397. https://www.researchgate.net/publication/391672657_Forum_for_Linguistic_Studies
Al-Kadi, A. (2025). Fostering a ’Human with AI’approach for evaluating students’ writing in English. Studies in Linguistics, Culture, and FLT, 13(1), 140–159. 10.13140/RG.2.2.24560.16642
Allen, T. J., & Mizumoto, A. (2024). ChatGPT over my friends: Japanese English-as-a-Foreign-Language learners’ preferences for editing and proofreading strategies. RELC Journal, 1–18. https://doi.org/10.1177/00336882241262533
Barrett, A., & Pack, A. (2023). Not quite eye to AI: Student and teacher perspectives on the use of generative artificial intelligence in the writing process. International Journal of Educational Technology in Higher Education, 20(1), 59. https://doi.org/10.1186/s41239-023-00427-0
Barrot, J. S. (2024). Trends in automated writing evaluation systems research for teaching, learning, and assessment: A bibliometric analysis. Education and Information Technologies, 29(6), 7155-7179. https://doi.org/10.1007/s10639-023-12083-y
López, M. B. (2021). An updated typology of written corrective feedback: Resolving terminology issues. Revista Educación, 45(2), 577-592. https://doi.org/10.15517/revedu.v45i1.43289
Boud, D., & Dawson, P. (2023). What feedback literate teachers do: an empirically-derived competency framework. Assessment & Evaluation in Higher Education, 48(2), 158-171. https://doi.org/10.1080/02602938.2021.1910928
Bozorgian, H., & Yazdani, A. (2021). Direct written corrective feedback with metalinguistic explanation: Investigating language analytic ability. Iranian Journal of Language Teaching Research, 9(1), 65-85. https://doi.org/10.30466/ijltr.2021.120976
Charpentier-Jiménez, W. (2024). Assessing artificial intelligence and professors’ calibration in English as a foreign language writing courses at a Costa Rican public university. Actualidad Investigativas en Educación, 24(1), 533-557. https://doi.org/10.15517/aie.v24i1.55612
Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in education and teaching international, 61(2), 228-239. https://doi.org/10.35542/osf.io/mrz8h
Cross, R. (2025). TESOL teacher education in 2034: Some predictions. International Journal of TESOL Studies, 250412. https://doi.org/10.58304/ijts.250412
Edmett, A. (2025). GenAI and TESOL. International Journal of TESOL Studies, 250228, 1-8. https://doi.org/10.58304/ijts.250228
Elmotri, B., Harizi, R., Boujlida, A., Elyasa, Y. M., Garrouri, S., Amri, F., Malik, F. H., & Al-humari, M. A. (2025). The Impact of AI-Generated Feedback Explicitness (Generic vs. Specific) on EFL Students’ Use of Automated Written Corrective Feedback. Arab World English Journal, 16(1), 384–402. https://doi.org/10.24093/awej/vol16no1.24
Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20(1), 57. https://doi.org/10.1186/s41239-023-00425-2
Teng, M. F. (2024). A Systematic Review of ChatGPT for English as a Foreign Language Writing: Opportunities, Challenges, and Recommendations. International Journal of TESOL Studies, 6(3), 36–57. https://doi.org/10.58304/ijts.20240304
Feng, H., Li, K., & Zhang, L. J. (2025). What does AI bring to second language writing? A systematic review (2014-2024). Language Learning & Technology, 29(1), 1–27. https://hdl.handle.net/10125/73629
Godwin-Jones, R. (2022). Partnering with AI: Intelligent writing assistance and instructed language learning. Language Learning & Technology, 26(2), 5–24. http://doi.org/10125/73474
Haruna, H. H., Iftikhar, S., Isa, S. M., & Hasan, M. M. (2025). Effect of Professional Development, Collaborative Learning, and Technology Integration on Teachers' Self-Access Support Competence. Studies in Self-Access Learning Journal, 16(3). https://doi.org/10.37237/160304
Hasan, M. M., Islam, M. N., Nirjon, M. I. H., & Uddin, M. S. (2025). Predicting student performance and identifying learning behaviors using decision trees and K-means clustering. Int J Eval & Res Educ ISSN, 2252(8822), 3873. http://doi.org/10.11591/ijere.v14i5.33815
Hasan, M. M., Sikder, A., & Mahmud, R. (2025). Factors influencing Bangladeshi English teachers’ perceptions of academic policy, academic culture and knowledge related to plagiarism in higher education. Language Teaching Research Quarterly, 47, 20-39. https://doi.org/10.32038/ltrq.2025.47.02
Hasan, M. M., Khanom, S., Rumman, A. M., & Fatema, K. (2024). Blended Supervision of Thesis: Lessons and Future Directions from COVID-19 and Post-Pandemic Situation. Crossings: A Journal of English Studies, 15(1), 196–214. https://doi.org/10.59817/cjes.v15i1.572
Islam, M., Hasan, M. M., & Mahmud, R. (2024). EFL teachers' perceptions of AI's impact on academic integrity and pedagogy in Bangladeshi universities. Language Literacy: Journal of Linguistics, Literature, and Language Teaching, 8(2), 564–579. https://doi.org/10.30743/ll.v8i2.10082
Kannan, J., & Munday, P. (2018). New trends in second language learning and teaching through the lens of ICT, networked learning, and artificial intelligence, 76, 13-30. https://doi.org/10.5209/CLAC.62495
Kao, C. W., & Reynolds, B. L. (2024). Timed second language writing performance: Effects of perceived teacher vs perceived automated feedback. Humanities and Social Sciences Communications, 11(1), 1-14. https://doi.org/10.1057/s41599-024-03522-3
Karatay, Y., & Karatay, L. (2024). Automated writing evaluation use in second language classrooms: A research synthesis. System, 123, 103332. https://doi.org/10.1016/j.system.2024.103332
Keerthiwansha, N. W. B. S. (2018). Artificial intelligence education (AIEd) in English as a second language (ESL) classroom in Sri Lanka. Artificial Intelligence, 6(1), 31-36. https://wairco.org/IJCCIT/August2018Paper4SL.pdf
Khan, A. L., Hasan, M. M., Islam, M. N., & Uddin, M. S. (2024). Artificial Intelligence Tools in Developing English Writing Skills: Bangladeshi University EFL Students’ Perceptions. English Education: Jurnal Tadris Bahasa Inggris, 17(2), 345-371. https://dx.doi.org/10.24042/ee-jtbi.v17i2.24369
Kohnke, L., & Zou, D. (2025). Artificial intelligence integration in TESOL Teacher education: Promoting a critical lens guided by TPACK and SAMR. TESOL Quarterly. https://doi.org/10.1002/tesq.3396
Li, Y. (2024). Usability of ChatGPT in Second Language Acquisition: Capabilities, Effectiveness, Applications, Challenges, and Solutions. Studies in Applied Linguistics & TESOL, 24(1), 24-37. 10.52214/salt.v24i1.12864
Lodge, J. M., Thompson, K., & Corrin, L. (2023). Mapping out a research agenda for generative artificial intelligence in tertiary education. Australasian Journal of Educational Technology, 39(1), 1-8. https://doi.org/10.14742/ajet.8695
Lu, L. (2023). Evaluative and feedback mechanisms in writing for English as a second language (ESL) learners. Lect Notes Lang Lite, 6(15), 28-31. https://doi.org/10.23977/langl.2023.061505
Mirzaeian, V. R. (2025). A Comparative Evaluation of Artificial Intelligence Scoring Versus Human Scoring of EFL Students’ Essays. Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 44(1), 97-117. https://doi.org/10.22099/tesl.2025.50852.3313
Muñoz-Basols, J., Neville, C., Lafford, B. A., & Godev, C. (2023). Potentialities of applied translation for language learning in the era of artificial intelligence. Hispania, 106(2), 171-194. https://doi.org/10.1353/hpn.2023.a899427
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial. Heliyon, 7(5). https://doi.org/10.1016/j.heliyon.2021.e07014
Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B. P. T. (2023). Ethical principles for artificial intelligence in education. Education and information technologies, 28(4), 4221-4241. https://doi.org/10.1007/s10639-022-11316-w
Okata, N. G., & Adebayo, A. A. (2024). Exploring (AI) Artificial Intelligence’s Role in Language Teaching and Learning: A Review of Key Technologies and Their Applications. Beyond Babel: BU Journal of Language, Literature, and Humanities, 8(2), 50-73. https://doi.org/10.5281/zenodo.14599743
Povey, E. (2025). Leveraging AI for TESOL: Grammar lesson planning. Global Scientific and Academic Research Journal of Education and Literature, 3(1), 11-25. https://gsarpublishers.com/wp-content/uploads/2025/01/GSARJEL042025-Gelary-script.pdf
Pratama, A., & Sulistiyo, U. (2024). A Systematic Review of Artificial Intelligence in Enhancing English Foreign Learners’ Writing Skills. PPSDP International Journal of Education, 3(2), 170-181. 10.59175/pijed.v3i2.299
Rad, H. S., Alipour, R., & Jafarpour, A. (2024). Using artificial intelligence to foster students’ writing feedback literacy, engagement, and outcome: A case of Wordtune application. Interactive Learning Environments, 32(9), 5020-5040. https://doi.org/10.1080/10494820.2023.2208170
Rahmi, R., Amalina, Z., Andriansyah, A., & Rodgers, A. (2024). Does it really help? Exploring the impact of Al-Generated writing assistant on the students’ English writing. Studies in English Language and Education, 11(2), 998-1012. https://doi.org/10.24815/siele.v11i2.35875
Rashid, F. (2025). The Role Of Ai In Language Acquisition: A Study On Esl Learners’experiences. Journal of Applied Linguistics and TESOL (JALT), 8(2), 472-480.
Rusmiyanto, N., Huriati, N., Fitriani, N., Kusumaning Tyas, N., Rofi’i, A., & Sari, M. N. (2023). The role of artificial intelligence (AI) in developing English language learners’ communication skills. Journal on Education, 6(1), 750-757. 10.31004/joe.v6i1.2990
Sahito, J. K. M., Panwar, A. H., & Ramzan, I. (2025). Exploring The Impact Of Artificial Intelligence (Ai) On The Listening Skills Of English As A Second Language (Esl) Learners. Journal of Applied Linguistics and TESOL (JALT), 8(1), 1059-1067.
Schmidt, T., & Strasser, T. (2022). Artificial intelligence in foreign language learning and teaching: a CALL for intelligent practice. Anglistik: International Journal of English Studies, 33(1), 165-184. 10.33675/ANGL/2022/1/14
Shalevska, E. (2023). English teaching just got an upgrade: how AI is revolutionizing TESOL. International Journal of Education Teacher, 25, 109-113. 10.20544/teacher.2.11
Sharifuddin, N. S., & Hashim, H. (2024). Benefits and challenges in implementing artificial intelligence in education (AIED) in ESL classroom: A systematic review (2019-2022). International Journal of Academic Research in Business and Social Sciences, 14(1), 146-164. http://dx.doi.org/10.6007/IJARBSS/v14-i1/20422
Shen, C., Shi, P., Guo, J., Xu, S., & Tian, J. (2023). From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction. Frontiers in Psychology, 14, 1258286. https://doi.org/10.3389/fpsyg.2023.1258286
Siddique, R. (2025). Assisting Second Language Acquisition Through Artificial Intelligence: Effective Instructional Strategies For Non-Native English Speakers In Anglophone Contexts. Journal of Applied Linguistics and TESOL (JALT), 8(1), 1084-1099.
Son, J. B., Ružić, N. K., & Philpott, A. (2025). Artificial intelligence technologies and applications for language learning and teaching. Journal of China Computer-Assisted Language Learning, 5(1), 94-112. https://doi.org/10.1515/jccall-2023-0015
Taşkıran, A. (2022). AI-based automated writing evaluation for online language learning: Perceptions of distance learners. Kocaeli Üniversitesi Eğitim Dergisi, 5(1), 111-129. http://doi.org/10.33400/kuje.1053862
Taufiqulloh, T., Fadhly, F. Z., Rosdiana, I., Ferrer, C. N., Ratsamemonthon, C., Nindya, M. A., & Irawan, N. (2025). Comprehensive Review of Writing Assessments in EFL Contexts: A Meta-Synthetic Study. International Journal of Language Testing, 15(1), 193-213. https://doi.org/10.22034/ijlt.2024.475218.1367
Tran, T. T. T. (2025). Enhancing EFL writing revision practices: The impact of AI-and teacher-generated feedback and their sequences. Education Sciences, 15(2), 232. https://doi.org/10.3390/educsci15020232
Uddin, M. S., Islam, M. N., Nirjon, M. I. H., Hilaly, M. R., Mazed, M. F. H., & Hasan, M. M. (2024). University EFL Teachers’ Perceptions About the Effectiveness of AI-Enhanced E-Assessments in Bangladesh: A Phenomenological Study. Bulletin of Advanced English Studies, 9(2), 71-82. https://doi.org/10.31559/BAES2024.9.2.4
Wang, C. (2024). Exploring students’ generative AI-assisted writing processes: Perceptions and experiences from native and nonnative English speakers. Technology, Knowledge and Learning, 1-22. https://doi.org/10.1007/s10758-024-09744-3
Zainuddin, N. M., Bukhari, N. A., & Mohamad, M. (2024). Implementation of Artificial Intelligence (AI) As A Pedagogical Tool in Tertiary ESL Classroom: Teachers’ Perspectives. Language Teaching and Technology Journal, 14(8), 907-921. https://doi.org/10.6007/IJARBSS/v14-i8/22456
Zhai, C., & Wibowo, S. (2023). A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students’ interactional competence in the university. Computers and Education: Artificial Intelligence, 4, 100134. https://doi.org/10.1016/j.caeai.2023.100134
Zhang, Z., Aubrey, S., Huang, X., & Chiu, T. K. (2025). The role of generative AI and hybrid feedback in improving L2 writing skills: a comparative study. Innovation in Language Learning and Teaching, 1-19. https://doi.org/10.1080/17501229.2025.2503890
Zhu, M., & Wang, C. (2025). A systematic review of research on AI in language education: Current status and future implications. Language Learning & Technology, 29(1), 1-29. https://hdl.handle.net/10125/73606
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2026 Husnul Jannath, Antura Akter
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:
- They are authorized by their co-authors to enter into these arrangements.
- The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
- That it is not under consideration for publication elsewhere,
- That its publication has been approved by all the author(s) and by the responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
- They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
- They agree to the following license and publishing agreement.
Copyright
Authors who publish with JOLLT Journal of Languages and Language Teaching agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
Licensing for Data Publication
-
Open Data Commons Attribution License, http://www.opendatacommons.org/licenses/by/1.0/ (default)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
