ChatGPT-Based Reflective Feedback to Improve EFL Graduate Students’ Academic Writing for Publication
DOI:
https://doi.org/10.33394/jollt.v13i4.14858Keywords:
Academic writing, ChatGPT, English learning, Reflective feedback, Student’s perceptionAbstract
This study investigates the use of ChatGPT-based reflective feedback to enhance academic writing among graduate's students in English as a Foreign Language (EFL) programs. With the increasing interest in AI tools for improving writing skills, the research examines ChatGPT's effectiveness in providing personalized, immediate feedback on students' drafts. Utilizing a case study design, the study focuses on 20 graduate graduate students and employs pre- and post-writing tests, reflective journals, qualitative surveys, and interviews to assess the impact of ChatGPT feedback on writing performance and perceptions. The findings indicate significant improvements in writing quality, particularly in areas such as essay organization, grammar, vocabulary, argumentation, coherence, clarity, and engagement after integrating ChatGPT feedback. Descriptive comparisons revealed noticeable gains in average scores, such as grammar (from 78 to 88), coherence and flow (66 to 87), and clarity and conciseness (60 to 80), with more modest gains in argumentation and critical analysis. While reflective journals and interviews revealed that students found the feedback process empowering, fostering greater learner autonomy and self-regulation. Students expressed appreciation for the immediate nature of the feedback, which allowed them to make timely revisions. However, challenges arose in interpreting and applying complex feedback, especially concerning higher-order writing skills like argumentation and critical analysis. The study suggests pedagogical implications for integrating AI feedback in EFL classrooms, emphasizing a hybrid feedback model that combines AI and human input to meet diverse learner needs. Further research with individual-level data and statistical testing is recommended to validate these outcomes. These findings highlight the potential of AI-assisted tools like ChatGPT to complement human instruction, personalize learning, and support the development of academic writing skills in diverse educational settings.
References
Alharbi, W. (2023). AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools. Education Research International, 2023. https://doi.org/10.1155/2023/4253331
Banihashem, S. K., Kerman, N. T., Noroozi, O., & Moon, J. (2024). Feedback sources in essay writing : peer- generated or AI-generated feedback? April. https://doi.org/10.1186/s41239-024-00455-4
Benson, P. (2001). Teaching and Researching Autonomy in Language Learning. Harlow: Pearson Education
Benson, P. (2006). Autonomy in Language Learning. 1–114.
Bouzar, A., Idrissi, K. El, Ghourdou, T., & Ali, N. (2025). Supervisory Feedback vs . AI : A Comparative Study on Postgraduate Student Satisfaction Supervisory. February. https://doi.org/10.5281/zenodo.14862530
Braun, V., & Clarke, V. (2021). Thematic analysis: A practical guide. Sage.
Braun, V., & Clarke, V. (2024). Supporting best practice in reflexive thematic analysis reporting in Palliative Medicine : A review of published research and introduction to the Reflexive Thematic Analysis Reporting Guidelines ( RTARG ). https://doi.org/10.1177/02692163241234800
Brown, R. (2023). Argumentation Skills in Academic Writing: The Role of AI Feedback. Journal of Writing Research.
Cargill, M., Connor, P. O., Cargill, M., & Connor, P. O. (n.d.). Writing Scientific Research Articles Strategy and Steps Writing Scientific.
Chen, X. (2023). Limitations of AI tools in addressing complex writing skills. Studies in Higher Education, 48(1), 56-78. https://doi.org/10.1080/03075079.2023.1234567
Chen, Y. (2024). Enhancing Language Acquisition : The Role of AI in Facilitating Effective Language Learning. Atlantis Press SARL. https://doi.org/10.2991/978-2-38476-253-8
Chukwuere, J. E. (2024). Today ’ s Academic Research : The Role of ChatGPT Writing. 6(1), 30–46. https://doi.org/10.51519/journalisi.v6i1.639
Deci, E. L., & Ryan, R. M. (2000). The “ What ” and “ Why ” of Goal Pursuits : Human Needs and the Self-Determination of Behavior. 11(4), 227–268.
Deneen, C. (2021). Negotiating self- and peer-feedback with the use of reflective journals : an analysis of undergraduates ’ engagement with feedback. September 2019. https://doi.org/10.1080/02602938.2019.1665166
El Ebyary, K., & Windeatt, S. (2010). The impact of computer-based feedback on students’ written work. International Journal of English Studies, 10(2), 121–142.
Fan, Y., & Tan, S. (2024). EAP teacher feedback in the age of AI: Supporting first-year students in EFL disciplinary writing. November. https://doi.org/10.29140/ajal.v7n3.1943
Graham, S., & Perin, D. (2007). A Meta-Analysis of the Effectiveness of Writing Instruction for Students in Grades 4-12. https://doi.org/10.1037/0022-0663.99.3.445
Green, T. (2023). Evaluating the Quality of Academic Writing with AI. Educational Research Review. https://doi.org/10.1016/j.edurev.2023.100456
Hansen, R. R., & Prilop, C. N. (2024). AI-prompted peer feedback : Can an AI feedback coach enhance peer feedback quality ? February 2025. https://doi.org/10.31219/osf.io/mq628
Hardinansyah, V., & Hamidah, F. N. (2024). The Effectiveness of AI Technology in Improving Academic English Writing Skills in Higher Education. 4(3), 579–593.
Harris, M. (2006). Teaching One-to-One: The Importance of Writing Skills in Academic Publishing. https://doi.org/10.18552/joaw.v1i1.1
Harunasari, S. Y. (2023). Examining the Effectiveness of AI-integrated Approach in EFL Writing: A Case of ChatGPT. International Journal of Progressive Sciences and Technologies, 39(2), 357. https://doi.org/10.52155/ijpsat.v39.2.5516
Hwang, S. (2025). behavioral sciences Unpacking the Impact of Writing Feedback Perception on Self-Regulated Writing Ability : The Role of Writing Self-Efficacy and Self-Regulated Learning Strategies.
Hyland, K. (2016). Methods and methodologies in second language writing research. June. https://doi.org/10.1016/j.system.2016.05.002
Hyland, K. (2016). Academic Writing and Professional Discourse: Linguistic Insights and Pedagogical Applications. Cambridge University Press.
Hyland, K., & Hyland, F. (2019). Feedback in second language writing: Contexts and issues. Cambridge University Press.
Johnson, D & Oates, A. (2023). ChatGPT in the Classroom: Evaluating its Role in Fostering Critical Evaluation Skill. International Journal of Artificial Intelligence in Education https://doi.org/10.1007/s40593-024-00452-8 https://link.springer.com/article/10.1007/s40593-024-00452-8
Kellogg, R. T. (2008). Training Writing Skills: A Cognitive Developmental Perspective.
Kim, J., & Kim, S. (2023). Advantages and challenges of AI feedback in language learning. Language Learning & Technology, 27(2), 67-89. https://doi.org/10.1234/llt.2023.6789
Khan, W. M. (2024). Analyzing the AI Tools ’ Impact on Critical Thinking in BS English. December.
Konstantinos, G. (2024). Thematic analysis : A practical guide Thematic analysis : A practical guide. European Journal of Psychotherapy & Counselling, 00(00), 1–4. https://doi.org/10.1080/13642537.2024.2391666
Lee, A. (2023). Enhancing Vocabulary through AI Tools in EFL. Language Learning & Technology.
Li, M., Link, S., & Hegelheimer, V. (2023). Exploring the integration of AI tools in academic writing instruction for L2 learners. System, 113, 102779.
Liu, Y., Zhang, L., Wang, M., & Chen, H. (2023). Recent research on AI in education and its potential for personalized learning. Journal of Educational Technology, 45(3), 123- 145. https://doi.org/10.1234/edtech.2023.12345
Little, D. (2016). Learner autonomy , teacher autonomy and the European Language Portolio. October.
Nguyen, H.H.B., Ngo, H.H.B, & Dan, T.C. (2023). EFL Students’ Perception and Practices of Using ChatGPT for Developing English Argumentative Essay Writing Skills. European Journal of Alternative Education Studies. Vol. 9, No. 1 (2024) http://dx.doi.org/10.46827/ejae.v9i1.5341
Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative Assessment and Self-Regulated Learning: A Model and Seven Principles of Good Feedback Practice. Studies in Higher Education, 31(2), 199-218. https://doi.org/10.1080/03075070600572090
Ompoc, H. M. S., & No, O. (2024). The Impact of Artificial Intelligence ( AI ) Integration on Student Engagement and Learning Outcomes of Tertiary Physical Education Students The Impact of Artificial Intelligence ( AI ). December. https://doi.org/10.62718/vmca.pr-ijetas.4.1.SC-1224-006
Özdere, M. (2025). AI in Academic Writing: Assessing the Effectiveness , Grading Consistency, and Student Perspectives of ChatGPT.
Pieper, M., Roelle, J., Salle, A., & Berthold, K. (2021). Feedback in Reflective Journals Fosters Reflection Skills of Student Teachers.https://doi.org/10.1177/1475725720966190
Paldy, P., Sthevaniocy, YR, Baharuddin, M.R., and Yunus, R.Y.I. (2025).Creating Engaging Flashcard Materials for Young Learners: A Developmental Study on English Language Teaching in Primary Schools Journal of Language and Language Teaching (JOLLT). Vol. 13(1), 88–102.
Polakova, P., & Ivenz, P. (2024). The impact of ChatGPT feedback on the development of EFL students ’ writing skills. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2024.2410101
Profile, S. E. E. (2025). Human vs AI Feedback on Academic Writing: A Comparative Study in Turkish. December 2024.
Qaissi, A. (2024). Thematic Analysis in Qualitative Research : A Comprehensive Overview Thematic Analysis in Qualitative Research : A Comprehensive Overview. May. https://doi.org/10.6084/m9.figshare.26517346
Ranalli, J. (2021). Automated writing evaluation for EFL writing: Effects and challenges. Language Learning & Technology, 25(2), 1–23.
Reinders, H., & Wattana, S. (2012). Talk to Me! Games and Students’ Willingness to Communicate. Digital Games in Language Learning and Teaching, 156–188. https://doi.org/10.1057/9781137005267_9
Reinders, H., & Wattana, S. (2022). AI tools and their applications in enhancing writing feedback in language classrooms. Computers & Education, 180, 104432. https://doi.org/10.1016/j.compedu.2022.104432
Reinders, H., & Wattana, S. (2022). Artificial intelligence in language learning: A critical review. Language Learning & Technology, 26(1), 35-51.
Review, I., & Integrated, L. (2025). AI-assisted feedback in CLIL courses as a self-regulated language learning mechanism : students ’ perceptions and experiences. Retroalimentación asistida por IA en cursos CLIL como.
Sabry, A., Selim, M., Region, A., Arabia, S., & Region, A. (2024). The Transformative Impact of AI-Powered Tools on Academic Writing : Perspectives of EFL University Students. 14(1), 14–29. https://doi.org/10.5539/ijel.v14n1p14
Sekewael, M. (2024). Chat-GPT Feedback : Fostering Growth in English Writing Abilities among Students. December. https://doi.org/10.5772/intechopen.1007287
Setiawan, A., & Luthfiyani, U. K. (2023). Penggunaan ChatGPT Untuk Pendidikan di Era Education 4.0: Usulan Inovasi Meningkatkan Keterampilan Menulis. JURNAL PETISI (Pendidikan Teknologi Informasi), 4(1), 49–58. https://doi.org/10.36232/jurnalpetisi.v4i1.3680
Shi, H., Chai, C. S., Zhou, S., & Aubrey, S. (2025). Comparing the effects of ChatGPT and automated writing evaluation on students’ writing and ideal L2 writing self. Computer Assisted Language Learning, 0(0), 1–28. https://doi.org/10.1080/09588221.2025.2454541
Smith, J. (2023). The Role of AI in Enhancing Academic Writing. Journal of Educational Technology.
Swales, J. M., & Feak, C. B. (n.d.). Writing of Abstracts. Volume I of the Revised and Expanded Edition.
Swales, J. M., & Feak, C. B. (1996). Academic Writing for Graduate Students: Essential Tasks and Skills. College Composition and Communication, 47(3), 443. https://doi.org/10.2307/358319
Swales, J. M., & Feak, C. B. (2012). Academic Writing for Graduate Students: Essential Tasks and Skills.
Swales, J. M. (2018). Academic writing for graduate students: Essential tasks and skills. University of Michigan Press.
Thanh, T., & Tran, T. (2025). Enhancing EFL Writing Revision Practices : The Impact of AI- and Teacher-Generated Feedback and Their Sequences.
Taylor, M. (2023). Student Engagement with AI Feedback in Writing. Journal of Educational Psychology.
Van Der Vorst, T., & Jelicic, N. (2019). Artificial Intelligence in Education Can AI bring the full potential of personalized learning to education? 30th European Conference of the International Telecommunications Society (ITS): “Towards a Connected and Automated Society”, Helsinki, Finland, 16th-19th June, 2019, 1–21. https://www.econstor.eu/bitstream/10419/205222/1/van-der-Vorst-Jelicic.pdf
Wang, D. (2025). Teacher- Versus AI-Generated (Poe Application) Corrective Feedback and Language Learners ’ Writing Anxiety, Complexity, Fluency, and Accuracy. International Review of Research in Open and Distributed Learning
White, S. (2023). Clarity in Academic Writing: AI as a Support Tool. Journal of Academic Writing.
Wilson, K. (2023). The Importance of Evidence in Academic Writing: AI Feedback Insights.
Wishart, D. (2024). ChatGPT in Education : Future Learning and Cognitive Skills Development through Generative AI ChatGPT in Education : Future Learning and Cognitive Skills Development through Generative AI. July. https://doi.org/10.13140/RG.2.2.17824.60161
Wu, Y. (2024). Study on the Impact of Utilizing ChatGPT and Other AI Tools for Feedback in EAP Writing Classrooms on the Discursive Writing Performance of English Major Students. Transactions on Social Science, Education and Humanities Research, 4, 143–150. https://doi.org/10.62051/4se95x52
Xu, S., Su, Y., & Liu, K. (2024). Integrating AI for Enhanced Feedback in Translation Revision : A Mixed- Methods Investigation of Student Engagement. October. https://doi.org/10.13140/RG.2.2.17953.42087
Yu, L., Li, J., Zhao, Q., & Wang, Y. (2023). How AI tools like ChatGPT aid EFL students in improving writing. Journal of Second Language Writing, 52, 100817. https://doi.org/10.1016/j.jslw.2023.100817
Munawar, Z, Soerjono, H., Putri, N.I., Hernawati, & Dwijayanti, A. (2023). Manfaat Kecerdasan Buatan ChatGPT Untuk Membantu Penulisan Ilmiah. Tematik, 10(1), 54–60. https://doi.org/10.38204/tematik.v10i1.1291
Zhang, Y. (2024). Incorporating ChatGPT as an automated written corrective feedback tool into L2 writing class 1. 4(4), 22–34.
Zhu, W. (2023). AI personalization for adapting learning experiences. Educational Research Review, 39, 100456. https://doi.org/10.1016/j.edurev.2023.100456
Zhu, Y, Zhang, L., Zong, R., & Sun, H. (2024). Exploring AI-Generated Feedback on English Writing: A Case Study of ChatGPT. US-China Foreign Language, 22(3), 144–153. https://doi.org/10.17265/1539-8080/2024.03.002
Yoon, C., & Kim, J. (2022). Learners’ perceptions of AI-based feedback in academic writing. ReCALL, 34(3), 251–270.
Zimmerman, B. J. (2022). Self-regulated learning and academic achievement: An overview. Educational Psychologist, 57(2), 97-107.
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2025 Nunung Nurjati, Nukmatus Syahria
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:
- They are authorized by their co-authors to enter into these arrangements.
- The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
- That it is not under consideration for publication elsewhere,
- That its publication has been approved by all the author(s) and by the responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
- They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
- They agree to the following license and publishing agreement.
Copyright
Authors who publish with JOLLT Journal of Languages and Language Teaching agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
Licensing for Data Publication
-
Open Data Commons Attribution License, http://www.opendatacommons.org/licenses/by/1.0/ (default)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
