The Effect of Formative Assessment Assisted by Artificial Intelligence on Students' Essay Writing Skills at UMMY Solok
Article Sidebar
Page Numbers:
2664-2681
Digital Object Identifier:
10.58578/mikailalsys.v4i2.10688
Viewed: 0 times
Downloaded: 0 times
LYAS Publisher cordially invites qualified professionals to serve as Editors or Reviewers. Your expertise will make an important contribution to maintaining and strengthening the academic quality of our publications. Interested applicants are kindly requested to complete the application form at the following link: Editors & Reviewers
Please feel free to contact us if you need any further information about the submission process or if you have any additional questions.
Authors:
Mega Putri1*, Yenni Rozimela2, Syahrul Ramadhan3 
Copyright :
Authors retain copyright and grant the journal right of first publication.
Main Article Content
Abstract
The development of Artificial Intelligence (AI) has created new opportunities for implementing formative assessment in higher education, including writing instruction. However, empirical research examining the effect of AI-assisted formative assessment on essay writing skills among students in Indonesian language education remains limited. This study aims to analyze the effect of AI-assisted formative assessment on the essay writing skills of students in the Indonesian Language Education Study Program at Mahaputra Muhammad Yamin University (UMMY) Solok. A quantitative approach with a quasi-experimental method and a nonequivalent control group design was employed. The sample consisted of 40 students, comprising 20 students in the experimental group and 20 students in the control group. The experimental group received AI-assisted formative assessment, whereas the control group received conventional formative assessment. Data were collected using an essay writing test assessed based on five aspects: content, organization, vocabulary, language use, and writing mechanics. The data were analyzed using descriptive statistics, normality tests, homogeneity tests, paired sample t-tests, independent sample t-tests, and effect size analysis using Cohen’s d. The findings show that the average post-test score of the experimental group was higher than that of the control group. The independent sample t-test produced a Sig. (2-tailed) value of 0.020 (< 0.05), indicating a significant difference between the two groups. The effect size analysis yielded a Cohen’s d value of 0.77, categorized as medium to high. In addition, improvement in the experimental group occurred across all assessment aspects, with the highest gains found in content and language use. This study concludes that AI-assisted formative assessment has a significant effect on students’ essay writing skills. The findings contribute to the development of technology-enhanced formative assessment in writing instruction and provide practical implications for using AI as a supporting tool to improve academic writing quality through fast, specific, and continuous feedback.
Citation Metrics:
Downloads
Article Details
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
References
Andrade, H. L., & Cizek, G. J. (Eds.). (2010). Handbook of formative assessment. Routledge. https://doi.org/10.4324/9780203874851
Banihashem, S. K., Noroozi, O., van Ginkel, S., & Biemans, H. J. A. (2024). Artificial intelligence and feedback in higher education: A systematic review. Educational Technology Research and Development.
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. https://doi.org/10.1007/s11092-008-9068-5
Chan. (2025). Students’ use of generative artificial intelligence in higher education: Opportunities and challenges. 50(1), 1–15.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
Graham, S. (2019). Changing how writing is taught. Review of Research in Education, 43(1), 277–303. https://doi.org/10.3102/0091732X18821125
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
Heritage, M. (2010). Formative assessment: Making it happen in the classroom. Corwin Press.
Hyland, K. (2019). Second language writing (2nd ed.). Cambridge University Press.
Jacobs, H. L., Zinkgraf, S. A., Wormuth, D. R., Hartfiel, V. F., & Hughey, J. B. (1981). Testing ESL composition: A practical approach. Newbury House Publishers.
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, Article 102274. https://doi.org/10.1016/j.lindif.2023.102274
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). Exploring generative artificial intelligence preparedness among university language instructors: A case study. Computers and Education: Artificial Intelligence, 5, Article 100156. https://doi.org/10.1016/j.caeai.2023.100156
Lee, S. S., & Moore, R. L. (2024). Harnessing generative AI (GenAI) for automated feedback in higher education: A systematic review. Online Learning, 28(3), 82–104. https://doi.org/10.24059/olj.v28i3.4593
Lim, W. M., & Gunasekara, A. N. (2024). Generative AI and the future of education: Current insights and future directions. Journal of Educational Technology Systems, 53(1), 1–24.
Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: A mixed methods intervention study. Smart Learning Environments, 11, Article 9. https://doi.org/10.1186/s40561-024-00295-9
Ogunleye, B., Zakariyyah, K. I., Ajao, O., Olayinka, O., & Sharma, H. (2024). A systematic review of generative AI for teaching and learning practice. Education Sciences, 14(6), Article 636. https://doi.org/10.3390/educsci14060636
Panadero, E., Brown, G. T. L., & Strijbos, J.-W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830. https://doi.org/10.1007/s10648-015-9350-2
Richards, J. C., & Renandya, W. A. (Eds.). (2002). Methodology in language teaching: An anthology of current practice. Cambridge University Press. https://doi.org/10.1017/CBO9780511667190
Xia, Q., Weng, X., Ouyang, F., Lin, T. J., & Chiu, T. K. F. (2024). A scoping review on how generative artificial intelligence transforms assessment in higher education. International Journal of Educational Technology in Higher Education, 21, Article 40. https://doi.org/10.1186/s41239-024-00468-z
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education: Where are the educators? International Journal of Educational Technology in Higher Education, 16, Article 39. https://doi.org/10.1186/s41239-019-0171-0
Zhang, Z., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102. https://doi.org/10.1016/j.asw.2018.02.004