Multimodal Reading Engagement: A Conceptual Review of AI-Mediated Text Transformation

Sulfaedah Lestari

doi:10.34050/els-jish.v9i2.51001

Authors

Sulfaedah Lestari STIA Abdul Haris

DOI:

https://doi.org/10.34050/els-jish.v9i2.51001

Keywords:

Generative artificial intelligence, Reading engagement, Multimodal learning, Higher education, AI-mediated learning

Abstract

The increasing availability of generative artificial intelligence (AI) tools has introduced new possibilities for transforming how students interact with academic texts. While most educational discussions have focused on AI-assisted writing and assessment, the role of AI in supporting reading engagement remains underexplored. This study presents a narrative literature review examining the relationship between generative AI, multimodal learning, and reading engagement in higher education. Relevant studies were identified through academic databases using keywords related to generative AI in education, multimodal learning, and reading engagement, and were analyzed through thematic categorization. The review indicates that AI-mediated text transformation, particularly converting text into visual or animated representation, may restructure reading activity into an iterative process involving rereading, verification, and adjustment. Such interaction aligns with cognitive, behavioral, and affective dimensions of engagement by encouraging learners to compare generated representations with original textual sources. Rather than functioning as an automated comprehension tool, generative AI can act as a mediating learning artefact that supports active involvement with reading material when pedagogically guided. The study proposes a conceptual framework describing AI-assisted text-to-animation learning as a cyclical engagement process. The findings suggest that the educational value of generative AI depends on instructional design that promotes critical interaction with generated output. Future research should empirically investigate classroom implementation to validate the proposed framework.

References

Albrecht-Crane, C. (2025). Thinking Smarter, not Harder? Google NotebookLM’s Misalignment Problem in Education. Proceedings of the 43rd ACM International Conference on Design of Communication, 121–127. https://doi.org/10.1145/3711670.3764628

Alisoy, H. (2025). Can NotebookLM Support English Language Learners? A Theoretical Perspective on AI Tools in Education. Porta Universorum, 1(6), 25–55.

Andini, C., Youngsun, K., Sunnuraini, S., & Warouw, D. S. (2026). Developing a Chunk-Based Learning Model to Improve Korean Speaking Skills for Beginner Learners. International Journal of L2CT, 1(2), 156-172.

Baumeister, R. F., & Leary, M. R. (1997). Writing Narrative Literature Reviews. Review of General Psychology, 1(3), 311–320. https://doi.org/10.1037/1089-2680.1.3.311

Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

Chea, P., & Xiao, Y. (2024). Artificial Intelligence in Higher Education: The Power and Damage of AI-assisted Tools on Academic English Reading Skills. Journal of General Education and Humanities, 3(3), 287–306. https://doi.org/10.58421/gehu.v3i3.242

Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239.

Daulay, E., & Dewi, U. (2025). Reading comprehension through multimodal literacy approach for English education. ETERNAL (English Teaching Journal), 16(2), 397–404.

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059

Gallent Torres, C., Zapata-González, A., & Ortego-Hernando, J. L. (2023). The impact of Generative Artificial Intelligence in higher education: A focus on ethics and academic integrity. RELIEVE. Revista ELectrónica de Investigación y EValuación Educativa, 2023, Vol. 29, Num. 2, p. 1-19.

Gasaymeh, A.-M. M., Beirat, M. A., & Abu Qbeita, A. A. (2024). University students’ insights of generative artificial intelligence (AI) writing tools. Education Sciences, 14(10), 1062.

Ghorbani Shemshadsara, Z., Ahour, T., & Hadidi Tamjid, N. (2019). Raising text structure awareness: A strategy of improving EFL undergraduate students’ reading comprehension ability. Cogent Education, 6(1), 1644704.

Gordon, C. M., & Hanauer, D. (1995). The interaction between task and meaning construction in EFL reading comprehension tests. Tesol Quarterly, 29(2), 299–324.

Grabe, W. (2009). Reading in a second language: Moving from theory to practice. Cambridge university press.

Huszti, I., Fodor, K., & Hnatik, K. (2025). Enhancing students’ English reading comprehension with AI assistance. Наука і Техніка Сьогодні, 6(47), 372–379.

Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kharbach, M. (2026). 10 Unexpected Ways to Use NotebookLM with Your Students.

Kim, J., Yu, S., Detrick, R., & Li, N. (2025). Exploring students’ perspectives on generative AI-assisted academic writing. Education and Information Technologies, 30(1), 1265–1300.

Komiyama, R. (2013). Factors underlying second language reading motivation of adult EAP students. Reading in a Foreign Language, 25(2), 149–169.

Lee, T., & Cho, V. (2025). Enhancing language learning through generative artificial intelligence in blended learning: An empirical study on productive and receptive of informal digital learning English. Journal of Educational Technology Systems, 53(3), 143–169.

Lestari, S. (2024a). The Implementation of ChatGPT-based Learning for Higher Education in Indonesia: Systematic Literature Review. 7(2). https://doi.org/https://doi.org/10.34050/elsjish.v7i2.35265

Lestari, S. (2024b). The implementation of ChatGPT-based learning for higher education in Indonesia: Systematic literature review. ELS Journal on Interdisciplinary Studies in Humanities, 7(2), 339–347.

Levy, L. S. (2016). Extensive reading in English as a foreign language/English as a second language contexts. Reports from the Faculty of Clinical Psychology, 9(3), 69–85.

Liu, X., Gu, M. M., & Jin, T. (2024). Strategy use in collaborative academic reading: Understanding how undergraduate students co-construct comprehension of academic texts. Language Teaching Research, 28(4), 1391–1411.

Manglara, V., Marengo, A., Stouka, N., & Pange, J. (2025). AI-powered Literature Review with Notebook LM: Implications for Educational Technology and Older Adults. Συνέδρια Της Ελληνικής Επιστημονικής Ένωσης Τεχνολογιών Πληροφορίας & Επικοινωνιών Στην Εκπαίδευση, 91–100.

Mayer, R. E. (2014). Incorporating motivation into multimedia learning. Learning and Instruction, 29, 171–173.

Mayer, R. E. (2024). The past, present, and future of the cognitive theory of multimedia learning. Educational Psychology Review, 36(1), 8.

Mikami, A. (2017). Students’ attitudes toward extensive reading in the Japanese EFL context. Tesol Journal, 8(2), 471–488.

Naderi Anari, N., Rostami Aboo Saeedi, A. A., & Shariati, M. (2019). The effects of multimodality on reading comprehension and vocabulary retention among Iranian EFL learners. Iranian Journal of English for Academic Purposes, 8(4), 86–101.

Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic Analysis: Striving to Meet the Trustworthiness Criteria. International Journal of Qualitative Methods, 16(1), 1609406917733847. https://doi.org/10.1177/1609406917733847

Pentaraki, A., & Burkholder, G. J. (2017). Emerging Evidence Regarding the Roles of Emotional, Behavioural, and Cognitive Aspects of Student Engagement in the Online Classroom. European Journal of Open, Distance and E-Learning, 20(1), 1–21.

Pilotti, M., Anderson, S., Hardy, P., Murphy, P., & Vincent, P. (2017). Factors related to cognitive, emotional, and behavioral engagement in the online asynchronous classroom. International Journal of Teaching and Learning in Higher Education, 29(1), 145–153.

Prihandoko, L. A., Anggawirya, A. M., & Rahman, F. (2021, December). Students’ perceptions towards autonomous learners concept in academic writing classes: Sequential mixed-method. In International Joined Conference on Social Science (ICSS 2021) (pp. 487-491). Atlantis Press.

Rahman, F., Abbas, A., Hasyim, M., Rahman, F., Abbas, A., & Hasyim, M. (2019). Facebook group as media of learning writing in ESP context: A case study at Hasanuddin University. Asian EFL Journal Research Articles, 26(6.1), 153-167.

Ritonga, N., Zuhairya, N., Fitrah, G. A., Rahman, F., Nanda, M. F. D., & Ismahani, S. (2024). The impact of syntax-semantics awareness on English writing proficiency in undergraduate students. Journal on Teacher Education, 6(2), 43-51.

Rotgans, J. I., & Schmidt, H. G. (2011). Cognitive engagement in the problem-based learning classroom. Advances in Health Sciences Education, 16(4), 465–479.

Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039

Varaporn, S., & Sitthitikul, P. (2019). Effects of multimodal tasks on students’ critical reading ability and perceptions.

Xiao, Y., & Watson, M. (2019). Guidance on Conducting a Systematic Literature Review. Journal of Planning Education and Research, 39(1), 93–112. https://doi.org/10.1177/0739456X17723971

Yaumi, M., Rahman, F., & Sahib, H. (2023). Exploring WhatsApp as Teaching and Learning Activities during Covid-19/New Normal era: A Semiotic Technology Analysis.

Yaumi, M., Rahman, F., & Sahib, H. (2024). Bridging Language and Technology through Semiotic Technology. International Journal of Social Science Research and Review, 7(1), 52–61.

Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 39. https://doi.org/10.1186/s41239-019-0171-0

Zhan, Y., & Yan, Z. (2025). Students’ engagement with ChatGPT feedback: Implications for student feedback literacy in the context of generative artificial intelligence. Assessment & Evaluation in Higher Education, 1–14.