Abstract
While the application of artificial intelligence (AI) technologies in English as a Foreign Language (EFL) instruction is on the rise, there is still a scarcity of empirical research investigating their effects on learners' digital competence, engagement, and emotional experiences, especially within informal, conversation-oriented learning environments. The lack of evidence is especially evident in the high-stakes, rapidly changing EFL environment of Saudi Arabia, which poses distinct challenges for genuine conversational practice. This study aimed to fill a significant gap by employing a quasi-experimental design with a non-equivalent control group. It explored the impact of an AI-supported informal learning intervention on 140 intermediate-level female EFL learners within a university context in Saudi Arabia. Participants were methodically allocated to an experimental group (EG; n = 64) that engaged in AI-integrated conversational practice throughout eight units of the mandated curriculum Connect Book 3, or a control group (CG; n = 65) that experienced traditional teacher-led instruction utilizing the same curriculum material. Data were gathered through three validated self-report instruments that assess learners' self-perceived digital competence, academic enjoyment, and engagement. The research aimed to address three questions regarding the impact of the intervention on these significant outcomes. Multivariate Analysis of Covariance (MANCOVA) indicated notable enhancements in the experimental group relative to the control group concerning academic enjoyment, engagement, and digital competence. The intervention demonstrated a significant overall multivariate effect (Wilks’ Lambda = .80, F(3,122) = 9.86, p < .001, partial η2 = .19), affirming the beneficial influence of the AI intervention. The findings present important, practical considerations for curriculum developers and EFL teachers in Saudi Arabia concerning the incorporation of conversational AI tools to enhance digital literacy and emotional involvement.
References
Aladini, A., Ismail, S. M., Khasawneh, M. A. S., & Shakibaei, G. (2025). Self-directed writing development across computer/AI-based tasks: Unraveling the traces on L2 writing outcomes, growth mindfulness, and grammatical knowledge. Computers in Human Behavior Reports, 17, 100566. https://doi.org/10.1016/j.chbr.2024.100566
Alasmari, T. M. (2020). Can mobile learning technology close the gap caused by gender segregation in the Saudi educational institutions? Journal of Information Technology Education: Research, 19, 655–670
Alghamdi, F. A. M. (2024). Exploring the effectiveness of technology-enhanced self-access language learning (SALL) amongst primary level EFL learners in Saudi Arabia (Doctoral dissertation, University of Southampton).
Alrawashdeh, G. S., Fyffe, S., Azevedo, R. F. L., & Castillo, N. M. (2024). Exploring the impact of personalized and adaptive learning technologies on reading literacy: A global meta-analysis. Educational Research Review, 42, 100587. https://doi.org/10.1016/j.edurev.2023.100587
Chen, A., Li, W., & Fu, W. (2024). Unleashing digital superheroes: Unravelling the empathy factor in digital competence and online teacher autonomy support. British Journal of Educational Technology, 55(4), 1790-1810. https://doi.org/10.1111/bjet.13433
Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE Publications.
Deci, E. L., & Ryan, R. M. (2013). Intrinsic motivation and self-determination in human behavior. Springer Science & Business Media.
Deng, R., Benckendorff, P., & Gannaway, D. (2020). Learner engagement in MOOCs: Scale development and validation. British Journal of Educational Technology, 51(1), 245-262. https://doi.org/10.1111/bjet.12810
Dewaele, J. M., & MacIntyre, P. D. (2016). In P. D. MacIntyre, T. Gregersen, & S. Mercer (Eds.), Foreign language enjoyment and foreign language classroom anxiety. The right and left feet of FL learning? (pp. 215e236). Multilingual Matters.
Enferad, R., Amirian, S. M. R., Azari Noughabi, M., MacIntyre, P., & Ringeisen, T. (2025). A holistic perspective on the contribution of foreign language peace of mind, enjoyment, anxiety, and boredom to EFL learners’ willingness to communicate: The mediating role of engagement. Language Teaching Research, 13621688251352279. https://doi.org/10.1177/13621688251352279
Hammad Al-Rashidi, A., & Çakmak, F. (2024). Probing into the effects of teacher support on EFL learners' self-esteem, resilience, academic enjoyment, and academic achievement. Applied Research on English Language, 13(2), 149-180. https://doi.org/10.22108/are.2024.141168.2269
Huang, F., & Zou, B. (2024). English speaking with artificial intelligence (AI): The roles of enjoyment, willingness to communicate with AI, and innovativeness. Computers in Human Behavior, 159, 108355. https://doi.org/10.1016/j.chb.2024.108355
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning. Journal of computer assisted learning, 38(1), 237-257. https://doi.org/10.1111/jcal.12610
Hutson, J. (2025). The adoption of artificial intelligence and inertia in higher education: Exploring complex resistance to technological change. Taylor & Francis.
Jiang, R. (2022). How does artificial intelligence empower EFL teaching and learning nowadays? A review on artificial intelligence in the EFL context. Frontiers in Psychology, 13, 1049401. https://doi.org/10.3389/fpsyg.2022.1049401
Kaur, P., Kumar, H., & Kaushal, S. (2023). Technology-assisted language learning adaptive systems: A comprehensive review. International Journal of Cognitive Computing in Engineering, 4, 301–313. https://doi.org/10.1016/j.ijcce.2023.09.002
Martin, F., & Borup, J. (2022). Online learner engagement: Conceptual definitions, research themes, and supportive practices. Educational Psychologist, 57(3), 162-177. https://doi.org/10.1080/00461520.2022.2089147
Namaziandost, E., & Hwang, G.-J. (2025). Implementing multiple intelligence-informed tasks to cultivate willingness to communicate, academic engagement, and academic success: evidence from EFL learners. Instructional Science. https://doi.org/10.1007/s11251-025-09739-2
Niu, L., Wang, X., Wallace, M. P., Pang, H., & Xu, Y. (2022). Digital learning of English as a foreign language among university students: How are approaches to learning linked to digital competence and technostress?. Journal of Computer Assisted Learning, 38(5), 1332-1346. https://doi.org/10.1111/jcal.12679
Peláez‐Sánchez, I. C., George Reyes, C. E., & Glasserman‐Morales, L. D. (2023). Gender digital divide in education 4.0: A systematic literature review of factors and strategies for inclusion. Future in Educational Research, 1(2), 129-146. https://doi.org/10.1002/fer3.16
Rahimi, A. R. (2024). Beyond digital competence and language teaching skills: The bi-level factors associated with EFL teachers’ 21st-century digital competence to cultivate 21st-century digital skills. Education and Information Technologies, 29(8), 9061-9089. https://doi.org/10.1007/s10639-023-12171-z
Rezai, A., Namaziandost, E., & Hwang, G. J. (2024). How can ChatGPT open promising avenues for L2 development? A phenomenological study involving EFL university students in Iran. Computers in Human Behavior Reports, 16, 100510. https://doi.org/10.1016/j.chbr.2024.100510
Suharti, D. S., Suherdi, D., & Setyarini, S. (2021, April). Exploring students’ learning engagement in EFL online classroom. In Thirteenth Conference on Applied Linguistics (CONAPLIN 2020) (pp. 139-149). Atlantis Press.
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1207/s15516709cog1202_4
Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. (2007). Using multivariate statistics (Vol. 5, No. 7). Pearson. https://doi.org/10.1177/13621688251352279
Tikiz-Erturk, G., & Kurt-Taspinar, H. (2023). Applications of artificial intelligence (AI) in EFL classrooms. In Digital pedagogy in the 21st century: Emerging technologies in foreign language classrooms (27-44). Efe Academy Publishing.
Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (M. Cole, V. John-Steiner, S. Scribner, & E. Souberman, Eds. & Trans.). Harvard University Press. (Original work published 1930)
Wang, F., Zhou, X., Li, K., Cheung, A. C., & Tian, M. (2025). The effects of artificial intelligence-based interactive scaffolding on secondary students’ speaking performance, goal setting, self-evaluation, and motivation in informal digital learning of English. Interactive Learning Environments, 1-20. https://doi.org/10.1080/10494820.2025.2470319
Wang, X. (2022). Enhancing Chinese EFL students’ academic engagement: The impact of L2 enjoyment and academic motivation. Frontiers in Psychology, 13, 914682. https://doi.org/10.3389/fpsyg.2022.914682
Wu, T. T., Hapsari, I. P., & Huang, Y. M. (2025). Effects of incorporating AI chatbots into think–pair–share activities on EFL speaking anxiety, language enjoyment, and speaking performance. Computer Assisted Language Learning, 1-39. https://doi.org/10.1080/09588221.2025.2478271
Xia, Q., Chiu, T. K., Lee, M., Sanusi, I. T., Dai, Y., & Chai, C. S. (2022). A self-determination theory (SDT) design approach for inclusive and diverse artificial intelligence (AI) education. Computers & education, 189, 104582. https://doi.org/10.1016/j.compedu.2022.104582
Xu, J., & Liu, Q. (2025). Uncurtaining windows of motivation, enjoyment, critical thinking, and autonomy in AI-integrated education: Duolingo vs. ChatGPT. Learning and Motivation, 89, 102100. https://doi.org/10.1016/j.lmot.2025.102100
Yuan, L., & Liu, X. (2025). The effect of artificial intelligence tools on EFL learners' engagement, enjoyment, and motivation. Computers in Human Behavior, 162, 108474. https://doi.org/10.1016/j.chb.2024.108474
Zhai, C., Wibowo, S., & Li, L. D. (2024). The effects of over-reliance on AI dialogue systems on students' cognitive abilities: A systematic review. Smart Learning Environments, 11(28), 1-37. https://doi.org/10.1186/s40561-024-00316-7
Zhang, Z., Gao, X. (A.), & Liu, T. (2024). Enjoyment in foreign language learning: A systematic review. Heliyon, 10(17), e37215. https://doi.org/10.1016/j.heliyon.2024.e37215
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2025 Author and CALL-EJ