Work place: Department of Information Technology, College of Computer Studies, MSU-Iligan Institute of Technology, Philippines
E-mail: january.naga@g.msuiit.edu.ph
Website:
Research Interests:
Biography
January F. Naga is a faculty member at Mindanao State University–Iligan Institute of Technology. Her research interests include information systems, social computing, and health informatics.
By January F. Naga Julieto E. Perez
DOI: https://doi.org/10.5815/ijmecs.2026.03.10, Pub. Date: 8 Jun. 2026
As Large Language Models (LLMs) become increasingly embedded in intelligent tutoring systems (ITSs), a growing need exists to understand how learners engage with these tools, especially in cognitively demanding domains such as computer programming. While prior research has focused mainly on LLM-generated scaffolding, less attention has been paid to student-side engagement, including how learners think, respond, and regulate their learning during natural language tutoring sessions. This study addresses that gap by identifying learner engagement state profiles based on behavioral and metacognitive patterns in student dialogue. Drawing on data from 36 recorded LLM-mediated C introductory programming tutorials, 1,046 dual-annotated student utterances were analyzed using K-means clustering. The analysis revealed three distinct learner engagement state profiles: Passive Reactors, Clarification Seekers, and Reflective Performers. These engagement states differed in response accuracy, metacognitive expression, and interaction style. Passive Reactors showed low initiative and limited self-regulation; Clarification Seekers demonstrated moderate accuracy and reactive help-seeking; Reflective Performers exhibited strategic engagement and high metacognitive activity. This study introduces an exploratory, scalable approach to learner profiling through natural language dialogue, advancing the design of adaptive, learner-aware LLM tutoring systems. The findings support the development of real-time learner modeling techniques that move beyond correctness, offering actionable insights for delivering more personalized and effective AI-assisted instruction in programming education.
[...] Read more.Subscribe to receive issue release notifications and newsletters from MECS Press journals