International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 18, No. 3, 8 Jun. 2026
Cover page and Table of Contents: PDF (size: 773KB)
Evaluating LLM-Assisted CLO–PLO Alignment Decisions for AUN-QA–Aligned Curriculum Mapping
PDF (773KB), PP.121-134
Views: 0 Downloads: 0
Author(s)
Suwut Tumthong
1,*
Nichanun Samakthai
1
Pinyaphat Tasatanattakool
1
Index Terms
AUN-QA Framework, Curriculum Management, Large Language Models, Learning Outcome Alignment, Quality Assurance in Higher Education, Educational Data Analytics
Abstract
Curriculum mapping for AUN-QA is often time-consuming and prone to inconsistency because learning-outcome evidence is scattered across multiple courses and program documents. This study examines the reliability of large language models in supporting course learning outcome–program learning outcome (CLO–PLO) alignment decisions for AUN-QA–aligned curriculum mapping. Using Mechatronics Engineering curriculum materials (2022–2024), AUN-QA v4.0 indicators were operationalized into a structured evidence schema to guide prompting and interpretation. GPT-4 produced 120 CLO–PLO alignment decisions, which were independently annotated by two domain experts and adjudicated by a third expert to establish reference labels. Model–reference agreement was evaluated using precision, recall, F1-score, and Cohen’s kappa (κ), yielding 0.89, 0.85, 0.87, and 0.81, respectively. We also developed a dashboard that summarizes alignment coverage and supports PDCA-based curriculum improvement by flagging potential gaps and redundancies. The findings suggest that LLM-assisted alignment can reduce mapping workload and improve auditability while remaining consistent with expert judgment, enabling more scalable evidence-based AUN-QA evaluation.
Cite This Paper
Suwut Tumthong, Nichanun Samakthai, Pinyaphat Tasatanattakool, "Evaluating LLM-Assisted CLO–PLO Alignment Decisions for AUN-QA–Aligned Curriculum Mapping", International Journal of Modern Education and Computer Science(IJMECS), Vol.18, No.3, pp. 121-134, 2026. DOI:10.5815/ijmecs.2026.03.08
Reference
[1]N. T.-N. Bui and P. Yasri, “Optimizing Quality Approaches and Investigating Lecturers’ Perception for Course Quality Assurance in Higher Education,” European Journal of Educational Management, vol. 7, no. 2, pp. 91–108, Jun. 2024, doi: 10.12973/eujem.7.2.91.
[2]S. A. MOSCOSO BERNAL, K. V. Bermeo Pazmiño, B. A. Poveda Sánchez, D. P. CASTRO LOPEZ, and A. Marrero Fernández, “Ética como eje transversal para el éxito de los procesos de aseguramiento de la calidad en las universidades,” Killkana Social, vol. 7, no. Especial, pp. 19–30, Mar. 2023, doi: 10.26871/killkanasocial.v7iespecial.1219.
[3]Luis Fabricio and Vargas Alfaro, “Evaluación y mejora continua, procesos para la calidad en la,” Revista El Labrador, vol. 8, no. 02, pp. 161–179, 2024. doi: 10.61285/r.e.l.-uisil.v8i02.156
[4]UNESCO, Global Education Monitoring Report 2023: Technology in education: A tool on whose terms, Revised version. GEM Report UNESCO, 2023. doi: 10.54676/UZQV8501.
[5]J. Wang, Q. Xing, Y. Qian, and A. Akbar, “A Systematic Review of the Role of Artificial Intelligence in Teaching and Learning,” in 2024 4th International Conference on Educational Technology, ICET 2024, Institute of Electrical and Electronics Engineers Inc., 2024, pp. 370–377. doi: 10.1109/ICET62460.2024.10868945.
[6]ASEAN University Network, “Guide to AUN-QA Assessment at Programme Level, Version 4.0,” Bangkok, Thailand: ASEAN University Network, Oct. 2020. [Online]. Available: https://www.aunsec.org/application/files/2816/7290/3752/Guide_to_AUN-QA_Assessment_at_Programme_Level_Version_4.0_4.pdf. Accessed: Jan. 31, 2026.
[7]T. Van Pham, A. T. Nguyen, H. H. Nguyen, M. D. Phan, and T. K. Chuan, “Alignment and mapping between CDIO standards and AUN-QA criteria,” in Proc. 16th Int. CDIO Conf., Gothenburg, Sweden, Jun. 2020, pp. 77–90. [Online]. Available: https://www.cdio.org/sites/default/files/docs/file/CDIO_Proceedings_2020_Pham.pdf. Accessed: Jan. 31, 2026.
[8]S. Tumthong, N. Samakthai, and P. Tasatanattakool, “Development of an intelligent platform for predicting curriculum management in higher education under the AUN-QA framework,” International Journal of Innovative Research and Scientific Studies, vol. 8, no. 1, pp. 1188–1195, Feb. 2025, doi: 10.53894/ijirss.v8i1.4550.
[9]O. Almatrafi and A. Johri, “Leveraging generative AI for course learning outcome categorization using Bloom’s taxonomy,” Computers and Education: Artificial Intelligence, vol. 8, Jun. 2025, doi: 10.1016/j.caeai.2025.100404.
[10]V. Jayalath, A. Barthakur, S. Dawson, J. Tingey, L. Crase, and V. Kovanović, “Scaling Curriculum Mapping in Higher Education: Evaluating Generative AI’s Role in Curriculum Analytics,” in Proc. Int. Conf. Artificial Intelligence in Education (AIED), Jul. 2025, pp. 294–308, doi: 10.1007/978-3-031-98414-3_21.
[11]J. Williams and L. Harvey, “Fifteen years of Quality in Higher Education (Part I),” Quality in Higher Education, vol. 16, no. 1, pp. 3–36, 2010, doi: 10.1080/13538321003679457.
[12]M. Kayyali, “Quality Assurance in Online and Blended Learning Environments,” in Quality Assurance and Accreditation in Higher Education, Springer Nature Switzerland, 2024, pp. 227–292. doi: 10.1007/978-3-031-66623-0_5.
[13]J. Biggs, “Enhancing teaching through constructive alignment,” Higher Education, vol. 32, no. 3, pp. 347–364, 1996, doi: 10.1007/BF00138871.
[14]R. M. Harden, “AMEE Guide No. 21: Curriculum mapping: A tool for transparent and authentic teaching and learning,” Med Teach, vol. 23, no. 2, pp. 123–137, 2001, doi: 10.1080/01421590120036547.
[15]S. Adam, “A consideration of the nature, role, application and implications for European education of employing ‘learning outcomes’ at the local, national and international levels,” Report (UK Bologna Seminar), Heriot-Watt Univ., Edinburgh, Scotland, Jun. 2004, ISBN: 0 7559 1058 32.
[16]S. Buckingham Shum, Á. Sándor, R. Goldsmith, R. Bass, and M. McWilliams, “Towards Reflective Writing Analytics: Rationale, Methodology and Preliminary Results,” Journal of Learning Analytics, vol. 4, no. 1, Mar. 2017, doi: 10.18608/jla.2017.41.5.
[17]N. Zaki, S. Turaev, K. Shuaib, A. Krishnan, and E. A. Mohamed, “Automating the Mapping of Course Learning Outcomes to Program Learning Outcomes using Natural Language Processing for Accurate Educational Program Evaluation,” United Arab Emirates University, Oct. 2022, doi: 10.21203/rs.3.rs-2196467/v1.
[18]J. Liang, Z. Cai, J. Zhu, H. Huang, K. Zong, B. An, A. Alharthi, J. He, L. Zhang, H. Li, B. Wang, and J. Xu, “Alignment at Pre-training! Towards Native Alignment for Arabic LLMs,” in Advances in Neural Information Processing Systems, vol. 37, 2024, pp. 13872–13896, doi: 10.52202/079017-0445.
[19]S. Surono, D. Pratama, and A. Budiono, “Study on Mapping of Qualification, Occupation, and Competence in Human Resources Management to Improve Link and Match Between Industry and Education Program,” Asian Journal of Engineering, Social and Health, vol. 3, no. 4, pp. 792–812, 2024, doi: 10.46799/ajesh.v3i4.299.
[20]J. Frattini, L. Montgomery, J. Fischbach, M. Unterkalmsteiner, D. Mendez, and D. Fucci, “A Live Extensible Ontology of Quality Factors for Textual Requirements,” in Proc. 2022 IEEE 30th Int. Requirements Engineering Conf. (RE), pp. 274–280, 2022, doi: 10.1109/RE54965.2022.00041.
[21]Y. Atig, A. Zahaf, D. Bouchiha, and M. Malki, “Alignment Conservativity Under the Ontology Change,” Journal of Information Technology Research, vol. 15, no. 1, pp. 1–19, Aug. 2022, doi: 10.4018/jitr.299923.
[22]J. Zhang, C. Zhu, and Z. Zhang, “AI-powered language learning: The role of NLP in grammar, spelling, and pronunciation feedback,” Applied and Computational Engineering, vol. 102, no. 1, pp. 18–23, Nov. 2024, doi: 10.54254/2755-2721/102/20240962.
[23]N. Dowell and V. Kovanović, “Modeling Educational Discourse with Natural Language Processing,” in The Handbook of Learning Analytics, SOLAR, 2022, pp. 105–119. doi: 10.18608/hla22.011.
[24]L. K. Allen, S. C. Creer, and P. Öncel, “Natural Language Processing: Towards a Multi-Dimensional View of the Learning Process,” in The Handbook of Learning Analytics, SOLAR, 2022, pp. 46–53. doi: 10.18608/hla22.005.
[25]A. Margienė, S. Ramanauskaitė, J. Nugaras, P. Stefanovič, and A. Čenys, “Competency-Based E-Learning Systems: Automated Integration of User Competency Portfolio,” Sustainability (Switzerland), vol. 14, no. 24, Dec. 2022, doi: 10.3390/su142416544.
[26]D. Zacharopoulou, M. Kokla, E. Tomai, and M. Kavouras, “A web-based application to support the interaction of spatial and semantic representation of knowledge,” AGILE: GIScience Series, vol. 3, pp. 1–6, Jun. 2022, doi: 10.5194/agile-giss-3-70-2022.
[27]E. Kasneci et al., “ChatGPT for good? On opportunities and challenges of large language models for education,” Learning and Individual Differences, vol. 103, Art. no. 102274, Apr. 2023, doi: 10.1016/j.lindif.2023.102274.
[28]L. Jiang and N. Bosch, “Short answer scoring with GPT-4,” in Proceedings of the Eleventh ACM Conference on Learning @ Scale, Atlanta, GA, USA, Jul. 18–20, 2024, pp. 438–442, doi: 10.1145/3657604.3664685.