International Journal of Education and Management Engineering (IJEME)
IJEME Vol. 16, No. 4, 8 Aug. 2026
Cover page and Table of Contents: PDF (size: 603KB)
A Multi-Criteria Evaluation Framework for Performance, Sustainability, and Scalability of Moodle-Based Learning Management Systems: A Data-Driven Approach
PDF (603KB), PP.89-105
Views: 0 Downloads: 0
Author(s)
Index Terms
Learning Management System, Moodle, Performance Evaluation, Sustainability, Scalability, Digital Education, Evaluation Framework, Higher Education
Abstract
Learning management systems (LMS) have become an important part of the modern higher education industry, and Moodle is one of the most popular open-source systems, which have become popular on an international level. Despite its extensive application, the majority of the existing evaluation tools are inclined to examine either performance, sustainability, or scalability separately and, thus, cannot be useful in long-term institutional planning. The current study proposes an assessment model that is a rational model of a Moodle-based LMS, as all three dimensions are included in the assessment model. The framework identifies the performance of the system, resource utilization and resource management, load-adaptive scalability metric, and an adaptable and predictable algorithmic-based assessment procedure in a variety of deployment environments. The framework applies Min–Max normalization and weighted aggregation to combine the three evaluation dimensions into a unified assessment score. To make the model more realistic, it was tested on publicly available data, for example, the Open University Learning Analytics Dataset (OULAD), which simulated actual interactions between LMS users and the utilization of cloud resource traces to analyze scalability and sustainability. Experimental evaluation using the OULAD and cloud resource datasets demonstrated approximately a 10% improvement in performance under medium workload conditions, an 18% reduction in sustainability due to increased resource utilization, and a 20% improvement in scalability as workload increased. These findings demonstrate that the proposed framework provides a systematic and data-driven approach for evaluating Moodle-based learning management systems and supports informed institutional decision-making.
Cite This Paper
Mohammad Nasar, Mohammad Abu Kausar, “A Multi-Criteria Evaluation Framework for Performance, Sustainability, and Scalability of Moodle-Based Learning Management Systems: A Data-Driven Approach”, International Journal of Education and Management Engineering (IJEME), Vol.16, No.4, pp. 89-105, 2026. DOI:10.5815/ijeme.2026.04.07
Reference
[1]H. A. Qaddumi and M. Smith, “Implementation of Learning Management Systems (Moodle): Effects on Students’ Language Acquisition and Attitudes towards Learning English as a Foreign Language,” Trends in Higher Education, vol. 3, no. 2, pp. 260–272, Apr. 2024, doi: 10.3390/higheredu3020016.
[2]D. Al-Fraihat, A. M. Alshahrani, M. Alzaidi, A. A. Shaikh, M. Al-Obeidallah, and M. Al-Okaily, “Exploring students’ perceptions of the design and use of the Moodle learning management system,” Computers in Human Behavior Reports, vol. 18, p. 100685, May 2025, doi: 10.1016/j.chbr.2025.100685.
[3]A. T. Rosário and J. C. Dias, “Learning Management Systems in Education,” 2022, pp. 47–77. doi: 10.4018/978-1-6684-4706-2.ch003.
[4]H. Aldabbas, A. M. Elamin, A. Z. E. Ahmed, and L. Gernal, “Assessing Learning Management System success in the UAE universities: how quality measures linked to students’ academic performance,” Front. Educ. (Lausanne)., vol. 10, Mar. 2025, doi: 10.3389/feduc.2025.1554641.
[5]M. J. Bonilla-Priego, M. Fernández-Giordano, and M. R. Pacheco-Olivares, “Evaluating the success of a learning management system for supplemental learning in accounting,” Accounting Education, pp. 1–26, Nov. 2024, doi: 10.1080/09639284.2024.2424269.
[6]A. Pacheco, R. Yupanqui, D. Mogrovejo, J. Garay, and Y. Uribe-Hernández, “Impact of digitization on educational management: Results of the introduction of a learning management system in a traditional school context,” Computers in Human Behavior Reports, vol. 17, p. 100592, Mar. 2025, doi: 10.1016/j.chbr.2025.100592.
[7]M. Furqon, P. Sinaga, L. Liliasari, and L. S. Riza, “The Impact of Learning Management System (LMS) Usage on Students,” TEM Journal, pp. 1082–1089, May 2023, doi: 10.18421/TEM122-54.
[8]A. M. Absatovna, A. A. Maldybaevna, Z. M. Zeinegabulovna, M. A. Erzhenbaikyzy, and L. Matkarimova, “Evaluation of Students’ Perceptions of Learning Management Systems and Technologies,” International Journal of Information and Education Technology, vol. 15, no. 10, pp. 2308–2317, 2025, doi: 10.18178/ijiet.2025.15.10.2426.
[9]Y. H. S. Al-Mamary, “Understanding the use of learning management systems by undergraduate university students using the UTAUT model: Credible evidence from Saudi Arabia,” International Journal of Information Management Data Insights, vol. 2, no. 2, p. 100092, Nov. 2022, doi: 10.1016/j.jjimei.2022.100092.
[10]M. Imran, N. Almusharraf, M. S. Abdellatif, and M. Y. Abbasova, “Artificial Intelligence in Higher Education: Enhancing Learning Systems and Transforming Educational Paradigms,” International Journal of Interactive Mobile Technologies (iJIM), vol. 18, no. 18, pp. 34–48, Sep. 2024, doi: 10.3991/ijim.v18i18.49143.
[11] M. Pawar and J. Dongardive, “Leveraging Artificial Intelligence in Learning Management Systems: A Systematic Review of Applications and Impacts in Higher Education,” Indian J. Sci. Technol., vol. 18, no. 38, pp. 3124–3135, Oct. 2025, doi: 10.17485/IJST/v18i38.1648.
[12]M. Nasar, R. H. Al Azri and M. Al Batahari, "Edge AI-Enabled Real-Time Learning Analytics for Scalable and Privacy-Aware E-Learning Platforms," 2026 International Conference on AI-Driven Smart Systems and Ubiquitous Computing (ICAUC), Pathum Thani, Thailand, 2026, pp. 1180-1186, doi: 10.1109/ICAUC68182.2026.11441257.
[13]O. Güntem and Y. Kılıç, “Efficiency and Sustainability in Online Education: An Evaluation of LMS Platforms and University Websites in Northern Cyprus,” Sustainability, vol. 17, no. 9, p. 4166, May 2025, doi: 10.3390/su17094166.
[14]S. Supiani, D. A. Kurniady, T. Yuniarsih, and N. Aedi, “Evaluating Learning Management System (LMS) Effectiveness: An LPOMR Model Approach,” Pedagogia: Jurnal Ilmiah Pendidikan, vol. 16, no. 2, pp. 71–77, Dec. 2024, doi: 10.55215/pedagogia.v16i2.2.
[15]Stéphan Vincent-Lancrin, Country Digital Education Ecosystems and Governance. OECD Publishing, 2023. doi: 10.1787/906134d4-en.
[16]Stéphan Vincent-Lancrin, OECD Digital Education Outlook 2023. OECD Publishing, 2023. doi: 10.1787/c74f03de-en.
[17]U. H. Jader, M. M. Delzy, S. R. M. Zeebaree, R. R. Zebari, Z. N. Rashid, and T. M. G. Sami, “Learning Management System (LMS) Performance Analysis and Evaluation for Some Kurdistan Region Universities,” in 2023 9th International Engineering Conference on Sustainable Technology and Development (IEC), IEEE, Feb. 2023, pp. 177–182. doi: 10.1109/IEC57380.2023.10438806.
[18]P. C. De Oliveira, C. José Castro de Almeida Cunha, and M. Keiko Nakayama, “Learning Management Systems (LMS) and e-learning management: an integrative review and research agenda,” Journal of Information Systems and Technology Management, vol. 13, no. 2, pp. 157–180, Sep. 2016, doi: 10.4301/S1807-17752016000200001.
[19]A. A. Shaame, J. R. Anatory, K. M. Osaki, and S. I. Mrutu, “Exploring a Learning Management System as a Way to Improve Students’ Understanding of Geometry in Secondary Schools,” Africa Education Review, vol. 17, no. 4, pp. 17–40, Jul. 2020, doi: 10.1080/18146627.2020.1868070.
[20]A. Ekuase-Anwansedo, S. F. Craig, and J. Noguera, “How to Survive a Learning Management System (LMS) Implementation?,” in Proceedings of the 2018 ACM SIGUCCS Annual Conference, New York, NY, USA: ACM, Sep. 2018, pp. 165–168. doi: 10.1145/3235715.3235735.
[21]Eljak, Hana, et al. “E-Learning-Based Cloud Computing Environment: A Systematic Review, Challenges, and Opportunities.” IEEE Access: Practical Innovations, Open Solutions, vol. 12, 2024, pp. 7329–7355, doi:10.1109/access.2023.3339250.
[22]Veljić A, Viduka D, Ilić L, Karabasevic D, Šijan A, Papić M. Sustainable Decision-Making in Higher Education: An AHP-NWA Framework for Evaluating Learning Management Systems. Sustainability. 2025; 17(22):10130. https://doi.org/10.3390/su172210130
[23]Kuzilek, J., Hlosta, M., & Zdrahal, Z. (2017). Open University Learning Analytics Dataset. Scientific Data, 4, 170171.
[24]Reiss, C., Tumanov, A., Ganger, G. R., Katz, R. H., & Kozuch, M. A. (2012). Heterogeneity and dynamicity of clouds at scale: Google trace analysis. ACM Symposium on Cloud Computing (SoCC).