International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 18, No. 4, 8 Aug. 2026
Cover page and Table of Contents: PDF (size: 725KB)
Impact of AI and Digital Skills Education on University Students' Knowledge and Attitudes toward Generative AI: A Descriptive Evaluation Study
PDF (725KB), PP.85-98
Views: 0 Downloads: 0
Author(s)
Esra Alzaghoul
1,*
Abdelbaset Assaf
1
Tahani Al-Khatib
1
Rana Yousef
1
Index Terms
Artificial Intelligence, Generative AI, Impact of AI, Digital Skills, Students’ Awareness, Higher Education, and Intelligent Software Tools
Abstract
The widespread use of Generative Artificial Intelligence tools among students across different educational levels is reshaping students’ attitude and education experience. They use it in various fields, including idea generation, writing assistance, and content creation. This study investigates the impact of the Modern Digital Skills course offered by the University of Jordan on students' digital literacy in Generative Artificial Intelligence. The study will employ a quantitative approach by conducting pre- and post-course surveys to measure changes in students' knowledge, skills, and attitudes across approximately 1,000 undergraduates from different majors at the university. Key variables include students' understanding of Generative Artificial Intelligence, their confidence in using Generative Artificial Intelligence tools, and their ability to critically evaluate AI-generated content and its ethical implications. The findings will determine whether the course significantly enhances students' knowledge, proficiency, critical thinking, and ethical awareness, while also exploring challenges and opportunities in integrating such a course into the academic curriculum. Ultimately, this study aims to provide insights for curriculum committees and decision-makers at universities in Jordan and the Middle East, emphasizing the importance of designing educational programs that foster essential Artificial Intelligence competencies and prepare students for a professional landscape increasingly shaped by Artificial Intelligence technologies.
Cite This Paper
Esra Alzaghoul, Abdelbaset Assaf, Tahani Al-Khatib, Rana Yousef, "Impact of AI and Digital Skills Education on University Students' Knowledge and Attitudes toward Generative AI: A Descriptive Evaluation Study", International Journal of Modern Education and Computer Science(IJMECS), Vol.18, No.4, pp. 85-98, 2026. DOI:10.5815/ijmecs.2026.04.06
Reference
[1]Russell S, Norvig P. Artificial Intelligence: A Modern Approach (4th Edition). Pearson; 2020.
[2]Haigh T. How the AI Boom Went Bust. Commun ACM 2024;67:22–6. https://doi.org/10.1145/3634901.
[3]Chen K, Tallant AC, Selig I. Exploring generative AI literacy in higher education: student adoption, interaction, evaluation and ethical perceptions. Information and Learning Sciences 2025;126:132–48. https://doi.org/10.1108/ILS-10-2023-0160.
[4]Fui-Hoon Nah F, Zheng R, Cai J, et al. Generative AI and ChatGPT: Applications, challenges, and AI-human collaboration. Journal of Information Technology Case and Application Research 2023;25:277–304. https://doi.org/10.1080/15228053.2023.2233814.
[5]Johri A, Hingle A, Schleiss J. Misconceptions, Pragmatism, and Value Tensions: Evaluating Students’ Understanding and Perception of Generative AI for Education. 2024 IEEE Frontiers in Education Conference (FIE), IEEE; 2024, p. 1–9. https://doi.org/10.1109/FIE61694.2024.10893017.
[6]De Vreede T, Singh VK, De Vreede G-J, et al. The Effect of IS Engagement on Generative AI Adoption, 2024. https://doi.org/10.24251/HICSS.2024.021.
[7]Siraj M, Duke J, Plötz T. The GenAI Generation: Student Views of Awareness, Preparedness, and Concern. ArXiv Preprint ArXiv:250502230 2025.
[8]Lin Z. Why and how to embrace AI such as ChatGPT in your academic life. R Soc Open Sci 2023;10. https://doi.org/10.1098/rsos.230658.
[9]Seghier ML. Using ChatGPT and other AI‐assisted tools to improve manuscripts readability and language. Int J Imaging Syst Technol 2023;33:773–5. https://doi.org/10.1002/ima.22902.
[10]Ng DTK, Chan EKC, Lo CK. Opportunities, challenges and school strategies for integrating generative AI in education. Computers and Education: Artificial Intelligence 2025;8:100373. https://doi.org/10.1016/j.caeai.2025.100373.
[11]Susnjak T, McIntosh T. ChatGPT: The End of Online Exam Integrity? Educ Sci (Basel) 2024;14:656. https://doi.org/10.3390/educsci14060656.
[12]Cotton DRE, Cotton PA, Shipway JR. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International 2024;61:228–39. https://doi.org/10.1080/14703297.2023.2190148.
[13]Hutson J. Rethinking Plagiarism in the Era of Generative AI. Journal of Intelligent Communication 2024;4. https://doi.org/10.54963/jic.v4i1.220.
[14]Rudolph J, Tan S, Tan Shannon. ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Learning & Teaching 2023;6. https://doi.org/10.37074/jalt.2023.6.1.9.
[15]Stokel-Walker C. AI bot ChatGPT writes smart essays — should professors worry? Nature 2022. https://doi.org/10.1038/d41586-022-04397-7.
[16]Duncan C, Mcculloh I. Unmasking Bias in Chat GPT Responses. Proceedings of the International Conference on Advances in Social Networks Analysis and Mining, New York, NY, USA: ACM; 2023, p. 687–91. https://doi.org/10.1145/3625007.3627484.
[17]Dwivedi YK, Kshetri N, Hughes L, et al. Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. Int J Inf Manage 2023;71:102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642.
[18]Steenbergen-Hu S, Cooper H. A meta-analysis of the effectiveness of intelligent tutoring systems on college students’ academic learning. J Educ Psychol 2014;106:331–47. https://doi.org/10.1037/a0034752.
[19]Ofusori LO, Hendradi R. ChatGPT and Its Impact on Students Assessment Practices in the Higher Educational Sector: A Systematic Review. Journal of Information Systems Engineering and Business Intelligence 2025;11:65–78. https://doi.org/10.20473/jisebi.11.1.65-78.
[20]Luo (Jess) J. How does GenAI affect trust in teacher-student relationships? Insights from students’ assessment experiences. Teaching in Higher Education 2025;30:991–1006. https://doi.org/10.1080/13562517.2024.2341005.
[21]Becker BA, Denny P, Finnie-Ansley J, et al. Programming Is Hard - Or at Least It Used to Be. Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1, New York, NY, USA: ACM; 2023, p. 500–6. https://doi.org/10.1145/3545945.3569759.
[22]MacNeil S, Tran A, Mogil D, et al. Generating Diverse Code Explanations using the GPT-3 Large Language Model. Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 2, New York, NY, USA: ACM; 2022, p. 37–9. https://doi.org/10.1145/3501709.3544280.
[23]MacNeil S, Tran A, Hellas A, et al. Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book. Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1, New York, NY, USA: ACM; 2023, p. 931–7. https://doi.org/10.1145/3545945.3569785.
[24]Bui NM, Barrot JS. ChatGPT as an automated essay scoring tool in the writing classrooms: how it compares with human scoring. Educ Inf Technol (Dordr) 2025;30:2041–58. https://doi.org/10.1007/s10639-024-12891-w.
[25]Hamtini T, Assaf AJ. Exploring the Efficacy of GenAI in Grading SQL Query Tasks: A Case Study. Cybernetics and Information Technologies 2024;24:102–11. https://doi.org/10.2478/cait-2024-0027.
[26]Messer M, Brown NCC, Kölling M, et al. Automated Grading and Feedback Tools for Programming Education: A Systematic Review. ACM Transactions on Computing Education 2024;24:1–43. https://doi.org/10.1145/3636515.
[27]Laine J, Minkkinen M, Mäntymäki M. Understanding the Ethics of Generative AI: Established and New Ethical Principles. Communications of the Association for Information Systems 2025;56:1–25. https://doi.org/10.17705/1CAIS.05601.
[28]Farhi F, Jeljeli R, Aburezeq I, et al. Analyzing the students’ views, concerns, and perceived ethics about chat GPT usage. Computers and Education: Artificial Intelligence 2023;5:100180. https://doi.org/10.1016/j.caeai.2023.100180.
[29]Lim WM, Gunasekara A, Pallant JL, et al. Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators. The International Journal of Management Education 2023;21:100790. https://doi.org/10.1016/j.ijme.2023.100790.
[30]Pedersen I. The rise of generative AI and enculturating AI writing in postsecondary education. Front Artif Intell 2023;6. https://doi.org/10.3389/frai.2023.1259407.
[31]Ariyo Okaiyeto S, Bai J, Xiao H. Generative AI in education: To embrace it or not？. International Journal of Agricultural and Biological Engineering 2023;16:285–6. https://doi.org/10.25165/j.ijabe.20231603.8486.
[32]Pratschke BM. Generative AI and Education. Cham: Springer Nature Switzerland; 2024. https://doi.org/10.1007/978-3-031-67991-9.
[33]Abu-Zayed AA-J, Alzaghoul E, Aldajani I, et al. Netnography Internet Research Methodology Applications: A Survey. Reconciliation, Heritage and Social Inclusion in the Middle East and North Africa, Cham: Springer International Publishing; 2022, p. 99–107. https://doi.org/10.1007/978-3-031-08713-4_7.
[34]Qasem MH, Aljaidi M, Samara G, et al. Towards Advancing Distributed Data Mining: Intelligent Agent Systems. 2023 2nd International Engineering Conference on Electrical, Energy, and Artificial Intelligence (EICEEAI), IEEE; 2023, p. 1–5. https://doi.org/10.1109/EICEEAI60672.2023.10590522.
[35]Shrivastava P. Understanding acceptance and resistance toward generative AI technologies: a multi-theoretical framework integrating functional, risk, and sociolegal factors. Front Artif Intell 2025;8. https://doi.org/10.3389/frai.2025.1565927.
[36]Su J, Yang W. Unlocking the Power of ChatGPT: A Framework for Applying Generative AI in Education. ECNU Review of Education 2023;6:355–66. https://doi.org/10.1177/20965311231168423.
[37]Duah JE, Lu X, McGivern P, et al. Interdisciplinary Perspectives on Generative Artificial Intelligence Adoption in Higher Education: A Theoretical Framework Review. Proceedings of the 2024 7th International Conference on Big Data and Education, New York, NY, USA: ACM; 2024, p. 1–9. https://doi.org/10.1145/3704289.3704293.
[38]Wainaina PK, Sun Y. Educators’ perceptions and willingness to integrate Generative Artificial Intelligence in teaching and research: evidence from Kenyan higher education. Discover Education 2025;4:347. https://doi.org/10.1007/s44217-025-00820-z.
[39]Jamieson S. Likert scales: how to (ab)use them. Med Educ 2004;38:1217–8. https://doi.org/10.1111/j.1365-2929.2004.02012.x.
[40]Boone H, Boone D. Analyzing Likert Data. J Ext 2012;50. https://doi.org/10.34068/joe.50.02.48.
[41]Agresti A, Kateri M. Categorical Data Analysis. International Encyclopedia of Statistical Science, Berlin, Heidelberg: Springer Berlin Heidelberg; 2025, p. 408–11. https://doi.org/10.1007/978-3-662-69359-9_94.
[42]Cohen J. Statistical Power Analysis for the Behavioral Sciences. Routledge; 2013. https://doi.org/10.4324/9780203771587.
[43]Sheskin DJ. Handbook of Parametric and Nonparametric Statistical Procedures. Chapman and Hall/CRC; 2003. https://doi.org/10.1201/9781420036268.
[44]Vargha A, Delaney HD. A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong. Journal of Educational and Behavioral Statistics 2000;25:101–32. https://doi.org/10.3102/10769986025002101.