Work place: Department of Industrial Electrical Engineering, Faculty of Agricultural Technology and Industrial Technology, Nakhon Sawan Rajabhat University, Nakhon Sawan, Thailand
E-mail: amnaj.p@nsru.ac.th
Website:
Research Interests:
Biography
Amnaj Prajong is an Assistant Professor in the Faculty of Agricultural Technology and Industrial Technology, Nakhon Sawan Rajabhat University, NSRU. He received B.S.Tech.Ed. in Electrical Engineering from KMUTNB in 2006. He received M.Eng. in Electronic Engineering from Technology Mahanakhon University in 2010. His research interests include senser and transducer, automation, programmable logic controller, IoT, IIoT, mobile networks, analog circuit design, wireless communications, and AI.
By Amnaj Prajong Therdpong Daengsi
DOI: https://doi.org/10.5815/ijmecs.2026.04.02, Pub. Date: 8 Aug. 2026
This study evaluates the performance of six generative artificial intelligence (AI) systems in solving Thai-language multiple-choice examinations in the subject of Programmable Logic Controllers (PLC), This study evaluates the performance of six generative artificial intelligence (AI) systems in solving Thai-language multiple-choice examinations in the subject of Programmable Logic Controllers (PLC), a core component of Industrial Electrical Engineering education. Six large language models (LLMs), including ChatGPT, Claude, DeepSeek, Gemini, Copilot, and Grok, were tested using fifteen sets of PLC examination questions. Statistical analysis was conducted using one-way ANOVA and two-sample t-Tests with Bonferroni correction to examine performance differences. In addition, effect size measures, including Eta-squared (η²) and Cohen’s d, were calculated to assess the magnitude of the observed differences. The results show that ChatGPT achieved the highest mean score (77.27%), while DeepSeek followed closely (76.73%) and demonstrated the lowest standard deviation (±1.83%), indicating the most consistent performance across test sets. Claude also performed strongly (74.80%), whereas Gemini, Copilot, and Grok obtained similar mid-tier scores ranging from 72.40% to 72.73%. Although all LLMs achieved scores within the passing grade range, ANOVA confirmed statistically significant differences among systems (p-value = 0.0002). However, after applying the Bonferroni correction, only a subset of pairwise differences remained statistically significant, particularly between DeepSeek and several mid-tier LLMs, while the differences among ChatGPT, Claude, and DeepSeek were not statistically significant under the adjusted threshold. Effect size analysis further indicates that some of these differences represent meaningful practical variation in LLM performance. These findings indicate that contemporary LLMs demonstrate baseline comprehension of PLC concepts and can achieve passing-level performance in technical examinations conducted in a non-English language. The study contributes empirical evidence on AI performance in Thai-language technical assessments and highlights the potential role of generative AI as a complementary learning support tool in vocational and engineering education.
[...] Read more.Subscribe to receive issue release notifications and newsletters from MECS Press journals