IJIEEB Vol. 18, No. 4, 8 Aug. 2026
Cover page and Table of Contents: PDF (size: 568KB)
PDF (568KB), PP.93-104
Views: 0 Downloads: 0
AI-driven platform, Convolutional Neural Networks, Large Language Models, YOLO, GenAI
This paper proposes IPAMS (Interview Performance Assessment using Gen AI), which is an AI-driven platform that automates interview evaluations using advanced technologies like Convolutional Neural Networks (CNN) to gain insights on facial emotions and expressions, Large Language Models (LLM) to generate and process interview questions, YOLO (You Only Look Once) for real-time object detection, and APIs for speech-to-text transcription and behavioral analysis. The system captures video responses and analyzes key elements such as sentiment, speech patterns, body posture, and facial expressions, generating a detailed report. This report highlights a candidate’s strengths and areas of improvement and is sent directly to their email with actionable insights. IPAMS modernizes recruitment by providing unbiased assessments, saving time and resources for recruiters. For candidates, it offers a valuable mock interview tool, delivering feedback on technical skills, confidence, stress levels, and nonverbal communication. By combining cutting-edge AI and analytics, IPAMS delivers an efficient, objective, and insightful solution for recruitment and self-assessment, benefiting all stakeholders in the interview process.
Sathvik Vadarevu, Manasa Viriyala, Garlapati K. V. S. Sai Komal, Venkat Vinukonda, Jeethu V. Devasia, "GenAI-Driven Interview Performance Assessment: Revolutionizing Recruitment with AI Insights", International Journal of Information Engineering and Electronic Business(IJIEEB), Vol.18, No.4, pp. 93-104, 2026. DOI:10.5815/ijieeb.2026.04.06
[1]Premanand Ghadekar, Aadesh Kabra, Ketan Gangwal, Atharv Kinage, Kirti Agarwal, and Kshitij Chaudhari. A semantic approach for automated hiring using artificial intelligence & computer vision. In 2023 IEEE 8th International Conference for Convergence in Technology (I2CT), pages 1–7. IEEE, 2023.
[2]Raj Pandey, Divya Chaudhari, Sahil Bhawani, Omkar Pawar, and Sunita Barve. Interview bot with automatic question generation and answer evaluation. In 2023 9th international conference on advanced computing and communication systems (ICACCS), volume 1, pages 1279–1286. IEEE, 2023.
[3]Bidyut Das, Mukta Majumder, Santanu Phadikar, and Arif Ahmed Sekh. Automatic question generation and answer assessment: a survey. Research and Practice in Technology Enhanced Learning, 16(1):5, 2021.
[4]Balasaheb Jadhav, Avadhut Sawant, Arnav Shah, Pranamya Vemula, Abhijeet Waikar, and Srushti Yadav. A comprehensive study and implementation of the mock interview simulator with ai and pose-based interaction. In 2024 1st International Conference on Cognitive, Green and Ubiquitous Computing (ICCGU), pages 01–05. IEEE, 2024.
[5]Surendra Mahajan, Nilesh Sonawane, Rohit Bagal, Saket Kulkarni, Ayush Suryawanshi, and Yadnyesh Mhaisne. Generative AI-based interview simulation and performance analysis. International Research Journal of Modernization in Engineering Technology and Science, 6(5):2623–2629, 2024.
[6]Rubi Mandal, Pranav Lohar, Dhiraj Patil, Apurva Patil, and Suvarna Wagh. AI-based mock interview evaluator: An emotion and confidence classifier model. In the 2023 International Conference on Intelligent Systems for Communication, IoT and Security (ICISCoIS), pages 521–526. IEEE, 2023.
[7]SN Ansy, E Ahmed Bilal, and MS Neethu. Emotion recognition through facial expressions from images using deep learning techniques. In International Conference on Data Science and Applications, pages 23–36. Springer, 2023.
[8]M Mohana, P Subashini, and M Krishnaveni. Emotion recognition from facial expression using hybrid CNN–LSTM network. International Journal of Pattern Recognition and Artificial Intelligence, 37(08):2356008, 2023.
[9]Yi-Chi Chou, Felicia R Wongso, Chun-Yen Chao, and Han-Yen Yu. An AI mock-interview platform for interview performance analysis. In 2022 10th International Conference on Information and Education Technology (ICIET), pages 37–41. IEEE, 2022.
[10]JS Ashwinkumar, Harshavardhini Saravana Kumaran, U Sivakarthikeyan, Konjeti PBV Rajesh, and R Lavanya. Deep learning based approach for facilitating online proctoring using transfer learning. In the 2021 5th International Conference on Computer, Communication and Signal Processing (ICCCSP), pages 306–312. IEEE, 2021.
[11]Lap-Kei Lee, Eric Ho Chan, Kyler Kin-Lik Tong, Nardo Kwun-Hei Wong, Ben Shing-Yan Wu, Yin-Chun Fung, Edmond King Sing Fong, U Leong Hou, and Nga-In Wu. Utilizing virtual reality and generative AI chatbot for job interview simulations. In 2024 International Symposium on Educational Technology (ISET), pages 209–212. IEEE, 2024.
[12]P Annan Naidu, M Gayatri, P Sreeja, V Rakesh Kumar, P Sai Tharun, and B Divakar. Computer vision–based malpractice detection system. In XVIII International Conference on Data Science and Intelligent Analysis of Information, pages 95–107. Springer, 2023.
[13]Shekhar Singh and Fatma Nasoz. Facial expression recognition with convolutional neural networks. In 2020 10th Annual Computing and Communication Workshop and Conference (CCWC), pages 0324–0328, 2020.
[14]Rahul Chauhan, Kamal Kumar Ghanshala, and RC Joshi. Convolutional neural network (CNN) for image detection and recognition. In 2018 first international conference on secure cyber computing and communication (ICSCCC), pages 278–282. IEEE, 2018.
[15]Harsha R Gaikwad and Arvind W Kiwelekar. A generative AI-based assistant to evaluate short and long answer questions. SN Computer Science, 5(5):633, 2024.
[16]Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Ćukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in Neural Information Processing Systems, volume 30, 2017.
[17]Rachana Patel and Sanskruti Patel. A comprehensive study of applying convolutional neural network for computer vision. International Journal of Advanced Science and Technology, 29(6s):2161–2174, 2020.
[18]B Nagaraju Yadav and M Kameshwara Rao. Malpractice detection in online assessments using eye gaze tracking and object detection. In Rising Threats in Expert Applications and Solutions: Proceedings of FICR-TEAS 2022, pages 701–708. Springer, 2022.
[19]Nikahat Mulla and Prachi Gharpure. Automatic question generation: a review of methodologies, datasets, evaluation metrics, and applications. Progress in Artificial Intelligence, 12(1):1–32, 2023.
[20]Gemini Team. Gemini: A family of highly capable multimodal models, 2024.
[21]Manas Sambare. FER-2013. https://www.kaggle.com/datasets/msambare/fer2013/data. [Online; accessed 7-November-2024].
[22]OpenAI. GPT-4 technical report. https://openai.com/research/gpt-4, 2023. Accessed: 2025-01-05.
[23]Meta AI. Llama: Open and efficient foundation language models. In Meta AI Research Blog, 2023. https://ai.meta.com.
[24]Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805, 2018.
[25]Rohan Taori et al. Alpaca: A strong, instruction-following model based on llama. https://crfm.stanford. edu/2023/03/13/alpaca.html, 2023.
[26]Hugo Touvron, Louis Rousset, Alexis Conneau, Thibaut Lavril, Mathieu Dupuy, Benjamin B., et al. Llama: Open and efficient foundation language models. https://arxiv.org/abs/2302.13971, 2023. Accessed: 2025-01-05.
[27]Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of NAACL-HLT 2019, 2019.
[28]IPAMS. Ipams: Intelligent project assessment and management system, 2026.