International Journal of Information Technology and Computer Science (IJITCS)
IJITCS Vol. 18, No. 3, 8 Jun. 2026
Cover page and Table of Contents: PDF (size: 1036KB)
Multi-model Fusion for Emotion Detection in Text: A Stacking and Majority Voting Approach
PDF (1036KB), PP.189-206
Views: 0 Downloads: 0
Author(s)
Index Terms
Emotion Detection, Multi-model Fusion, Text Analysis, Stacking, Majority Voting, Sentiment Analysis, Natural Language Processing, Ensemble Learning
Abstract
Emotion detection from text plays a pivotal role in applications such as sentiment analysis, social media insights, and customer experience management. This study introduces a multi-model fusion approach for emotion detection using the Kaggle Emotion Text Dataset, a widely recognized benchmark that captures a variety of emotions across diverse textual inputs. The proposed framework employs a combination of machine learning classifiers, including Random Forest (RF), Logistic Regression (LR), Decision Trees (DT), Stochastic Gradient Descent (SGD) and Support Vector Machine (SVM). To maximize predictive performance, these models are integrated using two ensemble strategies: Stacking and Majority Voting. Stacking combines base models with a meta-classifier, enabling the system to learn intricate patterns in the data, while Majority Voting provides a simpler yet effective method for decision consolidation by leveraging collective model predictions. Performance evaluation is conducted using metrics such as accuracy, precision, recall, F-measure, False Positive Rate (FPR), and False Negative Rate (FNR). The results demonstrate that the Stacking approach achieves the highest accuracy of 99.92%, with precision of 99.68 %, recall of 99.19% and f-measure of 99.43%, respectively with Micro FPR of 0.0001, Micro FNR of 0.0007, Macro FPR of 0.0002 and Macro FNR of 0.0081. Majority Voting, while slightly less accurate, excels in reducing FPR and FNR, making it a valuable alternative in scenarios where minimizing misclassification is critical. This work underscores the potential of ensemble learning in addressing the complexities of emotion detection in text. The integration of diverse classifiers enhances prediction robustness and highlights the trade-offs between model complexity and real-world feasibility. By delivering a comprehensive evaluation and actionable insights, this single-author study contributes to advancing the field of emotion analysis and its practical applications.
Cite This Paper
Dharmaraj R. Patil, "Multi-model Fusion for Emotion Detection in Text: A Stacking and Majority Voting Approach", International Journal of Information Technology and Computer Science(IJITCS), Vol.18, No.3, pp.189-206, 2026. DOI:10.5815/ijitcs.2026.03.12
Reference
[1]K. Khare, V. Blanes-Vidal, E. S. Nadimi, and U. R. Acharya, "Emotion recognition and artificial intelligence: A systematic review (2014–2023) and research recommendations," Information Fusion, vol. 102, p. 102019, 2024.
[2]F. M. Plaza-del-Arco, A. Curry, A. C. Curry, and D. Hovy, "Emotion analysis in NLP: Trends, gaps and roadmap for future directions," arXiv preprint, arXiv:2403.01222, 2024.
[3]P. Nandwani and R. Verma, "A review on sentiment analysis and emotion detection from text," Social Network Analysis and Mining, vol. 11, no. 1, p. 81, 2021.
[4]F. Liu, "Artificial intelligence in emotion quantification: A prospective overview," CAAI Artificial Intelligence Research, vol. 3, 2024.
[5]A. Al Maruf, F. Khanam, M. M. Haque, Z. M. Jiyad, F. Mridha, and Z. Aung, "Challenges and opportunities of text-based emotion detection: A survey," IEEE Access, 2024.
[6]F. A. Acheampong, C. Wenyu, and H. Nunoo‐Mensah, "Text‐based emotion detection: Advances, challenges, and opportunities," Engineering Reports, vol. 2, no. 7, p. e12189, 2020.
[7]A. R. Murthy and K. M. Anil Kumar, "A review of different approaches for detecting emotion from text," in IOP Conference Series: Materials Science and Engineering, vol. 1110, no. 1, p. 012009, IOP Publishing, 2021.
[8]T. Chutia and N. Baruah, "A review on emotion detection by using deep learning techniques," Artificial Intelligence Review, vol. 57, no. 8, p. 203, 2024.
[9]G. Gamage, D. De Silva, N. Mills, D. Alahakoon, and M. Manic, "Emotion AWARE: an artificial intelligence framework for adaptable, robust, explainable, and multi-granular emotion analysis," Journal of Big Data, vol. 11, no. 1, p. 93, 2024.
[10]Z.-Y. Huang, C.-C. Chiang, J.-H. Chen, Y.-C. Chen, H.-L. Chung, Y.-P. Cai, and H.-C. Hsu, "A study on computer vision for facial emotion recognition," Scientific Reports, vol. 13, no. 1, p. 8425, 2023.
[11]A. G. M. Meque, N. Hussain, G. Sidorov, and A. Gelbukh, "Machine learning-based guilt detection in text," Scientific Reports, vol. 13, no. 1, p. 11441, 2023.
[12]G. V. Singh, S. Ghosh, M. Firdaus, A. Ekbal, and P. Bhattacharyya, "Predicting multi-label emojis, emotions, and sentiments in code-mixed texts using an emojifying sentiments framework," Scientific Reports, vol. 14, no. 1, p. 12204, 2024.
[13]R. Plutchik, “Plutchik’s Wheel of Emotions,” 1980. [Online]. Available: https://www.6seconds.org/2022/03/13/plutchik-wheel-emotions/. [Accessed: Jan. 6, 2025].
[14]A. Das, M. M. Hoque, O. Sharif, M. A. A. Dewan, and N. Siddique, "Temox: Classification of textual emotion using ensemble of transformers," IEEE Access, vol. 11, pp. 1122-1133, 2023.
[15]F. Ullah, X. Chen, S. B. H. Shah, S. Mahfoudh, M. A. Hassan, and N. Saeed, “A novel approach for emotion detection and sentiment analysis for low resource Urdu language based on CNN-LSTM,”Electronics, vol. 11, no. 24, p. 4096, 2022.
[16]T. Han, Z. Zhang, M. Ren, C. Dong, X. Jiang, and Q. Zhuang, “Text emotion recognition based on XLNet-BiGRU-Att,” Electronics, vol. 12, no. 12, p. 2704, 2023.
[17]K. Machová, M. Szabóová, J. Paralič, and J. Mičko, “Detection of emotion by text analysis using machine learning,” Frontiers in Psychology, vol. 14, p. 1190326, 2023.
[18]Y. Chen and J. He, “Deep learning-based emotion detection,” Journal of Computer and Communications, vol. 10, no. 2, pp. 57–71, 2022.
[19]M. Hadikhah Mozhdehi and A. Eftekhari Moghadam, “Textual emotion detection utilizing a transfer learning approach,” The Journal of Supercomputing, vol. 79, no. 12, pp. 13075–13089, 2023.
[20]S. Kusal, S. Patil, K. Kotecha, R. Aluvalu, and V. Varadarajan, “AI based emotion detection for textual big data: Techniques and contribution,” Big Data and Cognitive Computing, vol. 5, no. 3, p. 43, 2021.
[21]A. De L. Languré and M. Zareei,“Breaking barriers in sentiment analysis and text emotion detection: toward a unified assessment framework,” IEEE Access, vol. 11, pp. 125698–125715, 2023.
[22]S. K. Bharti, S. Varadhaganapathy, R. K. Gupta, P. K. Shukla, M. Bouye, S. K. Hingaa, and A. Mahmoud, “Text-based emotion recognition using deep learning approach,” Computational Intelligence and Neuroscience, vol. 2022, no. 1, p. 2645381, 2022.
[23]P. Zhong, D. Wang, and C. Miao,“Knowledge-enriched transformer for emotion detection in textual conversations,” arXiv preprint arXiv:1909.10681, 2019.
[24]A. H. Wani,“Leveraging emotions in student feedback to improve course content and delivery,” Scalable Computing: Practice and Experience, vol. 25, no. 5, pp. 3388–3393, 2024.
[25]Guo,“Deep learning approach to text analysis for human emotion detection from big data,” Journal of Intelligent Systems, vol. 31, no. 1, pp. 113–126, 2022.
[26]D. Yohanes, J. S. Putra, K. Filbert, K. M. Suryaningrum, and H. A. Saputri, “Emotion detection in textual data using deep learning,” Procedia Computer Science, vol. 227, pp. 464–473, 2023.
[27]D. Patil, D. Pattewar, and T. Pattewar, "Multi-Model Learning to Detect Twitter Hate Speech," Pre-prints, 2022.
[28]D. R. Patil, "A Framework for Malicious Domain Names Detection Using Feature Selection and Majority Voting Approach," Informatica, vol. 48, no. 3, 2024.
[29]D. R. Patil, T. M. Pattewar, V. D. Punjabi, and S. M. Pardeshi, "Detecting Fake Social Media Profiles Using the Majority Voting Approach," EAI Endorsed Transactions on Scalable Information Systems, vol. 11, no. 3, 2024.
[30]D. R. Patil and T. M. Pattewar, "Majority voting and feature selection based network intrusion detection system," EAI Endorsed Transactions on Scalable Information Systems, vol. 9, no. 6, 2022.
[31]D. R. Patil, "Fake news detection using majority voting technique," arXiv preprint, arXiv:2203.09936, 2022.
[32]D. R. Patil and J. B. Patil, "Malicious URLs detection using decision tree classifiers and majority voting technique," Cybernetics and Information Technologies, vol. 18, no. 1, pp. 11-29, 2018.
[33]V. Maslej-Krešňáková, M. Sarnovský, P. Butka, and K. Machová, "Comparison of deep learning models and various text pre-processing techniques for the toxic comments classification," Applied Sciences, vol. 10, no. 23, p. 8631, 2020.
[34]C. P. Chai, "Comparison of text preprocessing methods," Natural Language Engineering, vol. 29, no. 3, pp. 509-553, 2023.
[35]U. Naseem, I. Razzak, and P. W. Eklund, "A survey of pre-processing techniques to improve short-text quality: a case study on hate speech detection on twitter," Multimedia Tools and Applications, vol. 80, pp. 35239-35266, 2021.
[36]Z. Jianqiang and X. Gui, "Comparison research on text pre-processing methods on twitter sentiment analysis," IEEE Access, vol. 5, pp. 2870-2879, 2017.
[37]V. K. Pant, R. Sharma, and S. Kundu, "An overview of Stemming and Lemmatization Techniques," Advances in Networks, Intelligence and Computing, pp. 308-321.
[38]T. Turki and S. S. Roy, "Novel hate speech detection using word cloud visualization and ensemble learning coupled with count vectorizer," Applied Sciences, vol. 12, no. 13, p. 6611, 2022.
[39]M. M. Danyal, S. S. Khan, M. Khan, S. Ullah, M. B. Ghaffar, and W. Khan, "Sentiment analysis of movie reviews based on NB approaches using TF–IDF and count vectorizer," Social Network Analysis and Mining, vol. 14, no. 1, pp. 1-15, 2024.
[40]M. George, "Improving sentiment analysis of financial news headlines using hybrid Word2Vec-TFIDF feature extraction technique," Procedia Computer Science, vol. 244, pp. 1-8, 2024.
[41]V. Sundaram, S. Ahmed, S. A. Muqtadeer, and R. R. Reddy, "Emotion analysis in text using TF-IDF," in 2021 11th International Conference on Cloud Computing, Data Science & Engineering (Confluence), pp. 292-297, IEEE, 2021.
[42]A. Alslaity and R. Orji, "Machine learning techniques for emotion detection and sentiment analysis: Current state, challenges, and future directions," Behaviour & Information Technology, vol. 43, no. 1, pp. 139–164, 2024.
[43]L. Breiman, "Random forests," Machine Learning, vol. 45, pp. 5–32, 2001.
[44]G. Biau and E. Scornet, "A random forest guided tour," Test, vol. 25, pp. 197–227, 2016.
[45]D. G. Kleinbaum, K. Dietz, M. Gail, M. Klein, and M. Klein, Logistic Regression. New York: Springer-Verlag, 2002.
[46]T. G. Nick and K. M. Campbell, "Logistic regression," in Topics in Biostatistics, 2007, pp. 273–301.
[47]J. R. Quinlan, "Learning decision tree classifiers," ACM Computing Surveys (CSUR), vol. 28, no. 1, pp. 71–72, 1996.
[48]Y.-Y. Song and L. U. Ying, "Decision tree methods: Applications for classification and prediction," Shanghai Archives of Psychiatry, vol. 27, no. 2, p. 130, 2015.
[49]L. Bottou, "Large-scale machine learning with stochastic gradient descent," in Proceedings of COMPSTAT’2010: 19th International Conference on Computational Statistics, Paris, France, Aug. 22–27, 2010, pp. 177–186, Physica-Verlag HD, 2010.
[50]L. Bottou, "Stochastic gradient descent tricks," in Neural Networks: Tricks of the Trade, 2nd ed., Berlin, Heidelberg: Springer Berlin Heidelberg, 2012, pp. 421–436.
[51]C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121–167, 1998.
[52]M. A. Hearst, S. T. Dumais, E. Osuna, J. Platt, and B. Scholkopf, "Support vector machines," IEEE Intelligent Systems and their Applications, vol. 13, no. 4, pp. 18–28, 1998.
[53]S. Džeroski and B. Ženko, "Is combining classifiers with stacking better than selecting the best one?," Machine Learning, vol. 54, pp. 255–273, 2004.
[54]G. Sakkis, I. Androutsopoulos, G. Paliouras, V. Karkaletsis, C. D. Spyropoulos, and P. Stamatopoulos, "Stacking classifiers for anti-spam filtering of e-mail," arXiv preprint cs/0106040, 2001.
[55]L. Lam and S. Y. Suen, "Application of majority voting to pattern recognition: An analysis of its behavior and performance," IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, vol. 27, no. 5, pp. 553–568, 1997.
[56]D. Ruta and B. Gabrys, "Classifier selection for majority voting," Information Fusion, vol. 6, no. 1, pp. 63–81, 2005.
[57]S. Anjali, "Emotion Analysis based on Text," Available online: https://www.kaggle.com/datasets/simaanjali/emotion-analysis-based-on-text, 2025.
[58]M. Sokolova and G. Lapalme, "A systematic analysis of performance measures for classification tasks," Information Processing & Management, vol. 45, no. 4, pp. 427–437, 2009.