International Journal of Information Engineering and Electronic Business (IJIEEB)
IJIEEB Vol. 17, No. 3, 8 Jun. 2025
Cover page and Table of Contents: PDF (size: 1048KB)
Enhancing E-commerce Sentiment Analysis with Advanced BERT Techniques
PDF (1048KB), PP.49-61
Views: 0 Downloads: 0
Author(s)
Nusrat Jahan
1,*
Jubayer Ahamed
1
Dip Nandi
1
Index Terms
E-commerce, Sentiment analysis, Machine Learning, BERT, Explainable AI, LIME
Abstract
This study introduces an improved BERT-based model for sentiment analysis in several languages, specifically focusing on analyzing e-commerce evaluations written in English and Bengali. Conventional sentiment analysis techniques frequently face difficulties in dealing with the subtle linguistic differences and cultural diversities present in datasets containing multiple languages. The model we propose integrates sophisticated methodologies and utilizes Local Interpretable Model-agnostic Explanations (LIME) to enhance the accuracy, interpretability, and dependability of sentiment assessments in various language situations. To tackle the challenges of sentiment categorization in a multilingual setting, we enhance the pre-trained BERT architecture by incorporating extra neural network layers. Compared to traditional machine learning and current deep learning methods, the model underwent a thorough evaluation, showcasing its superior capabilities with accuracy, precision, recall, and F1-score of 0.92. Including LIME improves the model’s transparency, allowing for a better understanding of the decision-making process and increasing user confidence. This research highlights the potential of utilizing advanced deep learning models to address the difficulties of sentiment analysis in global e-commerce environments, providing major implications for both academic research and practical applications in industry.
Cite This Paper
Nusrat Jahan, Jubayer Ahamed, Dip Nandi, "Enhancing E-commerce Sentiment Analysis with Advanced BERT Techniques", International Journal of Information Engineering and Electronic Business(IJIEEB), Vol.17, No.3, pp. 49-61, 2025. DOI:10.5815/ijieeb.2025.03.04
Reference
[1]Aytug Onan. Sentiment analysis on product reviews based on weighted word embeddings and deep neural networks.˘ Concurrency and computation: Practice and experience, 33(23):e5909, 2021.
[2]Marouane Birjali, Mohammed Kasri, and Abderrahim Beni-Hssane. A comprehensive survey on sentiment analysis: Approaches, challenges and trends. Knowledge-Based Systems, 226:107134, 2021.
[3]El Mahdi Mercha and Houda Benbrahim. Machine learning and deep learning for sentiment analysis across languages: A survey. Neurocomputing, 531:195–216, 2023.
[4]Dina Oralbekova, Orken Mamyrbayev, Mohamed Othman, Dinara Kassymova, and Kuralai Mukhsina. Contemporary approaches in evolving language models. Applied Sciences, 13(23):12901, 2023.
[5]Xianchang Luo, Yinxing Xue, Zhenchang Xing, and Jiamou Sun. Prcbert: Prompt learning for requirement classification using bert-based pretrained language models. In Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering, pages 1–13, 2022.
[6]Shinji Kawakura, Masayuki Hirafuji, Seishi Ninomiya, and Ryosuke Shibasaki. Analyses of diverse agricultural worker data with explainable artificial intelligence: Xai based on shap, lime, and lightgbm. European Journal of Agriculture and Food Sciences, 4(6):11–19, 2022.
[7]Tofayet Sultan, Nusrat Jahan, Ritu Basak, Mohammed Shaheen Alam Jony, and Rashidul Hasan Nabil. Machine learning in cyberbullying detection from social-media image or screenshot with optical character recognition. Int. J. Intell. Syst. Appl, 15:1–13, 2023.
[8]Sanjay Dey, Sarhan Wasif, Dhiman Sikder Tonmoy, Subrina Sultana, Jayjeet Sarkar, and Monisha Dey. A comparative study of support vector machine and naive bayes classifier for sentiment analysis on amazon product reviews. In 2020 International Conference on Contemporary Computing and Applications (IC3A), pages 217–220. IEEE, 2020.
[9]Minhajul Abedin Shafin, Md Mehedi Hasan, Md Rejaul Alam, Mosaddek Ali Mithu, Arafat Ulllah Nur, and Md Omar Faruk. Product review sentiment analysis by using nlp and machine learning in bangla language. In 2020 23rd International Conference on Computer and Information Technology (ICCIT), pages 1–5. IEEE, 2020.
[10]S Soumya and KV Pramod. Sentiment analysis of malayalam tweets using machine learning techniques. ICT Express, 6(4):300–305, 2020.
[11]Kanwal Zahoor, Narmeen Zakaria Bawany, and Soomaiya Hamid. Sentiment analysis and classification of restaurant reviews using machine learning. In 2020 21st International Arab Conference on Information Technology (ACIT), pages 1–6. IEEE, 2020.
[12]N Pavitha, Vithika Pungliya, Ankur Raut, Roshita Bhonsle, Atharva Purohit, Aayushi Patel, and R Shashidhar. Movie recommendation and sentiment analysis using machine learning. Global Transitions Proceedings, 3(1):279– 284, 2022.
[13]Sachin Chirgaiya, Deepak Sukheja, Niranjan Shrivastava, and Romil Rawat. Analysis of sentiment based movie reviews using machine learning techniques. Journal of Intelligent & Fuzzy Systems, 41(5):5449–5456, 2021.
[14]Amgad Muneer and Suliman Mohamed Fati. A comparative analysis of machine learning techniques for cyberbullying detection on twitter. Future Internet, 12(11):187, 2020.
[15]Kamaran H Manguri, Rebaz N Ramadhan, and Pshko R Mohammed Amin. Twitter sentiment analysis on worldwide covid-19 outbreaks. Kurdistan Journal of Applied Research, pages 54–65, 2020.
[16]Furqan Rustam, Madiha Khalid, Waqar Aslam, Vaibhav Rupapara, Arif Mehmood, and Gyu Sang Choi. A performance comparison of supervised machine learning models for covid-19 tweets sentiment analysis. Plos one, 16(2):e0245909, 2021.
[17]Petr Hajek, Aliaksandr Barushka, and Michal Munk. Fake consumer review detection using deep neural networks integrating word embeddings and emotion mining. Neural Computing and Applications, 32(23):17259–17274, 2020.
[18]S Nagi Alsubari, Sachin N Deshmukh, A Abdullah Alqarni, Nizar Alsharif, TH Aldhyani, Fawaz Waselallah Alsaade, and Osamah I Khalaf. Data analytics for the identification of fake reviews using supervised learning. Computers, Materials & Continua, 70(2):3189–3204, 2022.
[19]Srikanth Tammina and Sunil Annareddy. Sentiment analysis on customer reviews using convolutional neural network. In 2020 International Conference on Computer Communication and Informatics (ICCCI), pages 1–6. IEEE, 2020.
[20]Saeed Mian Qaisar. Sentiment analysis of imdb movie reviews using long short-term memory. In 2020 2nd International Conference on Computer and Information Sciences (ICCIS), pages 1–4. IEEE, 2020.
[21]Anisha P Rodrigues, Roshan Fernandes, Adarsh Shetty, Kuruva Lakshmanna, R Mahammad Shafi, et al. Real-time twitter spam detection and sentiment analysis using machine learning and deep learning techniques. Computational Intelligence and Neuroscience, 2022, 2022.
[22]Biswarup Ray, Avishek Garain, and Ram Sarkar. An ensemble-based hotel recommender system using sentiment analysis and aspect categorization of hotel reviews. Applied Soft Computing, 98:106935, 2021.
[23]Yi Luo and Xiaowei Xu. Comparative study of deep learning models for analyzing online restaurant reviews in the era of the covid-19 pandemic. International Journal of Hospitality Management, 94:102849, 2021.
[24]Lin Li, Tiong-Thye Goh, and Dawei Jin. How textual quality of online reviews affect classification performance: a case of deep learning sentiment analysis. Neural Computing and Applications, 32:4387–4415, 2020.
[25]Li Yang, Ying Li, Jin Wang, and R Simon Sherratt. Sentiment analysis for e-commerce product reviews in chinese based on sentiment lexicon and deep learning. IEEE access, 8:23522–23530, 2020.
[26]The Devastator. Amazon customer reviews with 2013-2019 sentiment. Kaggle Dataset, 2021.
[27]Kowshir Bitto. Bangla e-commerce sentiment. Kaggle Dataset, 2022.