BiLSTM-Powered Emotion Recognition from ECG and GSR Signals

PDF (713KB), PP.38-51

Views: 0 Downloads: 0

Author(s)

Vanapalli Satya Sumanth 1,* Vanapalli Sashi Vardhan 2 Peruri Bhuvan Satwik 3 Neelamsetty Glory 4 Vallala Lohitha Prakaashini 5 Saragadam Charishma 6 Adiraju Shasank 7

1. Department of CSE, VR Siddhartha Engineering College,Vijayawada, India

2. Department of IT, GVP college of Engineering, Visakhapatnam, India

3. Narayana Junior College, Vijayawada, India

4. Department of CSE, VVIT college of Engineering, Namburu, India

5. Department of IT, JNTU, Vizianagaram, India

6. Department of ECE, Vignan's institute of Engineering for Women, Visakhapatnam, India

7. Department of CSE, Anil Neerukonda Institute of Techonology and Sciences, India

* Corresponding author.

DOI: https://doi.org/10.5815/ijmsc.2025.02.04

Received: 18 Feb. 2025 / Revised: 25 Mar. 2025 / Accepted: 24 Apr. 2025 / Published: 8 Jun. 2025

Index Terms

Electrocardiogram (ECG), Galvanic Skin Response (GSR), BiLSTM Networks, Emotion Classification, Affective Computing, Human-Computer Interaction (HCI), Physiological Signal Processing, Deep Learning

Abstract

Emotions significantly influence human behaviour, decision-making, and communication, making their accurate recognition essential for various applications. This study introduces a novel approach for emotion extraction from electrocardiogram (ECG) and galvanic skin response (GSR) signals using Bidirectional Long Short-Term Memory (BiLSTM) networks. Unlike conventional emotion recognition methods that rely on facial expressions or self-reports, our model utilizes physiological signals to capture emotional states with high precision. ECG provides insights into cardiac activity, while GSR reflects changes in skin conductance, both serving as reliable indicators of emotional responses. By leveraging advanced signal processing techniques and deep learning algorithms, the model effectively identifies intricate patterns within these biosignals, enabling accurate emotion classification. Experimental validation demonstrates the model’s effectiveness in distinguishing between different emotional states, surpassing traditional methods. This research contributes to affective computing and human-computer interaction (HCI) by enhancing the capability of intelligent systems to recognize and respond to human emotions, paving the way for applications in mental health monitoring, driver assistance systems, and adaptive user interfaces.

Cite This Paper

Vanapalli Satya Sumanth, Vanapalli Sashi Vardhan, Peruri Bhuvan Satwik, Neelamsetty Glory, Vallala Lohitha Prakaashini, Saragadam Charishma, Adiraju Shasank, "BiLSTM-Powered Emotion Recognition from ECG and GSR Signals", International Journal of Mathematical Sciences and Computing(IJMSC), Vol.11, No.2, pp. 38-51, 2025. DOI: 10.5815/ijmsc.2025.02.04

Reference

[1]Lee, M.S.; Lee, Y.K.; Pae, D.S.; Lim, M.T.; Kim, D.W.; Kang, T.K. Fast emotion recognition based on single pulse PPG signal with convolutional neural network. Appl. Sci. 2019, 9, 3355. 
[2] Bulagang, Aaron Frederick, Ng Giap Weng, James Mountstephens, and Jason Teo. "A review of recent approaches for emotion classification using electrocardiography and electrodermography signals." Informatics in Medicine Unlocked 20 (2020): 100363.
[3]Egger, Maria, Matthias Ley, and Sten Hanke. "Emotion recognition from physiological signal analysis: A review." Electronic Notes in Theoretical Computer Science 343 (2019): 35-55. 
[4]Hsu, Yu-Liang, Jeen-Shing Wang, Wei-Chun Chiang, and Chien-Han Hung. "Automatic ECG-based emotion recognition in music listening." IEEE Transactions on Affective Computing 11, no. 1 (2017): 85-99. 
[5]Goshvarpour, Atefeh, Ataollah Abbasi, and Ateke Goshvarpour. "An accurate emotion recognition system using ECG and GSR signals and matching pursuit method." Biomedical journal 40.6 (2017): 355-368. 
[6]Dessai, Amita, and Hassanali Virani. "Emotion Classification Based on CWT of ECG and GSR Signals Using Various CNN Models." Electronics 12.13 (2023): 2795. 
[7]Dutta, Stobak, Brojo Kishore Mishra, Anirban Mitra, and Amartya Chakraborty. "An analysis of emotion recognition based on GSR signal." ECS Transactions 107, no. 1 (2022): 12535. 
[8]Panahi, F., Rashidi, S., & Sheikhani, A. (2021). Application of fractional Fourier transform in feature extraction from ELECTROCARDIOGRAM and GALVANIC SKIN RESPONSE for emotion recognition. Biomedical Signal Processing and Control, 69, 102863. 
[9]Sepúlveda, Axel, Francisco Castillo, Carlos Palma, and Maria Rodriguez-Fernandez. "Emotion recognition from ECG signals using wavelet scattering and machine learning." Applied Sciences 11, no. 11 (2021): 4945. 
[10]Raheel, Aasim, Muhammad Majid, Majdi Alnowami, and Syed Muhammad Anwar. "Physiological sensors based emotion recognition while experiencing tactile enhanced multimedia." Sensors 20, no. 14 (2020): 4037. 
[11]Dessai, Amita, and Hassanali Virani. "Multimodal and Multidomain Feature Fusion for Emotion Classification Based on Electrocardiogram and Galvanic Skin Response Signals." Sci 6.1 (2024): 10. 
[12]Dar, Muhammad Najam, Muhammad Usman Akram, Sajid Gul Khawaja, and Amit N. Pujari. "CNN and LSTM-based emotion charting using physiological signals." Sensors 20, no. 16 (2020): 4551. 
[13]Patlar Akbulut, Fatma. "Hybrid deep convolutional model-based emotion recognition using multiple physiological signals." Computer Methods in Biomechanics and Biomedical Engineering 25, no. 15 (2022): 1678-1690.
[14]Chandra, Raga Madhuri, Giri Venkata Sai Tej Neelaiahgari, and Satya Sumanth Vanapalli. "EXTRACTING EMOTION-CAUSE PAIRS: A BILSTM-DRIVEN METHODOLOGY." Informatyka, Automatyka, Pomiary w Gospodarce i Ochronie Środowiska 14, no. 4 (2024): 97-103. 
[15]Chandra, Raga Madhuri, Girivenkata Saitej Neelaiahgari, and Satya Sumanth Vanapalli. "Enhancing Driver Safety Through SensorBased Detection and Mitigation of Health Risks in Vehicles." International Conference on Algorithms and Computational Theory for Engineering Applications. Cham: Springer Nature Switzerland, 2024.
[16]C. R. Madhuri, P. Hemanth Suresh, P. S. Kiran and V. Satya Sumanth, "Smart Irrigation Optimization with IoT and Weather Forecasts for Sustainable Crop Management," 2024 1st International Conference on Advances in Computing, Communication and Networking (ICAC2N), Greater Noida, India, 2024, pp. 1-7, doi: 10.1109/ICAC2N63387.2024.10895564.keywords: {Irrigation;Schedules;Rain;Soil moisture;Weather forecasting;Sensor systems;Real-time systems;Crop yield;Optimization;Farming;Smart Irrigation;IoT;Weather Forecasting;Machine Learning;Water Management;Farmer Interface;Soil Moisture;Sustainable Farming}