International Journal of Computer Network and Information Security (IJCNIS)
IJCNIS Vol. 17, No. 3, 8 Jun. 2025
Cover page and Table of Contents: PDF (size: 2094KB)
Multi-modal Cyberbullying Detection with Severity Analysis Using Deep-Tensor Fusion Framework
PDF (2094KB), PP.144-150
Views: 0 Downloads: 0
Author(s)
Index Terms
Cyberbullying, Stemming, Dense Capsule Network, LSTM, Sigmoid Layer
Abstract
In today’s internet age, cyberbullying is a serious threat to people. Bullies hurt their victims by using online social media sites like Facebook, Twitter, and so on. Since then, cyberbullying or online bullying has become an increasingly significant societal problem due to its psychological and emotional impact on the victim. To overcome this issue, the proposed method is used for the identification of social network cyberbullying using many modalities. The first step is data collection, the data are collected through text, image, audio and video. Firstly, the text data is pre-processed using tokenization, stemming, lemmatization, spell correction, and PoS tagging methods. After pre-processing, feature extraction is done using Log Term Frequency-based Modified Inverse Class Frequency (LTF-MICF) and glove modelling, and the feature is extracted using the convolutional dense capsule network (Conv_DCapNet) model. Second, image data is pre-processed using Gabor filtering and image resizing. Once the pre-processing is done, the feature is extracted using image modality generation through Self-attention based bidirectional gated recurrent auto-encoder network (SA_BiGR_AENet). Third, audio (acoustic) data is extracted using the Librosa library and Attentional convolutional BiLSTM. The next step is video extraction, in this video data are extracted using keyframe extraction and Residual 101 network. Finally, in the fusion method, all four extracted features (text, image, audio and video) are fused by the deep tensor fusion framework. After that, the sigmoid layer classifies whether the data is cyberbullying or not. Then, the notification of highly detected severe is sent to the user. Thus, the proposed method detects cyberbullying. Python tool is used for implementation, and the performance metrics of recall is 96%, F1-score for bullying class 92% and weighted F1-score 91% compared with existing methods.
Cite This Paper
Neha Minder Singh, Sanjay Kumar Sharma, "Multi-modal Cyberbullying Detection with Severity Analysis Using Deep-Tensor Fusion Framework", International Journal of Computer Network and Information Security(IJCNIS), Vol.17, No.3, pp.144-160, 2025. DOI:10.5815/ijcnis.2025.03.08
Reference
[1]Kumar, Akshi, and Nitin Sachdeva. "Multimodal cyberbullying detection using capsule network with dynamic routing and deep convolutional neural network." Multimedia Systems (2021): 1-10.
[2]Maity, Krishanu, Abhishek Kumar, and Sriparna Saha. "A Multitask Multimodal Framework for Sentiment and Emotion-Aided Cyberbullying Detection." IEEE Internet Computing 26, no. 4 (2022): 68-78.
[3]Yi, Peiling, and Arkaitz Zubiaga. "Session-based cyberbullying detection in social media: A survey." Online Social Networks and Media 36 (2023): 100250.
[4]Maity, Krishanu, Sriparna Saha, and Pushpak Bhattacharyya. "Emoji, sentiment and emotion aided cyberbullying detection in hinglish." IEEE Transactions on Computational Social Systems (2022).
[5]Suhas Bharadwaj, R., S. Kuzhalvaimozhi, and N. Vedavathi. "A Novel Multimodal Hybrid Classifier Based Cyberbullying Detection for Social Media Platform." In Proceedings of the Computational Methods in Systems and Software, pp. 689-699. Cham: Springer International Publishing, 2022.
[6]Lin, Hong, Patrick Siarry, H. L. Gururaj, Joel Rodrigues, and Deepak Kumar Jain. "Special issue on deep learning methods for cyberbullying detection in multimodal social data." Multimedia Systems 28, no. 6 (2022): 1873-1875.
[7]Kim, Seunghyun, Afsaneh Razi, Gianluca Stringhini, Pamela J. Wisniewski, and Munmun De Choudhury. "A human-centered systematic literature review of cyberbullying detection algorithms." Proceedings of the ACM on Human-Computer Interaction 5, no. CSCW2 (2021): 1-34.
[8]Roy, Pradeep Kumar, and Fenish Umeshbhai Mali. "Cyberbullying detection using deep transfer learning." Complex & Intelligent Systems 8, no. 6 (2022): 5449-5467.
[9]Alam, Firoj, Stefano Cresci, Tanmoy Chakraborty, Fabrizio Silvestri, Dimiter Dimitrov, Giovanni Da San Martino, Shaden Shaar, Hamed Firooz, and Preslav Nakov. "A survey on multimodal disinformation detection." arXiv preprint arXiv:2103.12541 (2021).
[10]Zhao, Zehua, Min Gao, Fengji Luo, Yi Zhang, and Qingyu Xiong. "LSHWE: improving similarity-based word embedding with locality sensitive hashing for cyberbullying detection." In 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1-8. IEEE, 2020.
[11]Kiela, Douwe, Hamed Firooz, Aravind Mohan, Vedanuj Goswami, Amanpreet Singh, Pratik Ringshia, and Davide Testuggine. "The hateful memes challenge: Detecting hate speech in multimodal memes." Advances in neural information processing systems 33 (2020): 2611-2624.
[12] Arif, Muhammad. "A systematic review of machine learning algorithms in cyberbullying detection: future directions and challenges." Journal of Information Security and Cybercrimes Research 4, no. 1 (2021): 01-26.
[13]Suryawanshi, Shardul, Bharathi Raja Chakravarthi, Mihael Arcan, and Paul Buitelaar. "Multimodal meme dataset (MultiOFF) for identifying offensive content in image and text." In Proceedings of the second workshop on trolling, aggression and cyberbullying, pp. 32-41. 2020.
[14]Woo, Wai Hong, Hui Na Chua, and May Fen Gan. "Cyberbullying Conceptualization, Characterization and Detection in Social Media–A Systematic Literature Review." International Journal on Perceptive and Cognitive Computing 9, no. 1 (2023): 101-121.
[15]Rezvani, Nabi, and Amin Beheshti. "Towards attention-based context-boosted cyberbullying detection in social media." J. Data Intell 2 (2021): 418-433.
[16]Gomez, Raul, Jaume Gibert, Lluis Gomez, and Dimosthenis Karatzas. "Exploring hate speech detection in multimodal publications." In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp. 1470-1478. 2020.
[17]Wu, Fan, Bin Gao, Xiaoou Pan, Zelong Su, Yu Ji, Shutian Liu, and Zhengjun Liu. "FACapsnet: A fusion capsule network with congruent attention for cyberbullying detection." Neurocomputing 542 (2023): 126253.
[18]Bharti, Shubham, Arun Kumar Yadav, Mohit Kumar, and Divakar Yadav. "Cyberbullying detection from tweets using deep learning." Kybernetes 51, no. 9 (2021): 2695-2711.
[19]Bhowmick, Rajat Subhra, Isha Ganguli, Jayanta Paul, and Jaya Sil. "A multimodal deep framework for derogatory social media post identification of a recognized person." Transactions on Asian and Low-Resource Language Information Processing 21, no. 1 (2021): 1-19.
[20]Pramanick, Shraman, Shivam Sharma, Dimitar Dimitrov, Md Shad Akhtar, Preslav Nakov, and Tanmoy Chakraborty. "MOMENTA: A multimodal framework for detecting harmful memes and their targets." arXiv preprint arXiv:2109.05184 (2021).
[21]Kumari, Kirti, and Jyoti Prakash Singh. "Multi-modal cyber-aggression detection with feature optimization by firefly algorithm." Multimedia systems 28, no. 6 (2022): 1951-1962.
[22]Al-Harigy, Lulwah M., Hana A. Al-Nuaim, Naghmeh Moradpoor, and Zhiyuan Tan. "Building towards automated cyberbullying detection: A comparative analysis." Computational Intelligence and Neuroscience 2022 (2022).
[23]Murshed, Belal Abdullah Hezam, Suresha, Jemal Abawajy, Mufeed Ahmed Naji Saif, Hudhaifa Mohammed Abdulwahab, and Fahd A. Ghanem. "FAEO-ECNN: cyberbullying detection in social media platforms using topic modelling and deep learning." Multimedia Tools and Applications (2023): 1-40.
[24]Maity, Krishanu, Prince Jha, Sriparna Saha, and Pushpak Bhattacharyya. "A multitask framework for sentiment, emotion and sarcasm aware cyberbullying detection from multi-modal code-mixed memes." In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1739-1749. 2022.
[25]Abishak, I. K. M., J. I. Sheeba, and D. S. Pradeep. "Unsupervised hybrid approaches for cyberbullying detection in Instagram." International Journal of Computer Applications 174, no. 26 (2021): 41-46.
[26]Pericherla, Subbaraju, and Ilavarasan Egambaram. "Cyberbullying detection on multi-modal data using pre-trained deep learning architectures." Ingeniería Solidaria 17, no. 3 (2021): 1-20.
[27]Sharon, Rini, Heet Shah, Debdoot Mukherjee, and Vikram Gupta. "Multilingual and multimodal abuse detection." arXiv preprint arXiv:2204.02263 (2022).