A Novel Deep Learning Framework for Multi-Class Skin Cancer Classification Using Modified Stacked Capsule Network

PDF (1668KB), PP.82-105

Views: 0 Downloads: 0

Author(s)

Mudiyam Sivani 1,* M. Shahina Parveen 2

1. Department of Computer Science and Engineering, School of Engineering, Dayananda Sagar University, Bangalore, India

2. Department of Computer Science & Technology, School of Engineering Dayananda Sagar University, Bangalore, India

* Corresponding author.

DOI: https://doi.org/10.5815/ijigsp.2026.04.05

Received: 18 Jul. 2025 / Revised: 9 Jan. 2026 / Accepted: 2 Feb. 2026 / Published: 8 Aug. 2026

Index Terms

Skin cancer, Multi-class classification, Dermoscopic images, EfficientNetB7, Bottleneck Attention Module, Modified Stacked Capsule Network, Disperse Dynamic Routing, and Pelican Optimization Algorithm

Abstract

Skin cancer is one of the deadliest kinds of cancer because of it’s due to its visible onset and the potential for rapid progression and spread. Oncologists employ several techniques, including imaging and biopsies, to determine whether skin cancer is present, but these are labor-intensive and time-consuming. Developing an automated and accurate framework is essential for early skin cancer detection, which greatly increases the probability of a successful treatment and recovery. Therefore, to address the aforementioned problems, this study aim to propose a novel Deep Learning (DL)-based multi-class skin cancer classification (MC-SC2) model for automatically diagnosing skin cancers using dermoscopic images. Initially, the dermoscopic images are preprocessed using a Gaussian Filter (GF) to effectively remove noise. To address the class imbalance issue, we applied advanced augmentation techniques to oversample minority classes, ensuring a uniform class distribution and enhancing the model's ability to generalize. To extract the complex and dominant features, we propose a novel DL-based model called BAM-EfficientNet (Bottleneck Attention Module with EfficientNetB7). In BAM-EfficientNet, we replace each Squeeze-and-Excitation (SE) attention module with a BAM in the traditional EfficientNetB7; this modification enables the network to concentrate on the most relevant regions in the images. The extracted features fed into the proposed Modified Stacked Capsule Network (MSCNet) to classify a skin lesion image as AKIEC, BCC, BKL, DF, MEL, NV, and VASC. In the proposed MSCNet employs the Disperse Dynamic Routing (DDR) algorithm to improve capsule networks performance, and network's initial weights and biases are fine-tuned using Pelican Optimization Algorithm (POA) to further enhance performance. The HAM10000 dataset is used to assess the suggested model. The findings indicate that our approach beats current methods with an accuracy of 99.21% in classifying the seven different types of skin cancer, yielding substantial outcomes. These results demonstrate the potential of the suggested model as a quick, precise, and useful tool for early skin cancer diagnosis, providing important assistance in diagnosing skin cancer for medical professionals.

Cite This Paper

Mudiyam Sivani, M. Shahina Parveen, "A Novel Deep Learning Framework for Multi-Class Skin Cancer Classification Using Modified Stacked Capsule Network ", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.18, No.4, pp. 82-105, 2026. DOI:10.5815/ijigsp.2026.04.05

Reference

[1]Ozdemir, B., &Pacal, I. (2025). An innovative Deep learning framework for skin cancer detection employing ConvNeXtV2 and focal self-attention mechanisms. Results in Engineering, 25, 103692.
[2]DorathiJayaseeli, J. D., Briskilal, J., Fancy, C., Vaitheeshwaran, V., Patibandla, R. L., Syed, K., & Swain, A. K. (2025). An intelligent framework for skin cancer detection and classification using fusion of Squeeze-Excitation-DenseNet with Metaheuristic-driven ensemble deep learning models. Scientific Reports, 15(1), 7425.
[3]Ali, K., Shaikh, Z. A., Khan, A. A., & Laghari, A. A. (2022). Multiclass skin cancer classification using EfficientNets–a first step towards preventing skin cancer. Neuroscience Informatics, 2(4), 100034.
[4]Purni, J. T., &Vedhapriyavadhana, R. (2024). Eosa-net: A deep learning framework for enhanced multi-class skin cancer classification using optimized convolutional neural networks. Journal of King Saud University-Computer and Information Sciences, 36(3), 102007.
[5]Rosendahl, C., &Marozava, A. (2023). Dermatoscopy and Skin Cancer, updated edition: A handbook for hunters of skin cancer and melanoma. Scion Publishing Ltd.
[6]Balaha, H. M., & Hassan, A. E. S. (2023). Skin cancer diagnosis based on deep transfer learning and sparrow search algorithm. Neural Computing and Applications, 35(1), 815-853.
[7]Pathania, Y. S., Apalla, Z., Salerni, G., Patil, A., Grabbe, S., &Goldust, M. (2022). Non-invasive diagnostic techniques in pigmentary skin disorders and skin cancer. Journal of cosmetic dermatology, 21(2), 444-450.
[8]Bansal, M., Goyal, A., & Choudhary, A. (2022). A comparative analysis of K-nearest neighbour, genetic, support vector machine, decision tree, and long short-term memory algorithms in machine learning. Decision Analytics Journal, 3, 100071.
[9]Mampitiya, L. I., Rathnayake, N., & De Silva, S. (2023). Efficient and low-cost skin cancer detection system implementation with a comparative study between traditional and CNN-based models. Journal of Computational and Cognitive Engineering, 2(3), 226-235.
[10]Jütte, L., González-Villà, S., Quintana, J., Steven, M., Garcia, R., & Roth, B. (2024). Integrating generative AI with ABCDE rule analysis for enhanced skin cancer diagnosis, dermatologist training and patient education. Frontiers in Medicine, 11, 1445318.
[11]Saeed, A., Shehzad, K., Ahmed, S., & Azar, A. T. (2025). EG-VAN: A Global and Local Attention based Dual-Branch Ensemble Network with Advanced color balancing for Multi-Class Skin Cancer Recognition. IEEE Access.
[12]Sakib, A. H., Siddiqui, M. I. H., Akter, S., Al Sakib, A., & Mahmud, M. R. (2025). LEVit-Skin: A balanced and interpretable transformer-CNN model for multi-class skin cancer diagnosis. International Journal of Science and Research Archive [Internet], 1860-73.
[13]Haque, M. Z., &Morzina, M. S. Multi-Class Skin Cancer Detection: Implementing Various CNN Architectures with Mobile App Integration. International Journal of Computer Applications, 975, 8887.
[14]Haque, M. I., Khatun, K., Rohman, G., Al Rakib, A., &Billah, M. M. (2025). A Deep Learning Framework for Multi-Class Skin Cancer Diagnosis: Addressing Class Imbalance and Performance Optimization Through Convolutional Neural Network Architectures. European Journal of Computer Science and Information Technology, 13(1), 63-71.
[15]Houssein, E. H., Abdelkareem, D. A., Hu, G., Hameed, M. A., Ibrahim, I. A., &Younan, M. (2024). An effective multiclass skin cancer classification approach based on deep convolutional neural network. Cluster Computing, 27(9), 12799-12819.
[16]Alruwaili, M., & Mohamed, M. (2025). An Integrated Deep Learning Model with EfficientNet and ResNet for Accurate Multi-Class Skin Disease Classification. Diagnostics, 15(5), 551.
[17]Noaman, A., Ahmad, R., Khan, M. F., Mohammed, A. S., Farooq, M., & Adnan, K. M. (2025). Beyond binary: multi-class skin lesion classification with AlexNet transfer learning-towards enhanced dermatological diagnosis. Discover Applied Sciences, 7(1), 1-18.
[18]Toprak, A. N., &Aruk, I. (2024). A Hybrid Convolutional Neural Network Model for the Classification of Multi‐Class Skin Cancer. International Journal of Imaging Systems and Technology, 34(5), e23180.
[19]Fisher Yu and Vladlen Koltun. Multi-scale context aggregation by dilated convolutions. 2015.
[20]Trojovský, P. and Dehghani, M., 2022. Pelican optimization algorithm: A novel nature-inspired algorithm for engineering applications. Sensors, 22(3), p.855.