HCTSpeckle and Lightweight YUV Transformer with ViT Encoder-Sandwich Decoder Network For Underwater Microplastic High Resolution Image Segmentation

PDF (1355KB), PP.65-81

Views: 0 Downloads: 0

Author(s)

Badugu Vimala Victoria 1,* Kamil Reza Khondakar 1 Ravi Kumar Suggala 2

1. School of Technology, Woxsen University, Hyderabad, India

2. Department of Information Technology, Shri Vishnu Engineering College for Women, Bhimavaram, India

* Corresponding author.

DOI: https://doi.org/10.5815/ijigsp.2026.04.04

Received: 5 Feb. 2026 / Revised: 11 Mar. 2026 / Accepted: 18 May 2026 / Published: 8 Aug. 2026

Index Terms

Marine Pollution, Microplastic Segmentation, Hctspeckle Denoising, Lightweight YUV Transformer-Based Network, Vision Transformer, Sandwich Decoder Network

Abstract

Microplastics are tiny particles made of plastic that are a significant source of pollution in the sea, and are dangerous to both the environment and human health. Nevertheless, the existing detection techniques are not robust and general in dynamic underwater settings with varying microplastic shapes and sizes. To overcome these issues, a high-resolution underwater microplastic segmentation framework was implemented that integrates HCTSpeckle and Vision Transformer Encoder–Sandwich Decoder Network. Initially, underwater sensors record continuous visual images. The captured images are pre-processed with HCTSpeckle, a CNN-Transformer denoising network, for removing speckle noise, and it retains important structural information through the use of hybrid convolution-transformer blocks and double residual interactions. The denoised images were contrasted with the Lightweight YUV Transformer-based Network, in which multistage squeeze-and-excitation fusion is used to improve the visibility of object boundaries. The enhanced images are subjected to a hybrid Vision Transformer- Sandwich Decoder to produce precise underwater microplastic segmentation, where the ViT encoder captures high-level features that are globally correlated without distorting positioning information in space by patch embeddings and self-attention mechanisms. They are decoded using a Sandwich Decoder Network, which learns both local and global dependencies. Also, ranking and region-based pooling priorities fine edges and microplastic structures, whereas the pixel-wise segmentation head precisely categorizes the identified microplastics into fiber, film, pellet, and fragment types. The proposed approach attains the pixel accuracy of 0.97 and specificity of 0.98 with a Dice Coefficient of 0.934, which contains the effective segmentation result of underwater microplastic images. These findings ensure the framework efficiently identifies and categorizes various types of microplastics in diverse underwater sceneries.

Cite This Paper

Badugu Vimala Victoria, Kamil Reza Khondakar, Ravi Kumar Suggala, "HCTSpeckle and Lightweight YUV Transformer with ViT Encoder-Sandwich Decoder Network For Underwater Microplastic High Resolution Image Segmentation", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.18, No.4, pp. 65-81, 2026. DOI:10.5815/ijigsp.2026.04.04

Reference

[1]L. M. Dang, A. S. Sagar, N. D. Bui, L. V. Nguyen, and T. H. Nguyen, “Attention-guided marine debris detection with an enhanced transformer framework using drone imagery,” Process Safety and Environmental Protection, vol. 197, Art. no. 107089, 2025.
[2]S. Karthick, and N. Muthukumaran, “Deep RegNet-150 architecture for single image super resolution of real-time unpaired image data,” Applied Soft Computing, vol. 162, Art. no. 111837, 2024.
[3]H. Liu et al., “Underwater particle classification detector using Mueller matrix and fluorescence signal,” IEEE Journal of Oceanic Engineering, 2025.
[4]N. Deluxni, P. Sudhakaran, M. Alsafyani, and A. Yousef, “Underwater debris segmentation using improved YOLOv12s with recursive efficient layer aggregation and FlashAttention for autonomous underwater vehicle,” IEEE Access, vol. 13, pp. 200239–200252, 2025.
[5]P. Russo, F. Di Ciaccio, P. Santaniello, T. Cacace, P. Carcagnì, M. Del Coco, and M. Paturzo, “Encoding holographic data into synthetic video streams for enhanced microplastic detection,” IEEE Access, 2025.
[6]S. Galata et al., “Rapid detection of microfibres in environmental samples using open-source visual recognition models,” Journal of Hazardous Materials, vol. 480, Art. no. 135956, 2024.
[7]F. Han, J. Yao, H. Zhu, and C. Wang, “Underwater image processing and object detection based on deep CNN method,” Journal of Sensors, vol. 2020, Art. no. 6707328, 2020.
[8]Z. He et al., “UISS-Net: Underwater image semantic segmentation network for improving boundary segmentation accuracy of underwater images,” Aquaculture International, vol. 32, no. 5, pp. 5625–5638, 2024.
[9]A. A. Alsuwaylimi, “Enhanced YOLOv8-Seg instance segmentation for real-time submerged debris detection,” IEEE Access, 2024.
[10]P. Govindarajan et al., “Tracking microplastic pathways: Real-time IoT monitoring for water quality and public health,” MethodsX, Art. no. 103674, 2025.
[11]S. Pavithra, “An efficient approach to detect and segment underwater images using Swin Transformer,” Results in Engineering, vol. 23, Art. no. 102460, 2024.
[12]K. P. Pushkala and P. Subbulakshmi, “Synergistic integration of vision transformers and advanced segmentation algorithms for panoptic mapping of marine litter,” Frontiers in Marine Science, vol. 12, Art. no. 1726472, 2025.
[13]A. Sivaanpu et al., “Speckle noise reduction for medical ultrasound images using hybrid CNN-transformer network,” IEEE Access, 2024.
[14]A. Brateanu et al., “Lyt-Net: Lightweight YUV transformer-based network for low-light image enhancement,” IEEE Signal Processing Letters, vol. 32, pp. 2065–2069, 2025.
[15]Y. Lee and P. Kang, “Anovit: Unsupervised anomaly detection and localization with vision transformer-based encoder-decoder,” IEEE Access, vol. 10, pp. 46717–46724, 2022.
[16]H. Ni et al., “SDNet: Sandwich decoder network for waterbody segmentation in remote sensing imagery,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 18, pp. 13895–13911, 2025.
[17]“Microplastic_100 dataset,” Roboflow, 2023. [Online]. Available: https://universe.roboflow.com/kueranan/microplastic_100
[18]Q. Jiang, Y. Chen, G. Wang, and T. Ji, “A novel deep neural network for noise removal from underwater image,” Signal Processing: Image Communication, vol. 87, Art. no. 115921, 2020.
[19]M. Guan et al., “DiffWater: Underwater image enhancement based on conditional denoising diffusion probabilistic model,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 17, pp. 2319–2335, 2023.
[20]I. S. Chandra et al., “CNN based color balancing and denoising technique for underwater images: CNN-CBDT,” Measurement: Sensors, vol. 28, Art. no. 100835, 2023.
[21]W. Zhang et al., “Underwater image enhancement via minimal color loss and locally adaptive contrast enhancement,” IEEE Transactions on Image Processing, vol. 31, pp. 3997–4010, 2022.
[22]T. Wang et al., “Underwater image enhancement based on optimal contrast and attenuation difference,” IEEE Access, vol. 11, pp. 68538–68549, 2023.
[23]W. Zhang et al., “Underwater image enhancement via weighted wavelet visual perception fusion,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 34, no. 4, pp. 2469–2483, 2023.