International Journal of Intelligent Systems and Applications (IJISA)
IJISA Vol. 17, No. 6, 8 Dec. 2025
Cover page and Table of Contents: PDF (size: 2327KB)
Performance Analysis of Deep Learning Techniques for Multi-Focus Image Fusion
PDF (2327KB), PP.58-74
Views: 0 Downloads: 0
Author(s)
Ravpreet Kaur
1,*
Sarbjeet Singh
1
Index Terms
Multi-focus Image Fusion, Computer Vision, Deep Learning, Lytro Dataset, RealMFF Dataset
Abstract
Multi-Focus Image Fusion (MFIF) plays an important role in the field of computer vision. It aims to merge multiple images that possess different focus depths, resulting in a single image with a focused appearance. Though deep learning based methods have demonstrated development in the MFIF field, they vary significantly with regard to fusion quality and robustness to different focus changes. This paper presents the performance analysis of three deep learning-based MFIF methods specifically ECNN (Ensemble based Convolutional Neural Network), DRPL (Deep Regression Pair Learning) and SESF-Fuse. These techniques have been selected due to their publicly availability of training and testing source code, facilitating a thorough and reproducible analysis along with their diverse architectural approaches to MFIF. For training, three datasets were used ILSVRC2012, COCO2017, and DIV2K. The performance of the techniques was evaluated on two publicly available MFIF datasets: Lytro and RealMFF datasets using four objective evaluation metrics viz. Mutual Information, Gradient based metric, Piella metric and Chen-Varshney metric. Extensive experiments were conducted both qualitatively and quantitatively to analyze the effectiveness of each technique in terms of preserving details, artifacts reduction, consistency at the boundary region, texture fidelity etc. which jointly determine the feasibility of these methods for real-world applications. Ultimately, the findings illuminate the strengths and limitations of these deep learning approaches, providing valuable insights for future research and development in methodologies for MFIF.
Cite This Paper
Ravpreet Kaur, Sarbjeet Singh, "Performance Analysis of Deep Learning Techniques for Multi-Focus Image Fusion", International Journal of Intelligent Systems and Applications(IJISA), Vol.17, No.6, pp.58-74, 2025. DOI:10.5815/ijisa.2025.06.05
Reference
[1]Zhang, J., Liao, Q., Liu, S., Ma, H., Yang, W., & Xue, J. H. (2020). Real-MFF: A large realistic multi-focus image dataset with ground truth. Pattern Recognition Letters, 138, 370-377.
[2]Liu, Y., Wang, L., Cheng, J., Li, C., & Chen, X. (2020). Multi-focus image fusion: A survey of the state of the art. Information Fusion, 64, 71-91.
[3]Liu, Y., Liu, S., & Wang, Z. (2015). Multi-focus image fusion with dense SIFT. Information Fusion, 23, 139-155.
[4]De, I., & Chanda, B. (2013). Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure. Information Fusion, 14(2), 136-146.
[5]Li, M., Cai, W., & Tan, Z. (2006). A region-based multi-sensor image fusion scheme using pulse-coupled neural network. Pattern Recognition Letters, 27(16), 1948-1956.
[6]Li, S., Kang, X., & Hu, J. (2013). Image fusion with guided filtering. IEEE Transactions on Image processing, 22(7), 2864-2875.
[7]Kaur, H., Koundal, D., & Kadyan, V. (2021). Image fusion techniques: a survey. Archives of computational methods in Engineering, 28(7), 4425-4447.
[8]Tang, H., Xiao, B., Li, W., & Wang, G. (2018). Pixel convolutional neural network for multi-focus image fusion. Information Sciences, 433, 125-141.
[9]Guo, X., Nie, R., Cao, J., Zhou, D., & Qian, W. (2018). Fully convolutional network-based multifocus image fusion. Neural computation, 30(7), 1775-1800.
[10]Liu, Y., Chen, X., Peng, H., & Wang, Z. (2017). Multi-focus image fusion with a deep convolutional neural network. Information Fusion, 36, 191-207.
[11]Burt, P. J., & Adelson, E. H. (1987). The Laplacian pyramid as a compact image code. In Readings in computer vision (pp. 671-679). Morgan Kaufmann.
[12]Kingsbury, N. (2000, September). A dual-tree complex wavelet transform with improved orthogonality and symmetry properties. In Proceedings 2000 international conference on image processing (Cat. No. 00CH37101) (Vol. 2, pp. 375-378). IEEE.
[13]Da Cunha, A. L., Zhou, J., & Do, M. N. (2006). The nonsubsampled contourlet transform: theory, design, and applications. IEEE transactions on image processing, 15(10), 3089-3101.
[14]Liu, Y., & Wang, Z. (2015). Simultaneous image fusion and denoising with adaptive sparse representation. IET Image Processing, 9(5), 347-357.
[15]Zhang, X. (2021). Deep learning-based multi-focus image fusion: A survey and a comparative study. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(9), 4819-4838.
[16]Zhang, H., Xu, H., Tian, X., Jiang, J., & Ma, J. (2021). Image fusion meets deep learning: A survey and perspective. Information Fusion, 76, 323-336.
[17]Li, J., Guo, X., Lu, G., Zhang, B., Xu, Y., Wu, F., & Zhang, D. (2020). DRPL: Deep regression pair learning for multi-focus image fusion. IEEE Transactions on Image Processing, 29, 4816-4831.
[18]Amin-Naji, M., Aghagolzadeh, A., & Ezoji, M. (2019). Ensemble of CNN for multi-focus image fusion. Information fusion, 51, 201-214.
[19]Ma, B., Zhu, Y., Yin, X., Ban, X., Huang, H., & Mukeshimana, M. (2021). Sesf-fuse: An unsupervised deep model for multi-focus image fusion. Neural Computing and Applications, 33, 5793-5804.
[20]Du, C., & Gao, S. (2017). Image segmentation-based multi-focus image fusion through multi-scale convolutional neural network. IEEE access, 5, 15750-15761.
[21]Zhao, W., Wang, D., & Lu, H. (2018). Multi-focus image fusion with a natural enhancement via a joint multi-level deeply supervised convolutional neural network. IEEE Transactions on Circuits and Systems for Video Technology, 29(4), 1102-1115.
[22]Lai, R., Li, Y., Guan, J., & Xiong, A. (2019). Multi-scale visual attention deep convolutional neural network for multi-focus image fusion. IEEE Access, 7, 114385-114399.
[23]Zhang, Y., Liu, Y., Sun, P., Yan, H., Zhao, X., & Zhang, L. (2020). IFCNN: A general image fusion framework based on convolutional neural network. Information Fusion, 54, 99-118.
[24]Xiao, Y., Guo, Z., Veelaert, P., & Philips, W. (2022). DMDN: Degradation model-based deep network for multi-focus image fusion. Signal Processing: Image Communication, 101, 116554.
[25]Mustafa, H. T., Zareapoor, M., & Yang, J. (2020). MLDNet: Multi-level dense network for multi-focus image fusion. Signal Processing: Image Communication, 85, 115864.
[26]Xu, H., Fan, F., Zhang, H., Le, Z., & Huang, J. (2020). A deep model for multi-focus image fusion based on gradients and connected regions. IEEE Access, 8, 26316-26327.
[27]Xu, H., Ma, J., Jiang, J., Guo, X., & Ling, H. (2020). U2Fusion: A unified unsupervised image fusion network. IEEE transactions on pattern analysis and machine intelligence, 44(1), 502-518.
[28]Jung, H., Kim, Y., Jang, H., Ha, N., & Sohn, K. (2020). Unsupervised deep image fusion with structure tensor representations. IEEE Transactions on Image Processing, 29, 3845-3858.
[29]Nejati, M., Samavi, S., & Shirani, S. (2015). Multi-focus image fusion using dictionary-based sparse representation. Information fusion, 25, 72-84.
[30]Xu, S., Wei, X., Zhang, C., Liu, J., & Zhang, J. (2020). MFFW: A new dataset for multi-focus image fusion. arXiv preprint arXiv:2002.04780.
[31]Zhang, H., Le, Z., Shao, Z., Xu, H., & Ma, J. (2021). MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion. Information Fusion, 66, 40-53.
[32]Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C., & Fei-Fei, L. (2015). Imagenet large scale visual recognition challenge. International journal of computer vision, 115, 211-252.
[33]Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C.L., (2014). Microsoft coco: Common objects in context. In Computer vision–ECCV 2014: 13th European conference, zurich, Switzerland, September 6-12, 2014, proceedings, part v 13 (pp. 740-755). Springer International Publishing.
[34]Agustsson, E., & Timofte, R. (2017). Ntire 2017 challenge on single image super-resolution: Dataset and study. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops (pp. 126-135).
[35]Zhou, Y., Yu, L., Zhi, C., Huang, C., Wang, S., Zhu, M., Ke, Z., Gao, Z., Zhang, Y., & Fu, S., (2022). A survey of multi-focus image fusion methods. Applied Sciences, 12(12), 6281.
[36]Zafar, R., Farid, M. S., & Khan, M. H. (2020). Multi-focus image fusion: algorithms, evaluation, and a library. Journal of Imaging, 6(7), 60.
[37]Liu, Z., Blasch, E., Xue, Z., Zhao, J., Laganiere, R., & Wu, W. (2011). Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: a comparative study. IEEE transactions on pattern analysis and machine intelligence, 34(1), 94-109.
[38]Hossny, M., Nahavandi, S., & Creighton, D. (2008). Comments on ‘Information measure for performance of image fusion’. Electronics letters, 44(18), 1066-1067.
[39]Xydeas, C. S., & Petrovic, V. (2000). Objective image fusion performance measure. Electronics letters, 36(4), 308-309.
[40]Piella, G., & Heijmans, H. (2003, September). A new quality metric for image fusion. In Proceedings 2003 international conference on image processing (Cat. No. 03CH37429) (Vol. 3, pp. III-173). IEEE.
[41]Chen, H., & Varshney, P. K. (2007). A human perception inspired quality metric for image fusion based on regional information. Information fusion, 8(2), 193-207.