Scale Space Reduction with Interpolation to Speed up Visual Saliency Detection

Full Text (PDF, 685KB), PP.58-65

Views: 0 Downloads: 0


Omprakash S. Rajankar 1,* Uttam D.Kolekar 2

1. MPSTME, NMIMS University, Mumbai, India

2. A.P. Shah Institute of Technology, Thane, India

* Corresponding author.


Received: 3 Feb. 2015 / Revised: 1 Apr. 2015 / Accepted: 9 Jun. 2015 / Published: 8 Jul. 2015

Index Terms

Hypercomplex Fourier Transform, Interpolation, Scale Space Analysis, Object scales, Visual saliency


The scale of salient object in an image is not a known priori, therefore to detect salient objects accurately multiple scale analysis is used by saliency detection models. However, multiple scale analysis makes the saliency detection slow. Fast and accurate saliency detection is essential to obtain Region of Interest in image processing applications. This paper proposes a scale space reduction with interpolation to speed up the saliency detection. To demonstrate the concept, this method is integrated with Hypercomplex Fourier Transform saliency detection which reduced the computational complexity from O(N) to O(N/2).

Cite This Paper

Omprakash S. Rajankar, Uttam D.Kolekar,"Scale Space Reduction with Interpolation to Speed up Visual Saliency Detection", IJIGSP, vol.7, no.8, pp.58-65, 2015. DOI: 10.5815/ijigsp.2015.08.07


[1]Laurent Itti, "Visual salience - Scholarpedia," Scholarpedia, vol. 2, no. 9, p. 3327, 2007.

[2]L. Itti and C. Koch, "A saliency-based search mechanism for overt and covert shifts of visual attention.," Vision Res., vol. 40, no. 10–12, pp. 1489–506, Jan. 2000.

[3]A. Witkin, "Scale-space filtering: A new approach to multi-scale description," in ICASSP '84. IEEE International Conference on Acoustics, Speech, and Signal Processing, 1984, vol. 9, pp. 150–153.

[4]A. Oliva, A. Torralba, M. S. Castelhano, and J. M. Henderson, "Top-down control of visual attention in object detection," in Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429), 2003, vol. 1, pp. I–253–6.

[5]R. Achanta, S. Hemami, F. Estrada, S. Sabine, and D. L. Epfl, "Frequency-tuned Salient Region Detection," CVPR, no. Ic, 2009.

[6]L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254–1259, 1998.

[7]X. Hou and L. Zhang, "Saliency Detection: A Spectral Residual Approach," in 2007 IEEE Conference on Computer Vision and Pattern Recognition, 2007, no. 800, pp. 1–8.

[8]C. Guo and L. Zhang, "A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression.," IEEE Trans. Image Process., vol. 19, no. 1, pp. 185–98, Jan. 2010.

[9]J. Li, M. D. Levine, X. An, X. Xu, and H. He, "Visual Saliency Based on Scale-Space Analysis in the Frequency Domain.," IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 1, Jul. 2012.

[10]C. Li, J. Xue, N. Zheng, X. Lan, and Z. Tian, "Spatio-temporal saliency perception via hypercomplex frequency spectral contrast.," Sensors (Basel)., vol. 13, no. 3, pp. 3409–31, Jan. 2013.

[11]O. Rajankar and U. Kolekar, "Fast Visual Saliency Detection with Bisection search to Scale Selection," in IEEE Inter- national Conference on ICPC, 2015, p. 6.

[12]O. Rajankar and U. Kolekar, "Heuristic Approach to Reduce Spectral Scale Space for Fast Visual Saliency Detection," Image Vis. Comput., (in press),p. 13.

[13]L. M. . Florack, B. M. ter Haar Romeny, J. J. Koenderink, and M. A. Viergever, "Scale and the differential structure of images," Image Vis. Comput., vol. 10, no. 6, pp. 376–388, Jul. 1992.

[14]J. J. Koenderink, "The structure of images.," Biol. Cybern., vol. 50, pp. 363–370, 1984.

[15]T. Lindeberg, "Scale-space theory: A basic tool for analysing structures at di erent scales," J. Appl. Stat., 1994.

[16]P. P. Jonathan Harel, Christof Koch, J. Harel, C. Koch, and P. Perona, "Graph-Based Visual Saliency," Nat. Rev. Immunol., Jun. 2006.

[17]D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int. J. Comput. Vis., vol. 60, pp. 91–118, 2004.

[18]T. Veit, J. Tarel, P. Nicolle, and P. Charbonnier, "Evaluation of Road Marking Feature Extraction," in 2008 11th International IEEE Conference on Intelligent Transportation Systems, 2008, pp. 174–181.

[19]N. D. B. B. Bruce, J. K. Tsotsos, N. Bruce and J. Tsotsos, and J. K. Tsotosos, "Saliency Based on Information Maximization," J. Vis., vol. 7, no. 9, pp. 155–162, Mar. 2006.

[20]T. Judd, F. Durand, and A. Torralba, "A Benchmark of Computational Models of Saliency to Predict Human Fixations A Benchmark of Computational Models of Saliency to Predict Human Fixations," 2012.

[21]A. Borji and L. Itti, "State-of-the-art in visual attention modeling.," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 1, pp. 185–207, Jan. 2013.

[22]U. Rajashekar, A. C. Bovik, and L. K. Cormack, "Visual search in noise: revealing the influence of structural cues by gaze-contingent classification image analysis.," J. Vis., vol. 6, no. 4, pp. 379–86, Jan. 2006.

[23]R. J. Peters, A. Iyer, L. Itti, and C. Koch, "Components of bottom-up gaze allocation in natural images.," Vision Res., vol. 45, no. 18, pp. 2397–416, Aug. 2005.

[24]O. Pele and M. Werman, "Fast and robust Earth Mover's Distances," in 2009 IEEE 12th International Conference on Computer Vision, 2009, pp. 460–467.

[25]O. Pele and M. Werman, Computer Vision – ECCV 2008, vol. 5304. Berlin, Heidelberg: Springer Berlin Heidelberg, 2008, pp. 495–508.

[26]C. Moler, "Interpolation," in Numerical Computing with MATLAB, Electronic., Natick, MA: The MathWorks, Inc., 2004, p. 27.

[27]N. N. Zheng, X. Tang, Liu Tie;, Y. Zejian, S. Jian, W. Jingdong, Z. Nanning, A. Xiaoou, S. Heung-Yeung, T. Liu, Z. Yuan, J. Sun, J. Wang, and H.-Y. Shum, "Learning to detect a salient object.," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 2, pp. 353–67, Feb. 2011.

[28]J. Li, M. Levine, X. An, and H. He, "ImgSal: A benchmark for saliency detection v1.0," in Proceedings of the British Machine Vision Conference, 2011, pp. 86.1–86.11.

[29]Z. W. Z. Wang and B. L. B. Li, "A two-stage approach to saliency detection in images," 2008 IEEE Int. Conf. Acoust. Speech Signal Process., pp. 965–968, 2008.