Real Time Hand Detection & Tracking for Dynamic Gesture Recognition

Full Text (PDF, 640KB), PP.38-44

Views: 0 Downloads: 0


Varsha Dixit 1,* Anupam Agrawal 1

1. Department of Information Technology, IIIT Allahabad, UP, India

* Corresponding author.


Received: 11 Oct. 2014 / Revised: 9 Feb. 2015 / Accepted: 1 Apr. 2015 / Published: 8 Jul. 2015

Index Terms

Haar Cascade, Adaboost Algorithm, Hidden Markov Model, Douglas Peucker Algorithm


In the recent year gesture recognition has become the most intuitive and effective communication technique for human interaction with machines. In this paper we are going to work on hand gesture recognition and interpret the meaning of it from video sequences. Our work takes place in following three phases: 1. Hand Detection & Tracking 2. Feature extraction 3. Gesture recognition. We have started proposed work with first step as applying hand tracking and hand detection algorithm to track hand motion and to extract position of the hand. Trajectory based features are being drawn out from hand and used for recognition process and hidden markov model is being design for each gesture for gesture recognition. Hidden Markov Model is basically a powerful statistical tool to model generative sequences. Our method is being tested on our own data set of 16 gestures and the average recognition rate we have got is 91%. With proposed methodology gives the better recognition results compare with the traditional approaches such as PCA, ANN, SVM, DTW and many more.

Cite This Paper

Varsha Dixit, Anupam Agrawal, "Real Time Hand Detection & Tracking for Dynamic Gesture Recognition", International Journal of Intelligent Systems and Applications(IJISA), vol.7, no.8, pp.38-44, 2015. DOI:10.5815/ijisa.2015.08.05


[1]W. Du and H. Li, “Vision based gesture recognition system with single camera,” IEEE 5th International Conference on ICSP, Beijing, vol. 2, pp. 1351-1357, 2000.
[2]Gray Bradski and Adrian Kaehler, Learning OpenCV, O’Reilly Media, Inc.
[3]Chen-Chiung Hsieh, Dung-Hua Liou and David Lee, “A Real Time Hand Gesture Recognition System using Motion History Image,” IEEE 2nd International Conference on Singal Processing Systems, Dalian, vol. 2, pp. 394-398, 2010.
[4]Yang Zhong, Li Yi, Chen Weidong and Zheng Yang, “Dynamic Hand Gesture Recognition using hidden Markov models,” IEEE 7th International Conference on ICCSE, Melbourne, pp. 360-365, 2012.
[5]S.M. Shitole, S.B. Patil and S.P. Narote, “Dynamic Hand Gesture Recognition using PCA, Pruning and ANN,” International Journal of Computer Applications, New York, vol.74, 2013.
[6]S.M. Nadgeri, S.D Sawarkar and A.D Gawande, “Hand Gesture Recognition using Camshift Algorithm,” IEEE 3rd International Conference on ICETET, Goa, pp. 37-41, 2010.
[7]Kittasil Silanon and Nikom Suvonvorn, “Thai Alphabet Recognition from Hand Motion Trajectory using HMM,” International Journal of Computer and Electrical Engineering, vol.4, 2012.
[8]P. Viola and M. Jones, “Rapid Object Detection using a Boosted Cascade of Simple Features,” IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 511-518, 2001.
[9]M.S.M Asaari and S.A Suandi, “Hand Gesture Tracking System using Adaptive Kalman Filter,” IEEE 10th International Conference on ISDA, Cairo, pp 166-171, 2010.
[10]Lawrence R “A tutorial on hidden markov models and selected applications in speech recognition,” Proceedings of IEEE, vol. 77, pp. 257-286, 1989.
[11]G.D. Forney, The viterbi algorithm, proceeding of the IEEE pp. 268-278.
[12]T. Baudel, M. Baudouin-Lafon and Charade, “Remote Control of Objects using Free-Hand Gestures,” Comm. ACM, New York vol. 36, pp. 28–35. 1993
[13]D.J. Sturman and D. Zeltzer, “A survey of glove-based input,” IEEE conference on Computer Graphics and Applications,” vol. 14, pp. 30-39, 1994.
[14]Qing Chen, Nicolas D. Georganas and Emil M. Petriu, “Vision Based Hand Gesture Recognition using Haar-like Features,” IEEE conference on Instrumentation and Measurement Technology, Warsaw, pp. 1-6, 2007.
[15]L.W. Campbell, D.A. Becker, A. Azarbayejani, A.F. Bobick and A. Plentland, “Invariant Features for 3-D Gesture Recognition,” IEEE Second International Conference on Automatic Face and Gesture Recognition, Killington, pp. 157-162, 1996.
[16]J. Schlenzig, E. Hunter and R. Jain, “Recursive Identification of Gesture Inputers using Hidden Markov Models”, IEEE Second Workshop on Applications of Computer Vision, Sarasota, pp. 187–194, 1994.
[17]Jose Manuel Palacious, Carlos Sagiies, Eduardo Montijano and Sergio Liorente, “Human-Computer Interaction Based on Hand Gesture Using RGB-D Sensors,” Journal on Sensors, vol. 13, pp. 11842-11860, 2013.
[18]S. S. Rautaray and A. Agrawal, “Real Time Hand Gesture Recognition System for Dynamic Applications,” International Journal of UbiComp, vol. 3(1), pp. 21-31, Jan 2012.
[19]S. S. Rautaray and A. Agrawal, “Vision Based Hand Gesture Recognition for Human Computer Interaction: A Survey,” Artificial Intelligence Review, Published Online: 06 November, 2012.
[20]J. C. Peng, L. Z. Gu and J. B. Su, “The Hand Tracking for Humanoid Robot using Camshift Algorithm and Kalman Filter”, Journal of Shanghai Jiaotong University, 2006.