Open Access Open Access  Restricted Access Subscription Access

Vision-based Virtual Input Using Gesture Recognition for Robotic Platform Control

Nadira Nordin, M. R. Arshad


The aim of this research is to build a robust image virtual input for robotic platform control. In this paper, we propose robust real-time hand gesture recognition input devices to control the robotic platform. hand gesture algorithm is built on two main steps: hand segmentation and gesture recognition. The hand segmentation is performed using skin colour as a detection cue. From the segmentation process, we extract the hand features that are required for the gesture recognition process. The fundamental model of the system is to control the robotic platform based on the number of active fingers counted from the gesture recognition process. A set of six instructions including stop, start, forward, backward, left and right is presented.

Full Text:



Cipolla, R. and N.J. Hollinghurst, Human-robot interface by pointing with uncalibrated stereo vision. Image and Vision Computing, 1996. 14(3):

p. 171-178.

Kawasaki, H. and T. Mouri, Design and Control of Five-Fingered Haptic Interface Opposite to Human Hand. Robotics, IEEE Transactions on, 2007.

(5): p. 909-918.

Bhuyan, M.K., D. Ghosh, and P.K. Bora. Designing of Human Computer Interactive Platform for Robotic Applications. in TENCON 2005 2005 IEEE

Region 10. 2005.

Vladimir Vezhnevets Vassili , V.S., Alla Andreeva A Survey on Pixel-Based Skin Color Detection Techniques. in Proc. Graphicon. 2003.

Manresa, C., Varona, J., Mas, R., Perales, F.J.,, Real-time hand tracking and gesture recognition for human-computer interaction. ELCVIA(5) 2005(3): p. 96-104.

Sebastian, P., V. Yap Vooi, and R. Comley. The effect of colour space on tracking robustness. in Industrial Electronics and Applications, 2008.

ICIEA 2008. 3rd IEEE Conference on. 2008.

Yikai, F., et al. Hand Gesture Recognition Using Fast Multi-scale Analysis. in Image and Graphics, 2007. ICIG 2007. Fourth International Conference on. 2007.

Malima, A., E. Ozgur, and M. Cetin. A Fast Algorithm for Vision-Based Hand Gesture Recognition for Robot Control. in Signal Processing and Communications Applications, 2006 IEEE 14th. 2006.

Yin, X. and M. Xie, Finger identification and hand posture recognition for human-robot interaction. Image Vision Comput., 2007. 25(8): p. 1291-1300.

Kenney, C.S., M. Zuliani, and B.S. Manjunath. An axiomatic approach to corner detection. in Computer Vision and Pattern Recognition, 2005.

CVPR 2005. IEEE Computer Society Conference on. 2005.

Harris, C.G. Determination of ego-motion from matched points. in Proc. Alvey Vision Conf. . 1987.



  • There are currently no refbacks.