Monocular hand gesture recognition systems usually model a human hand as a pixel or a blob by which the motion of the whole hand are analyzed and the appearance features are extracted. But the system presented in this paper begins with the motion of a hand's local parts. Firstly by fusing on multiple information including motion, color and edge, the characteristic curves that can represent the structure of a hand are obtained. The characteristic curves are cut into short segments with the equal length, which,which are easily analyzed and and tracked.Then the planar model is adopted to model the appearance change between the consecutive images and calculated by motion of the short segments.At last,the deviation caused bu the coordinate system is also analyzed and a moving coordinate system is set up,from which translation-independent parameters of the planar model are exrtactrd for hand gesture recognition.
[2] Ren Hai-bing, Xu Guang-you, Zhu Yuan-xin, et al. Motion-and-Color based hand segmentation and hand gesture recognition. Journal of Image and Graphics, 2000,5:384~388.
[3] Heap, T., Hogg, D. Wormholes in shape space: tracking through discontinuous changes in shape. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1998. 344~349.
[4] Imagawa, K., Taniguchi, R., Arita, D., et al. Appearance-Based recognition of hand shapes for sign language in low resolution image. In: Proceedings of the 4th Asian Conference on Computer Vision, IEEE, 2000. 943~948.
[5] Starner, T., Weaver, J., Pentland, A. Real-Time American sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998,20(12):1371~1375.
[6] Bradski, G., Yeo, B.L., Yeung, M.M. Gesture for video content navigation. In: Proceedings of the Storage and Retrieval for Image and Video Databases VII. 1999. 230~242.
[7] Cui, Yun-tao, Weng, J.J. View-based hand segmentation and hand-sequence recognition with complex backgrounds. In: Proceedings of the International Conference of Patter Recognition. 1996. 617~621.
[8] Cui, Yun-tao, Weng, Jun-yang. A learning-based prediction-and-verification segmentation scheme for hand sign image sequence. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1999,21(8):798~804.
[9] Kervrann, C. A hierarchical Markov modeling approach for the segmentation and tracking of deformable shapes. Graphical Models and Image Processing, 1998,60(3):173~195.
[10] Gluckman, J., Nayar, S.K. Planar catadioptric stereo: geometry and calibration. In: Proceedings of the Computer Vision and Pattern Recognition. 1999. 22~28.
[11] Lee, H.K., Kim, J.H. An HMM-based threshold model approach for gesture recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1999,21(10):961~972.
[12] Hong, P., Turk, M., Huang, T.S. Gesture modeling and recognition using finite machines. In: Proceedings of the 4th International Conference on Face and Gesture Recognition. 2000. 410~415.
[13] Tao, Lin-mi, Xu, Guang-you. A 2.5-dimensional description of surface spectral reflectance. In: Proceedings of the 5th International Conference on Mechatronics and Machine Vision in Practice. 1998. 169~172.
[14] Bergen J.R, Keith, P., Hanna, J., et al. Hierarchical model-based motion estimation. In: Sandini, G., ed. Proceedings of the 2nd European Conference on Computer Vision. Berlin: Springer-Verlag, 1992. 237~252.