• Article
  • | |
  • Metrics
  • |
  • Reference [11]
  • |
  • Related [20]
  • |
  • Cited by [4]
  • | |
  • Comments
    Abstract:

    Sign language recognition is to provide an efficient and accurate mechanism to transcribe sign language into text or speech. State-of-the-Art sign language recognition should be able to solve the signer-independent continuous problem for practical applications. In this paper, a divide-and-conquer approach, which takes the problem of continuous CSL (Chinese sign language) recognition as subproblems of isolated CSL recognition, is presented for signer-independent continuous CSL recognition. In the proposed approach, the SRN (simple recurrent network) is used to segment the continuous CSL. The outputs of SRN are regarded as the states of HMM (hidden Markov models) in which the lattice Viterbi algorithm is employed for searching the best word sequence. Experimental results show that SRN/HMM approach has better performance than the standard HMM.

    Reference
    [1] Starner, T., Weaver, J., Pentland, A. Real-Time American sign language recognition using desk and wearable computer based video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998,20(12):1371~1375.
    [2] Liang, R.H., Ouhyoung, M. A real-time continuous gesture recognition system for sign language. In: Yachida, M., ed. Proceedings of the 3rd International Conference on Automatic Face and Gesture Recognition. New York: IEEE, 1998. 558~565.
    [3] Vogler, C., Metaxas, D. ASL recognition based on a coupling between HMMs and 3D motion analysis. In: Davis, L., et al., eds. Proceedings of the IEEE International Conference on Computer Vision. New York: IEEE, 1998. 363~369. http://citeseer.nj.nec. com/vogler98asl.html.
    [4] Vogler, C., Metaxas, D. Toward scalability in ASL recognition: breaking down signs into phonemes. In : Braffort, A., Gherbi, R., Gibet, S., et al. eds. Gesture-Based Communication in Human-Computer Interaction. Berlin: Springer-Verlag, 1999. 400~404.
    [5] Gao, Wen, Ma, Ji-yong, Shan, Shi-guan, et al. HandTalker: a multimodal dialog system using sign language and 3-D virtual human. In: Tan, Tie-niu, Shi, Yuan-chun, Gao, Wen, eds. Advances in Multimodal Interfaces-ICMI. Berlin: Springer-Verlag, 2000. 564~571.
    [6] Elman, J.L. Finding structure in time. Cognitive Science, 1990,14(2):179~211.
    [7] Robinson, T. An application of recurrent nets to phone probability estimation. IEEE Transactions on Neural Networks, 1994,5(2): 298~305.
    [8] Kershaw, D.J., Hochberg, M., Robinson, A.J. Context-Dependent classes in a hybrid recurrent network-HMM speech recognition system. Advances in Neural Information Processing Systems, 1996,8:750~756.
    [9] Senior, A., Robinson, A.J. Forward-Backward retraining of recurrent neural networks. In: Advances in Neural Information Processing Systems, Vol 8. 1996. 743~749.
    [10] Murakami, K., Taguchi, H. Gesture recognition using recurrent neural networks. In: Proceedings of the CHI'91 Human Factors in Computing Systems. New York: ACM Press, 1991. 237~242. http://portal.acm.org/citation.cfm?id=108900&coll=portal&dl= ACM&CFID=662409&CFTOKEN=62522583.
    [11] Rumelhart, D.E., Hinton, G.E., Williams, R.J. Learning internal representations by error propagation. In: Rumelhart, D.E., McClelland, J.L., eds. Parallel Distributed Processing, Vol 1. Cambridge, MA: MIT Press, 1986. 318~362.
    Comments
    Comments
    分享到微博
    Submit
Get Citation

方高林,高文,陈熙霖,王春立,马继勇.基于SRN/HMM的非特定人连续手语识别系统.软件学报,2002,13(11):2169-2175

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:April 12,2001
  • Revised:July 13,2001
You are the first2033380Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063