微信服务号

微信订阅号

2025年3月24日 18:12 星期一
首页 > 过刊浏览>2007年第18卷第3期 >477-489
PDF HTML阅读 XML下载 导出引用 引用提醒
非特定人手语识别进展及关键问题研究思路
作者:
基金项目:

Supported by the National Natural Science Foundation of China under Grant Nos.60332010,60603023(国家自然科学基金);the Program for New Century Excellent Talents in University under Grant No.NCET-05-03 34(新世纪优秀人才支持计划)

  • 摘要
    • | |
  • 访问统计
    • |
  • 参考文献 [13]
    • |
  • 相似文献 [20]
    • |
  • 引证文献
    • | |
  • 文章评论
    摘要:

    非特定人手语识别是推动手语系统实用化所必须解决的问题.在非特定人手语识别研究中,训练数据的缺乏和非特定人手语数据的差异性矛盾给原有研究框架的有效性带来了挑战.提出了非特定人手语识别新的研究框架,并给出了解决问题的策略与思路.这些问题的解决将对中国手语识别及其他相关领域具有非常重要的意义.

    Abstract:

    Signer-Independent sign language recognition is an unavoidable problem that must be solved in order to promote the practicality of sign language systems. In the signer-independent sign language recognition research, the lack of training data and the signer-independent sign language data variation bring a challenge to the effectivity of the existent research frame. This paper proposes a new research frame for signer-independent sign language recognition, and provides the strategy and ideas to solve the problem. Finding resolution to these problems is significant not only to the research on Chinese sign language recognition but also to other related fields.

    参考文献
    [1]Gao W,Chen XL,Ma JY,Wang ZQ.Building language communication between deaf people and hearing society through multimodal human computer interface.Chinese Journal of Computers,2000,23(12):1253-1260 (in Chinese with English abstract).
    [2]Waldron MB,Kim S.Isolated ASL sign recognition system for deaf persons.IEEE Trans.on Rehabilitation Engineering,1995,3(3):261-271.
    [3]Stokoe WC.Sign Language Structure:An Outline of the Visual Communication System of the American Deaf.University of Buffalo:Linstok Press,1960.
    [4]Lee CS,Park GT,Kim JS,Bien Z,Jang W.Real time recognition system of Korean sign language based on elementary components.In:Proc.Of the IEEE Int'l Conf.On Fuzzy Systems.IEEE Press,1997.1463-1468.http://ieeexplore.ieee.org/xpls/ abs_all.jsp?arnumber=619759
    [5]Kim JS,Jang W,Bien Z.Dynamic gesture recognition system for the Korean sign language (KSL).IEEE Trans.on Systems,Man,and Cybernetics,1996,26(2):354-359.
    [6]Su MC,Huang H,Lin CH,Huang CL,Lin CD.Application of neural networks in spatio-temporal hand gesture recognition.In:Simpson PK ed.Proc.of the IEEE World Congress on Computational Intelligence.New York:IEEE Press,1998.2116-2121.
    [7]Yang MH,Ahuja N.Extraction and classification of visual motion patterns for hand gesture recognition.In:Proc.of the IEEE Conf.on Computer Vision and Pattern Recognition.Santa Barbara:IEEE Press,1998.892-897.http://citeseer.ist.psu.edu/ yang98extraction.html
    [8]Yang MH,Ahuja N.Recognizing hand gestures using motion trajectories.In:Proc.of the IEEE Conf.on Computer Vision and Pattern Recognition (CVPR'99).Fort Collins:IEEE Press,1999.466-472.http://vision.ai.uiuc.edu/mhyang/papers/cvpr99.pdf
    [9]Murakami K,Taguchi H.Gesture recognition using recurrent neural networks.In:Proc.of the CHI'91 Human Factors in Computing Systems.New York:ACM Press,1991.237-242.http://portal.acm.org/ft_gateway.cfm?id=108900&type=pdf
    [10]Robinson T.An application of recurrent nets to phone probability estimation.IEEE Trans.on Neural Networks,1994,5(2):298-305.
    [11]Senior A,Robinson AJ.Forward-Backward retraining of recurrent neural networks.Advances in Neural Information Processing Systems,1996,8:743-749.
    [12]Bengio Y,Simard P,Frasconi P.Learning long-term dependencies with gradient descent is difficult.IEEE Trans.on Neural Networks,1994,5(2):157-166.
    [13]Bauer B,Kraiss KF.Towards an automatic sign language recognition system using subunits.In:Proc.of the Gesture Workshop.London:ACM Press,2001.64-75.http://www.springerlink.com/index/07DPUY0RPPMNE9M0.pdf [14h]Bauer B,Kraiss KF.Video-Based sign recognition using self-organizing subunits.In:Kasturi R.,Laurendeau D.,Suen C.eds.Proc.of the Int'l Conf.Pattern Recognition.Quebec:IEEE Computer Society,2002.434-437. [15]Gao W,Ma J,Wu J,Wang C.Sign language recognition based on HMM/ANN/DP.Int'l J.Pattern Recognition Artificial Intelligence,2000,14(5):587-602. [16]Wang C,Gao W,Shan S.An approach based on phonemes to large vocabulary Chinese sign language recognition.In:Proc.of the Int'l Conf.Automatic Face and Gesture Recognition.New York:ACM Press,2002.393-398. [17]Vogler C.American sign language recognition:Reducing the complexity of the task with phoneme-based modeling and parallel hidden Markov models[Ph.D.Thesis].University of Pennsylvania,2003. [18]McGuire RM,Hernandez-Rebollar J,Starner T,Henderson V,Brashear H,Ross DS.Towards a one-way American sign language translator.In:Proc.of the Int'l Conf.Automatic Face and Gesture Recognition.Seoul:ACM Press,2004.620-625.http://ieeexplore.ieee.org/iel5/9123/28919/01301602.pdf [19]Starner T,Weaver J,Pentland A.Real-Time American sign language recognition using desk and wearable computer based video.IEEE Trans.on Pattern Analysis Machine Intelligence,1998,20(12):1371-1375. [20]Hernandez-Rebollar JL,Lindeman RW,Kyriakopoulos N.A multi-class pattern recognition system for practical finger spelling translation.In:Proc.of the Int'l Conf.Multimodal Interfaces.2002.185-190.http:ieeexplore.ieee.org/iel5/8346/26309/ 01166990.pdf [21]Hernandez-Rebollar JL,Kyriakopoulos N,Lindeman RW.A new instrumented approach for translating American sign language into sound and text.In:Proc.of the Int'l Conf.Automatic Face and Gesture Recognition.Seoul:ACM Press,2004.547-552.http://ieeexplore.ieee.org/iel5/9123/28919/01301590.pdf [22]Kramer J,Leifer L.The talking glove:An expressive and receptive verbal communication aid for the deaf,deaf-blind,and nonvocal.In:Brown.C.ed.Proc.of the 3rd Annual Conf.on Computer Technology,Special Education,Rehabilitation.Northridge:California State University Press,1987.335-340. [23]Gupta L,Ma S.Gesture-Based interaction and communication:Automated classification of hand gesture contours.IEEE Trans.on Systems,Man,and Cybernetics.Part C:Applications and Reviews,2001,31(1):114-120. [24]Sutherland A.Real-Time video-based recognition of sign language gestures using guided template matching.In:Harling PA,ed.Proc.of the Gesture Workshop.London:Springer-Verlag,1996.31-38. [25]Terrillon JC,Piplr A,Niwa Y,Yamamoto K.Robust face detection and Japanese sign language hand posture recognition for human-computer interaction in an "Intelligent" Room.In:Proc.of the Int'l Conf.Vision Interface.Banff:ACM Press,2002.369-376.http://www.cipprs.org/vi2002/pdf/s7-4.pdf [26]Wu J,Gao W.A fast sign word recognition method for Chinese sign language.In:Proc.of the Int'l Conf.Advances in Multimodal Interfaces.San Diego:Academic Press,2000.599-606.http://www.springerlink.com/index/8H84T698MF0AU23V.pdf [27]Chen FS,Fu CM,Huang CL.Hand gesture recognition using a real-time tracking method and hidden Markov models.Image and Vision Computing,2003,21(8):745-758. [28]Huang CL,Jeng SH.A model-based hand gesture recognition system.Machine Vision and Application,2001,12(5):243-258. [29]Kobayashi T,Haruyama S.Partly-Hidden Markov model and its application to gesture recognition.In:Taylor FJ,ed.Proc.of the Int'l Conf.on Acoustics,Speech and Signal Processing.New York:Academic Press,1997.3081-3084. [30]Kadous MW.Machine recognition of auslan signs using PowerGloves:Towards large-lexicon recognition of sign language.In:Messing L ed.Proc.of the Workshop Integration of Gestures in Language and Speech.Delaware:IEEE Computer Society Press,1996.165-174. [31]Assan M,Grobel K.Video-Based sign language recognition using hidden Markov models.In:Proc.of the Gesture Workshop.Bielefeld:Springer-Verlag,1997.97-109.http://www.springerlink.com/index/T34LRHBYXFQAL4CD.pdf [32]Vamplew P,Adams A.Recognition of sign language gestures using neural networks.Australian Journal of Intelligent Information Processing Systems,1998,5(2):94-102. [33]Handouyahia M,Ziou D,Wang S.Sign Language recognition using moment-based size functions.In:Proc.of the Int'l Conf.on vision interface.Kerkyra:CRC Press,1999.210-216.http://www.gel.ulaval.ca/～parizeau/vi99/PDF-files/S7/paper76.pdf [34]Su MC.A fuzzy rule-based approach to spatio-temporal hand gesture recognition.IEEE Trans.on Systems,Man,and Cybernetics,Part C:Applications and Reviews,2000,30(2):276-281. [35]Kong WW,Ranganath S.3-D Hand trajectory recognition for signing exact english.In:Proc.of the Int'l Conf.Automatic Face and Gesture Recognition.Seoul:ACM Press,2004.535-540.http://ieeexplore.ieee.org/iel5/9123/28919/01301588.pdf [36]Gao W,Fang GL,Zhao DB,Chen YQ.A Chinese sign language recognition system based on SOFM/SRN/HMM.Pattern Recognition,2004,37(12):2389-2402. [37]Ong S,Ranganath S.Deciphering gestures with layered meanings and signer adaptation.In:Proc.of the Int'l Conf.Automatic Face and Gesture Recognition.Seoul:ACM Press,2004.559-564.http://ieeexplore.ieee.org/iel5/9123/28919/01301592.pdf [38]Wang ZQ,Gao W.A method to synthesize Chinese sign language based on virtual human technologies.Journal of Software,2002,13(10):2051-2056 (in Chinese with English abstract).http://www.jos.org.cn/1000-9825/13/2051.pdf [39]Zhang CX,Jiang F,Yao HX.Static gesture quantization and DCT based sign language generation.In:Tao J,Tan T,Picard RW,eds.Proc.of the 1st Int'l Conf.on Affective Computing and Intelligent Interaction (ACII 2005).Beijing:Springer-Verlag,2005.168-178. [40]Comaniciu D,Ramesh V,Meer P.Kernel-Based object tracking.IEEE Trans.on Pattern Analysis and Machine Intelligence,2003,25(5):564-575. [41]Laban R.The Mastery of Movement.Boston:Plays,Inc.,1971. [42]Laban R,Lawrence FC.Effort:Economy in Body Movement.Boston:Plays,Inc.,1974. [43]Kopp S,Wachsmuth I.Synthesizing multimodal utterances for conversational Agents.The Journal of Computer Animation and Virtual Worlds,2004,15(1):39-52. [1]高文,陈熙霖,马继勇,王兆其.基于多模态接口技术-聋人与正常人交流系统.计算机学报,2000,23(12):1253-1260. [38]王兆其,高文.基于虚拟人合成技术的中国手语合成方法http://vh.ict.ac.cn/personalweb/wzq/PAPER/zqwang2002.pdf.软件学报,2002,13(10):2051-2056.13/2051.pdf
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

姜峰,高文,王春立,姚鸿勋,赵德斌.非特定人手语识别进展及关键问题研究思路.软件学报,2007,18(3):477-489

复制
分享
文章指标
  • 点击次数:6758
  • 下载次数: 8087
  • HTML阅读次数: 0
  • 引用次数: 0
历史
  • 收稿日期:2006-06-25
  • 最后修改日期:2006-11-13
文章二维码
友情链接:中国科学院软件研究所中国计算机学会中国科学院国家自然科学基金委员会CCF数字图书馆Int'l J of Softw Info计算机系统应用
您是第19728477位访问者
版权所有：中国科学院软件研究所 京ICP备05046678号-3
地址：北京市海淀区中关村南四街4号,邮政编码：100190
电话：010-62562563 传真：010-62562533 Email：jos@iscas.ac.cn
技术支持：北京勤云科技发展有限公司

京公网安备 11040202500063号