微信服务号

微信订阅号

2025年5月14日 5:18 星期三
首页 > 过刊浏览>2014年第25卷第5期 >939-952. DOI:10.13328/j.cnki.jos.004418
PDF HTML阅读 XML下载 导出引用 引用提醒
多触点交互桌面左右手区分方法
作者:
基金项目:

国家重点基础研究发展计划（973）（2009CB320804）；国家自然科学基金（61173059，61103096，61135003）；国家高技术研究发展计划（863）（2012AA02A608）


Left-Right Hand Distinction for Multi-Touch Tabletop Interaction
Author:
  • 摘要
    • | |
  • 访问统计
    • |
  • 参考文献 [20]
    • |
  • 相似文献 [20]
    • | | |
  • 文章评论
    摘要:

    现有多触点交互桌面系统通常只提供触点位置、形状等信息，不包括触点左右手归属信息.触点所属手及左右手手性信息的提供，对于多指手势识别、丰富双手交互技术，尤其是非对称双手交互技术具有重要意义.基于手的解剖结构特征，提出一种不需辅助硬件设备的触点左右手归属判定方法.首先，以手势设计的基本原则为指导，根据手的解剖结构特征，提出交互桌面手-臂系统三角形模型；其次，基于该三角形模型，给出多触点交互桌面同手触点聚类方法及左右手识别方法；然后，对MTDriver做扩展，实现了提供左右手信息的多触点跟踪工具箱，并提出了基于左右手信息的交互桌面交互技术；最后，评估结果表明，同手触点聚类方法及触点左右手手性识别方法均具有较高的正确率，而且在时间性能方面满足交互桌面交互实时性要求.

    Abstract:

    In a multi-touch interactive system, distinguishing between user's left and right hands is of great significance for recognizing multi-finger gestures and further fully exploring the potential of bimanual interaction. However, the function of left-right hand distinction is beyond the capability of most multi-touch systems. In this paper, a robust solution to the left-right hand distinction based on the anatomical structure characteristic of hand is presented. Firstly, guided by the basic principles of gesture designing, the interactive tabletop hand-arm triangle model is proposed based on the anatomical structure characteristic of hand. Secondly, multi-touch interactive tabletop same hand contact points clustering method and left-right hand recognizing method are given based on the triangle model. Then, the methods are integrated into MTDriver to detect and send contact points's left-right information to the multi-touch applications and new bimanual interactive technologies are demonstrated. Finally, evaluation shows that the solution can achieve high recognition accuracy and good time performance that could support fluency bimanual interaction on interactive tabletop.

    参考文献
    [1] Wobbrock JO, Morris MR, Wilson AD. User-Defined gestures for surface computing. In: Olson G, Jeffries R, eds. Proc. of the 27th Int'l Conf. on Human Factors in Computing Systems. New York: ACM Press, 2009. 1083-1092. [doi: 10.1145/1518701. 1518866]
    [2] Epps J, Lichman S, Wu M. A study of hand shape use in tabletop gesture interaction. In: Olson G, ed. Proc. of the CHI 2006 Extended Abstracts on Human Factors in Computing. New York: ACM Press, 2006. 748-753. [doi: 10.1145/1125451.1125601]
    [3] Guiard Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 1987,19(4):486-517. [doi: 10.1080/00222895.1987.10735426]
    [4] Fu CW, Goh WB, Ng JA. Multi-Touch techniques for exploring large-scale 3D astrophysical simulations. In: Mynatt E, ed. Proc. of the 28th Int'l Conf. on Human Factors in Computing Systems. New York: ACM Press, 2010. 2213-2222. [doi: 10.1145/1753326. 1753661]
    [5] Morris MR, Huang A, Paepcke A, Winograd T. Cooperative gestures: Multi-user gestural interactions for co-located groupware. In: Grinter R, Rodden T, Aoki P, Cutrell E, Jeffries R, Olson G, eds. Proc. of the SIGCHI Conf. on Human Factors in Computing Systems. New York: ACM Press, 2006. 1201-1210. [doi: 10.1145/1124772.1124952]
    [6] Han JY. Low-Cost multi-touch sensing through frustrated total internal reflection. In: Baudisch P, Czerwinski M, eds. Proc. of the 18th Annual ACM Symp. on User Interface Software and Technology. New York: ACM Press, 2005. 115-118. [doi: 10.1145/ 1095034.1095054]
    [7] Teiche A, Rai AK, Yanc C, et al. Multi-Touch technologies. NUI Group, 2009. http://nuicode.com/attachments/download/115/ Multi-Touch_Technologies_v1.01.pdf
    [8] Marquardt N, Kiemer J, Greenberg S. What caused that touch: Expressive interaction with a surface through fiduciary-tagged gloves. In: Kruger A, Schoning J, eds. Proc. of the ACM Int'l Conf. on Interactive Tabletops and Surfaces (ITS 2010). New York: ACM Press, 2010. 139-142. [doi: 10.1145/1936652.1936680]
    [9] Dohse KC, Dohse T, Still JD, Parkhurst DJ. Enhancing multi-user interaction with multi-touch tabletop displays using hand tracking. In: Dini C, Dascalu S, eds. Proc. of the 1st Int'l Conf. on Advances in Computer-Human Interaction. Washington: IEEE Computer Society, 2008. 297-302. [doi: 10.1109/ACHI.2008.11]
    [10] Wilson AD. Using a depth camera as a touch sensor. In: Kruger A, Schoning J, eds. Proc. of the ACM Int'l Conf. on Interactive Tabletops and Surfaces (ITS 2010). New York: ACM Press, 2010. 69-72. [doi: 10.1145/1936652.1936665]
    [11] Au OKC, Tai CL. Multitouch finger registration and its applications. In: Brereton M, ed. Proc. of the 22nd Conf. of the Computer- Human Interaction Special Interest Group of Australia on Computer-Human Interaction. New York: ACM Press, 2010. 41-48. [doi: 10.1145/1952222.1952233]
    [12] Nielsen M, Storring M, Moeslund TB, Granum E. A procedure for developing intuitive and ergonomic gesture interface for HCI. In: Camurri A, Volpe G, eds. Gesture-Based Communication in Human-Computer Interaction, Vol.2915. Berlin, Heidelberg: Springer-Verlag, 2004. 409-420. [doi: 10.1007/978-3-540-24598-8_38]
    [13] Tan GF, Liu JS, Dai ZJ, Zhang FJ, Wang HA, Dai GZ. MTDriver: An improved multi-touch table toolkit. Ran Jian Xue Bao/ Journal of Software, 2010,21:121-130 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/10013.htm
    [14] Dietz P, Leigh D. DiamondTouch: A multi-user touch technology. In: Marks J, Mynatt E, eds. Proc. of the 14th Annual ACM Symp. on User Interface Software and Technology. New York: ACM Press, 2001. 219-226. [doi: 10.1145/502348.502389]
    [15] Benko H, Saponas TS, Morris D, Tan D. Enhancing input on and above the interactive surface with muscle sensing. In: Morrison G, Subramanian S, eds. Proc. of the ACM Int'l Conf. on Interactive Tabletops and Surfaces (ITS 2009). New York: ACM Press, 2009. 93-100. [doi: 10.1145/1731903.1731924]
    [16] Murugappan S, Vinayak, Elmqvist N, Ramani K. Extended multitouch: Recovering touch posture and differentiating users using a depth camera. In: Miller R, Hrvoje B, Latulipe C, eds. Proc. of the 25th Annual ACM Symp. on User Interface Software and Technology. New York: ACM Press, 2012. 487-496. [doi: 10.1145/2380116.2380177]
    [17] Dang CT, Straub M, Andre E. Hand distinction for multi-touch tabletop interaction. In: Morrison G, Subramanian S, eds. Proc. of the ACM Int'l Conf. on Interactive Tabletops and Surfaces (ITS 2009). New York: ACM Press, 2009. 101-108. [doi: 10.1145/ 1731903.1731925]
    [18] Walther-Franks B, Herrilich M, Aust M, Malaka R. Left and right hand distinction for multi-touch displays. Smart Graphics Lecture Notes in Computer Science, 2100,6815:155-158. [doi: 10.1007/978-3-642-22571-0_17]
    [19] Micire M, McCann E, Desai M, Tsui KM, Norton A, Yanco HA. Hand and finger registration for multi-touch joysticks on software- based operator control units. In: Greiner H, ed. Proc. of the 2011 IEEE Conf. on Technologies for Practical Robot Applications (TePRA). Washington: IEEE Computer Society, 2011. 88-93. [doi: 10.1109/TEPRA.2011.5753487]
    [20] Wang F, Cao X, Ren XS, Irani P. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In: Wilson A, ed. Proc. of the 22nd Annual ACM Symp. on User Interface Software and Technology. New York: ACM Press, 2009. 23-32. [doi: 10.1145/1622176.1622182]
    引证文献
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

刘佳升,张凤军,张镇嵩,陈辉,戴国忠,王宏安.多触点交互桌面左右手区分方法.软件学报,2014,25(5):939-952

复制
分享
文章指标
  • 点击次数:3412
  • 下载次数: 6457
  • HTML阅读次数: 1296
  • 引用次数: 0
历史
  • 收稿日期:2013-03-04
  • 最后修改日期:2013-04-22
  • 在线发布日期: 2014-05-04
文章二维码
友情链接:中国科学院软件研究所中国计算机学会中国科学院国家自然科学基金委员会CCF数字图书馆Int'l J of Softw Info计算机系统应用
您是第19937774位访问者
版权所有：中国科学院软件研究所 京ICP备05046678号-3
地址：北京市海淀区中关村南四街4号,邮政编码：100190
电话：010-62562563 传真：010-62562533 Email：jos@iscas.ac.cn
技术支持：北京勤云科技发展有限公司

京公网安备 11040202500063号