微信服务号

微信订阅号

2025-4-24- 22
Home > Archive>Volume 29, Issue S2, 2018 >108-119
PDF HTML XML Export Cite reminder
BCI Assisted Dynamic Target Selection Technique
Author:
Affiliation:

Fund Project:

National Key Research & Development Plan of China (2017YFB1002504); Science and Technology Service Platform Project of Chongqing Science and Technology Commission (cstc2015ptfw-ggfw120002)

  • Article
    • | |
  • Metrics
    • |
  • Reference [34]
    • |
  • Related [20]
    • | | |
  • Comments
    Abstract:

    Dynamic target selection is one of the most basic interactive tasks in modern interaction interfaces. There are a variety of assistive techniques, but the design and parameters of these techniques are largely based on experimental data and cannot be adjusted according to the users' current state. In order to solve this problem, a brain-computer interface assisted dynamic target selection technique based on two assumptions of cognitive load and difficulty perception in this study is proposed, which uses the functional near-infrared spectroscopy (fNIRS) signals to cognitive load perception of users and adjusts the parameters of target selection techniques in real time. This technique can provide personalized assistance to different users and be applicable to different scenarios, user status and task difficulty. The proposed hypothesis through a set of experiments is verified, and brain-computer assisted dynamic target selection technique constructed based on this assumption is better than both the auxiliary and fixed auxiliary technologies. Specifically, the selection error rate is reduced by 20.55% and 12.09% respectively, and the completion time is reduced by 998.35 ms and 208.67 ms respectively.

    Reference
    [1] Allanson J, Fairclough SH. A research agenda for physiological computing. Interacting with Computers. 2004,16(5):857-878.
    [2] Baudisch P, Zotov A, Cutrell E, Hinckley K. Starburst:A target expansion algorithm for non-uniform target distributions. In:Proc. of the Working Conf. on Advanced Visual Interfaces. 2008.
    [3] Fitts PM. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 1954,47(6):381-391.
    [4] MacKenzie IS. Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction, 1992,7(1):91-139.
    [5] MacKenzie IS. A note on the information-theoretic basis for Fitts' law. Journal of Motor Behavior, 1989,21(3):323-330.
    [6] Brouwer AM, Middelburg T, Smeets JBJ, et al. Hitting moving targets. Experimental Brain Research, 2003,152(3):368-375.
    [7] Nakayama K. Biological image motion processing:A review. Vision Research, 1985,25(5):625-660.
    [8] Lyon DR, Waag WL. Time course of visual extrapolation accuracy. Acta Psychologica, 1995,89(3):239-260.
    [9] Huang J, Tian F, Fan X, et al. Understanding the uncertainty in 1D unidirectional moving target selection. In:Proc. of the 2018 CHI Conf. on Human Factors in Computing Systems. ACM, 2018. 237.
    [10] Wickens C. Multiple resources and mental workload. Human Factors:The Journal of the Human Factors and Ergonomics Society, 2008,50(3):449-455.
    [11] Fairclough SH. Fundamentals of physiological computing. Interacting with Computers, 2009,21(1-2):133-145.
    [12] Cutrell E, Tan D. BCI for passive input in HCI. In:Proc. of the CHI 2008. ACM Press, 2008.
    [13] Hoffmann ER. Capture of moving targets:A modification of Fitts' Law. Ergonomics, 1991,34(2):211-220.
    [14] Gunn TJ, Irani P, Anderson J. An evaluation of techniques for selecting moving targets. In:Proc. of the CHI 2009 Extended Abstracts on Human Factors in Computing Systems (CHI EA 2009). 2009. 3329-3334.
    [15] Al Hajri A, Fels S, Miller G, Ilich M. Moving target selection in 2D graphical user interfaces. In:Proc. of the Int'l Conf. on Human Computer Interaction (INTERACT 2011). 2011. 141-161.
    [16] Tresilian JR. Hitting a moving target:Perception and action in the timing of rapid interceptions. Perception & Psychophysics, 2005,67(1):129-149.
    [17] Ilich MV. Moving target selection in interactive video[MS. Thesis]. Vancouver, BC:University of British Columbia, 2009.
    [18] Jagacinski RJ, Monk DL. Fitts' law in two dimensions with hand and head movements movements. Journal of Motor Behavior, 1985,17(1):77-95.
    [19] MacKenzie S, Buxton W. Extending Fitts' law to two-dimensional tasks. In:Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI'92). 1992. 219-226.
    [20] Hasan K, Grossman T, Irani P. Comet and target ghost:Techniques for selecting moving targets. In:Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI 2011). 2011. 839-848.
    [21] Zhai S, Conversy S, Beaudouin-Lafon M, Guiard Y. Human on-line response to target expansion. In:Proc. of the SIGCHI Conf. on Human Factors in Computing Systems (CHI 2003). 2003. 177-184.
    [22] Yuksel BF, Oleson KB, Harrison L, et al. Learn piano with BACh:An adaptive learning interface that adjusts task difficulty based on brain state. In:Proc. of the 2016 CHI Conf. on Human Factors in Computing Systems. ACM, 2016. 5372-5384.
    [23] Harrison J, Izzetoglu K, Ayaz H, Willems B, Hah S, Ahlstrom U, Woo H, Shewokis P, Bunce SC, Onaral B. Cognitive workload and learning assessment during the implementation of a next-generation air traffic control technology using functional near-infrared spectroscopy. IEEE Trans. on Human-Machine Systems, 2014,44(4):429-440.
    [24] Gevins A, Smith ME, Leong H, McEvoy L, Whitfield S, Du R, Rush G. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors:The Journal of the Human Factors and Ergonomics Society, 1998, 40(1):79-91.
    [25] Afergan D, Peck EM, Solovey ET, Jenkins A, Hincks SW, Brown ET, Chang R, Jacob RJK. Dynamic difficulty using brain metrics of workload. In:Proc. of the SIGCHI Conf. on Human Factors in Computing Systems. 2014. 3797-3806.
    [26] Huppert T, Hoge R. A temporal comparison of BOLD, ASL, and NIRS hemodynamic responses to motor stimuli in adult humans. Neuroimage, 2006,29(2):368-382.
    [27] Villringer A, Chance B. Non-Invasive optical spectroscopy and imaging of human brain function. Trends in Neurosciences, 1997, 20(10):435-442.
    [28] Zacharias V, Ramirez R. P300 Harmonies:A brain-computer musical interface. In:Proc. of the ICMC. 2014.
    [29] Lukanov K, Maior HA, Wilson ML. Using fNIRS in usability testing:Understanding the effect of Web form layout on mental workload. In:Proc. of the 2016 CHI Conf. on Human Factors in Computing Systems. ACM, 2016. 4011-4016.
    [30] Afergan D, Shibata T, Hincks SW, et al. Brain-Based target expansion. In:Proc. of the 27th Annual ACM Symp. on User Interface Software and Technology. ACM, 2014. 583-593.
    [31] Pike MF, Maior HA, Porcheron M, et al. Measuring the effect of think aloud protocols on workload using fNIRS. In:Proc. of the 32nd Annual ACM Conf. on Human Factors in Computing Systems. ACM, 2014. 3807-3816.
    [32] Solovey ET, Girouard A, Chauncey K, Hirshfield LM, Sassaroli A, Zheng F, Fantini S, Jacob RJK. Using fNIRS brain sensing in realistic HCI settings:Experiments and guidelines. In:Proc. of the UIST. ACM Press, 2009.
    [33] Peck EMM, Yuksel BF, Ottley A, et al. Using fNIRS brain sensing to evaluate information visualization interfaces. In:Proc. of the SIGCHI Conf. on Human Factors in Computing Systems. ACM, 2013. 473-482.
    [34] fNIR Devices LLC. fNIR Imager & COBI Studio Manual. Biopac, 2013.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

孙伟,黄进,李念龙,范向民,田丰,戴国忠,王宏安.脑机接口辅助的动态目标选择技术.软件学报,2018,29(S2):108-119

Copy
Share
Article Metrics
  • Abstract:1660
  • PDF: 4098
  • HTML: 0
  • Cited by: 0
History
  • Received:June 15,2018
  • Online: August 07,2019
Links:Institute of Software, CASChina Computer FederationCASNSFC
You are the first2038330Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address：4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code：100190
Phone：010-62562563 Fax：010-62562533 Email：jos@iscas.ac.cn
Technical Support：Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063