Research on Puppet Animation Controlled by Electromyography (EMG) in Virtual Reality Environment
Author:
Affiliation:

Clc Number:

Fund Project:

National Key Research and Development Plan of of Cooperation between the BRICS of China (2017YFE 0100500); National Key R&D Program of China (2017YFB1002604, 2017YFB1402105, 2017YFB1002804); Beijing Natural Science Foundation of China (4172033)

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Quanzhou puppet is one of the intangible cultural heritages of China. It is the physical embodiment of traditional Chinese culture. However, the large size of the puppet and inconvenience to carry and manipulate directly makes it hard to reach a wider audience. In order to realize the effective inheritance and protection of Quanzhou puppet, this study designs a virtual real-line puppet animation scheme based on gesture recognition, builds a prototype system which uses MYO Armband EMG signal to control the generation of animation, and applies it in user experiment to verify the high accuracy and easy manipulation of the algorithm. Firstly, low-pass filtering and smoothing is used to process the original multi-channel EMG data. Secondly, after eight-channel EMG signal time-domain feature and time-frequency-domain feature extraction, the dimension of the feature vector is reduced to six by linear discriminator to eliminate the correlation between features and enhance the robustness of the algorithm. Thirdly, a multi-class support vector machine is constructed which uses feature vector to determine the result of gesture recognition. Experiments show that the average recognition accuracy of offline action is 95.59%, the average recognition accuracy of real-time action is 90.75%, and the gesture recognition is completed within 1.1 s. For the puppet task, two users task is designed:the common users and the expert users. In the common user study, the gestures recognition accuracy is high. In the aspects of user's willingness to use and easiness to learn, the performance of this system is significantly higher than real puppets manipulation. In the expert user study, user's acceptance and usability of the system are also highly evaluated. These two user tasks indicate the system meets the requirements of real-time and accuracy, and has good interactivity and interesting. Relevant research can be widely applied to similar systems, such as computer animation. It has practical significance for experiencing and protecting the puppet.

    Reference
    Related
    Cited by
Get Citation

谭宇彤,周旭峰,孔令芝,王醒策,武仲科,税午阳,付艳,周明全,Vladimir KORKHOV, Luciano Paschoal GASPARY.面向肌电信号的虚拟现实提线木偶动画研究.软件学报,2019,30(10):2964-2985

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:August 19,2018
  • Revised:November 01,2018
  • Adopted:
  • Online: May 16,2019
  • Published:
You are the firstVisitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063