Abstract:This article analyzes the application and existing problems of touch interaction for mobile handsets and wearable device. Based on time continuity and space continuity of interactive action, a hybrid gesture input method with characteristic and advantages of air gesture and touch gestures is proposed by combining the contact trajectory and in-air trajectory of the interactive action. Based on the concept of continuous interaction space, hybrid interaction gestures, air gestures, and surface touch gestures are unified to establish a continuous interaction space hierarchical processing model including the air layer, surface layer and hybrid layer. The definition of information data and the transformation process are then provided. The general gesture recognition framework is also constructed. Furthermore, the trajectory segmentation method and gestures classification methods are introduced in detail. Finally, an application instance is designed, and the availability of the hybrid interaction gestures and feasibility of the continuous interaction space hierarchical processing model are verified. Experimental results show that the presented hybrid gesture interaction model possesses advantages of both air gesture and touch gestures, and has good recognition efficiency and better spatial freedom.