Gesture interaction based on muscle sensing has received great attention due to its wearability, implicit interaction, and reliability under the background of human-computer interaction technique shifting from computer-centered to human-centered. However, current researchs lack of a unified semantic model and system model. This paper discussed the classification of interactive gestures, summarized the input primitives suitable for physiological computing technology, and proposed muscle sensing based gesture interaction semantic model and hierarchical processing a system model. Finally, this paper implemented a prototype of object operating gesture recognition under scenario of office environment.