In this paper, human language is regarded as consisting of nature language and body language, the conception of body language and the construction of human language are introduced, then the fusion model of body language and nature language is put forward. Based on the model, the framework of a multiple functional perceptive system is designed using agent oriented technology and expressed as an ARD (agent relation diagram), and an implementation of prototype system for body language perception is given.