Because human face tracking is prone to be affected under complex postures (largely tilt, rotate, occlusion and color interference), this paper proposes a new face tracking algorithm based on online modifying, which includes two modules: detection module and tracking module. Tracking module is effective when detection is failed, and in the process of face tracking, in order to reduce the continuous accumulation of errors, we use real-time face detection to fix the parameters (including tracking the location and scale) of the tracking module, which made use of face detection and tracking with their respective advantages. Experiments show that the algorithm is able to accurately track a face under largely tilt and rotate and is also robust to color interfere and occlusion. In addition, the algorithm is used to control commercial games, which provides a new interactive way for HCI.