With the development of network, the video applications based on Internet are growing rapidly. The real-time video applications become popular. Because of the complexity of the network and real-time stream video on demand, the scheduling algorithm has great influence on the QoS. In this paper, a scheduling algorithm based on real-time stream video, QFEC (QoS based on FEC) algorithm is proposed, associated the FEC and Kalman filter theories. According to the status of the receiver, the sending rate is adapted automatically by Kalman filter. The state of the scheduling algorithm is analyzed. This algorithm can maintain the continuity of the real-time video transmission. The simulation results are given, which indicate the scheduling algorithm can provide good video service.