An algorithm combining source statistics and network congestion control for robust video transmission over wireless network is proposed in this paper. Based on scene modeling and characteristic analyzing, all layers generated by scalable coding are classified into several types and two queuing are made respectively according to their contribution to network congestion and to the quality of reconstructed video. Then the source rate, unequal error protection level and congestion control strategy are dynamically adjusted according to different network status in which the packet loss is caused by network congestion or by unreliable transmission in wireless channel. The simulation results show that the proposed method can achieve better results than MPEG-4 video source coding with fixed rate Turbo coding and than the one which dynamically adjusting source coding and channel coding rates and using network congestion control method of selectively dropping I, B or P packets.