A part-based tracking approach based on multi collaborative model is proposed that can address the problem of losing object based on the holistic appearance model in complex scenarios. Object appearance model is constructed by fusing the generative model based on local sensitive histogram (LSH) and discriminative model based on superpixel segmentation, by extracting the illumination invariant feature of the LSH resist the influence of the illumination changes on the object model effectively; for the lack of effective occlusion handling mechanism of the LSH algorithm, the part-based adaptive model segmentation method is introduced to improve the performance of resistance occlusion; by through the relative entropy and mean shift cluster method, measuring the differences confidence value and the foreground-background confidence value of the local part, establish the dual weights constraint mechanism and asynchronous update strategy for the part model, the partes with high confidence are selected to locate object in the particle filter framework. Experimental results on challenging sequences confirm that the proposed approach outperforms the related tracking algorithm in complex scenarios.