A hybrid representation of environment models is proposed by combining points and polygons through which a real time walkthrough of a complex environment can be achieved. Starting from multiple depth reference images, the pixels of images are classified into two categories, corresponding to the planar and non-planar surfaces in 3D space. For the pixels corresponding to the planar surfaces, the plane coefficients are reconstructed and all their appearances in the reference images are merged to form uniform-sampled texture images by a comparison of sampling rate and resampling.For the pixels coresponding to the non-planar surfaces,their point representation is kept and no 3D models are reconstructed,the redundant pixels are removed by sampling rate comparison.The remained pixels are organized by OBB-tree according to their space coordinates.At the same time,the holes that are unable to be captured by all the reference images are pre-filled in the preprocessing phase so that the probability of hole appearance in walkthrough is greatly reduced.Under this hybrid representation,texture mapping and point warping are employed to render the novel views,to take full advantages of acceleration utility of graphics hardware.