This paper presents an algorithm for image inpainting based on the large displacement view images, it fills in the occluded or damaged regions of the target image using the visible information from other large displacement view images. The key issues are, first, how to convert the visible information in the large displacement view images into useful information; second, how to make use of the useful information to repair the target image effectively. After specifying the target region with interaction, this paper tackles the first issue by dividing all the images into different planar scene regions, and then transforming all the regions in the large displacement view images into the current view by image matching. As a result, the visible information in them can be directly used. For the second issue, through the properly defined repairing and fusion priority functions, a new image inpainting algorithm is developed based on texture synthesis and image fusion to repair the target region with the acquired usable information. In addition, the ghost effect between the repaired region and the target image is eliminated by Poisson image fusion to generate the seamless result. Experimental results show that this algorithm can recover the structural and texture information in the large missing region, and holds its practical value.