A method for extracting realistic textures from real-world reference spheres is proposed in this paper. The BRDF (bidirectional reflectance distribution function) parameters of fundamental materials, as well as a material weight map for the sphere are obtained through a non-linear optimization process. The material weight map can be used as a conventional texture for relighting. With the BRDF models recovered, the rendered 3D objects can exhibit real and complex appearances with varying light direction/intensity, view point and surface orientations.