Abstract: In image-based visual hull (IBVH) rendering, highlight spots in reference images often cause undesired artifacts in the rendering results. In this paper, we propose a method that can automatically recognize and remove highlight spots from reference images, by utilizing the features of IBVH. First, highlight sub-images are extracted by histogram analyzing; then, their counterparts in other images are calculated. The highlight pixels can be retrieved from their corresponding pixels by pixel blending, and finally be seamlessly integrated back into the target image by resolving a Poisson equation.