Pieter Peers

"Accurate Image Based Re-lighting through Optimization"
Pieter Peers, and Philip Dutré

Department of Computer Science, K.U.Leuven, CW336, April 2002

Abstract
In this report we present a new re-lighting technique that, for a single viewpoint, accurately captures the reflectance field of real and virtual objects, without restrictions on their geometrical complexity or material properties. As a result the objects can be re-lit under arbitrary lighting conditions. To capture the reflectance field, we take photographs of an object lit by several lighting patterns on a surrounding discretized hemicube. The illumination of each pixel due to emitted radiance from each discrete patch on the hemicube is approximated by a reflection coefficient and a rectangular support which are found through an optimization procedure. The discretization of the hemicube ensures sufficient angular sampling to capture diffuse material properties. The use of a per patch support accommodates the small solid angle of a incoming light important for specular materials. To re-light the object, the target illumination, a high-dynamic range environment map, is averaged over the support and multiplied by the reflection coefficient, per pixel and per discrete patch on the hemicube. The results obtained show accurate re-lighting of diffuse as well as specular objects.

Download

Peers_TechReport2002.pdf (3.06Mb)

Supplementary Material

Video: movie_caustic.mpg (5.52Mb)
Video: movie_sun.mpg (6.60Mb)
Image: Setup1.jpg (0.48Mb)
Image: Setup2.jpg (0.47Mb)
Image: Setup3.jpg (0.47Mb)
Image: beach_car.jpg (0.03Mb)
Image: beach_car.pic (0.50Mb)
Image: color_car.jpg (0.04Mb)
Image: color_car.pic (0.48Mb)
Image: imec_car.jpg (0.03Mb)
Image: imec_car.pic (0.46Mb)
Image: uffizi_car.jpg (0.04Mb)
Image: uffizi_car.pic (0.50Mb)
Image: beach_mask.jpg (0.07Mb)
Image: beach_mask.pic (0.82Mb)
Image: building_mask.jpg (0.07Mb)
Image: building_mask.pic (0.83Mb)
Image: color_mask.jpg (0.07Mb)
Image: color_mask.pic (0.81Mb)
Image: imec_mask.jpg (0.06Mb)
Image: imec_mask.pic (0.81Mb)
Image: uffizi_mask.jpg (0.07Mb)
Image: uffizi_mask.pic (0.83Mb)

Related Publications

Pieter Peers, and Philip Dutré, "Accurate Image Based Re-lighting through Optimization", ACM SIGGRAPH 2002 Conference Abstracts and Applications, pages 145-145, San Antonio, USA, August 2002,
@misc{Peers:2002:AIB:Sketch,
author = {Peers, Pieter and Dutr{\'e}, Philip},
title = {Accurate Image Based Re-lighting through Optimization},
month = {August},
year = {2002},
pages = {145--145},
howpublished = {ACM SIGGRAPH 2002 Conference Abstracts and Applications},
doi = {http://doi.acm.org/10.1145/1242073.1242158},
}
Pieter Peers, and Philip Dutré, "Accurate Image Based Re-lighting through Optimization", Poster presentation at 13th Eurographics Workshop on Rendering, Pisa, Italy, June 2002,
@misc{Peers:2002:AIB:Poster,
author = {Peers, Pieter and Dutr{\'e}, Philip},
title = {Accurate Image Based Re-lighting through Optimization},
month = {June},
year = {2002},
howpublished = {Poster presentation at 13th Eurographics Workshop on Rendering},
}

Bibtex

@techreport{Peers:2002:AIB:TechReport,
author = {Peers, Pieter and Dutr\'{e}, Philip},
title = {Accurate Image Based Re-lighting through Optimization},
month = {April},
year = {2002},
institution = {Department of Computer Science, K.U.Leuven},
number = {CW336},
}