"Compressive Light Transport Sensing"
Pieter Peers, Dhruv K. Mahajan, Bruce Lamond, Abhijeet Ghosh, Wojciech Matusik, Ravi Ramamoorthi, and Pauk Debevec

Institute for Creative Technologies, USC, ICT-TR-05-2008, May 2008
Abstract
In this paper we propose a new framework for capturing light transport data of a real scene, based on the recently developed theory of compressive sensing. Compressive sensing offers a solid mathematical framework to infer a sparse signal from a limited number of non-adaptive measurements. Besides introducing compressive sensing for fast acquisition of light transport to computer graphics, we develop several innovations that address specific challenges for image-based relighting, and which may have broader implications. We develop a novel hierarchical decoding algorithm that improves reconstruction quality by exploiting inter-pixel coherency relations. Additionally, we design new non-adaptive illumination patterns that minimize measurement noise and further improve reconstruction quality. We illustrate our framework by capturing detailed highresolution reflectance fields for image-based relighting.


Download
Additional Notes
  • Errata: In our quest to simplify the derivations, we simplified too far and introduced an error. Consequently, Eq. 15 is incorrect. However, Eq. 16 is correct.
  • Concurrent Work: We have recently become aware of concurrent and independent work "Compressive Dual Photography" performed by Pradeep Sen and Soheil Darabi at the University of New Mexico that applies compressive sensing to Dual Photography. This work tackles the problem of measuring high resolution reflectance fields in a similar manner. The main difference is that they directly apply Bernoulli noise measurement patterns that work well in a Dual Photography setup.

Related Publications
  • Pieter Peers, Dhruv K. Mahajan, Bruce Lamond, Abhijeet Ghosh, Wojciech Matusik, Ravi Ramamoorthi, and Pauk Debevec, "Compressive Light Transport Sensing", Institute for Creative Technologies, USC, ICT-TR-05-2008, May 2008,
Bibtex
@techreport{Peers:2008:CLT:Techreport,
author = {Peers, Pieter and Mahajan, Dhruv K. and Lamond, Bruce and Ghosh, Abhijeet and Matusik, Wojciech and Ramamoorthi, Ravi and Debevec, Pauk},
title = {Compressive Light Transport Sensing},
month = {May},
year = {2008},
institution = {Institute for Creative Technologies, USC},
number = {ICT-TR-05-2008},
}