"Facial Cartography: Interactive Scan Correspondence"
Proceedings of ACM/Eurographics Symposium on Computer Animation, pages 205-214, August 2011
Abstract
We present a semi-automatic technique for computing surface correspondences between 3D facial scans in different expressions, such that scan data can be mapped into a common domain for facial animation. The technique can accurately correspond high-resolution scans of widely differing expressions -- without requiring intermediate pose sequences -- such that they can be used, together with reflectance maps, to create high-quality blendshape-based facial animation. We optimize correspondences through a combination of Image, Shape, and Internal forces, as well as Directable forces to allow a user to interactively guide and refine the solution. Key to our method is a novel representation, called an Active Visage, that balances the advantages of both deformable templates and correspondence computation in a 2D canonical domain. We show that our semi-automatic technique achieves more robust results than automated correspondence alone, and is more precise than is practical with unaided manual input.
Download
Supplementary Material
Related Publications
Bibtex
Proceedings of ACM/Eurographics Symposium on Computer Animation, pages 205-214, August 2011
AbstractWe present a semi-automatic technique for computing surface correspondences between 3D facial scans in different expressions, such that scan data can be mapped into a common domain for facial animation. The technique can accurately correspond high-resolution scans of widely differing expressions -- without requiring intermediate pose sequences -- such that they can be used, together with reflectance maps, to create high-quality blendshape-based facial animation. We optimize correspondences through a combination of Image, Shape, and Internal forces, as well as Directable forces to allow a user to interactively guide and refine the solution. Key to our method is a novel representation, called an Active Visage, that balances the advantages of both deformable templates and correspondence computation in a 2D canonical domain. We show that our semi-automatic technique achieves more robust results than automated correspondence alone, and is more precise than is practical with unaided manual input.
Download
- Wilson_SCA2011.pdf (16.02Mb)
Supplementary Material
- Document: Wilson_SCA2011_Supplement.pdf (25.24Mb)
- Video: Wilson_SCA2011_Video.mov (136.17Mb)
Related Publications
-
"Facial Cartography: Interactive High-resolution Scan Correspondence",
ACM SIGGRAPH 2011 Talks,
Vancouver, British Columbia, Canada,
August 2011,
@conference{Wilson:2011:FCI,
author = {Wilson, Cyrus A. and Alexander, Oleg and Tunwattanapong, Borom and Peers, Pieter and Ghosh, Abhijeet and Busch, Jay and Hartholt, Arno and Debevec, Paul},
title = {Facial Cartography: Interactive Scan Correspondence},
month = {August},
year = {2011},
pages = {205--214},
booktitle = {Proceedings of ACM/Eurographics Symposium on Computer Animation},
doi = {http://doi.acm.org/10.1145/2019406.2019434},
}
author = {Wilson, Cyrus A. and Alexander, Oleg and Tunwattanapong, Borom and Peers, Pieter and Ghosh, Abhijeet and Busch, Jay and Hartholt, Arno and Debevec, Paul},
title = {Facial Cartography: Interactive Scan Correspondence},
month = {August},
year = {2011},
pages = {205--214},
booktitle = {Proceedings of ACM/Eurographics Symposium on Computer Animation},
doi = {http://doi.acm.org/10.1145/2019406.2019434},
}