2012 Summer Symposium Program - Middlebury College

Page 14
16
Nera Nesic ‘13
Major: CSCI
NSF Grant IIS-0917109
(Scharstein)
Xi Wang ‘14
Major: CSCI, ECON
NSF Grant IIS-0917109
(Scharstein)
Daniel Scharstein
Professor of Computer Science
Middlebury Summer Research Symposium 2012
3D Capture of Complex Real-World Scenes
Nera Nesic, Xi Wang, and Daniel Scharstein
Department of Computer Science, Middlebury College, Middlebury VT 05753
The goal of this project is to create new datasets and benchmarks for 3D
reconstruction methods. Middlebury hosts an internationally-known benchmark
for stereo algorithms, which compute 3D depth maps from multiple input images.
Existing test datasets, however, do not exhibit real-world challenges such as
complex occlusion, large depth ranges, and specular objects. Building on work
done in previous summers, we used a mobile stereo rig with four cameras and
structured lighting from two video projectors to capture images and accurate 3D
scene structure. We acquired 7 new datasets of different scenes, each under multiple
lighting conditions and exposures. Our new datasets include a reconstruction of the
famous Tsukuba “head and lamp” scene as well as a motorcycle scene in which we
applied matte white paint to glossy surfaces in order to enable 3D measurements. We
also improved both hardware and software of our system for increased robustness,
accuracy, and usability. Finally, we created scripts for automatic generation of
extensive webpages organizing and visualizing our results.