There has recently been a lot of interest in capturing 3D representations of the real world around us.  In particular, several research efforts around the world are aiming at creating 3D models of urban environments that can be used for interactive exploration.

Topics

• Basics: sensor, techniques, ...
• Video, LIDAR, GPS, IMU, …
• SfM, Stereo, …
• Robot Mapping, GIS, …

• Review state-of-the-art
• Video and LIDAR-based systems

• Projects to experiment
  

• Virtual UNC-Chapel Hill
• DARPA Urban Challenge
• …
  

Slides

• Introduction
• Video-based Urban 3D Capture (Jan-Michael Frahm)
  
• Cameras
• Epipolar geometry and triangulation
• Feature tracking and matching (Sudipta Sinha)
• Binocular Stereo (Philippos Mordohai)
• GPS/INS/LIDAR (Brian Clipp)

Papers

• C. Früh, S. Jain, and A. Zakhor, "Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images", International Journal of Computer Vision, Vol. 61 No.2, Feb. 2005, pp. 159-184.[pdf]

• C. Früh and A. Zakhor, "An Automated Method for Large-Scale, Ground-Based City Model Acquisition" in International Journal of Computer Vision, Vol. 60, No. 1, October 2004, pp. 5 - 24. [pdf]

• MIT city scanning project (and publications)

• 4D Cities

• Fast Compact City Modeling for Navigation Pre-Visualization, Cornelis et al. CVPR06.
  
• 3D City Modeling using Cognitive Loops, Cornelis et al. 3DPVT06.

• UW Photo Tourism

Marc Pollefeys, September, 2006.