Research Areas

Multi-perspective Modeling, Rendering, Imaging, and Display

Camera models are fundamental to the fields of computer vision, computer graphics, and photogrammetry. The classic pinhole and orthographic camera models have long served as the workhorse of 3D imaging applications. Recent developments have suggested alternative camera models that can capture rays from spatially varying viewpoints and provide potentially advantageous imaging systems for understanding the structure of observed scenes. In this project, we aim to build a complete framework to characterize and design new multi-perspective cameras and displays, and to use these systems for vision and graphics applications.

Computational Cameras and Displays

Light Field for Computer Vision

With the availability of commodity light field cameras such as Lytro, Raytrix, and Pelican mobile light field cameras, it has become increasingly common to acquire a light field in place of a single image of the scene. While the original goal of acquiring a light field is to conduct image-based modeling and rendering (e.g., to produce after-capture refocusing), recent studies have shown that light fields can be extremely useful in various applications in computer vision and robotics, including stereo matching and 3D reconstruction, stereoscopy synthesis, saliency detection, surveillance, recognition, etc. There has been also useful and interesting research in several geometrical aspects of light field cameras such as calibration.