Depth Recovery with Rectification using Single-Lens Prism based Stereovision System

Abstract

This thesis aims to study the depth recovery of a 3D scene using a single-lens stereovision system with prism (filter). A geometry-based approach has been proposed to solve stereo vision rectification issue of the stereovision in this work which involves virtual cameras. This approach eliminates the usual complicated calibration process. It has also been generalized to a single-lens based multi-ocular stereovision system. Next, an algorithm of segment-based stereo matching using cooperative optimization to extract the disparities information from stereo image pairs is proposed. In addition, the algorithm for multi-view stereo matching has been developed, which is generalized from the two views stereo matching approach. The experimental results demonstrate that our approach is effective in this endeavour. Finally, a triangulation algorithm was employed to recover the 3D depth of a scene.