Joint spatial-temporal alignment of networked cameras

Abstract

In this paper, we propose a method for aligning networked cameras spatially and temporally. Synchronizing video sequences and recovering spatial information among cameras are crucial steps for applications such as robust tracking and video mosaic. Without prior knowledge of internal and external parameters of cameras, we attempt to automatically estimate their spatial relationship and time offset which is possibly caused by network transmission delay. Our main focus is on cameras with overlapping field of views. Exploiting the fact that spatial and temporal information are related, we use one to boost the other. Initially assuming no time delay, the homography between cameras can be estimated by motion detection. Based on the homography, time difference can thus be recovered by analyzing activities in overlapping regions. We iteratively use spatial and temporal information to boost each other till reaching converging criteria. The algorithm can be extend to finding spatial and temporal relationship in multiple cameras. The experiment is performed in an outdoor parking lot and it is showed that our algorithm can successfully align cameras both in space and time.