SPATIAL SENSOR DATA PROCESSING AND ANALYSIS FOR MOBILE MEDIA APPLICATIONS

Abstract

Currently, an increasing number of user-generated videos are collected and uploaded to the Web -- a trend that is driven by the ubiquitous availability of smartphones. With these sensor-equipped mobile devices, various spatial sensor data (e.g., data from GPS, digital compass, etc.) can be continuously acquired in conjunction with any captured video stream. The collected spatial sensor information becomes a useful contextual feature to facilitate multimedia analysis and management in diverse media applications. Most sensor information collected from mobile devices, however, is not highly accurate. In this dissertation we enhance the accuracy of such noisy sensor data -- the location and orientation of a camera -- generated by smartphones during video recording. After more accurate sensor data is obtained, we further investigate the possibility of applying sensor data analysis techniques to mobile systems and applications, such as key frame selection for 3D model reconstruction, camera motion characterization and video encoding.