Multimedia content classification using motion and audio information

Abstract

Content-based video segmentation and classification is a key to the success of future multimedia databases. Research in this area in the past several years has focused on the use of speech recognition and image analysis techniques. As a complimentary effort to prior research, we have focused on the use of motion and audio characteristics. Fundamental to both segmentation and classification tasks is the characterization by certain features of a given video segment. In this paper, we describe several audio and motion features that have been found to be effective in distinguishing motion and audio characteristics of different types of scenes.