Event detection in soccer video based on audio/visual keywords

Abstract

In this thesis, we propose a multi-modal two-level event detection framework and demonstrate it on soccer videos. We use a mid-level representation called Audio and Visual Keyword (AVK) that can be learned and detected in video segments. AVKs are intended to summarize the video segment in the text form and each of them has its semantic meaning. In our thesis, nine visual keywords and three audio keywords are defined and classified to facilitate highlight detection in soccer videos. Based on AVK, a two-level computational system that realizes the framework achieves good performance on soccer video event detection.