Interactive video advertising: A multimodal affective approach

Abstract

Online video advertising (video-in-video) strategies are typically agnostic to the video content (ex.: advertising on YouTube) and the human viewer's preferences. How to assess the emotional state and engagement of the viewer to place an advertisement? Where to insert an advertisement based on the content in an advertisement and a specific target video stream? Surely these are relevant questions that should be addressed by a good model for video advertisement placement. In this paper, we propose a novel framework to address two important aspects of (a) multi-modal affective analysis of video content and viewer behavior (b) a method for interactive personalized advertisement insertion for a single user. Our analysis and framework is backed by a systematic study of literature in marketing, consumer psychology and affective analysis of videos. Results from the user-study experiments demonstrate that the proposed method performs better than the state-of-the-art in video-in-video advertising. © Springer-Verlag 2013.