Please use this identifier to cite or link to this item:
Title: Automatic tag generation and ranking for sensor-rich outdoor videos
Authors: Shen, Z.
Ay, S.A. 
Kim, S.H.
Zimmermann, R. 
Keywords: Geospatial
Location sensors
Mobile video
Video tags
Issue Date: 2011
Citation: Shen, Z.,Ay, S.A.,Kim, S.H.,Zimmermann, R. (2011). Automatic tag generation and ranking for sensor-rich outdoor videos. MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops : 93-102. ScholarBank@NUS Repository.
Abstract: Video tag annotations have become a useful and powerful feature to facilitate video search in many social media and web applications. The majority of tags assigned to videos are supplied by users - a task which is time consuming and may result in annotations that are subjective and lack precision. A number of studies have utilized content-based exraction techniques to automate tag generation. However, these methods are compute-intensive and challenging to apply across domains. Here, we describe a complementary approach for generating tags based on the geographic properties of videos. With today's sensor-equipped smartphones, the location and orientation of a camera can be continuously acquired in conjunction with the captured video stream. Our novel technique utilizes these sensor meta-data to automatically tag outdoor videos in a two step process. First, we model the viewable scenes of the video as geometric shapes by means of its accompanied sensor data and determine the geographic objects that are visible in the video by querying geo-information databases through the viewable scene descriptions. Subsequently we extract textual information about the visible objects to serve as tags. Second, we define six criteria to score the tag relevance and rank the obtained tags based on these scores. Then we associate the tags with the video and the accurately delimited segments of the video. To evaluate the proposed technique we implemented a prototype tag generator and conducted a user study. The results demonstrate significant benefits of our method in terms of automation and tag utility. © 2011 ACM.
Source Title: MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops
ISBN: 9781450306164
DOI: 10.1145/2072298.2072312
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.