Content-based video summarization to Object Maps

Thesis by Manuel Martos

Abstract

The amount of digital video content available in the web is constantly increasing. Its handling requires efficient technologies: text search on large databases provides users a great amount of videos; the content results are accessible by a description. Users need a fast and visual way to access relevant video content effectively. Quick visualization of content using static image summarization is a sophisticated problem. However, it is worth it because it may solve video navigation problems. Users can very rapidly get an idea of the video with no need to browse through it with a sliding bar as normally done. In this work a system for automatic video summarization is developed. It creates an object map the segments of which are extracted from an input video. It allows enhancing video browsing and large video databases management generating a visual index so that the user can rapidly grasp the most relevant content. Finally, accessing them with a simple action requires several technologies that define a complex information processing. Firstly, shot boundary detection algorithms are required to reduce time redundancy of the video. Secondly, different relevant objects are extracted from each keyframe (faces, cars, etc.). We also describe a workflow to train detection models using multiple open source solutions. Furthermore, faces are a particular and very relevant semantic class. For this reason, we use clustering methods in order to recognize them in an unsupervised recognition process. The image composition of all selected objects and faces is the final stage of the architecture. Composition is defined as the combination of distinct parts to form a whole, therefore, objects have to be rendered in the map in a visually attractive manner. To validate our approach and assess end-user satisfaction, we conducted a user study in which we compare requirements collected by analyzing related literature. We analyze redundancy and informativeness as well as pleasantness. The results show that our approach effectively creates an image representation for videos and is able to summarize customizable content in an attractive way.

Reference

M. Martos: "Content-based video summarization to Object Maps"; Supervisor: H. Eidenberger; Softwaretechnik und Interaktive Systeme, 2013.

BibTeX

@mastersthesis{TUW-224066, author = {Martos, Manuel}, title = {Content-based video summarization to Object Maps}, school = {Softwaretechnik und Interaktive Systeme}, year = {2013} } Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.