Media handling for visual information retrieval in VizIR

Abstract

This paper describes how the handling of visual media objects is implemented in the visual information retrieval project VizIR. Essentially, four areas are concerned: media access, media representation in user interfaces, visualisation of media-related data and media transport over the network. The paper offers detailed technical descriptions of the solutions developed in VizIR for these areas. Unified media access for images and video is implemented through class MediaContent. This class contains methods to access the view on a media object at any point in time as well as methods to change the colour model and read/write format parameters (size, length, frame-rate). Based on this low-level-API class VisualCube allows accessing spatio-temporal areas in temporal media randomly. Transformer-classes allow to modify visual objects in a very simple but effective way. Visualisation of media object is implemented in class MediaRenderer. Each MediaRenderer represents one media object and is responsible for any aspect of its visualisation. In the paper examples for reasonable implementations of MediaRenderer-classes are presented. Visualisation of media-related data is strongly connected to MediaRenderer. MediaRenderer is to a large extent responsible for displaying visual panels created by other framework components. Finally, media object transport in VizIR is based on the Realtime Transfer Protocol (for media objects) and XML-messaging (for XML-data).

Reference

H. Eidenberger: "Media handling for visual information retrieval in VizIR"; in: "Visual Communications and Image Processing", SPIE, 2003, ISBN: 0819450235.

BibTeX

@incollection{TUW-137419, author = {Eidenberger, Horst}, title = {Media handling for visual information retrieval in VizIR}, booktitle = {Visual Communications and Image Processing}, year = {2003}, publisher = {SPIE}, url = {http://www.ims.tuwien.ac.at/~hme/}, isbn = {0819450235}, keywords = {VizIR, Visual Information Retrieval, Content-based Image Retrieval, Content-based Video Retrieval, Media Handling, Media Processing, Video Visualisation, Java Media Framework} } Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.