ATTENTION: This is a web archive! The IMS Group was split up in 2018 and does not exist anymore. Recent work of former members can be found at the VR/AR Group and the Computer Vision Group.

Interactive Media Systems, TU Wien

Media Processing

Contact: Horst Eidenberger

Our ultimate media processing goal is human-like understanding of multimedia content. We extract semantically relevant patterns from audio, biosignals, images, text, video and other data types and set them into context by intelligent categorization.

Completed

Research Projects

Deep Learning for Optical Music Recognition Deep Learning for Optical Music Recognition   (“DeepOMR”)
A. Pacha — March 2017 to February 2020 • Keywords: Music, Document Analysis, Computer Vision, Machine Learning, Deep Learning, Pattern Recognition
Optical Music Recognition (OMR) aims at automatically processing written music scores, comparable to Optical Character Recognition for text, but…

Unusual sequences detection in very large video collections Unusual sequences detection in very large video collections   (“FAMOUS”)
M. Rohm — October 2012 to September 2016 • Keywords: video data mining, Outlier detection, unusual sequence detection, Media analysis
Large media repositories are often facing large additions of new material with no prior knowledge about the content. The screening, assessment, and…

MobiGuide: Guiding Patients Anytime Everywhere MobiGuide: Guiding Patients Anytime Everywhere
Silvia Miksch — November 2011 to October 2015 • Keywords: clinical Decision-Support Systems, Computer-Interpretable Guidelines, Body Area Networks, Personalized Medicine, Information Visualization, Personal Health Record, Monitoring Devices, Visual Analytics
MobiGuide (MG) will develop a patient guidance system that integrates hospital and monitoring data into a Personal Health Record (PHR) accessible by…

Support for Authoring and Transformation of Clinical Guidelines and Protocols Support for Authoring and Transformation of Clinical Guidelines and Protocols   (“Brigid”)
K. Kaiser — November 2010 to October 2015 • Keywords: Clinical Practice Guidelines, Information Extraction, Knowledge Modelling
Clinical guidelines and protocols (CGPs) are promising means to improve the quality of health care. Supporting their application by computer systems…

Automatic Analysis of Elephant Vocalizations Automatic Analysis of Elephant Vocalizations   (“Elevoc”)
C. Breiteneder — February 2011 to January 2015 • Keywords: Multimodal content-based analysis, automatic monitoring, bioacoustics, vocal communication, elephants
The decline of habitat for elephants as a result of expanding human activity combined with increasing elephant numbers in spatially separated…

Intelligent Video Annotation and Retrieval Techniques Intelligent Video Annotation and Retrieval Techniques   (“IV-ART”)
H. Eidenberger — September 2009 to August 2012 • Keywords: Video Annotation, Video Retrieval, Image Descriptor
Although content based image and video analysis have been used successfully to solve a set of real world tasks in recent years, approaches to employ…

Digital Formalism - The Vienna Vertov Collection Digital Formalism - The Vienna Vertov Collection
C. Breiteneder — February 2007 to July 2010 • Keywords: video analysis, Dziga Vertov, formalism
Digital Formalism: The Vienna Vertov Collection focuses on the computer-aided digital analysis of the senses of cinema. On the foundation of…

Information Extraction from Evidence-Based Guidelines Information Extraction from Evidence-Based Guidelines   (“EviX”)
Silvia Miksch — January 2006 to November 2009 • Keywords: Information Extraction, Clinical Guidelines and Protocols, Evidence-Based Medicine
The goal of the proposed project is the experimental application and further development of promising approaches in the area of semi-automatic…

VizIR - A Framework for Visual Information Retrieval VizIR - A Framework for Visual Information Retrieval
H. Eidenberger — March 2003 to February 2006 • Keywords: Visual Information Retrieval
The project VizIR - A Framework for Visual Information Retrieval, submitted by the Institute of Software Technology and Interactive Systems at the…

Lab Projects

Semantic Multimodal TU Information System Semantic Multimodal TU Information System   (“mplTIS2”)
H. Eidenberger — December 2015 to December 2020
Enhance the existing TU Wien information system TISS by semantic and multimodal components, including but not limited to, semantic search over all…

Audio Analysis and Authoring Audio Analysis and Authoring   (“mplAudio”)
H. Eidenberger — July 2000 to December 2019 • Keywords: Audio Retrieval, Speech Processing, Sound Recognition, Music Analysis
The audio analysis and authoring project comprises all our efforts in the area of audio signal processing and categorization. Projects range from…

Biosignal Understanding Biosignal Understanding   (“mplBiosignal”)
H. Eidenberger — January 2004 to December 2019 • Keywords: Brain Computer Interface, EEG, EMG, Noise Mesurement
Biosignal processing activities in the IMS group range from mental cursor control over various applications for the brain computer interface to the…

Geographical Media Systems Geographical Media Systems   (“mplGeomedia”)
H. Eidenberger — January 2000 to December 2019 • Keywords: Location-Based Services, Gemedia Referencing, Map-Based Sonfication
The Geomedia project summarizes our efforts in the area of location-based media presentation, summarization and referencing. Tasks range from classic…

Machine Learning for Multimedia Understanding Machine Learning for Multimedia Understanding   (“mplLearning”)
H. Eidenberger — January 1998 to December 2019 • Keywords: Limits of Categorization, Psychophysics, Similarity Modeling, Kernel-Based Learning
The machine learning activities of the media processing group derive from the necessity to classify media objects described by signal processing in…

Media Authoring and Production Media Authoring and Production   (“mplAuthoring”)
H. Eidenberger — January 2002 to December 2019 • Keywords: Mobile Apps, Media Storage, Media Applications, Media Production
In this project, we endeavor to frame media content with application design, thus giving interactivity to the per se passive content. Typical…

Media Programming and Transport Media Programming and Transport   (“mplProgramming”)
H. Eidenberger — July 2000 to December 2019 • Keywords: Mobile Media Programming, Sensor Control, Evaluation Databases, Programming Environments, Streaming
The media processing team of the IMS group has collected expertise in the area of media programming and transport for almost two decades. Programming…

Multimedia Gaming Multimedia Gaming   (“mplGaming”)
H. Eidenberger — January 2003 to December 2019 • Keywords: Gaming Apps, Strategy Gaming, Media Games for Children, Multimedia Storytelling
Multimedia and gaming are two areas as closely linked in science as in practical application. The IMS has always endeavored to provide multimedia in…

Text Understanding Text Understanding   (“mplText”)
H. Eidenberger — January 2004 to December 2019 • Keywords: Text Retrieval, Autmated Translation, Natural Language Processing
Text is a traditional source for information retrieval applications. At the IMS we develop solutions for selected (domain-specific) text…

Visual Media Analysis Visual Media Analysis   (“mplVisual”)
H. Eidenberger — January 1998 to December 2019 • Keywords: Video Summrization, Scene Classification, Visual Retrieval, Image Understanding, Big Media Data
Visual media analysis is the central activity of the media processing subgroup at the IMS. Expertise has been gained since the mid 1990ies. Today,…

Forensic Media Analysis Forensic Media Analysis   (“mplForensic”)
H. Eidenberger — January 2002 to January 2019 • Keywords: Biometric Face Analysis, Voice Identification, Forensic Video Recording, Limits of Biometric Recognition
The media processing group of the IMS is highly active in the application and further development of solutions for forensic audio and video analysis.…

TU Fly Into the Future TU Fly Into the Future   (“mplTUFly”)
H. Eidenberger — April 2015 to October 2016 • Keywords: Virtual Reality, Immersion, Virtual Flying, Immersive Virtual Reality, Virtual Space Walk, Virtual Diving
The focus of this project is real flying through virtual worlds, where the applications are not just bird flight, but as well diving along virtual…

TU Jump Into The Future TU Jump Into The Future   (“VirtualJumpSimulator”)
H. Eidenberger — September 2014 to April 2015 • Keywords: Virtual Reality, Immersion, Virtual Parachute Jump, Immersive Virtual Reality, 3D City Model
Within the project "TU Jump Into The Future", a Virtual Jump Simulator (VJS) was developed that allows users to perform a virtual parachute jump over…