Einsatz von Augmented Reality zur Abnahme und Qualitätssicherung auf Baustellen   (“AR-AQ-BAU”)
H. Kaufmann — October 2018 to September 2020
The aim of this research project is the development of a construction site-suitable augmented reality (AR) system for improving the quality of…

Systematic Evaluation for AR Controllers   (“EvaluARte”)
H. Kaufmann — August 2017 to July 2019 • Keywords: Augmented Reality, 3D Interaction, AR Controller, UI Widget, AR Displays
Augmented Reality (AR) glass users have a direct view of the real environment while computer-generated information is superimposed on the…

Realistic Indoor Path Visualization with Real-Time Obstacle Avoidance in Augmented Reality   (“ARPathVis”)
H. Kaufmann — March 2016 to August 2018 • Keywords: Indoor Navigation, Augmented Reality, Mobile Devices
Accurate navigation systems for large indoor environments utilizing visual features, which are able to provide real time 3D positions and rotations,…

Virtual Simulation and On-Site Training for First Responders   (“VR on-site”)
H. Kaufmann — July 2015 to December 2017 • Keywords: Virtual Reality, Immersive, First Responders, Training, Multi-User, Collaboration
The project’s goal is to develop and evaluate the first fully mobile, generic, multi-user immersive virtual reality platform to train squad leaders…

Flexible Spaces: Dynamic Layout Generation for Infinite Walking in Virtual Environments
H. Kaufmann — December 2011 to December 2017 • Keywords: Virtual Reality, Redirected Walking, Impossible Spaces, Change Blindness
Redirected walking techniques enable natural locomotion through immersive virtual environments (VEs) that are larger than the real world workspace.…

Automated Architectural 3D Model Generation for Virtual Reality Walk-Through   (“Virtual Architect”)
H. Kaufmann — July 2015 to June 2017
This project addresses the interactive virtual exploration of buildings. Virtual walkthroughs of property are becoming increasingly popular in the…

Material Reconstruction and High Quality, Angle-Dependent Real-Time Visualization on Mobile Devices   (“MobileBRDF”)
H. Kaufmann — January 2014 to December 2015
The quality of synthetic, photorealistic images depends crucially on the quality of the materials that are used and shown. A customer expects…

Multimodal Feedback for Supporting Gestural Interaction in Smart Environments   (“Life-Stage”)
H. Kaufmann — January 2014 to December 2015
The smart environments of our future ubiquitous computing era need to deliver their users with appropriate interfaces that go beyond today’s standard…

Virtual Reality Training for CBRN-Defense and First Responders   (“VR-Defensetraining”)
A. Mossel, H. Kaufmann — October 2014 to September 2015 • Keywords: Virtual Reality, Training, CBRN-Defense
In this project we investigate how Virtual Reality (VR) technologies can be utilized to enhance the quality of training, reduce costs and increase…

Development of a Didactic Concept for Modern 3D Geometry Teaching Materials   (“GEODIKON”)
H. Kaufmann — November 2012 to December 2014 • Keywords: Geometry Education, teaching materials, Spatial Abilities
In GEODIKON we work on a didactic and methodic design of modern 3D geometry teaching material, especially for mathematics courses and "Linear…

High-Quality Real-Time Global Illumination in Augmented Reality   (“RayEngine”)
P. Kán — January 2010 to December 2014 • Keywords: Augmented Reality, High-quality rendering, Photorealistic rendering, Visual coherence
In this research we aim to examine using high-quality rendering techniques in augmented reality scenario. We use ray-tracing based rendering to…

Mobile Hybrid Tracking in Large and Changing Interior Spaces   (“HyMoTrack”)
H. Kaufmann — January 2013 to December 2014 • Keywords: light field camera, mobile tracking, SLAM
The goal of this project is to develop a hybrid indoor tracking system for mobile devices like smartphones or tablets. The system will be…

Conceptional Development of image recognition engine for outdoor 3D objects on smartphones   (“MusketIR”)
H. Kaufmann — February 2013 to October 2014 • Keywords: Mobile Tracking, Large Scale Tracking, 3D Outdoor Object Recognition, SLAM
The goal of this project is not only to track, but also to recognize 3 dimensional structures in open space with the use of devices like smartphones…

Evaluation of Modular Actuated Tangible User Interfaces   (“ACTO”)
H. Kaufmann — September 2012 to September 2014 • Keywords: tabletop interaction, widgets, haptics, actuation, prototyping platform, Tangible User Interfaces
"Tangible Computing" is an active area of research in the field of human-computer-interaction. Its intention is the design of intuitive and…

A Framework for the Design and Development of Multimodal Interaction on Tabletops   (“MINT”)
T. Pintaric — January 2009 to December 2012 • Keywords: Multi-touch, Gesture-based Interaction Framework, Infrared Optical Tracking
Innerhalb des MINT-Projekts sollen neuartige Methoden zur Generalisierung komplexer Interaktionstechniken mit speziellem Fokus auf Gesten-basierte…

Real-time Tunneling Measurement based on Infrared Optical Tracking   (“RTMIOT”)
A. Mossel — January 2009 to December 2012 • Keywords: Tunnel Measurement System, Realtime Infrared Optical Tracking
This project develops a system to perform tunneling measurement in real time based on optical infrared tracking. This stereo measurement system,…

Virtual Reality Training for Upper Limb Prosthesis Patients   (“Arm Prosthesis”)
H. Kaufmann — January 2011 to October 2012 • Keywords: Virtual Reality, Virtual Rehabilitation, Serious Gaming, 6DOF Interaction, Bio Sensor, ARTiFICe, iotracker
The initial fitting of an upper limb prosthesis can be a frustrating experience for amputees, impairing the learning of prosthesis control.…

ProFiTex - Providing Fire Fighters with Technology for Excellent Work Safety
H. Kaufmann — October 2009 to September 2012 • Keywords: work safety, protective clothing, Fire brigade, textile-based system, emergency responders, personal protective equipment
The aim of project ProFiTex is to support fire fighters in their perilous work with a system that supplies mission-relevant information without…

Visual Tracking in historical buildings   (“Hofburg Tracking”)
H. Kaufmann — October 2011 to August 2012 • Keywords: Tracking, Historical Buildings, Optical Tracking
Gegenstand des geförderten Vorhabens ist die Entwicklung und Implementierung eines neuartigen Algorithmus für mobile Endgeräte zur genauen…

Playmancer
H. Kaufmann — January 2007 to December 2011 • Keywords: Serious Gaming, Motion Capturing, Virtual Reality Rehabilitation, Infrared Optical Tracking
PlayMancer will implement a new Serious Game environment by augmenting existing 3D gaming engines with new possibilities. The objectives of the…

Immersive interface technologies for life-cycle human-oriented activities in interactive aircraft-related virtual products   (“Vision”)
C. Breiteneder — November 2008 to June 2011 • Keywords: interaction, Visualization, virtual cockpit, virtual cabin, immersion
Although Virtual Reality (VR) has demonstrated a significant potential for interactive applications on product and process development, the proven…

Affordable Infrared-Optical Pose Tracking   (“iotracker”)
T. Pintaric — January 2005 to December 2010 • Keywords: Augmented Reality, Virtual Reality, 6-DoF Tracking, Realtime
iotracker is a new low-cost infrared-optical pose-tracking system for room-sized virtual environments. The system consists of 4-8…

Studierstube - A Collaborative Augmented Reality System
D. Schmalstieg — January 1996 to December 2009 • Keywords: Studierstube, Augmented Reality, Distributed Systems, User Interfaces
Studierstube is the study room where Goethe's famous character, Faust, tries to acquire knowledge and enlightenment. We chose this term as the…

Development of an Augmented-Reality Dynamic Spatial Test   (“ARST”)
H. Kaufmann — November 2006 to October 2009 • Keywords: training, Spatial Abilities, Dynamic Testin, Augmented Reality, Item-Response-Models
In the proposed project we intend to develop a new type of test for the assessment of spatial abilities that differs from conventional spatial…

Construct3D - An Augmented Reality System for Mathematics and Geometry Education
H. Kaufmann — January 1999 to December 2008 • Keywords: Studierstube, Augmented Reality, Applications
Construct3D is a three dimensional geometric construction tool based on the collaborative augmented reality system "Studierstube". Our setup uses a…

Seminar: Virtual Reality Systems for Psychology   (“Joint Seminar”)
H. Kaufmann — September to November 2008 • Keywords: Virtual Reality, Spatial Abilities, Virtual Reality in Education, Virtual Reality in Therapy, Psychology
The aim of the bilateral seminar is to report ongoing work and projects, to exchange views and specify directions of future joint work. The focus of…

Development of Opitcal Tracking-System   (“Tracking-System”)
C. Breiteneder — January to December 2006 • Keywords: High speed cameras, Infrared Optical Tracking, Computer vision software
In this project we develop and improve an infrared-optical tracking system and the according tracking software in order to track multiple targets in…

Geometrie content with Construct3D   (“Construct3D-Lernmodule”)
C. Breiteneder — December 2005 to August 2006 • Keywords: Virtual Reality, Augmented Reality, Construct 3D, Geometry
Erstellung von Geometrieinhalten für den Unterricht in Darstellender Geometrie in Virtual Reality mit Construct 3D

Educating Spatial Intelligence in Augmented Reality   (“Spatial Abilities”)
H. Kaufmann, C. Breiteneder — January 2003 to December 2005 • Keywords: Spatial Abilities, Augmented Reality, Studierstube, Construct3D
Spatial abilities present an important component of human intelligence. Many studies have shown that spatial abilities can be improved by…

Mobile Collaborative Augmented Reality   (“MCAR”)
D. Schmalstieg — January 2000 to December 2003 • Keywords: Studierstube, Augmented Reality, Distributed Systems, Mobile Computing
Mobile computing is naturally complemented by Augmented Reality (AR), which superimposes computer-generated images onto a user's perception of the…

Deep Learning for Optical Music Recognition   (“DeepOMR”)
A. Pacha — March 2017 to February 2020 • Keywords: Music, Document Analysis, Computer Vision, Machine Learning, Deep Learning, Pattern Recognition
Optical Music Recognition (OMR) aims at automatically processing written music scores, comparable to Optical Character Recognition for text, but…

Unusual sequences detection in very large video collections   (“FAMOUS”)
M. Rohm — October 2012 to September 2016 • Keywords: video data mining, Outlier detection, unusual sequence detection, Media analysis
Large media repositories are often facing large additions of new material with no prior knowledge about the content. The screening, assessment, and…

MobiGuide: Guiding Patients Anytime Everywhere
Silvia Miksch — November 2011 to October 2015 • Keywords: clinical Decision-Support Systems, Computer-Interpretable Guidelines, Body Area Networks, Personalized Medicine, Information Visualization, Personal Health Record, Monitoring Devices, Visual Analytics
MobiGuide (MG) will develop a patient guidance system that integrates hospital and monitoring data into a Personal Health Record (PHR) accessible by…

Support for Authoring and Transformation of Clinical Guidelines and Protocols   (“Brigid”)
K. Kaiser — November 2010 to October 2015 • Keywords: Clinical Practice Guidelines, Information Extraction, Knowledge Modelling
Clinical guidelines and protocols (CGPs) are promising means to improve the quality of health care. Supporting their application by computer systems…

Automatic Analysis of Elephant Vocalizations   (“Elevoc”)
C. Breiteneder — February 2011 to January 2015 • Keywords: Multimodal content-based analysis, automatic monitoring, bioacoustics, vocal communication, elephants
The decline of habitat for elephants as a result of expanding human activity combined with increasing elephant numbers in spatially separated…

Intelligent Video Annotation and Retrieval Techniques   (“IV-ART”)
H. Eidenberger — September 2009 to August 2012 • Keywords: Video Annotation, Video Retrieval, Image Descriptor
Although content based image and video analysis have been used successfully to solve a set of real world tasks in recent years, approaches to employ…

Digital Formalism - The Vienna Vertov Collection
C. Breiteneder — February 2007 to July 2010 • Keywords: video analysis, Dziga Vertov, formalism
Digital Formalism: The Vienna Vertov Collection focuses on the computer-aided digital analysis of the senses of cinema. On the foundation of…

Information Extraction from Evidence-Based Guidelines   (“EviX”)
Silvia Miksch — January 2006 to November 2009 • Keywords: Information Extraction, Clinical Guidelines and Protocols, Evidence-Based Medicine
The goal of the proposed project is the experimental application and further development of promising approaches in the area of semi-automatic…

VizIR - A Framework for Visual Information Retrieval
H. Eidenberger — March 2003 to February 2006 • Keywords: Visual Information Retrieval
The project VizIR - A Framework for Visual Information Retrieval, submitted by the Institute of Software Technology and Interactive Systems at the…

Doctoral College TrustRobots   (“TrustRobots”)
M. Gelautz — September 2018 to August 2021 • Keywords: robotcs, computer vision, human motion, motion capture, embodiment
The main objectives of this DC are (i) to analyse the phenomenon of trust in robots in a transdisciplinary research project from different…

Advanced Vision-Based Sensing for Aerial Vehicles   (“AVIS”)
M. Gelautz — April 2015 to December 2020
The small, low-cost design and easy handling of advanced unmanned aerial vehicles (UAV - unmanned air vehicle) rapidly foster their further…

Combined 3D-Vision and Adaptive Front-Lighting System for Safe Autonomous Driving   (“CarVisionLight”)
M. Gelautz — September 2017 to December 2020
Driven by the trend towards highly automated or even autonomous driving, the automotive industry currently undergoes dramatic changes. The evolution…

Innovative production workflow for precise 3D scene reconstruction   (“Precise3D”)
M. Gelautz — August 2016 to December 2019
The goal of the project is the development of a scalable and cost-efficient workflow for the accurate 3D scanning of film sets and the creation of…

Intelligent Assistant System for Video Production on Mobile Devices   (“PersonalFilmAssistant”)
M. Gelautz — August 2016 to September 2019
Modern mobile devices such as smartphones enable even the most novice user to easily take high quality pictures. Along with technological advances in…

KOROS – Collaborating Robot Systems
M. Gelautz — January 2012 to December 2017 • Keywords: Robotics
Our institute is a member of TU Vienna's KOROS network - an interdisciplinary collaboration between different departments for joint research in the…

Intelligent Workflow Design for Low-Cost 3D Film Production   (“Hyperion3D”)
M. Gelautz — June 2013 to December 2016 • Keywords: Computer Vision, 3D film, Stereo
Goal of Hyperion3D is the development of an intelligent and cost-efficient workflow for producing 3D film content for stereoscopic and multi-view 3D…

3D content creation, coding and transmission over future media networks   (“3D-ConTourNet”)
M. Gelautz — October 2014 to September 2016 • Keywords: 3D Media Network Protocols, 3D Media Coding, 3D Multimedia Services, 3D Quality of Experience, 3D Multimedia Transmission
3D-ConTourNet is a COST Action which undertakes coordinated research collaboration, at European level, in 3D multimedia creation, encoding, delivery…

HDRi: The digital capture, storage, transmission and display of real-world lighting
M. Gelautz — May 2011 to December 2015 • Keywords: Human perception, Image Processing, High Dynamic Range, imaging
The natural world presents our eyes with a wide range of colours and intensities from moonlight to bright sunshine. We can see detail in regions that…

Robust Real-Time Depth Measurement Using Structured Light   (“Robust Depth 3D”)
M. Gelautz — November 2014 to December 2015 • Keywords: structured light, depth measurement
The project "Robust Real-Time Depth Measurement Using Structured Light" explores the current state of the art in Depth Measurement using Structured…

Temporal-Consistent Stereo Matting for High-Quality Novel View Synthesis and Visual Effects   (“3D-TV”)
M. Gelautz — April 2009 to December 2015 • Keywords: video processing, stereo analysis, 3D reconstruction, special effects, image matting
This project develops new image processing techniques for the emerging field of 3D television. On the basis of two videos that are recorded by…

Video Engine Design Methodology Rules   (“VENDOR”)
M. Gelautz — August 2006 to September 2015 • Keywords: video coding, video processing
The rapid increase in integration density on chips sets leads to an increasin amount of complex applications. In modern SoC (System on Chip) designs,…

An industrial implementation of modern inpainting techniques for depth-based 3D film editing   (“PAINT3D”)
M. Gelautz — January 2012 to December 2014 • Keywords: Inpainting, Novel Views, 3D film
The goal of this project is the implementation of a software prototype which enables the adaption of depth perception in 3D films in unprecedented…

High-quality 3D Video by Fusing Active and Passive Sensors   (“3D VideoFusion”)
M. Gelautz — June 2012 to November 2014 • Keywords: 3D video, stereo analysis, Active (TOF, Kinect) sensor, 3D scene reconstruction, sensor fusion, image and video matting
The aim of this project is to develop new technologies for creating high-quality 3D video materials by combining active and passive 3D sensors. The…

3D Scene Completion   (“Complete3D”)
M. Gelautz — October 2011 to October 2014 • Keywords: 3D scene reconstruction, scene geometry, novel view synthesis, 3D scene analysis
Creating 2D or 3D views from a finite set of input images has been a long-standing goal in Computer Vision - this project revisits this fundamental…

Computational Perception   (“CP”)
M. Gelautz — March 2010 to February 2014 • Keywords: Multimodal Scene Perception, Visual Attention and Human Behavior, Object recognition
The perception, interpretation and presentation of our environment using sensors and computer technology, in combination with related communication…

Changes
M. Gelautz — October 2010 to September 2012
The Changes program supports female researchers working on application-oriented research projects that are carried out in collaboration between TU…

Evaluation and Design of Energy Functions for Global Stereo Matching   (“Stereo Matching”)
M. Gelautz — January 2007 to December 2011 • Keywords: Stereo, 3D Reconstruction, Computer Vision, Scene Modeling, Energy Function, Optimization
This project investigates and improves the modelling component of energy minimization techniques for stereo matching. One major contribution is a…

Evaluation of Methods for Generating Virtual Views for 3D Film Material   (“Eva3D”)
M. Gelautz — February to December 2011 • Keywords: 3D cinema, 3D video, Stereo, Virtual views
We evaluate a method for generating virtual views derived from stereoscopic film material regarding the visual quality (e.g. image artifacts) and…

Evaluation of Methods for Live-Webcam-Videoconferencing   (“EvaWeb”)
M. Gelautz — August to December 2011 • Keywords: evaluation, webcam, video conference
Technical evaluation on live webcam videoconferencing systems

Alpha Matting from Single and Multiple Images   (“ALPHAMAT”)
M. Gelautz — January 2006 to December 2009 • Keywords: Matting
This project aims to make a step forward in image matting, by developing novel algorithms and user interaction techniques that meet the requirements…

3D Video Analysis for Interactive Multimedia Applications   (“Video3D”)
M. Gelautz — October 2002 to January 2006
In our project, we concentrate on video processing tasks that arise in the context of interactive multimedia applications. In particular, we…

Image and Video Analysis for Artistic Rendering (VideoArt)   (“VideoArt”)
M. Gelautz — January to December 2004 • Keywords: Image Processing, Video Analysis, Art, Painting, Non-photorealistic Rendering (NPR), Computer Graphics, Visualization
The Hochschuljubiläumsstiftung der Stadt Wien granted a project entitled "Bild- und Videoverarbeitung zur Erzeugung künstlerischer Effekte", which…

Bhutan: Fortress of the Gods
C. Breiteneder — January 1999 to December 2000 • Keywords: Web, Content Management, Database, Lookmarks, Virtual Exhibition
Mit der virtuellen Ausstellung Bhutan: Festung der Götter wurde ein bisher einzigartiges, preisgekröntes Projekt verwirklicht, in dem neue Wege im…