Streaming and Exploration of Dynamically Changing Dense 3D Reconstructions in Immersive Virtual Reality

By Annette Mossel and Manuel Kröter

Abstract

We introduce a novel framework that enables large-scale dense 3D scene reconstruction, data streaming over the network and immersive exploration of the reconstructed environment using virtual reality. The system is operated by two remote entities, where one entity - for instance an autonomous aerial vehicle - captures and reconstructs the environment as well as transmits the data to another entity - such as human observer - that can immersivly explore the 3D scene, decoupled from the view of the capturing entity. The performance evaluation revealed the framework´s capabilities to perform RGB-D data capturing, dense 3D reconstruction, streaming and dynamic scene updating in real time for indoor environments up to a size of 100m2, using either a state-of-the-art mobile computer or a workstation. Thereby, our work provides a foundation for enabling immersive exploration of remotely captured and incrementally reconstructed dense 3D scenes, which has not shown before and opens up new research aspects in future.

Reference

A. Mossel, M. Kröter: "Streaming and Exploration of Dynamically Changing Dense 3D Reconstructions in Immersive Virtual Reality"; Poster: 15th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Meriada, Mexico; 09-19-2016 - 09-23-2016; in: "Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR)", (2016), ISBN: 978-1-5090-3740-7; 43 - 48.

BibTeX

@inproceedings{TUW-250044,     author = {Mossel, Annette and Kr{\"o}ter, Manuel},     title = {Streaming and Exploration of Dynamically Changing Dense 3D Reconstructions in Immersive Virtual Reality},     booktitle = {Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR)},     year = {2016},     pages = {43--48},     url = {http://publik.tuwien.ac.at/files/PubDat_250044.pdf},     isbn = {978-1-5090-3740-7},     doi = {10.1109/ISMAR-Adjunct.2016.0035},     keywords = {Dense 3D Reconstruction, Immersive Exploration, Streaming, Virtual Reality},     note = {poster presentation: 15th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Meriada, Mexico; 2016-09-19 -- 2016-09-23} } Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.