ATTENTION: This is a web archive! The IMS Group was split up in 2018 and does not exist anymore. Recent work of former members can be found at the VR/AR Group and the Computer Vision Group.

Interactive Media Systems, TU Wien

Evaluating RGB+D Hand Posture Detection Methods for Mobile 3D Interaction

By Daniel Fritz, Annette Mossel, and Hannes Kaufmann

Abstract

In mobile applications it is crucial to provide intuitive means for 2D and 3D interaction. A large number of techniques exist to support a natural user interface (NUI) by detecting the user´s hand posture in RGB+D (depth) data. Depending on a given interaction scenario, each technique hast its advantages and disadvantages. To evaluate the performance of the various techniques on a mobile device, we conducted a systematic study by comparing the accuracy of five common posture recognition approaches with varying illumination and background. To be able to perform this study, we developed a powerful hard- and software framework that is capable of processing and fusing RGB and depth data directly on a handheld device. Overall results reveal best recognition rate of posture detection for combined RGB+D data at the expense of update rate. Finally, to support users in choosing the appropriate technique for their specific mobile interaction task, we derived guidelines based on our study.

Reference

D. Fritz, A. Mossel, H. Kaufmann: "Evaluating RGB+D Hand Posture Detection Methods for Mobile 3D Interaction"; Talk: 16th International Conference and Exibition on Virtual Technologies, Laval, France; 04-09-2014 - 04-11-2014; in: "Proceedings of the 16th International Conference of Virtual Technologies (VRIC'14)", ACM, (2014), ISBN: 978-1-4503-2626-1.

BibTeX

Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.