ATTENTION: This is a web archive! The IMS Group was split up in 2018 and does not exist anymore. Recent work of former members can be found at the VR/AR Group and the Computer Vision Group.

Interactive Media Systems, TU Wien

Does Color Really Help in Dense Stereo Matching?

By Michael Bleyer and Sylvie Chambon

Abstract

This paper investigates the role of color in global stereo matching approaches. In our evaluation study, we build various energy functions by combining nine color spaces with four dissimilarity functions and test their performance on 30 ground truth stereo pairs. Our experiments start by computing the matching scores via the absolute difference of color values. As is consistent with previous studies, we observe that color-based matching clearly outperforms grey-scale matching. However, our key observation is that this improvement largely stems from considerably improved performance in radiometric distorted regions, i.e. regions where corresponding pixels have different intensities/colors in the two input images, which is e.g. caused by illumination variations. Hence, we claim that color basically serves the same purpose as radiometric insensitive measures, namely to reduce matching errors in radiometric distorted image areas. However, the important difference is that radiometric insensitive measures are considerably superior in this respect, which we demonstrate by using Mutual Information, ZNCC and Census as dissimilarity functions in our experiments. Interestingly, we observe that for these dissimilarity functions color even has a negative effect. Therefore, our suggestion is to not use color at all, but radiometric insensitive measures on grey-scale images, also on images where radiometric distortions seem to be very small.

Reference

M. Bleyer, S. Chambon: "Does Color Really Help in Dense Stereo Matching?"; Talk: International Symposium 3D Data Processing, Visualization and Transmission (3DPVT) 2010, Paris, France; 05-17-2010 - 05-20-2010; in: "International Symposium 3D Data Processing, Visualization and Transmission (3DPVT) 2010", (2010), 1 - 8.

Additional Information

Presentation slides are available for download as PDF and PPTX.

Downloads

Does Color Really help 1.33 MB PDF document Download
Does Color Really Help PPT 3.05 MB PowerPoint 2007 presentation Download

BibTeX

Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.