Temporally Consistent Disparity Maps from Uncalibrated Stereo Videos

Abstract

We address the problem of computing a sequence of dense disparity maps from two synchronized video streams recorded by slightly displaced cameras. Generating such disparity videos is becoming increasingly important in the light of new autostereoscopic displays and novel viewpoint applications. We propose a good-quality, computationally fast and easy-to-use solution to accomplish this task. This paper describes the four major steps of our 2D to 3D video conversion procedure. (1) The user segments the video into its scenes. (2) For each scene, we rectify the uncalibrated stereo pairs so that correspondences lie on the same horizontal scanline. (3) A fast and accurate dynamic programming-based stereo matcher is then applied to compute a dense disparity map for each stereo pair. (4) We perform temporal smoothing on the computed disparity sequence to reduce the disparity flickering problem. All of these functionalities can be accessed via an easy-to-use Graphical User Interface, which makes our conversion procedure applicable even for technical unskilled users. We demonstrate the good quality of our results using various challenging real-world stereo streams.

Reference

M. Bleyer, M. Gelautz: "Temporally Consistent Disparity Maps from Uncalibrated Stereo Videos"; Talk: International Symposium on Image and Signal Processing and Analysis 2009, Salzburg; 09-16-2009 - 09-18-2009; in: "Proceedings of the 6th International Symposium on Image and Signal Processing and Analysis (ISPA 2009), Special Session on Stereo Analysis and 3D Video/TV", IEEE, (2009), 5 pages.

BibTeX

@inproceedings{TUW-181920, author = {Bleyer, Michael and Gelautz, Margrit}, title = {Temporally Consistent Disparity Maps from Uncalibrated Stereo Videos}, booktitle = {Proceedings of the 6th International Symposium on Image and Signal Processing and Analysis (ISPA 2009), Special Session on Stereo Analysis and 3D Video/TV}, year = {2009}, publisher = {IEEE}, numpages = {5}, url = {http://publik.tuwien.ac.at/files/PubDat_181920.pdf}, note = {Vortrag: International Symposium on Image and Signal Processing and Analysis 2009, Salzburg; 2009-09-16 -- 2009-09-18} } Click into the text area and press Ctrl+A/Ctrl+C or ⌘+A/⌘+C to copy the BibTeX into your clipboard… or download the BibTeX.