Full Text:   <2639>

CLC number: TN911.73

On-line Access: 2012-06-05

Received: 2011-10-23

Revision Accepted: 2012-02-02

Crosschecked: 2012-05-04

Cited: 3

Clicked: 3678

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
1. Reference List
Open peer comments

Journal of Zhejiang University SCIENCE C 2012 Vol.13 No.6 P.472-482

http://doi.org/10.1631/jzus.C1100311


Accurate real-time stereo correspondence using intra- and inter-scanline optimization


Author(s):  Li Yao, Dong-xiao Li, Jing Zhang, Liang-hao Wang, Ming Zhang

Affiliation(s):  Institute of Information and Communication Engineering, Zhejiang University, Hangzhou 310027, China; more

Corresponding email(s):   zjyaoli@163.com, lidx@zju.edu.cn

Key Words:  Stereo correspondence, Scanline optimization, Real-time


Share this article to: More <<< Previous Article|

Li Yao, Dong-xiao Li, Jing Zhang, Liang-hao Wang, Ming Zhang. Accurate real-time stereo correspondence using intra- and inter-scanline optimization[J]. Journal of Zhejiang University Science C, 2012, 13(6): 472-482.

@article{title="Accurate real-time stereo correspondence using intra- and inter-scanline optimization",
author="Li Yao, Dong-xiao Li, Jing Zhang, Liang-hao Wang, Ming Zhang",
journal="Journal of Zhejiang University Science C",
volume="13",
number="6",
pages="472-482",
year="2012",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.C1100311"
}

%0 Journal Article
%T Accurate real-time stereo correspondence using intra- and inter-scanline optimization
%A Li Yao
%A Dong-xiao Li
%A Jing Zhang
%A Liang-hao Wang
%A Ming Zhang
%J Journal of Zhejiang University SCIENCE C
%V 13
%N 6
%P 472-482
%@ 1869-1951
%D 2012
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.C1100311

TY - JOUR
T1 - Accurate real-time stereo correspondence using intra- and inter-scanline optimization
A1 - Li Yao
A1 - Dong-xiao Li
A1 - Jing Zhang
A1 - Liang-hao Wang
A1 - Ming Zhang
J0 - Journal of Zhejiang University Science C
VL - 13
IS - 6
SP - 472
EP - 482
%@ 1869-1951
Y1 - 2012
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.C1100311


Abstract: 
This paper deals with a novel stereo algorithm that can generate accurate dense disparity maps in real time. The algorithm employs an effective cross-based variable support aggregation strategy within a scanline optimization framework. Rather than matching intensities directly, the use of adaptive support aggregation allows for precisely handling the weak textured regions as well as depth discontinuities. To improve the disparity results with global reasoning, we reformulate the energy function on a tree structure over the whole 2D image area, as opposed to dynamic programming of individual scanlines. By applying both intra- and inter-scanline optimizations, the algorithm reduces the typical ‘streaking’ artifact while maintaining high computational efficiency. The experimental results are evaluated on the Middlebury stereo dataset, showing that our approach is among the best for all real-time approaches. We implement the algorithm on a commodity graphics card with CUDA architecture, running at about 35 fames/s for a typical stereo pair with a resolution of 384×288 and 16 disparity levels.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Bobick, A.F., Intille, S.S., 1999. Large occlusion stereo. Int. J. Comput. Vis., 33(3):181-200.

[2]Criminisi, A., Blake, A., Rother, C., Shotton, J., Torr, P.H.S., 2007. Efficient dense stereo with occlusions for new view-synthesis by four-state dynamic programming. Int. J. Comput. Vis., 71(1):89-110.

[3]Crow, F.C., 1984. Summed-Area Tables for Texture Mapping. Proc. 11th Annual Conf. on Computer Graphics and Interactive Techniques, p.207-212.

[4]Darabiha, A., Rose, J., MacLean, W.J., 2003. Video-Rate Stereo Depth Measurement on Programmable Hardware. IEEE Conf. on Computer Vision and Pattern Recognition, p.203-210.

[5]Gong, M., Yang, Y., 2005. Near Real-Time Reliable Stereo Matching Using Programmable Graphics Hardware. IEEE Conf. on Computer Vision and Pattern Recognition, p.924-931.

[6]Gong, M., Yang, Y., 2007. Real-time stereo matching using orthogonal reliability-based dynamic programming. IEEE Trans. Image Process., 16(3):879-884.

[7]Gupta, R.K., Cho, S.Y., 2010. Real-Time Stereo Matching Using Adaptive Binary Window. Proc. 3DPVT, Session 2, p.1-8.

[8]Hartley, R.I., Zisserman, A., 2004. Multiple View Geometry. Cambridge University Press, Cambridge, UK.

[9]Hirschmüller, H., Innocent, P., Garibaldi, J., 2002. Real-time correlation-based stereo vision with reduced border errors. Int. J. Comput. Vis., 47(1-3):229-246.

[10]ISO/IEC, 2008. HHI Test Material for 3D Video. M15413.

[11]Kim, J.C., Lee, K.M., Choi, B.T., Lee, S.U., 2005. A Dense Stereo Matching Using Two-Pass Dynamic Programming with Generalized Ground Control Points. IEEE Conf. on Computer Vision and Pattern Recognition, p.1075-1082.

[12]Konolige, K., 1997. Small Vision System: Hardware and Implementation. Proc. Int. Symp. on Robotics Research, p.111-116.

[13]Kosov, S., Thormählen, T., Seidel, H., 2009. Accurate real-time disparity estimation with variational methods. LNCS, 5875:796-807.

[14]Lei, C., Selzer, J., Yang, Y., 2006. Region-Tree Based Stereo Using Dynamic Programming Optimization. IEEE Conf. on Computer Vision and Pattern Recognition, p.2378-2385.

[15]Mattoccia, S., Tombari, F., di Stefano, L., 2007. Stereo vision enabling precise border localization within a scanline optimization framework. LNCS, 4844:517-527.

[16]McDonnell, M.J., 1981. Box-filtering techniques. Comput. Graph. Image Process., 17(1):65-70.

[17]Moallemi, C.C., van Roy, B., 2010. Convergence of min-sum message-passing for convex optimization. IEEE Trans. Inform. Theory, 56(4):2041-2050.

[18]Mulligan, J., Isler, V., Daniilidis, K., 2002. Trinocular stereo: a real-time algorithm and its evaluation. Int. J. Comput. Vis., 47(1-3):51-61.

[19]Salmen, J., Schlipsing, M., Edelbrunner, J., Hegemann, S., Lueke, S., 2009. Real-time stereo vision: making more out of dynamic programming. LNCS, 5702:1096-1103.

[20]Sara, R., 2010. How to Teach Stereoscopic Matching? Proc. 52nd Int. Symp. ELMAR, p.445-453.

[21]Scharstein, D., Szeliski, R., 2001. Middlebury Stereo Vision Page. Available from http://vision.middlebury.edu/stereo/ [Accessed on Oct. 20, 2011].

[22]Scharstein, D., Szeliski, R., 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis., 47(1):7-42.

[23]Tombari, F., Mattoccia, S., di Stefano, L., Addimanda, E., 2008a. Classification and Evaluation of Cost Aggregation Methods for Stereo Correspondence. IEEE Conf. on Computer Vision and Pattern Recognition, p.1-8.

[24]Tombari, F., Mattoccia, S., di Stefano, L., Addimanda, E., 2008b. Near Real-Time Stereo Based on Effective Cost Aggregation. Int. Conf. on Pattern Recognition, p.1-4.

[25]Veksler, O., 1999. Efficient Graph-Based Energy Minimization Methods in Computer Vision. PhD Thesis, Cornell University, New York, USA.

[26]Veksler, O., 2003. Fast Variable Window for Stereo Correspondence Using Integral Images. IEEE Conf. on Computer Vision and Pattern Recognition, p.556-561.

[27]Veksler, O., 2005. Stereo Correspondence by Dynamic Programming on a Tree. IEEE Conf. on Computer Vision and Pattern Recognition, p.384-390.

[28]Wang, L., Liao, M., Gong, M., Yang, R., Nister, D., 2006. High-Quality Real-Time Stereo Using Adaptive Cost Aggregation and Dynamic Programming. 3rd Int. Symp. on 3DPVT, p.798-805.

[29]Weiss, Y., Freeman, W.T., 2001. On the optimality of solutions of the max-product belief-propagation algorithm in arbitrary graphs. IEEE Trans. Inform. Theory, 47(2):736-744.

[30]Woodfill, J., Herzen, B.V., 1997. Real-Time Stereo Vision on the PARTS Reconfigurable Computer. Proc. IEEE Symp. on FPGAs for Custom Computing Machines, p.201-210.

[31]Yang, Q., Wang, L., Yang, R., Wang, S., Liao, M., Nister, D., 2006. Real-Time Global Stereo Matching Using Hierarchical Belief Propagation. The British Machine Vision Conf., p.989-998.

[32]Yang, R., Welch, G., Bishop, G., 2002. Real-Time Consensus-Based Scene Reconstruction Using Commodity Graphics Hardware. Proc. 10th Pacific Conf. on Computer Graphics and Applications, p.225-234.

[33]Yoon, K., Kweon, I., 2006. Adaptive support-weight approach for correspondence search. IEEE Trans. Pattern Anal. Mach. Intell., 28(4):650-656.

[34]Zhang, K., Lu, J., Lafruit, G., 2009. Cross-based local stereo matching using orthogonal integral images. IEEE Trans. Circ. Syst. Video Technol., 19(7):1073-1079.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - Journal of Zhejiang University-SCIENCE