Full Text:   <1770>

CLC number: TP317.4; TP391

On-line Access: 

Received: 2007-11-14

Revision Accepted: 2008-02-18

Crosschecked: 0000-00-00

Cited: 4

Clicked: 3428

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Journal of Zhejiang University SCIENCE A 2008 Vol.9 No.10 P.1341~1350


Vision based terrain reconstruction for planet rover using a special binocular bundle adjustment

Author(s):  Min-yi SHEN, Zhi-yu XIANG, Ji-lin LIU

Affiliation(s):  Institute of Information and Communication Engineering, Zhejiang University, Hangzhou 310027, China; more

Corresponding email(s):   xiangzy@zju.edu.cn

Key Words:  3D reconstruction, Binocular bundle adjustment (BBA), Scale-invariant feature transform (SIFT), Re-projection error, RANSAC

Min-yi SHEN, Zhi-yu XIANG, Ji-lin LIU. Vision based terrain reconstruction for planet rover using a special binocular bundle adjustment[J]. Journal of Zhejiang University Science A, 2008, 9(10): 1341~1350.

@article{title="Vision based terrain reconstruction for planet rover using a special binocular bundle adjustment",
author="Min-yi SHEN, Zhi-yu XIANG, Ji-lin LIU",
journal="Journal of Zhejiang University Science A",
publisher="Zhejiang University Press & Springer",

%0 Journal Article
%T Vision based terrain reconstruction for planet rover using a special binocular bundle adjustment
%A Min-yi SHEN
%A Zhi-yu XIANG
%A Ji-lin LIU
%J Journal of Zhejiang University SCIENCE A
%V 9
%N 10
%P 1341~1350
%@ 1673-565X
%D 2008
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.A0720057

T1 - Vision based terrain reconstruction for planet rover using a special binocular bundle adjustment
A1 - Min-yi SHEN
A1 - Zhi-yu XIANG
A1 - Ji-lin LIU
J0 - Journal of Zhejiang University Science A
VL - 9
IS - 10
SP - 1341
EP - 1350
%@ 1673-565X
Y1 - 2008
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.A0720057

This paper presents a pure vision based technique for 3D reconstruction of planet terrain. The reconstruction accuracy depends ultimately on an optimization technique known as ‘bundle adjustment’. In vision techniques, the translation is only known up to a scale factor, and a single scale factor is assumed for the whole sequence of images if only one camera is used. If an extra camera is available, stereo vision based reconstruction can be obtained by binocular views. If the baseline of the stereo setup is known, the scale factor problem is solved. We found that direct application of classical bundle adjustment on the constraints inherent between the binocular views has not been tested. Our method incorporated this constraint into the conventional bundle adjustment method. This special binocular bundle adjustment has been performed on image sequences similar to planet terrain circumstances. Experimental results show that our special method enhances not only the localization accuracy, but also the terrain mapping quality.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article


[1] Brown, M., Lowe, D.G., 2005. Unsupervised 3D Object Recognition and Reconstruction in Unordered Datasets. Proc. 5th Int. Conf. on 3-D Digital Imaging and Modeling, p.56-63.

[2] Brown, M., Szeliski, R., Winder, S., 2005. Multi-image Matching Using Multi-scale Oriented Patches. Proc. Int. Conf. on Computer Vision and Pattern Recognition, San Diego, p.510-517.

[3] Di, K.C., Xu, F.L., Li, R.X., 2004. Constrained Bundle Adjustment of Panoramic Stereo Images for Mars Landing Site Mapping. Proc. 4th Int. Symp. on Mobile Mapping Technology, Kunming, China, p.1-6.

[4] Di, K.C., Xu, F.L., Wang, J., Niu, X.T., Serafy, C., Zhou, F., Li, R.X., Matthies, L., 2005. Surface Imagery Based Mapping and Rover Localization. Proc. ASPRS Annual Conf., Baltimore, MD (CD-ROM).

[5] Eaton, D., 2005. Answering ‘Where Am I?’ by Nonlinear Least Squares. Proc. Int. Conf. on Computer Vision, Beijing, p.1-15.

[6] Fischler, M.A., Bolles, R.C., 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24(6):381-385.

[7] Kwolek, B., 2007. Visual Odometry Based on Gabor Filters and Sparse Bundle Adjustment. IEEE Int. Conf. on Robotics and Automation, Roma, Italy, p.3573-3578.

[8] Labrie, M., Hebert, P., 2007. Efficient Camera Motion and 3D Recovery Using an Inertial Sensor. Fourth Canadian Conf. on Computer and Robot Vision, p.55-62.

[9] Li, R.X., Ma, F., Xu, F.L., Matthies, L.H., Olson, C.F., Arvidson, R.E., 2002. Localization of Mars rovers using descent and surface-based image data. J. Geophys. Res., 107(E11):8004.

[10] Li, R.X., Di, K.C., Matthies, L.H., Arvidson, R.E., Folkner, W.M., Archinal, B.A., 2004. Rover localization and landing site mapping technology for the 2003 Mars exploration rover mission. J. Photo. Eng. Remote Sensing, 70(1):77-90.

[11] Lourakis, M.I.A., Argyros, A.A., 2004. The Design and Implementation of a Generic Sparse Bundle Adjustment Software Package Based on the Levenberg-Marquardt Algorithm. Technical Report 340. Institute of Computer Science, FORTH, Heraklion, Crete, Greece, p.1-21.

[12] Lowe, D.G., 1999. Object Recognition from Local Scale-invariant Features. Proc. Int. Conf. on Computer Vision, Corfu, Greece, p.1150-1157.

[13] Lowe, D.G., 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60(2):91-110.

[14] Matthies, L.H., Shafer, S.A., 1987. Error modeling in stereo navigation. IEEE J. Rob. Autom., 3(3):239-248.

[15] Olson, C.F., Matthies, L.H., Schoppers, M., Maimone, M.W., 2003. Rover navigation using stereo ego-motion. Rob. Auton. Syst., 43:215-229.

[16] Reitinger, B., Zach, C., Schmalstieg, D., 2007. Augmented Reality Scouting for Interactive 3D Reconstruction. IEEE Virtual Reality Conf., Charlotte, North Carolina, USA, p.219-222.

[17] Sato, T., Kanbara, M., Yokoya, N., 2003. Outdoor Scene Reconstruction from Multiple Image Sequences Captured by a Hand-held Video Camera. Proc. IEEE Int. Conf. on Multisensor Fusion and Integration for Intelligent Systems, p.113-118.

[18] Shum, H.Y., Ke, Q.F., Zhang, Z.Y., 1999. Efficient Bundle Adjustment with Virtual Key Frames: A Hierarchical Approach to Multi-frame Structure from Motion. Proc. Int. Conf. on Computer Vision and Pattern Recognition, 2:538-543.

[19] Triggs, B., McLauchlan, P., Hartley, R., Fitzgibbon, A., 1999. Bundle Adjustment—A Modern Synthesis. Proc. Int. Workshop on Visual Algorithm: Theory and Practice, Corfu, Greece, p.298-372.

[20] Umeyama, S., 1991. Least-squares estimation of transformation parameters between two point patterns. IEEE Trans. on Pattern Anal. Machine Intell., 13(4):376-380.

[21] Wolf, P.R., DeWitt, B.A., 2000. Elements of Photogrammetry with Applications in GIS (3rd Ed.). McGraw Hill, Boston, MA, USA, p.608.

[22] Wong, K.H., Chang, M.M.Y., 2004. 3D Model Reconstruction by Constrained Bundle Adjustment. Proc. 17th Int. Conf. on Pattern Recognition, 3:902-905.

Open peer comments: Debate/Discuss/Question/Opinion


Please provide your name, email address and a comment

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - Journal of Zhejiang University-SCIENCE