Full Text:   <1050>

Summary:  <616>

CLC number: TP391.7

On-line Access: 2014-12-23

Received: 2014-04-20

Revision Accepted: 2014-08-24

Crosschecked: 2014-12-10

Cited: 2

Clicked: 2308

Citations:  Bibtex RefMan EndNote GB/T7714

 ORCID:

HyungSeok KIM

http://orcid.org/0000-0003-4816-2992

-   Go to

Article info.
Open peer comments

Frontiers of Information Technology & Electronic Engineering  2015 Vol.16 No.1 P.12-27

http://doi.org/10.1631/FITEE.1400141


An image-based approach to the reconstruction of ancient architectures by extracting and arranging 3D spatial components


Author(s):  Divya Udayan J, HyungSeok Kim, Jee-In Kim

Affiliation(s):  Internet and Multimedia Engineering, Konkuk University, Seoul 143-701, Korea; more

Corresponding email(s):   divuda@konkuk.ac.kr, hyuskim@konkuk.ac.kr, jnkm@konkuk.ac.kr

Key Words:  Digital reconstruction, 3D virtual world, 3D spatial components, Vision and scene understanding


Divya Udayan J, HyungSeok Kim, Jee-In Kim. An image-based approach to the reconstruction of ancient architectures by extracting and arranging 3D spatial components[J]. Frontiers of Information Technology & Electronic Engineering, 2015, 16(1): 12-27.

@article{title="An image-based approach to the reconstruction of ancient architectures by extracting and arranging 3D spatial components",
author="Divya Udayan J, HyungSeok Kim, Jee-In Kim",
journal="Frontiers of Information Technology & Electronic Engineering",
volume="16",
number="1",
pages="12-27",
year="2015",
publisher="Zhejiang University Press & Springer",
doi="10.1631/FITEE.1400141"
}

%0 Journal Article
%T An image-based approach to the reconstruction of ancient architectures by extracting and arranging 3D spatial components
%A Divya Udayan J
%A HyungSeok Kim
%A Jee-In Kim
%J Frontiers of Information Technology & Electronic Engineering
%V 16
%N 1
%P 12-27
%@ 2095-9184
%D 2015
%I Zhejiang University Press & Springer
%DOI 10.1631/FITEE.1400141

TY - JOUR
T1 - An image-based approach to the reconstruction of ancient architectures by extracting and arranging 3D spatial components
A1 - Divya Udayan J
A1 - HyungSeok Kim
A1 - Jee-In Kim
J0 - Frontiers of Information Technology & Electronic Engineering
VL - 16
IS - 1
SP - 12
EP - 27
%@ 2095-9184
Y1 - 2015
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/FITEE.1400141


Abstract: 
The objective of this research is the rapid reconstruction of ancient buildings of historical importance using a single image. The key idea of our approach is to reduce the infinite solutions that might otherwise arise when recovering a 3D geometry from 2D photographs. The main outcome of our research shows that the proposed methodology can be used to reconstruct ancient monuments for use as proxies for digital effects in applications such as tourism, games, and entertainment, which do not require very accurate modeling. In this article, we consider the reconstruction of ancient Mughal architecture including the Taj Mahal. We propose a modeling pipeline that makes an easy reconstruction possible using a single photograph taken from a single view, without the need to create complex point clouds from multiple images or the use of laser scanners. First, an initial model is automatically reconstructed using locally fitted planar primitives along with their boundary polygons and the adjacency relation among parts of the polygons. This approach is faster and more accurate than creating a model from scratch because the initial reconstruction phase provides a set of structural information together with the adjacency relation, which makes it possible to estimate the approximate depth of the entire structural monument. Next, we use manual extrapolation and editing techniques with modeling software to assemble and adjust different 3D components of the model. Thus, this research opens up the opportunity for the present generation to experience remote sites of architectural and cultural importance through virtual worlds and real-time mobile applications. Variations of a recreated 3D monument to represent an amalgam of various cultures are targeted for future work.

This article creates a rapid prototype of a less accurate 3D model for the 3D reconstruction of ancient monuments from a single image that should be interesting to the readers.

基于3D空间组件提取和排列的古建筑重建图像方法

目的:利用单一图像重建古建筑,简化从2D照片恢复3D几何结构方法中无穷解的情况。该方法可以应用于观光、游戏、娱乐业中的古迹恢复。
创新:简化从2D照片恢复3D几何结构过程中无穷解的情况。对特定建筑风格生成的组件库可以应用于相同风格的其它古建筑的重建。
方法:本文主要以泰姬陵为例分析。首先,沿边界多面体和多面体之间的邻近关系利用合适的局部平面基元自动重建初始模型。然后,利用建模软件人工推断装配并调整模型3D组件获取最终重建模型。以Mughal风格的三个著名古建筑为例,测试基于前视图的模型重建(图10-12)。
结论:对图像组件的分层分析有助简化从2D照片恢复3D几何结构过程中无穷解的情况。对特定建筑风格生成的组件库可以应用于相同风格的其它古建筑的重建。对三个Mughal风格的三个古建筑进行模型重建,结果表明所提方法的有效性。

关键词:数字重建;3D虚拟世界;3D空间组件;视觉场景理解

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]AlHalawani, S., Yang, Y.L., Liu, H., et al., 2013. Interactive facades analysis and synthesis of semi-regular facades. Comput. Graph. Forum, 32(2pt2):215-224.

[2]Bao, F., Yan, D.M., Mitra, N.J., et al., 2013. Generating and exploring good building layouts. ACM Trans. Graph., 32(4):122.1-122.10.

[3]Bay, H., Tuytelaars, T., van Gool, L., 2006. SURF: speeded up robust features. Proc. 9th European Conf. on Computer Vision, p.404-417.

[4]Bokeloh, M., Berner, A., Wand, M., et al., 2009. Symmetry detection using feature lines. Comput. Graph. Forum, 28(2):697-706.

[5]Ceylan, D., Mitra, N.J., Li, H., et al., 2012. Factored facade acquisition using symmetric line arrangements. Comput. Graph. Forum, 31(2pt3):671-680.

[6]Ceylan, D., Mitra, N.J., Zheng, Y., et al., 2014. Coupled structure-from-motion and 3D symmetry detection for urban facades. ACM Trans. Graph., 33(1):2.1-2.15.

[7]Chen, E., Williams, L., 1993. View interpolation for image synthesis. Proc. 20th Annual Conf. on Computer Graphics and Interative Techniques, p.279-288.

[8]Chen, T., Zhu, Z., Shamir, A., et al., 2013. 3-Sweep: extruding editable objects from a single photo. ACM Trans. Graph., 32(6):195.1-195.10.

[9]Çıçek, A., Gülesın, M., 2004. Reconstruction of 3D models from 2D orthographic views using solid extrusion and revolution. J. Mater. Process. Technol., 152(3):291-298.

[10]Cignoni, P., Rocchini, C., Scopigno, R., 1998. Metro: measuring error on simplified surfaces. Comput. Graph. Forum, 17(2):167-174.

[11]Criminisi, A., Reid, I., Zisserman, A., 2000. Single view metrology. Int. J. Comput. Vis., 40(2):123-148.

[12]Davies, E.R., 2005. Machine Vision: Theory, Algorithms, Practicalities. Morgan Kauffman Press, San Francisco, USA.

[13]Debevec, P.E., Taylor, C.J., Malik, J., 1996. Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach. Proc. 23rd Annual Conf. on Computer Graphics and Interative Techniques, p.11-20.

[14]Dung, L.R., Huang, C.M., Wu, Y.Y., 2013. Implementation of RANSAC algorithm for feature-based image registration. J. Comput. Commun., 1:46-50.

[15]Encyclopedia, 2014. Mughal Architecture, Britannica Online. Available from http://global.britannica.com/EBchecked/topic/396119/Mughal-architecture [Accessed on Dec. 11, 2014].

[16]Faugeras, O., Laveau, S., Robert, L., 1995. 3-D reconstruction of urban scenes from sequences of images. Automatic Extraction of Man-Made Objects from Aerial and Space Images, p.145-168.

[17]Felzenszwalb, P.F., Huttenlochet, D.P., 2004. Efficient graph-based image segmentation. Int. J. Comput. Vis., 59(2):167-181. [doi:10.1023/B:VISI.0000022288.19776.77

[18]Frahm, J.M., Fite-Georgel, P., Gallup, D., et al., 2010. Building Rome on a cloudless day. Proc. 11th European Conf. on Computer Vision, p.368-381.

[19]Garcia-Gago, J., Gomez-Lahoz, J., Rodríguez-Méndez, J., et al., 2014. Historical single image-based modeling: the case of Gobierna Tower, Zamora (Spain). Remote Sens., 6(2):1085-1101.

[20]Geman, S., Geman, D., 1984. Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. Patt. Anal. Mach. Intell., 6(6):721-741.

[21]Gormen, T.H., Leiserson, C.E., Rivest, R.L., et al., 1990. Introduction to Algorithms. MIT Press, McGraw-Hill Book Company, New York, USA.

[22]Guillou, E., Meneveaux, D., Maisel, E., et al., 2000. Using vanishing points for camera calibration and coarse 3D reconstruction from a single image. Vis. Comput., 16(7):396-410.

[23]Hoiem, D., Efros, A.A., Hebert, M., 2005. Geometric context from a single image. Proc. 10th IEEE Int. Conf. on Computer Vision, p.654-661.

[24]Horn, B.K.P., 1990. Height and gradient from shading. Int. J. Comput. Vis., 5(1):37-75.

[25]Horry, Y., Anjyo, K., Arai, K., 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. Proc. 24th Annual Conf. on Computer Graphics and Interactive Techniques, p.225-232.

[26]Kang, S., 1998. Depth Painting for Image-Based Rendering Applications. Technical Report, Compaq Computer Corporation, Cambridge Research Lab.

[27]Laveau, S., Faugeras, O., 1994. 3D scene representation as a collection of images. Proc. 12th Int. Conf. on Pattern Recognition, p.689-691.

[28]Liebowitz, D., Criminisi, A., Zisserman, A., 1999. Creating architectural models from images. Comput. Graph. Forum, 18(3):39-50.

[29]Lowe, D.G., 2004. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis., 60(2):91-110.

[30]Ma, J., Chan, J.C., Canters, F., 2010. Fully automatic subpixel image registration of multiangle CHRIS/Proba data. IEEE Trans. GeoSci. Remote Sens., 48(7):2829-2839.

[31]Manferdini, A.M., 2012. A methodology for the promotion of cultural heritage sites through the use of low-cost technologies and procedures. Proc. 17th Int. Conf. on 3D Web Technology, p.180.

[32]McMillan, L., Bishop, G., 1995. Plenoptic modeling: an image-based rendering system. Proc. 22nd Annual Conf. on Computer Graphics and Interactive Techniques, p.39-46.

[33]Mitra, N.J., Pauly, M., 2008. Symmetry for architectural design. Advances in Architectural Geometry, p.13-16.

[34]Mitra, N.J., Pauly, M., Wand, M., et al., 2013. Symmetry in 3D geometry: extraction and applications. Comput. Graph. Forum, 32(6):1-23.

[35]Müller, P., Zeng, G., Wonka, P., et al., 2007. Image-based procedural modeling of facades. ACM Trans. Graph., 26(3):85.1-85.9.

[36]Nagai, T., Ikehara, M., Kurematsu, A., 2007. HMM-based surface reconstruction from single images. Syst. Comput. Jpn., 38(11):80-89.

[37]Nan, L., Sharf, A., Zhang, H., et al., 2010. SmartBoxes for interactive urban reconstruction. ACM Trans. Graph., 29(4):93.1-93.10.

[38]Nevatia, R., Babu, K.R., 1980. Linear feature extraction and description. Comput. Graph. Image Process., 13(3):257-269.

[39]Oh, B.M., Chen, M., Dorsey, J., et al., 2001. Image-based modeling and photo editing. Proc. 28th Annual Conf. on Computer Graphics and Interactive Techniques, p.433-442.

[40]Poulin, P., Ouimet, M., Frasson, M.C., 1998. Interactively modeling with photogrammetry. Proc. Eurographics Workshop on Rendering, p.93-104.

[41]Pylvanainen, T., Berclaz, J., Korah, T., et al., 2012. 3D city modeling from street-level data for augmented reality applications. Proc. 2nd Int. Conf. on 3D Imaging, Modeling, Processing, Visualization and Transmission, p.238-245.

[42]Remondino, F., 2011. Heritage recording and 3D modeling with photogrammetry and 3D scanning. Remote Sens., 3(6):1104-1138.

[43]Saxena, A., Chung, S.H., Ng, A.Y., 2008a. 3-D depth reconstruction from a single still image. Int. J. Comput. Vis., 76(1):53-69.

[44]Saxena, A., Sun, M., Ng, A.Y., 2008b. Make3D: depth perception from a single still image. Proc. 23rd AAAI Conf. on Artificial Intelligence, p.1571-1576.

[45]Shade, J., Gortler, S., He, L., et al., 1998. Layered depth images. Proc. 25th AAAI Annual Conf. on Computer Graphics and Interactive Techniques, p.231-242.

[46]Shen, C.H., Fu, H., Chen, K., et al., 2012. Structure recovery by part assembly. ACM Trans. Graph., 31(6):180.1-180.11.

[47]Styliadis, A.D., Sechidis, L.A., 2011. Photography-based facade recovery & 3D modeling: a CAD application in cultural heritage. J. Cult. Herit., 12(3):243-252.

[48]Super, B.J., Bovik, A.C., 1995. Shape from texture using local spectral moments. IEEE Trans. Patt. Anal. Mach. Intell., 17(4):333-343.

[49]Wang, Y., Olano, M., 2011. A framework for GPU 3D model reconstruction using structure-from-motion. Proc. 38th Annual Conf. on Computer Graphics and Interactive Techniques, p.27.1.

[50]Wei, Y.M., Kang, L., Yang, B., et al., 2013. Applications of structure from motion: a survey. J. Zhejiang Univ.-Sci. C (Comput. & Electron.)}, 14(7):486-494.

[51]Yang, M.D., Chao, C.F., Huang, K.S., et al., 2013. Image-based 3D scene reconstruction and exploration in augmented reality. Autom. Constr., 33:48-60.

[52]Zhang, H., Xu, K., Jiang, W., et al., 2013. Layered analysis of irregular facades via symmetry maximization. ACM. Trans. Graph., 32(4):121.1-121.10.

[53]Zhang, L., Dugas-Phocion, G., Samson, J.S., et al., 2002. Single-view modeling of free-form scenes. J. Visual. Comput. Animat., 13(4):225-235.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - Journal of Zhejiang University-SCIENCE