JZUS - Journal of Zhejiang University SCIENCE

Frontiers of Information Technology & Electronic Engineering 2015 Vol.16 No.5 P.367-379

A method of shadow puppet figure modeling and animation

Author(s): Xiao-fang Huang, Shou-qian Sun, Ke-jun Zhang, Tian-ning Xu, Jian-feng Wu, Bin Zhu
Affiliation(s): College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China; more
Corresponding email(s): xfhuangava@gmail.com, ssq@zju.edu.cn, channy@zju.edu.cn, alicexutt@163.com, jianfw@126.com, zhubinxx@sohu.com
Key Words: Shadow play, Shadow puppet figure, 3D human body, Data processing, 2D modeling

Share this article to： More <<< Previous Article \|Next Article >>>

Abstract: To promote the development of the intangible cultural heritage of the world, shadow play, many studies have focused on shadow puppet modeling and interaction. Most of the shadow puppet figures are still imaginary, spread by ancients, or carved and painted by shadow puppet artists, without consideration of real dimensions or the appearance of human bodies. This study proposes an algorithm to transform 3D human models to 2D puppet figures for shadow puppets, including automatic location of feature points, automatic segmentation of 3D models, automatic extraction of 2D contours, automatic clothes matching, and animation. Experiment proves that more realistic and attractive figures and animations of the shadow puppet can be generated in real time with this algorithm.

This paper presents a method to shadowgraph a human 3D model scanned by a 3D laser scanner. It finds the feature points and then segments the various parts of the object. Then with projection planes they get the 2D contours find key points, joints and then map a garment to it. The paper is well written and easy to read and understand. Indeed, the subject of the work is quite original. The paper is worth of interest and of publication.

一种皮影人物建模及动画生成方法

目的：建立基于真实人体数据的皮影人物模型并生成动画来促进皮影艺术发展。
创新点：本文使用三维人体扫描数据来建立皮影人物模型，并生成动画。
方法：通过研究分析皮影艺术现状，提出一种通过获取三维人体扫描数据来建立皮影人物并生成动画的方法。二维皮影人物的建模过程（图1）如下：第一步，自动定位三维人体模型特征点，并且根据定位的特征点将人体模型自动分段（图8）；第二步，提取皮影人物的初始轮廓（图11），并进行二维数据处理；第三步，对数据处理后的初始皮影人物（图13）进行自动服饰匹配（图14、15），生成二维皮影人物及动画（图17-19）。最后通过比较实验前后被试者对皮影的兴趣度，来验证该方法的有效性。
结论：针对人们对皮影艺术逐渐失去兴趣的现状，提出一种基于三维人体扫描数据的皮影人物建模方法。实验证明，该方法可以生成更多具有真实感、引人入胜的皮影人物和实时动画。该研究促进了皮影艺术的发展，尤其是在现代皮影动画和个性化定制方面。

关键词：皮影艺术；皮影人物；三维人体；数据处理；二维建模

Reference

[1]Allen, B., Curless, B., Popović, B., 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans. Graph., 22(3):587-594.

[2]Chen, T.K., 2014. A case study of a digital archives programme: the development of digital shadow plays in Taiwan. Int. J. Human. Arts Comput., 8(suppl):38-48.

[3]Currell, D., 2008. Shadow Puppets & Shadow Play. Crowood Press, UK.

[4]Dekker, L., Khan, S., West, E., et al., 1998. Models for understanding the 3D human body form. Proc. Int. Conf. on Computer Vision, p.65-74.

[5]Dekker, L., Douros, I., Buston, B.F., et al., 1999. Building symbolic information for 3D human body modeling from range data. Proc. 2nd Int. Conf. on 3-D Digital Imaging and Modeling, p.388-397.

[6]Geisen, G.R., Mason, C.P., Houston, V.L., et al., 1995. Automatic detection, identification, and registration of anatomical landmarks. Proc. Human Factors and Ergonomics Society Annual Meeting, p.750-753.

[7]Ghani, D.A., 2011a. A study of visualization elements of shadow play technique movement and computer graphic imagery (CGI) in Wayang Kulit Kelantan. Int. J. Comput. Graph. Animat., 1(1):1-11.

[8]Ghani, D.A., 2011b. Wayang Kulit: digital puppetry character rigging using Maya MEL language. Proc. 4th Int. Conf. on Modeling, Simulation and Applied Optimization, p.1-5.

[9]Golovinskiy, A., Funkhouser, T., 2008. Randomized cuts for 3D mesh analysis. ACM Trans. Graph., 27(5), Article 145.

[10]Gutiérrez, M., García-Rojas, A., Thalmann, D., et al., 2007. An ontology of virtual humans. Vis. Comput., 23(3):207-218.

[11]Held, R.T., Gupta, A., Curless, B., et al., 2012. 3D puppetry: a Kinect-based interface for 3D animation. UIST, p.423-434.

[12]Jernigan, D.K., Chansavang, A., Martin-Rall, H., et al., 2013. Aesthetic affordances: computer animation and Wayang Kulit puppet theatre. Animat. Pract. Process Product., 3(1-2):195-217.

[13]Kalogerakis, E., Hertzmann, A., Singh, K., 2010. Learning 3D mesh segmentation and labeling. ACM Trans. Graph., 29(4), Article 102.

[14]Katz, S., Tal, A., 2003. Hierarchical mesh decomposition using fuzzy clustering and cuts. ACM Trans. Graph., 22(3):954-961.

[15]Katz, S., Leifman, G., Tal, A., 2005. Mesh segmentation using feature point and core extraction. Vis. Comput., 21(8-10):649-658.

[16]Kavan, L., Dobbyn, S., Collins, S., et al., 2008. Polypostors: 2D polygonal impostors for 3D crowds. Proc. Symp. on Interactive 3D Graphics and Games, p.149-155.

[17]Lam, T.K., Talib, A.Z., Osman, M.A., 2008. Real-time visual simulation and interactive animation of shadow play puppets using OpenGL. World Acad. Sci. Eng. Technol., 21:212-218.

[18]Lewark, E.A., Nurre, J.H., 1998. Automated fudicial labeling on human body data. Proc. SPIE, p.82-89.

[19]Li, Q., Hua, Q.Y., Feng, J., et al., 2011. Design and implementation of interactive digital shadow simulation system. Proc. Int. Conf. on Electric and Electronics, p.187-194.

[20]Li, T.Y., Hsu, S.W., 2007. An authoring tool for generating shadow play animations with motion planning techniques. Int. J. Innov. Comput. Inform. Contr., 3(6B):1601-1612.

[21]Liu, J.L., 1988. Chinese Shadow Puppet Plays. Morning Glory Publishers, China (in Chinese).

[22]Matusky, P., 1994. Malaysian Shadow Play and Music: Continuity of an Oral Tradition. South-East Asian Social Science Monographs. Oxford University Press, Kuala Lumpur.

[23]McHenry, K., Bajcsy, P., 2008. An Overview of 3D Data Content, File Formats and Viewers. Technical Report, National Center for Supercomputing Applications, Urbana, USA.

[24]Morse, L., 2013. The shadow puppet theatre of Malaysia: a study of Wayang Kulit with performance scripts and puppet designs. Theat. J., 65(1):137-138.

[25]Mortara, M., Patané, G., Spagnuolo, M., 2006. From geometric to semantic human body models. Comput. Graph., 30(2):185-196.

[26]Nurre, J.H., 1997. Locating landmarks on human body scan data. Proc. Int. Conf. on Recent Advances in 3-D Digital Imaging and Modeling, p.289-295.

[27]Nurre, J.H., Connor, J., Lewark, E.A., et al., 2000. On segmenting the three-dimensional scan data of a human body. IEEE Trans. Med. Imag., 19(8):787-797.

[28]Salij, H.J., 1982. Shadow Play and Other Stories. Heinemann Asia, Singapore.

[29]Shapira, L., Shamir, A., Cohen-Or, D., 2008. Consistent mesh partitioning and skeletonisation using the shape diameter function. Vis. Comput., 24(4):249-259.

[30]Simari, P., Nowrouzezahrai, D., Kalogerakis, E., et al., 2009. Multi-objective shape segmentation and labeling. Comput. Graph. Forum, 28(5):1415-1425.

[31]Skipitares, T., 2013. A new aesthetic in Indian puppetry. PAJ, 35(3):61-68.

[32]Talib, A.Z., Osman, M.A., Tan, K.L., et al., 2012. Design and development of an interactive virtual shadow puppet play. Proc. 2nd Int. Conf. on Arts and Technology, p.118-126.

[33]Tilley, A.R., 1993. The Measure of Man and Woman: Human Factors in Design. Whitney Library of Design, New York.

[34]van Ness, E., Prawirohardjo, S., 1981. Javanese Wayang Kulit: an Introduction. Oxford University Press, USA.

[35]Wang, C.C.L., Chang, T.K.K., Yuen, M.M.F., 2003. From laser-scanned data to feature human model: a system based on fuzzy logic concept. Comput.-Aid. Des., 35(3):241-253.

[36]Wang, I.C., 2013. Globalization and theater spectacles in Asia. CLCWeb: Compar. Liter. Cult., 15(2), Article 22.

[37]Werghi, N., Xiao, Y.J., Siebert, J.P., 2006. A functional-based segmentation of human body scans in arbitrary postures. IEEE Trans. Syst. Man Cybern. B, 36(1):153-165.

[38]Wuhrer, S., Ben Azouz, Z., Shu, C., 2010. Semi-automatic prediction of landmarks on human models in varying poses. Proc. Canadian Conf. on Computer and Robot Vision, p.136-142.

[39]Zhang, H., Song, Y.H., Chen, Z., et al., 2012. Chinese shadow puppetry with an interactive interface using the Kinect sensor. Proc. Computer Vision, p.352-361.

[40]Zhu, Y.B., Li, C.J., Shen, I.F., et al., 2003. A new form of traditional art: visual simulation of Chinese shadow play. Proc. ACM SIGGRAPH Sketches & Applications, p.1.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Similar articles

- Go to

一种皮影人物建模及动画生成方法

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference