Full Text:   <2793>

CLC number: TP39

On-line Access: 2024-08-27

Received: 2023-10-17

Revision Accepted: 2024-05-08

Crosschecked: 0000-00-00

Cited: 0

Clicked: 5610

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
1. Reference List
Open peer comments

Journal of Zhejiang University SCIENCE A 2006 Vol.7 No.7 P.1282-1288

http://doi.org/10.1631/jzus.2006.A1282


Tracking facial features with occlusions


Author(s):  MARKIN Evgeny, PRAKASH Edmond C.

Affiliation(s):  School of Computer Engineering, Nanyang Technological University, Singapore

Corresponding email(s):   evge0001@ntu.edu.sg, asprakash@ntu.edu.sg

Key Words:  Active Appearance Model (AAM), Facial feature tracking, Computer vision


Share this article to: More <<< Previous Article|

MARKIN Evgeny, PRAKASH Edmond C.. Tracking facial features with occlusions[J]. Journal of Zhejiang University Science A, 2006, 7(7): 1282-1288.

@article{title="Tracking facial features with occlusions",
author="MARKIN Evgeny, PRAKASH Edmond C.",
journal="Journal of Zhejiang University Science A",
volume="7",
number="7",
pages="1282-1288",
year="2006",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.2006.A1282"
}

%0 Journal Article
%T Tracking facial features with occlusions
%A MARKIN Evgeny
%A PRAKASH Edmond C.
%J Journal of Zhejiang University SCIENCE A
%V 7
%N 7
%P 1282-1288
%@ 1673-565X
%D 2006
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.2006.A1282

TY - JOUR
T1 - Tracking facial features with occlusions
A1 - MARKIN Evgeny
A1 - PRAKASH Edmond C.
J0 - Journal of Zhejiang University Science A
VL - 7
IS - 7
SP - 1282
EP - 1288
%@ 1673-565X
Y1 - 2006
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.2006.A1282


Abstract: 
Facial expression recognition consists of determining what kind of emotional content is presented in a human face. The problem presents a complex area for exploration, since it encompasses face acquisition, facial feature tracking, facial expression classification. facial feature tracking is of the most interest. active Appearance Model (AAM) enables accurate tracking of facial features in real-time, but lacks occlusions and self-occlusions. In this paper we propose a solution to improve the accuracy of fitting technique. The idea is to include occluded images into AAM training data. We demonstrate the results by running experiments using gradient descent algorithm for fitting the AAM. Our experiments show that using fitting algorithm with occluded training data improves the fitting quality of the algorithm.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1] Baker, S., Gross, R., Matthews, I., 2004. Lucas-Kanade 20 Years on: A Unifying Framework: Part 4. Technical Report CMURI-TR-04-14, Robotics Institute, Carnegie Mellon University.

[2] Bartlett, M., Braathen, B., Littlewort-Ford, G., Hershey, J., Fasel, I., Marks, T., Smith, E., Sejnowski, T., Movellan, J.R., 2001. Automatic Analysis of Spontaneous Facial Behavior: A Final Project Report. Technical Report INC-MPLab-TR-2001.08, Machine Perception Lab, Institute for Neural Computation, University of California.

[3] Blanz, V., Vetter, T., 1999. A Morphable Model for the Synthesis of 3D Faces. Proceedings of the International Conference on Computer Graphics and Interactive Techniques, p.187-194.

[4] Blanz, V., Vetter, T., 2003. Face recognition based on fitting a 3D morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(9):1063-1074.

[5] Brand, M., Bhotika, R., 2001. Flexible Flow for 3D Nonrigid Tracking and Shape Recovery. Proceedings of the International Conference on Computer Vision and Pattern Recognition, 1:315-322.

[6] Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S., 2003. Facial expression recognition from video sequences: temporal and static modelling. Computer Vision and Image Understanding, 91(1-2):160-187.

[7] Cootes, T.F., Edwards, G.J., Taylor, C.J., 1998. Active Appearance Models. Proceedings of the European Conference on Computer Vision, 2:484-498.

[8] Cootes, T.F., Edwards, G.J., Taylor, C.J., 2001. Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681-685.

[9] Ford, G.L., 2002. Fully Automatic Coding of Basic Expressions from Video. Technical Report INC-MPLab-TR-2002.03, Machine Perception Lab, Institute for Neural Computation, University of California.

[10] Gokturk, S.B., Bouguet, J.Y., Grzeszczuk, R., 2001. A Data-Driven Model for Monocular Face Tracking. Proceedings of the International Conference on Computer Vision, 2:701-708.

[11] Lee, J., Moghaddam, B., Pfister, H., Machiraju, R., 2003. Silhouette-based 3D face shape recovery. Graphics Interface.

[12] Lin, I.C., Ouhyoung, M., 2005. Mirror mocap: Automatic and efficient capture of dense 3D facial motion parameters from video. The Visual Computer, 21(6):355-372.

[13] Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J., 1998. Coding Facial Expressions with Gabor Wavelets. Proceedings of the International Conference on Automatic Face and Gesture Recognition, p.200-205.

[14] Matthews, I., Baker, S., 2004. Active appearance models revisited. International J. of Computer Vision, 60(2):135-164.

[15] Moghaddam, B., Lee, J., Pfister, H., Machiraju, R., 2003. Model-Based 3D Face Capture with Shape-from-Silhouettes. Proceedings of the International Workshop on Analysis and Modelling of Faces and Gestures, p.20-27.

[16] Pantic, M., Rothkrantz, L.J.M., 2000. Expert system for automatic analysis of facial expressions. Image and Vision Computing, 18(11):881-905.

[17] Romdhani, S., Vetter, T., 2003. Efficient, Robust and Accurate Fitting of a 3D Morphable Model. Proceedings of the International Conference on Computer Vision, 1:59-66.

[18] Tao, H., Huang, T.S., 1998. Connected Vibrations: A Modal Analysis Approach for Non-Rigid Motion Tracking. Proceedings of the International Conference on Computer Vision and Pattern Recognition, p.735-740.

[19] Tian, Y.I., Kanade, T., Cohn, J.F., 2001. Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(2):97-115.

[20] Tian, Y.I., Kanade, T., Cohn, J.F., 2002. Evaluation of Gabor-Wavelet-Based Facial Action Unit Recognition in Image Sequences of Increasing Complexity. Proceedings of the International Conference on Automatic Face and Gesture Recognition, p.218-223.

[21] Wen, Z., Huang, T.S., 2003. Capturing Subtle Facial Motions in 3D Face Tracking. Proceedings of the International Conference on Computer Vision, p.1343-1350.

[22] Xiao, J., Kanade, T., Cohn, J.F., 2002. Robust Full-Motion Recovery of Head by Dynamic Templates and Re-Registration Techniques. Proceedings of the International Conference on Automatic Face and Gesture Recognition, p.156-162.

[23] Xiao, J., Baker, S., Matthews, I., Kanade, T., 2004. Real-Time Combined 2D+3D Active Appearance Models. Proceedings of the International Conference on Computer Vision and Pattern Recognition, 2:535-542.

[24] Yang, M.H., Kriegman, D.J., Ahuja, N., 2002. Detecting faces in images: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1):34-58.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE