Full Text:   <3063>

CLC number: TP183

On-line Access: 

Received: 2006-05-28

Revision Accepted: 2006-07-28

Crosschecked: 0000-00-00

Cited: 2

Clicked: 5094

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Journal of Zhejiang University SCIENCE A 2006 Vol.7 No.11 P.1942-1947

http://doi.org/10.1631/jzus.2006.A1942


SVD-LSSVM and its application in chemical pattern classification


Author(s):  TAO Shao-hui, CHEN De-zhao, HU Wang-ming

Affiliation(s):  Department of Chemical Engineering, Zhejiang University, Hangzhou 310027, China

Corresponding email(s):   dzc@zju.edu.cn

Key Words:  Pattern classification, Structural risk minimization, Least squares support vector machine (LSSVM), Hyper parameter selection, Cross validation, Singular value decomposition (SVD)


TAO Shao-hui, CHEN De-zhao, HU Wang-ming. SVD-LSSVM and its application in chemical pattern classification[J]. Journal of Zhejiang University Science A, 2006, 7(11): 1942-1947.

@article{title="SVD-LSSVM and its application in chemical pattern classification",
author="TAO Shao-hui, CHEN De-zhao, HU Wang-ming",
journal="Journal of Zhejiang University Science A",
volume="7",
number="11",
pages="1942-1947",
year="2006",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.2006.A1942"
}

%0 Journal Article
%T SVD-LSSVM and its application in chemical pattern classification
%A TAO Shao-hui
%A CHEN De-zhao
%A HU Wang-ming
%J Journal of Zhejiang University SCIENCE A
%V 7
%N 11
%P 1942-1947
%@ 1673-565X
%D 2006
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.2006.A1942

TY - JOUR
T1 - SVD-LSSVM and its application in chemical pattern classification
A1 - TAO Shao-hui
A1 - CHEN De-zhao
A1 - HU Wang-ming
J0 - Journal of Zhejiang University Science A
VL - 7
IS - 11
SP - 1942
EP - 1947
%@ 1673-565X
Y1 - 2006
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.2006.A1942


Abstract: 
pattern classification is an important field in machine learning; least squares support vector machine (LSSVM) is a powerful tool for pattern classification. A new version of LSSVM, SVD-LSSVM, to save time of selecting hyper parameters for LSSVM is proposed. SVD-LSSVM is trained through singular value decomposition (SVD) of kernel matrix. cross validation time of selecting hyper parameters can be saved because a new hyper parameter, singular value contribution rate (SVCR), replaces the penalty factor of LSSVM. Several UCI benchmarking data and the Olive classification problem were used to test SVD-LSSVM. The result showed that SVD-LSSVM has good performance in classification and saves time for cross validation.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1] Blake, C.L., Merz, C.J., 1998. UCI Repository of Machine Learning Database. Http://www.ics.uci.edu/~mlearn/ mlrepository.html. Dept. of Information and Computer Science, University of California, Irvine, CA.

[2] Golub, G.H., van Loan, C.F., 1989. Matrix Computations. Gene Johns Hopkins University Press.

[3] Hopke, P.K., Massart, D.L., 1993. Reference data sets for chemometrical methods testing. Chemometrics and Intelligent Laboratory Systems, 19(1):35-41.

[4] Pelckmans, K., de Brabanter, J., Suykens, J.A.K., de Moor, B., 2005. The differogram: Nonparametric noise variance estimation and its use for model. Neurocomputing, Special Issue on Signal Processing, 69(1-3):100-122.

[5] Pelckmans, K., Suykens, J.A.K., de Moor, B., 2006. Additive regularization trade-off: Fusion of training and validation levels in kernel methods. Machine Learning, 62(3):217-252.

[6] Suykens, J.A.K., Vandewalle, J., 1999a. Least squares support vector machine classifiers. Neural Processing Letters, 9(3):293-300.

[7] Suykens, J.A.K., Vandewalle, J., 1999b. Multiclass Least Squares Support Vector Machines. Intl. Joint Conference on Neural Networks, IJCNN’99, Washington, D.C.

[8] van Gestel, T., Suykens, J.A.K., Baesens, B., Stijn, V., Vanthienen, J., Dedene, G., Bart, D.M., Vandewalle, J., 2004. Benchmarking least squares support vector machine classifiers. Machine Learning, 54(1):5-32.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE