Full Text:   <3484>

CLC number: TP399; R318

On-line Access: 2024-08-27

Received: 2023-10-17

Revision Accepted: 2024-05-08

Crosschecked: 2010-07-01

Cited: 9

Clicked: 9345

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Open peer comments

Journal of Zhejiang University SCIENCE C 2010 Vol.11 No.8 P.587-597

http://doi.org/10.1631/jzus.C0910530


A P300 based online brain-computer interface system for virtual hand control


Author(s):  Wei-dong Chen, Jian-hui Zhang, Ji-cai Zhang, Yi Li, Yu Qi, Yu Su, Bian Wu, Shao-min Zhang, Jian-hua Dai, Xiao-xiang Zheng, Dong-rong Xu

Affiliation(s):  Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou 310027, China, School of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China, Department of Biomedical Engineering, Zhejiang University, Hangzhou 310027, China, MRI Unit, Department of Psychiatry, Columbia University College of Physicians and Surgeons, New York, NY 10032, USA, New York State Psychiatric Institute, New York, NY 10032, USA

Corresponding email(s):   chenwd@zju.edu.cn, qaas@zju.edu.cn

Key Words:  Brain-computer interface (BCI), Electroencephalography (EEG), P300, Virtual reality (VR), Template matching, Support vector machine (SVM)


Wei-dong Chen, Jian-hui Zhang, Ji-cai Zhang, Yi Li, Yu Qi, Yu Su, Bian Wu, Shao-min Zhang, Jian-hua Dai, Xiao-xiang Zheng, Dong-rong Xu. A P300 based online brain-computer interface system for virtual hand control[J]. Journal of Zhejiang University Science C, 2010, 11(8): 587-597.

@article{title="A P300 based online brain-computer interface system for virtual hand control",
author="Wei-dong Chen, Jian-hui Zhang, Ji-cai Zhang, Yi Li, Yu Qi, Yu Su, Bian Wu, Shao-min Zhang, Jian-hua Dai, Xiao-xiang Zheng, Dong-rong Xu",
journal="Journal of Zhejiang University Science C",
volume="11",
number="8",
pages="587-597",
year="2010",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.C0910530"
}

%0 Journal Article
%T A P300 based online brain-computer interface system for virtual hand control
%A Wei-dong Chen
%A Jian-hui Zhang
%A Ji-cai Zhang
%A Yi Li
%A Yu Qi
%A Yu Su
%A Bian Wu
%A Shao-min Zhang
%A Jian-hua Dai
%A Xiao-xiang Zheng
%A Dong-rong Xu
%J Journal of Zhejiang University SCIENCE C
%V 11
%N 8
%P 587-597
%@ 1869-1951
%D 2010
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.C0910530

TY - JOUR
T1 - A P300 based online brain-computer interface system for virtual hand control
A1 - Wei-dong Chen
A1 - Jian-hui Zhang
A1 - Ji-cai Zhang
A1 - Yi Li
A1 - Yu Qi
A1 - Yu Su
A1 - Bian Wu
A1 - Shao-min Zhang
A1 - Jian-hua Dai
A1 - Xiao-xiang Zheng
A1 - Dong-rong Xu
J0 - Journal of Zhejiang University Science C
VL - 11
IS - 8
SP - 587
EP - 597
%@ 1869-1951
Y1 - 2010
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.C0910530


Abstract: 
brain-computer interface (BCI) is a communication system that can help lock-in patients to interact with the outside environment by translating brain signals into machine commands. The present work provides a design for a virtual reality (VR) based BCI system that allows human participants to control a virtual hand to make gestures by p300 signals, with a positive peak of potential about 300 ms posterior to the onset of target stimulus. In this virtual environment, the participants can obtain a more immersed experience with the BCI system, such as controlling a virtual hand or walking around in the virtual world. Methods of modeling the virtual hand and analyzing the p300 signals are also described in detail. template matching and support vector machine were used as the p300 classifier and the experiment results showed that both algorithms perform well in the system. After a short time of practice, most participants could learn to control the virtual hand during the online experiment with greater than 70% accuracy.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Bayliss, J.D., Inverso, S.A., Tentler, A., 2004. Changing the P300 brain computer interface. Cyberpsych. & Behav., 7(6):694-704.

[2]Beverina, F., Palmas, G., Silvoni, S., Piccione, F., 2003. User adaptive BCIs SSVEP and P300 based interfaces. PsychNol. J., 1(4):331-354.

[3]Boser, B.E., Guyon, I.M., Vapnik, V., 1992. A Training Algorithm for Optimal Margin Classifiers. Proc. 5th Annual Workshop on Computational Learning Theory, p.144-152.

[4]Cortes, C., Vapnik, U., 1995. Support-vector networks. Mach. Learn., 20(3):273-297.

[5]Croft, R.J., Barry, R.J., 2000. Removal of ocular artifact from the EEG: a review. Neurophys. Clin., 30(1):5-19.

[6]Farwell, L.A., Donchin, E., 1988. Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephal. Clin. Neurophys., 70(6):510-523.

[7]Feng, Z.Y., Chen, W.D., Ye, X.S., Zhang, S.M., Zheng, X.J., Wang, P., Jiang, J., Jin, L., Xu, Z.J., Liu, C.Q., et al., 2007. A remote control training system for rat navigation in complicated environment. J. Zhejiang Univ. Sci. A, 8(2):323-330.

[8]Finke, A., Lenhardt, A., Ritter, H., 2009. The MindGame: a P300-based brain computer interface game. Neur. Networks, 22(9):1329-1333.

[9]Friedman, D., Leeb, R., Guger, C., Steed, A., Pfurtscheller, G., 2007. Navigating virtual reality by thought: what is it like? Pres. Teleoper. Virt. Environ., 16(1):100-110.

[10]Hoffmann, U., Vesin, J.M., Ebrahimi, T., Diserens, K., 2008. An efficient P300-based brain-computer interface for disabled subjects. J. Neuros. Methods, 167(1):115-125.

[11]Krusienski, D.J., Sellers, E.W., McFarland, D.J., Vaughan, T.M., Wolpaw, J.R., 2008. Toward enhanced P300 speller performance. J. Neurosci. Methods, 167(1):15-21.

[12]Lebedev, M.A., Nicolelis, M.A., 2006. Brain-machine interfaces: past, present and future. Trends Neurosci., 29(9):536-546.

[13]Lee, J., Kunii, T.L., 1995. Model-based analysis of hand posture. IEEE Comput. Graph. Appl., 15(5):77-86.

[14]Li, Y., Zhang, J.H., Su, Y., Chen, W.D., Qi, Y., Zhang, J.C., Zheng, X.X., 2009. P300 Based BCI Messenger. IEEE/ICME Int. Conf. on Complex Medical Engineering, p.1-5.

[15]Lin, J., Wu, Y., Huang, T.S., 2000. Modeling the Constraints of Human Hand Motion. Proc. Workshop on Human Motion, p.121-126.

[16]Nijboer, F., Sellers, E.W., Mellinger, J., Jordan, M.A., Matuz, T., Furdea, A., Halder, S., Mochty, U., Krusienski, D.J., Vaughan, T.M., et al., 2008. A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin. Neurophys., 119(8):1909-1916.

[17]Piccione, F., Giorgi, F., Tonin, P., Priftis, K., Giove, S., Silvoni, S., Palmas, G., Beverina, F., 2006. A P300-based brain computer interface reliability and performance in healthy and paralysed participants. Clin. Neurophys., 117(3):531-547.

[18]Piccione, F., Priftis, K., Tonin, P., 2008. Task and stimulation paradigm effects in a P300 brain computer interface exploitable in a virtual environment: a pilot study. PsychNol. J., 6(1):99-108.

[19]Sellers, E.W., Donchin, E., 2006. A P300-based brain-computer interface: initial tests by ALS patients. J. Neurosci. Methods, 117:538-548.

[20]Sellers, E.W., Krusienski, D.J., McFarland, D.J., Vaughan, T.M., Wolpaw, J.R., 2006. A P300 event-related potential brain-computer interface (BCI): the effects of matrix size and inter stimulus interval on performance. Biol. Psychol., 73(3):242-252.

[21]Serby, H., Yom-Tov, E., Inbar, G.F., 2005. An improved P300-based brain-computer interface. IEEE Trans. Neur. Syst. Rehabil. Eng., 13(1):89-98.

[22]Sturman, D.J., 1992. Whole-Hand Input. PhD Thesis, Massachusetts Institute of Technology, USA.

[23]Su, Y., Wu, B., Chen, W.D., 2008. P300-based brain computer interface: prototype of a Chinese speller. J. Comput. Inform. Syst., 4(4):1515-1522.

[24]Theodoridis, S., Koutroumbas, K., 2006. Pattern Recognition. Elsevier/Academic Press, Boston.

[25]Vaughan, T.M., Wolpaw, J.R., 2006. The third international meeting on brain-computer interface technology: making a difference. IEEE Trans. Neur. Syst. Rehabil. Eng., 14(2):126-127.

[26]Vaughan, T.M., Heetderks, W.J., Trejo, L.J., Rymer, W.Z., Weinrich, M., Moore, M.M., Kübler, A., Dobkin, B.H., Birbaumer, N., Donchin, E., et al., 2003. Brain-computer interface technology: a review of the second international meeting. IEEE Trans. Neur. Syst. Rehabil. Eng., 11(2):94-109.

[27]Wolpaw, J.R., Birbaumer, N., Heetderks, W.J., McFarland, D.J., Peckham, P.H., Schalk, G., Donchin, E., Quatrano, L.A., Robinson, C.J., Vaughan, T.M., 2000. Brain-computer interface technology: a review of the first international meeting. IEEE Trans. Rehabil. Eng., 8(2):164-173.

[28]Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M., 2002. Brain-computer interfaces for communication and control. Clin. Neurophys., 113(6):767-791.

[29]Yi, B., Harris, F.C.Jr., Wang, L., Yan, Y., 2005. Real-time natural hand gestures. Comput. Sci. Eng., 7(3):92-96.

[30]Zhang, H.H., Guan, C.T., Wang, C.C., 2008. Asynchronous P300-based brain-computer interfaces: a computational approach with statistical models. IEEE Trans. Biomed. Eng., 55(6):1754-1763.

[31]Zhao, Q.B., Zhang, L.Q., Cichocki, A., 2009. EEG-based asynchronous BCI control of a car in 3D virtual reality environments. Chin. Sci. Bull., 54(1):78-87.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE