Full Text:   <331>

Summary:  <197>

Suppl. Mater.: 

CLC number: TP242.6; R748

On-line Access: 2019-04-09

Received: 2018-09-11

Revision Accepted: 2019-01-28

Crosschecked: 2019-03-14

Cited: 0

Clicked: 2370

Citations:  Bibtex RefMan EndNote GB/T7714

 ORCID:

Jia-ming Zhang

http://orcid.org/0000-0001-9146-0501

-   Go to

Article info.
Open peer comments

Frontiers of Information Technology & Electronic Engineering  2019 Vol.20 No.3 P.374-387

http://doi.org/10.1631/FITEE.1800555


Attention shifting during child–robot interaction: a preliminary clinical study for children with autism spectrum disorder


Author(s):  Guo-bin Wan, Fu-hao Deng, Zi-jian Jiang, Sheng-zhao Lin, Cheng-lian Zhao, Bo-xun Liu, Gong Chen, Shen-hong Chen, Xiao-hong Cai, Hao-bo Wang, Li-ping Li, Ting Yan, Jia-ming Zhang

Affiliation(s):  Shenzhen Maternal & Child Healthcare Hospital, Shenzhen 518000, China; more

Corresponding email(s):   zhangjiaming@cuhk.edu.cn

Key Words:  Human—robot interaction, Robot-enhanced therapy, Socially interactive robots, Robot-mediated intervention


Guo-bin Wan, Fu-hao Deng, Zi-jian Jiang, Sheng-zhao Lin, Cheng-lian Zhao, Bo-xun Liu, Gong Chen, Shen-hong Chen, Xiao-hong Cai, Hao-bo Wang, Li-ping Li, Ting Yan, Jia-ming Zhang. Attention shifting during child–robot interaction: a preliminary clinical study for children with autism spectrum disorder[J]. Frontiers of Information Technology & Electronic Engineering, 2019, 20(3): 374-387.

@article{title="Attention shifting during child–robot interaction: a preliminary clinical study for children with autism spectrum disorder",
author="Guo-bin Wan, Fu-hao Deng, Zi-jian Jiang, Sheng-zhao Lin, Cheng-lian Zhao, Bo-xun Liu, Gong Chen, Shen-hong Chen, Xiao-hong Cai, Hao-bo Wang, Li-ping Li, Ting Yan, Jia-ming Zhang",
journal="Frontiers of Information Technology & Electronic Engineering",
volume="20",
number="3",
pages="374-387",
year="2019",
publisher="Zhejiang University Press & Springer",
doi="10.1631/FITEE.1800555"
}

%0 Journal Article
%T Attention shifting during child–robot interaction: a preliminary clinical study for children with autism spectrum disorder
%A Guo-bin Wan
%A Fu-hao Deng
%A Zi-jian Jiang
%A Sheng-zhao Lin
%A Cheng-lian Zhao
%A Bo-xun Liu
%A Gong Chen
%A Shen-hong Chen
%A Xiao-hong Cai
%A Hao-bo Wang
%A Li-ping Li
%A Ting Yan
%A Jia-ming Zhang
%J Frontiers of Information Technology & Electronic Engineering
%V 20
%N 3
%P 374-387
%@ 2095-9184
%D 2019
%I Zhejiang University Press & Springer
%DOI 10.1631/FITEE.1800555

TY - JOUR
T1 - Attention shifting during child–robot interaction: a preliminary clinical study for children with autism spectrum disorder
A1 - Guo-bin Wan
A1 - Fu-hao Deng
A1 - Zi-jian Jiang
A1 - Sheng-zhao Lin
A1 - Cheng-lian Zhao
A1 - Bo-xun Liu
A1 - Gong Chen
A1 - Shen-hong Chen
A1 - Xiao-hong Cai
A1 - Hao-bo Wang
A1 - Li-ping Li
A1 - Ting Yan
A1 - Jia-ming Zhang
J0 - Frontiers of Information Technology & Electronic Engineering
VL - 20
IS - 3
SP - 374
EP - 387
%@ 2095-9184
Y1 - 2019
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/FITEE.1800555


Abstract: 
There is an increasing need to introduce socially interactive robots as a means of assistance in autism spectrum disorder (ASD) treatment and rehabilitation, to improve the effectiveness of rehabilitation training and the diversification of treatment, and to alleviate the shortage of medical personnel in mainland China and other places in the world. In this preliminary clinical study, three different socially interactive robots with different appearances and functionalities were tested in therapy-like settings in four different rehabilitation facilities/institutions in Shenzhen, China. Seventy-four participants, including 52 children with ASD, whose processes of interacting with robots were recorded by three different cameras, all received a single-session three-robot intervention. Data were collected from not only the videos recorded, but also the questionnaires filled mostly by parents of the participants. Some insights from the preliminary results were obtained. These can contribute to the research on physical robot design and evaluations on robots in therapy-like settings. First, when doing physical robot design, some preferential focus should be on aspects of appearances and functionalities. Second, attention analysis using algorithms such as estimation of the directions of gaze and head posture of a child in the video clips can be adopted to quantitatively measure the prosocial behaviors and actions (e.g., attention shifting from one particular robot to other robots) of the children. Third, observing and calculating the frequency of the time children spend on exploring/playing with the robots in the video clips can be adopted to qualitatively analyze such behaviors and actions. Limitations of the present study are also presented.

儿童与机器人交互过程中的注意力转移:对孤独症谱系障碍儿童的初步临床研究

摘要:在孤独症谱系障碍(autism spectrum disorder,ASD)治疗和康复中,越来越需要引入社会交互式机器人作为辅助手段,以提升康复训练有效性和治疗多样性,缓解中国大陆和世界其它地方医疗人员短缺。为开展本次初步临床研究,在中国深圳4个不同康复设施/机构,对3个不同外观和功能的社会交互式机器人进行类似孤独症康复疗程的测试。包括52名孤独症儿童在内的74名参与者接受同时有3个不同机器人干预的测试,每位参与者与机器人交互过程由3台不同摄像机记录。统计数据源于收集的录像和大部分由参与者父母填写的问卷。初步临床研究有助于物理机器人设计和治疗环境下机器人评估。首先,设计物理机器人应优先考虑外观和功能。其次,采用类似视频中儿童注视方向和头部姿势分析注意力,定量测量儿童亲社会行为和动作(如注意力从一个特定机器人转移到其他机器人)。再次,观察计算视频剪辑中儿童与机器人探索/玩耍的时间频率,定性分析这些行为和动作。最后列举了本研究的局限性。

关键词:人与机器人交互;机器人提升疗法;社会交互式机器人;机器人介导干预

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Baltrušaitis T, Robinson P, Morency LP, 2016. OpenFace: an open source facial behavior analysis toolkit. Proc IEEE Winter Conf on Applications of Computer Vision, p.1-10.

[2]Begum M, Serna RW, Yanco HA, 2016. Are robots ready to deliver autism interventions? A comprehensive review. Int J Soc Rob, 8(2):157-181.

[3]Clabaugh C, Becerra D, Deng E, et al., 2018. Month-long, in-home case study of a socially assistive robot for children with autism spectrum disorder. Companion of the ACM/IEEE Int Conf on Human–Robot Interaction, p.87-88.

[4]Coeckelbergh M, Pop C, Simut R, et al., 2016. A survey of expectations about the role of robots in robot-assisted therapy for children with ASD: ethical acceptability, trust, sociability, appearance, and attachment. Sci Eng Ethics, 22(1):47-65.

[5]Costescu CA, Vanderborght B, David DO, 2014. The effects of robot-enhanced psychotherapy: a meta-analysis. Rev Gen Psychol, 18(2):127-136.

[6]Diehl JJ, Schmitt LM, Villano M, et al., 2012. The clinical use of robots for individuals with autism spectrum disorders: a critical review. Res Autism Spectr Disord, 6(1):249-262.

[7]English BA, Coates A, Howard A, 2017. Recognition of gestural behaviors expressed by humanoid robotic platforms for teaching affect recognition to children with autism—a healthy subjects pilot study. In: Kheddar A, Yoshida E, Ge SS, et al. (Eds.), Social Robotics. Springer, Cham.

[8]Esteban PG, Baxter P, Belpaeme T, et al., 2017. How to build a supervised autonomous system for robot-enhanced therapy for children with autism spectrum disorder. Paladyn J Behav Rob, 8(1):18-38.

[9]Greczek J, Matarić M, 2015. Encouraging user autonomy through robot-mediated intervention. Proc 10th ACM/ IEEE Int Conf on Human–Robot Interaction Extended, p.189-190.

[10]Huijnen CAGJ, Lexis MAS, Jansens R, et al., 2016. Mapping robots to therapy and educational objectives for children with autism spectrum disorder. J Autism Dev Disord, 46(6):2100-2114.

[11]Huijnen CAGJ, Lexis MAS, Jansens R, et al., 2017. How to implement robots in interventions for children with autism? A co-creation study involving people with autism, parents and professionals. J Autism Dev Disord, 47(10): 3079-3096.

[12]Lee B, Xu J, Howard A, 2017. Does appearance matter? Validating engagement in therapy protocols with socially interactive humanoid robots. Proc IEEE Symp Series on Computational Intelligence, p.1-6.

[13]Matarić MJ, 2017. Socially assistive robotics: human augmentation versus automation. Sci Rob, 2(4), Article eaam5410.

[14]Munir KM, Lavelle TA, Helm DT, et al., 2016. Autism: a global framework for action. http://www.wish.org.qa/ summits/wish-2016/forum-reports/

[15]Pennisi P, Tonacci A, Tartarisco G, et al., 2016. Autism and social robotics: a systematic review. Autism Res, 9(2): 165-183.

[16]Robins B, Dautenhahn K, 2014. Tactile interactions with a humanoid robot: novel play scenario implementations with children with autism. Int J Soc Rob, 6(3):397-415.

[17]Scassellati B, Admoni H, Matarić M, 2012. Robots for use in autism research. Ann Rev Biom Eng, 14:275-294.

[18]Simut R, van de Perre G, Costescu C, et al., 2016. Probogotchi: a novel edutainment device as a bridge for interaction between a child with ASD and the typically developed sibling. J Evid Based Psychot, 16(1):91-112.

[19]Sun X, Allison C, Matthews FE, et al., 2013. Prevalence of autism in mainland China, Hong Kong and Taiwan: a systematic review and meta-analysis. Mol Autism, 4(1), Article 7.

[20]Wainer J, Dautenhahn K, Robins B, et al., 2014. A pilot study with a novel setup for collaborative play of the humanoid robot KASPAR with children with autism. Int J Soc Rob, 6(1):45-65.

[21]Wang S, Jiang M, Duchesne XM, et al., 2015. A typical visual saliency in autism spectrum disorder quantified through model-based eye tracking. Neuron, 88(3):604-616.

[22]WUCAILU ASD Research Institute, 2017. Report on the Industry Development of Autism Education and Rehabilitation in China (II). Huaxia Publishing House, Beijing, China (in Chinese).

[23]Zheng ZW, 2017. The Situation of the Life and the Learning of Two Million Autistic Children Became Severe. Modern Education News, Mar. 31, 2017 (in Chinese).

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - Journal of Zhejiang University-SCIENCE