广西师范大学学报（哲学社会科学版） ›› 2020, Vol. 56 ›› Issue (3): 111-119.doi: 10.16088/j.issn.1001-6597.2020.03.009

• 教育科学 • 上一篇    下一篇

人机交互技术在孤独症谱系障碍儿童教育干预中的应用

陈靓影1,2, 王广帅1, 刘俐俐1,2, 刘乐元1,2   

  1. 1.华中师范大学国家数字化工程技术研究中心,湖北武汉430079;
    2.华中师范大学教育大数据应用技术国家工程实验室,湖北武汉430079
  • 收稿日期:2020-01-06 出版日期:2020-05-25 发布日期:2020-06-04
  • 作者简介:陈靓影(1973-),华中师范大学教授,博士生导师,楚天学者,教育学博士,研究方向:图像处理与模式识别、人机交互、机器学习、特殊儿童教育等。
  • 基金资助:
    2018年度国家自然科学基金面上项目“孤独症儿童个性化智能干预与精细评估”(61977027)

The Application of Human-computer Interaction Technology in the Education Intervention of Children with Autism Spectrum Disorder

CHEN Jing-ying1,2, WANG guang-shuai1, LIU Li-li1,2, LIU Le-yuan1,2   

  1. 1. National Engineering Research Center for E-Learning, Central China Normal University, Wuhan 430079;
    2. National Engineering Laboratory for Educational Big Data, Central China Normal University, Wuhan 430079, China
  • Received:2020-01-06 Online:2020-05-25 Published:2020-06-04

PDF (PC)

693

摘要： 孤独症谱系障碍发病率不断攀升,成为亟待解决的社会问题,但缺乏有效的治疗药物和方法,教育干预训练是儿童孤独症康复的最佳手段。研究表明,基于人机交互技术的教育干预是实现孤独症儿童康复的可行新途径。虚拟现实、增强现实、多媒体、智能机器人与自然人机交互等技术在孤独症儿童教育干预中的相关应用研究已取得重要进展,但也面临一些问题,发展一种包含不同孤独症儿童发展轨迹的、适应于不同儿童个体的交互技术干预方法尤为迫切。

关键词: 人机交互技术, 孤独症谱系障碍, 儿童教育, 教育干预

Abstract: That the incidence rate of autism spectrum disorders is rising has made it a social problem to be solved urgently. As there lie no effective medicine and method, education intervention training is the best way for children to recover from autism. The educational intervention based on human-computer interaction technology, the research reveals, is a feasible new way to recover for these children. This study analyzes the application of virtual reality, augmented reality, multimedia, intelligent robot and natural human-computer interaction technology in the education intervention of autistic children. On this basis, it summarizes the problems faced in this field and puts forward suggestions for the development of an interactive technology intervention method that includes different development tracks of autistic children and suits different children.

Key words: human-computer interaction technology, autism spectrum disorder, children’s education, educational intervention

中图分类号: 

  • G76
[1] DSM-5 American Psychiatric Association.Diagnostic and statistical manual of mental disorders [M]. Arlington: American Psychiatric Publishing, 2013.
[2] Baio J, Wiggins L, Christensen D L, et al. Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2014[J]. MMWR Surveill Summ. 2018,67(6):1-23.
[3] 邹小兵.与你同行——自闭症儿童家长必读[M].北京:人民卫生出版社,2013.
[4] 冯乃光.交互技术的研究及实现——交互式多媒体教学系统的设计技巧[J].现代电子技术, 2007,30(19):175-177.
[5] Kagohara, D. M., van der Meer, L., Ramdoss, S., et al. Using iPods©and iPads©in teaching programs for individuals with developmental disabilities: A systematic review[J].Research in developmental disabilities,2013,34(1):147-156.
[6] 陈靓影,王广帅,张坤,等.基于计算机游戏的自闭症谱系障碍儿童评估研究[J].电化教育研究,2017,38(11):81-86.
[7] 俞蓉蓉.计算机辅助技术在自闭症儿童教育干预中的应用进展[J].中国特殊教育,2015(9).
[8] 李长山.虚拟现实技术及其应用:第1版[M].北京:石油工业出版社,2006.
[9] 王庭照,许琦,赵微.虚拟现实技术在特殊儿童教学与训练中的应用研究[J].华东师范大学学报(教育科学版),2013(3):33-40.
[10] Marnik, J., Szela, M. Multimedia Program for Teaching Autistic Children:Information Technologies in Biomedicine[M]. Springer Berlin Heidelberg,2008:505-512.
[11] Josman, Ben-Chaim, M., Friedrich, H., et al. Effectiveness of Virtual Reality for Teaching Street-Crossing Skills to Children and Adolescents with Autism[J]. International Journal of Disability Development & Education,2008,7(1):49-56.
[12] 张倩.虚拟现实技术在自闭症患者干预中的应用[J].中国特殊教育,2010(5):27-31.
[13] Parsons, S., Mitchell, P., Leonard, A. The Use and Understanding of Virtual Environments by Adolescents with Autistic SpectrumDisorders[J].Journal of Autism & Developmental Disorders,2004,34(4):449-466.
[14] Bellani, M., Fornasari, L., Chittaro, L., et al. Virtual reality in autism: state of the art[J]. Epidemiology & Psychiatric Sciences, 2011, 20(3):235-238.
[15] Parsons, S., Leonard, A., Mitchell, P. Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder [J].Compu-ters & Education, 2006, 47(2):186-206.
[16] M. D. Rutherford and M. T. Towns. Scan path differences and similarities during emotion perception in those with and without autism spectrum disorders [J].Aut. Dev. Disord., 2008 ,38:1371-1381,
[17] C. Y. Trepagnier, M. M. Sebrechts, A. Finkelmeyer, W. Stewart, J. Woodford and M. Coleman Simulating social interaction to address deficits of autistic spectrum disorder in children [J].Cyberpsychol. Behav., 2006, 9(2): 213-217.
[18] E. Bekele, et al.Multimodal adaptive social interaction in virtual environment (MASI-VR) for children with Autism spectrum disorders (ASD)[R]. 2016 IEEE Virtual Reality (VR), Greenville, SC, 2016:121-130.
[19] Charitos, D., Karadanos, G., Sereti, E., et al. Employing virtual reality for aiding the organisation of autistic children behaviour in everyday tasks[C]. Proceedings of ICDVRAT,2000.
[20] Bamasak, O., Braik, R., Al-Tayari, H., et al. Improving autistic children’s social skills using virtual reality[C]. Proceedings of the Second international conference on Design, User Experience, and Usability: health, learning, playing, cultural, and cross-cultural user experience - Volume Part II. Springer-Verlag, 2013:342-351.
[21] Josman, N., Ben-Chaim, H. M., Friedrich, S., et al. Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism[J]. International Journal on Disability and Human Development,2008,7(1): 49-56.
[22] 张玲.“医教结合”:教育康复人才培养的创新路径与对策[J].广西师范大学学报(哲学社会科学版),2016(3):120-125.
[23] 柳菁. 虚拟现实技术应用于心理治疗领域的最新进展[J].心理科学,2008(3):762-764.
[24] 刘翠娟,刘箴,刘婷婷,等.虚拟现实在焦虑症和自闭症治疗中的应用研究[J].系统仿真学报,2015(10):2233-2238.
[25] 王勇丽,梁峻波,万勤,等.基于体感技术的感觉统合游戏的设计与实现[J].中国教育技术装备,2016(2):53-57.
[26] 柳祖国,李世其,李作清.增强现实技术的研究进展及应用[J].系统仿真学报,2003(2):222-225.
[27] Richard and E. Augmented reality for rehabilitation of cognitive disabled children: a preliminary study[J] . Virtual Rehabilitation, 2007:102-108,
[28] P. Cunha, J. Brandão, J. Vasconcelos, F. Soares and V. Carvalho. Augmented reality for cognitive and social skills improvement in children with ASD[C]. 2016 13th International Conference on Remote Engineering and Virtual Instrumentation (REV), Madrid, 2016:334-335.
[29] 熊剑明.增强现实互动技术在学前教育领域的应用[J].中国教育信息化,2015(6):22.
[30] 程鹏润. 基于Android平台的增强现实的实现和应用[D]. 杭州:浙江工业大学,2015.
[31] 陈靓影,赵俊敏,王广帅,等.增强现实技术在孤独症儿童干预中的应用研究——以词汇认知干预为例[J].现代教育技术,2019,29(8):86-92.
[32] 冯学斌,赵建民.现代教育技术[M].济南:山东人民出版社,2003:11.
[33] 王广帅,鲁明辉,王广海,等.现代教育技术在自闭谱系障碍儿童干预中的应用[J].中国医学教育技术,2015,29(2):174-177.
[34] 曹漱芹,方俊明.自闭症谱系儿童语言干预中的“视觉支持”策略[J].中国特殊教育,2008(5):26-32.
[35] Macpherson, K. and Charlop, M. H. Miltenberger C A. Using portable video modeling technology to increase the compliment behaviors of children with autism during athletic group play[J]. Journal of autism and developmental disorders, 2015, 45(12): 3836-3845.
[36] Rao, K. and Skouge, J. Using Multimedia Technologies to Support Culturally and Linguistically Diverse Learners and Young Children with Disabilities:Young Children and Families in the Information Age[M]. Springer Netherlands,2015:101-115.
[37] Lorah, E. R., Parnell, A., Whitby, P. S., et al. A Systematic Review of Tablet Computers and Portable Media Players as Speech Generating Devices for Individuals with Autism Spectrum Disorder[J]. Journal of Autism & Developmental Disorders,2015, 45:1-13.
[38] 李亚华.多感官训练系统培养自闭症儿童交往能力的个案研究[J].乐山师范学院学报, 2014(5):133-136.
[39] 张春花.基于iPad的PECS教学方案干预自闭症儿童沟通行为之研究[D]. 重庆:重庆师范大学,2015.
[40] Kagohara, D. M., Sigafoos, J., Achmadi, D., et al. Teaching children with autism spectrum disorders to check the spelling of words[J]. Research in Autism Spectrum Disorders,2012,6(1):304-310.
[41] 申宁馨.机器人医生:治愈自闭症[J].环球科学,2011(9):84-85.
[42] Diehl, J. J., Schmitt, L. M., Villano, M., et al. The clinical use of robots for individuals with Autism Spectrum Disorders: A critical review[J]. Research in Autism Spectrum Disorders,2012,6(1):249-262.
[43] Scassellati, B., Admoni, H., Mataric′, M. Robots for use in autism research.[J]. Annual Review of Biomedical Engineering,2012,14(4):275-94.
[44] Thill, S., Pop, C. A., Belpaeme, T., et al. Robot-Assisted Therapy for Autism Spectrum Disorders with (Partially) Autonomous Control: Challenges and Outlook[J]. Paladyn,2012,3(4):209-217.
[45] Kee, N. K. N. Application of Universal Design for Learning (Udl1) and Living (Udl2) in Virtual Dolphin-Assisted Intervention (Vdai) for Children with Autism Noel Kok Hwee Chia National Institute of Education Nanyang Technological University[J]. The Journal of the International Association of Special Education, 2014,15(1):75.
[46] Wainer, J., Robins, B., Amirabdollahian, F., et al. Using the humanoid robot KASPAR to autonomously play triadic games and facilitate collaborative play among children with autism[J]. Autonomous Mental Development, IEEE Transactions, 2014, 6(3):183-199.
[47] Shamsuddin, S., Yussof, H., Hashim, H., et al. Humanoid Robot NAO as HRI Mediator to Teach Emotions using Game-centered Approach for Children with Austism[C]. 8th HRI 2013 International Conference on Human Robot Interaction. Tokyo, Japan,2013.
[48] Kajopoulos, J., Wong, A. H. Y., Yuen, A. W. C., et al. Robot-Assisted Training of Joint Attention Skills in Children Diagnosed with Autism[M]. Social Robotics. Springer International Publishing,2015:296-305.
[49] R. Bevill, et al. Multisensory robotic therapy to promote natural emotional interaction for children with ASD[R]. 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Christchurch, 2016, pp. 571-571.
[50] X. Liu, C. Liu, X. Zhou, X. Zhou and A. Jiang. Movement imitation underlying coaching platform for children with ASD[R]. Consumer Electronics - Taiwan (ICCE-TW), 2015 IEEE International Conference on Taipei, 2015, pp. 57-58.
[51] 李睿强. 基于NAO机器人的自闭症儿童康复训练核心模块的研究与应用[D].上海:华东师范大学,2016.
[52] D’Amico, G., Del Bimbo, A., Dini, F., et al. Natural Human–Computer Interaction: Multimedia Interaction and Intelligent User Interfaces[M]. Springer London,2010:85-106.
[53] Bartoli, L., Garzotto, F., Gelsomini, M., et al. Designing and evaluating touchless playful interaction for ASD children[C]. Proceedings of the 2014 conference on Interaction design and children.ACM,2014:17-26.
[54] 李青,王青.体感交互技术在教育中的应用现状述评[J].远程教育杂志,2015(1):48-56.
[55] 刘艳虹,雷显梅,胡晓毅.国外自闭症儿童体感游戏研究状况及启示[J].中国特殊教育, 2015(5):51-56.
[56] Uzuegbunam, N., Wong, W. H., Cheung, S. S., et al. MEBook: Kinect-based self-modeling intervention for children with autism[C]. Multimedia and Expo (ICME), 2015 IEEE International Conference on.IEEE,2015:1-6.
[57] Garzotto, F., Gelsomini, M., Oliveto, L., et al. Motion-based touchless interaction for ASD children: a case study[C]. Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces. ACM,2014:117-120.
[58] Christinaki, E., Vidakis, N., Triantafyllidis, G. A novel educational game for teaching emotion identification skills to preschoolers with autism diagnosis[J].Computer Science and Information Systems,2014,11(2):723-743.
[59] Boutsika, E. Kinect in Education: A Proposal for Children with Autism [J]. Procedia Computer Science,2014,27(27):123-129.
[1] 张坤, 高磊, 袁艺双, 彭世新, 徐如意. 自闭症儿童对卡通与真人动态社会情境的视觉注意特点研究[J]. 广西师范大学学报（哲学社会科学版）, 2020, 56(3): 120-127.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
[1] 欧阳修俊, 张传燧. 教育学跨界研究探析[J]. 广西师范大学学报（哲学社会科学版）, 2017, 53(3): 98 -104 .
[2] 余欣欣, 杨静, 张月. 信息化时代农村中小学心理健康教育家校合作模式探究[J]. 广西师范大学学报（哲学社会科学版）, 2018, 54(6): 94 -99 .
[3] 陈凤,蒙祖强. 基于BTM和加权K-Means的微博话题发现[J]. 广西师范大学学报（哲学社会科学版）, 2019, 37(3): 71 -78 .
[4] 国建文,苏德. 跨文化场景调查研究中的伦理问题及其解决——基于文化敏感性的视角[J]. 广西师范大学学报（哲学社会科学版）, 2019, 55(4): 75 -82 .
[5] 孙南申, 孙颖. 论国际投资仲裁裁决在《纽约公约》下的执行问题[J]. 广西师范大学学报（哲学社会科学版）, 2020, 56(1): 55 -64 .
[6] 张珊珊, 张野, 陈萌萌. 社会排斥危机对儿童欺骗行为的影响:归属需要的调节作用[J]. 广西师范大学学报（哲学社会科学版）, 2020, 56(1): 95 -102 .
[7] 包大为. 新民主主义论的当代性及其实践条件[J]. 广西师范大学学报（哲学社会科学版）, 2020, 56(2): 1 -10 .
[8] 黄顺春, 邓文德. 中国区域经济高质量发展差异及其影响因素分析[J]. 广西师范大学学报（哲学社会科学版）, 2020, 56(2): 82 -93 .
[9] 钱雨, 何梦瑶. 美国早期干预研究的启示:支持处境不利儿童[J]. 广西师范大学学报（哲学社会科学版）, 2020, 56(2): 124 -134 .
[10] 谭培文, 谌尧. 辩证认识资本的文明作用及当代价值[J]. 广西师范大学学报（哲学社会科学版）, 2020, 56(3): 1 -9 .
版权所有 © 广西师范大学学报（哲学社会科学版）编辑部
地址：广西桂林市三里店育才路15号　邮编：541004
电话：0773-5857325　E-mail: xbgj@mailbox.gxnu.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发