Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition) ›› 2020, Vol. 56 ›› Issue (3): 111-119.doi: 10.16088/j.issn.1001-6597.2020.03.009

Previous Articles     Next Articles

The Application of Human-computer Interaction Technology in the Education Intervention of Children with Autism Spectrum Disorder

CHEN Jing-ying1,2, WANG guang-shuai1, LIU Li-li1,2, LIU Le-yuan1,2   

  1. 1. National Engineering Research Center for E-Learning, Central China Normal University, Wuhan 430079;
    2. National Engineering Laboratory for Educational Big Data, Central China Normal University, Wuhan 430079, China
  • Received:2020-01-06 Online:2020-05-25 Published:2020-06-04

Abstract: That the incidence rate of autism spectrum disorders is rising has made it a social problem to be solved urgently. As there lie no effective medicine and method, education intervention training is the best way for children to recover from autism. The educational intervention based on human-computer interaction technology, the research reveals, is a feasible new way to recover for these children. This study analyzes the application of virtual reality, augmented reality, multimedia, intelligent robot and natural human-computer interaction technology in the education intervention of autistic children. On this basis, it summarizes the problems faced in this field and puts forward suggestions for the development of an interactive technology intervention method that includes different development tracks of autistic children and suits different children.

Key words: human-computer interaction technology, autism spectrum disorder, children’s education, educational intervention

CLC Number: 

  • G76
[1] DSM-5 American Psychiatric Association.Diagnostic and statistical manual of mental disorders [M]. Arlington: American Psychiatric Publishing, 2013.
[2] Baio J, Wiggins L, Christensen D L, et al. Prevalence of autism spectrum disorder among children aged 8 years - autism and developmental disabilities monitoring network, 11 sites, United States, 2014[J]. MMWR Surveill Summ. 2018,67(6):1-23.
[3] 邹小兵.与你同行——自闭症儿童家长必读[M].北京:人民卫生出版社,2013.
[4] 冯乃光.交互技术的研究及实现——交互式多媒体教学系统的设计技巧[J].现代电子技术, 2007,30(19):175-177.
[5] Kagohara, D. M., van der Meer, L., Ramdoss, S., et al. Using iPods©and iPads©in teaching programs for individuals with developmental disabilities: A systematic review[J].Research in developmental disabilities,2013,34(1):147-156.
[6] 陈靓影,王广帅,张坤,等.基于计算机游戏的自闭症谱系障碍儿童评估研究[J].电化教育研究,2017,38(11):81-86.
[7] 俞蓉蓉.计算机辅助技术在自闭症儿童教育干预中的应用进展[J].中国特殊教育,2015(9).
[8] 李长山.虚拟现实技术及其应用:第1版[M].北京:石油工业出版社,2006.
[9] 王庭照,许琦,赵微.虚拟现实技术在特殊儿童教学与训练中的应用研究[J].华东师范大学学报(教育科学版),2013(3):33-40.
[10] Marnik, J., Szela, M. Multimedia Program for Teaching Autistic Children:Information Technologies in Biomedicine[M]. Springer Berlin Heidelberg,2008:505-512.
[11] Josman, Ben-Chaim, M., Friedrich, H., et al. Effectiveness of Virtual Reality for Teaching Street-Crossing Skills to Children and Adolescents with Autism[J]. International Journal of Disability Development & Education,2008,7(1):49-56.
[12] 张倩.虚拟现实技术在自闭症患者干预中的应用[J].中国特殊教育,2010(5):27-31.
[13] Parsons, S., Mitchell, P., Leonard, A. The Use and Understanding of Virtual Environments by Adolescents with Autistic SpectrumDisorders[J].Journal of Autism & Developmental Disorders,2004,34(4):449-466.
[14] Bellani, M., Fornasari, L., Chittaro, L., et al. Virtual reality in autism: state of the art[J]. Epidemiology & Psychiatric Sciences, 2011, 20(3):235-238.
[15] Parsons, S., Leonard, A., Mitchell, P. Virtual environments for social skills training: comments from two adolescents with autistic spectrum disorder [J].Compu-ters & Education, 2006, 47(2):186-206.
[16] M. D. Rutherford and M. T. Towns. Scan path differences and similarities during emotion perception in those with and without autism spectrum disorders [J].Aut. Dev. Disord., 2008 ,38:1371-1381,
[17] C. Y. Trepagnier, M. M. Sebrechts, A. Finkelmeyer, W. Stewart, J. Woodford and M. Coleman Simulating social interaction to address deficits of autistic spectrum disorder in children [J].Cyberpsychol. Behav., 2006, 9(2): 213-217.
[18] E. Bekele, et al.Multimodal adaptive social interaction in virtual environment (MASI-VR) for children with Autism spectrum disorders (ASD)[R]. 2016 IEEE Virtual Reality (VR), Greenville, SC, 2016:121-130.
[19] Charitos, D., Karadanos, G., Sereti, E., et al. Employing virtual reality for aiding the organisation of autistic children behaviour in everyday tasks[C]. Proceedings of ICDVRAT,2000.
[20] Bamasak, O., Braik, R., Al-Tayari, H., et al. Improving autistic children’s social skills using virtual reality[C]. Proceedings of the Second international conference on Design, User Experience, and Usability: health, learning, playing, cultural, and cross-cultural user experience - Volume Part II. Springer-Verlag, 2013:342-351.
[21] Josman, N., Ben-Chaim, H. M., Friedrich, S., et al. Effectiveness of virtual reality for teaching street-crossing skills to children and adolescents with autism[J]. International Journal on Disability and Human Development,2008,7(1): 49-56.
[22] 张玲.“医教结合”:教育康复人才培养的创新路径与对策[J].广西师范大学学报(哲学社会科学版),2016(3):120-125.
[23] 柳菁. 虚拟现实技术应用于心理治疗领域的最新进展[J].心理科学,2008(3):762-764.
[24] 刘翠娟,刘箴,刘婷婷,等.虚拟现实在焦虑症和自闭症治疗中的应用研究[J].系统仿真学报,2015(10):2233-2238.
[25] 王勇丽,梁峻波,万勤,等.基于体感技术的感觉统合游戏的设计与实现[J].中国教育技术装备,2016(2):53-57.
[26] 柳祖国,李世其,李作清.增强现实技术的研究进展及应用[J].系统仿真学报,2003(2):222-225.
[27] Richard and E. Augmented reality for rehabilitation of cognitive disabled children: a preliminary study[J] . Virtual Rehabilitation, 2007:102-108,
[28] P. Cunha, J. Brandão, J. Vasconcelos, F. Soares and V. Carvalho. Augmented reality for cognitive and social skills improvement in children with ASD[C]. 2016 13th International Conference on Remote Engineering and Virtual Instrumentation (REV), Madrid, 2016:334-335.
[29] 熊剑明.增强现实互动技术在学前教育领域的应用[J].中国教育信息化,2015(6):22.
[30] 程鹏润. 基于Android平台的增强现实的实现和应用[D]. 杭州:浙江工业大学,2015.
[31] 陈靓影,赵俊敏,王广帅,等.增强现实技术在孤独症儿童干预中的应用研究——以词汇认知干预为例[J].现代教育技术,2019,29(8):86-92.
[32] 冯学斌,赵建民.现代教育技术[M].济南:山东人民出版社,2003:11.
[33] 王广帅,鲁明辉,王广海,等.现代教育技术在自闭谱系障碍儿童干预中的应用[J].中国医学教育技术,2015,29(2):174-177.
[34] 曹漱芹,方俊明.自闭症谱系儿童语言干预中的“视觉支持”策略[J].中国特殊教育,2008(5):26-32.
[35] Macpherson, K. and Charlop, M. H. Miltenberger C A. Using portable video modeling technology to increase the compliment behaviors of children with autism during athletic group play[J]. Journal of autism and developmental disorders, 2015, 45(12): 3836-3845.
[36] Rao, K. and Skouge, J. Using Multimedia Technologies to Support Culturally and Linguistically Diverse Learners and Young Children with Disabilities:Young Children and Families in the Information Age[M]. Springer Netherlands,2015:101-115.
[37] Lorah, E. R., Parnell, A., Whitby, P. S., et al. A Systematic Review of Tablet Computers and Portable Media Players as Speech Generating Devices for Individuals with Autism Spectrum Disorder[J]. Journal of Autism & Developmental Disorders,2015, 45:1-13.
[38] 李亚华.多感官训练系统培养自闭症儿童交往能力的个案研究[J].乐山师范学院学报, 2014(5):133-136.
[39] 张春花.基于iPad的PECS教学方案干预自闭症儿童沟通行为之研究[D]. 重庆:重庆师范大学,2015.
[40] Kagohara, D. M., Sigafoos, J., Achmadi, D., et al. Teaching children with autism spectrum disorders to check the spelling of words[J]. Research in Autism Spectrum Disorders,2012,6(1):304-310.
[41] 申宁馨.机器人医生:治愈自闭症[J].环球科学,2011(9):84-85.
[42] Diehl, J. J., Schmitt, L. M., Villano, M., et al. The clinical use of robots for individuals with Autism Spectrum Disorders: A critical review[J]. Research in Autism Spectrum Disorders,2012,6(1):249-262.
[43] Scassellati, B., Admoni, H., Mataric′, M. Robots for use in autism research.[J]. Annual Review of Biomedical Engineering,2012,14(4):275-94.
[44] Thill, S., Pop, C. A., Belpaeme, T., et al. Robot-Assisted Therapy for Autism Spectrum Disorders with (Partially) Autonomous Control: Challenges and Outlook[J]. Paladyn,2012,3(4):209-217.
[45] Kee, N. K. N. Application of Universal Design for Learning (Udl1) and Living (Udl2) in Virtual Dolphin-Assisted Intervention (Vdai) for Children with Autism Noel Kok Hwee Chia National Institute of Education Nanyang Technological University[J]. The Journal of the International Association of Special Education, 2014,15(1):75.
[46] Wainer, J., Robins, B., Amirabdollahian, F., et al. Using the humanoid robot KASPAR to autonomously play triadic games and facilitate collaborative play among children with autism[J]. Autonomous Mental Development, IEEE Transactions, 2014, 6(3):183-199.
[47] Shamsuddin, S., Yussof, H., Hashim, H., et al. Humanoid Robot NAO as HRI Mediator to Teach Emotions using Game-centered Approach for Children with Austism[C]. 8th HRI 2013 International Conference on Human Robot Interaction. Tokyo, Japan,2013.
[48] Kajopoulos, J., Wong, A. H. Y., Yuen, A. W. C., et al. Robot-Assisted Training of Joint Attention Skills in Children Diagnosed with Autism[M]. Social Robotics. Springer International Publishing,2015:296-305.
[49] R. Bevill, et al. Multisensory robotic therapy to promote natural emotional interaction for children with ASD[R]. 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Christchurch, 2016, pp. 571-571.
[50] X. Liu, C. Liu, X. Zhou, X. Zhou and A. Jiang. Movement imitation underlying coaching platform for children with ASD[R]. Consumer Electronics - Taiwan (ICCE-TW), 2015 IEEE International Conference on Taipei, 2015, pp. 57-58.
[51] 李睿强. 基于NAO机器人的自闭症儿童康复训练核心模块的研究与应用[D].上海:华东师范大学,2016.
[52] D’Amico, G., Del Bimbo, A., Dini, F., et al. Natural Human–Computer Interaction: Multimedia Interaction and Intelligent User Interfaces[M]. Springer London,2010:85-106.
[53] Bartoli, L., Garzotto, F., Gelsomini, M., et al. Designing and evaluating touchless playful interaction for ASD children[C]. Proceedings of the 2014 conference on Interaction design and children.ACM,2014:17-26.
[54] 李青,王青.体感交互技术在教育中的应用现状述评[J].远程教育杂志,2015(1):48-56.
[55] 刘艳虹,雷显梅,胡晓毅.国外自闭症儿童体感游戏研究状况及启示[J].中国特殊教育, 2015(5):51-56.
[56] Uzuegbunam, N., Wong, W. H., Cheung, S. S., et al. MEBook: Kinect-based self-modeling intervention for children with autism[C]. Multimedia and Expo (ICME), 2015 IEEE International Conference on.IEEE,2015:1-6.
[57] Garzotto, F., Gelsomini, M., Oliveto, L., et al. Motion-based touchless interaction for ASD children: a case study[C]. Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces. ACM,2014:117-120.
[58] Christinaki, E., Vidakis, N., Triantafyllidis, G. A novel educational game for teaching emotion identification skills to preschoolers with autism diagnosis[J].Computer Science and Information Systems,2014,11(2):723-743.
[59] Boutsika, E. Kinect in Education: A Proposal for Children with Autism [J]. Procedia Computer Science,2014,27(27):123-129.
[1] ZHANG Kun, GAO Lei, YUAN Yi-shuang, PENG Shi-xin, XU Ru-yi. Visual Attention Characteristics of Children with Autism Spectrum Disorder to Cartoon and Real Dynamic Social Situations [J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(3): 120-127.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] OUYANG Xiu-jun, ZHANG Chuan-sui. Analysis on Interdisciplinary Research of Pedagogy[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2017, 53(3): 98 -104 .
[2] YU Xin-xin, YANG Jing , ZHANG Yue. Research on the Home-School Cooperation Modeof Mental Health Education in Rural Primary and Secondary Schools in the Information Era[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2018, 54(6): 94 -99 .
[3] CHEN Feng,MENG Zuqiang. Topic Discovery in Microblog Based on BTM and Weighting K-Means[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2019, 37(3): 71 -78 .
[4] GUO Jian-wen, SU De. Ethical Problems and Solutions in Cross-cultural Scene Investigation: A Perspective Based on Cultural Sensitivity[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2019, 55(4): 75 -82 .
[5] SUN Nan-shen, SUN YING. On the Enforcement of International Investment Arbitration Awards under The New York Convention[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(1): 55 -64 .
[6] ZHANG Shan-shan, ZHANG Ye, CHEN Meng-meng. The Impact of Social Exclusion Crisis on Children’s Deception: the Moderating Role of Belonging Needs[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(1): 95 -102 .
[7] BAO Da-wei. The Contemporariness of the Theory of New Democracy and Its Practical Conditions[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(2): 1 -10 .
[8] HUANG Shun-chun, DENG Wen-de. An Analysis of the Differences and Influencing Factors of the High-quality Development of China’s Regional Economy[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(2): 82 -93 .
[9] QIAN Yu, HE Meng-yao. Inspirations of Early Intervention Studies in the US: For Children in Disadvantage[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(2): 124 -134 .
[10] TAN Pei-wen, CHEN Yao. Dialectical Understanding of the Civilized Role of Capital and Its Contemporary Value[J]. Journal of Guangxi Teachers Education University (Philosophy and Social Sciences Edition), 2020, 56(3): 1 -9 .