An Immersive Human-Robot Interactive Game Framework Based on Deep Learning for Children's Concentration Training.

Li Liu, Yangguang Liu, Xiao-Zhi Gao, Xiaomin Zhang
Author Information
  1. Li Liu: College of Digital Technology and Engineering, Ningbo University of Finance and Economics, Ningbo 315175, China. ORCID
  2. Yangguang Liu: College of Finance and Information, Ningbo University of Finance and Economics, Ningbo 315175, China. ORCID
  3. Xiao-Zhi Gao: School of Computing, University of Eastern Finland, 70210 Kuopio, Finland. ORCID
  4. Xiaomin Zhang: College of Digital Technology and Engineering, Ningbo University of Finance and Economics, Ningbo 315175, China. ORCID

Abstract

In order to alleviate bottlenecks such as the lack of professional teachers, inattention during training processes, and low effectiveness in concentration training, we have proposed an immersive Human-robot interactive (HRI) game framework based on deep learning for children's concentration training and demonstrated its use through Human-robot interactive games based on gesture recognition. The HRI game framework includes four functional modules: video data acquisition, image recognition modeling, a deep learning algorithm (YOLOv5), and information feedback. First, we built a gesture recognition model containing 10,000 pictures of children's gestures, using the YOLOv5 algorithm. The average accuracy in recognition trainingwas 98.7%. Second, we recruited 120 children with attention deficits (aged from 9 to 12 years) to play the HRI games, including 60 girls and 60 boys. In the HRI game experiment, we obtained 8640 sample data, which were normalized and processed.According to the results, we found that the girls had better visual short-term memory and a shorter response time than boys. The research results showed that HRI games had a high efficacy, convenience, and full freedom, making them appropriate for children's concentration training.

Keywords

References

  1. Sensors (Basel). 2022 Jan 08;22(2): [PMID: 35062425]
  2. IEEE Trans Pattern Anal Mach Intell. 2010 Sep;32(9):1627-45 [PMID: 20634557]
  3. EClinicalMedicine. 2022 Apr 07;46:101382 [PMID: 35434585]
  4. J Atten Disord. 2013 Jul;17(5):374-83 [PMID: 23086616]
  5. Front Robot AI. 2021 Jun 04;8:644529 [PMID: 34150857]
  6. Pediatrics. 2019 Jul;144(1): [PMID: 31243158]
  7. Healthcare (Basel). 2021 Jul 15;9(7): [PMID: 34356271]
  8. Int J Psychophysiol. 2008 Jun;68(3):186-92 [PMID: 18304665]
  9. Front Robot AI. 2021 May 11;8:605715 [PMID: 34046433]
  10. Psychol Aging. 2018 Aug;33(5):841-854 [PMID: 30091631]
  11. Science. 2009 Feb 6;323(5915):800-2 [PMID: 19197069]
  12. Sci Rep. 2016 Aug 24;6:31107 [PMID: 27553971]

Grants

  1. 19NDJC103YB/Zhejiang Philosophy and Social Science Planning Project
  2. 19YJC880053/Humanities and Social Science Research Youth Foundation of the Ministry of Education
  3. LQ18F010008/Zhejiang Provincial Natural Science Foundation of China
  4. Y201840312/general scientific research project of Zhejiang provincial education department

Word Cloud

Created with Highcharts 10.0.0trainingHRIrecognitionconcentrationgamedeeplearningchildren'sgamesgesturehuman-robotinteractiveframeworkbaseddataalgorithmYOLOv560girlsboysresultsorderalleviatebottleneckslackprofessionalteachersinattentionprocessesloweffectivenessproposedimmersivedemonstrateduseincludesfourfunctionalmodules:videoacquisitionimagemodelinginformationfeedbackFirstbuiltmodelcontaining10000picturesgesturesusingaverageaccuracytrainingwas987%Secondrecruited120childrenattentiondeficitsaged912yearsplayincludingexperimentobtained8640samplenormalizedprocessedAccordingfoundbettervisualshort-termmemoryshorterresponsetimeresearchshowedhighefficacyconveniencefullfreedommakingappropriateImmersiveHuman-RobotInteractiveGameFrameworkBasedDeepLearningChildren'sConcentrationTraininghuman–robotinteraction

Similar Articles

Cited By

No available data.