Download PDF
CC BY-NC-ND 4.0 · Appl Clin Inform 2021; 12(05): 1030-1040
DOI: 10.1055/s-0041-1736626
Research Article

A Mobile Game Platform for Improving Social Communication in Children with Autism: A Feasibility Study

Yordan Penev
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Kaitlyn Dunlap
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Arman Husic
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Cathy Hou
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Peter Washington
4   Department of Bioengineering, Stanford University, Stanford, California, United States
,
Emilie Leblanc
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Aaron Kline
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
John Kent
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Anthony Ng-Thow-Hing
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Bennett Liu
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Christopher Harjadi
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Meagan Tsou
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Manisha Desai
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
,
Dennis P. Wall
1   Department of Pediatrics (Systems Medicine), Stanford University, Stanford, California, United States
2   Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, California, United States
3   Department of Biomedical Data Science, Stanford University, Stanford, California, United States
› Author Affiliations Funding The work was supported in part by funds to DPW from the National Institutes of Health (1R01EB025025–01, 1R21HD091500–01, 1R01LM013083), the National Science Foundation (Award 2014232), The Hartwell Foundation, Bill and Melinda Gates Foundation, Coulter Foundation, Lucile Packard Foundation, the Weston Havens Foundation, and program grants from Stanford's Human Centered Artificial Intelligence Program, Precision Health and Integrated Diagnostics Center (PHIND), Beckman Center, Bio-X Center, Predictives and Diagnostics Accelerator (SPADA) Spectrum, Spark Program in Translational Research, MediaX, and from the Wu Tsai Neurosciences Institute's Neuroscience: Translate Program. P.W. would like to acknowledge support from the Stanford Interdisciplinary Graduate Fellowship (SIGF).
› Further Information
   Permissions and Reprints

Abstract

Background Many children with autism cannot receive timely in-person diagnosis and therapy, especially in situations where access is limited by geography, socioeconomics, or global health concerns such as the current COVD-19 pandemic. Mobile solutions that work outside of traditional clinical environments can safeguard against gaps in access to quality care.

Objective The aim of the study is to examine the engagement level and therapeutic feasibility of a mobile game platform for children with autism.

Methods We designed a mobile application, GuessWhat, which, in its current form, delivers game-based therapy to children aged 3 to 12 in home settings through a smartphone. The phone, held by a caregiver on their forehead, displays one of a range of appropriate and therapeutically relevant prompts (e.g., a surprised face) that the child must recognize and mimic sufficiently to allow the caregiver to guess what is being imitated and proceed to the next prompt. Each game runs for 90 seconds to create a robust social exchange between the child and the caregiver.

Results We examined the therapeutic feasibility of GuessWhat in 72 children (75% male, average age 8 years 2 months) with autism who were asked to play the game for three 90-second sessions per day, 3 days per week, for a total of 4 weeks. The group showed significant improvements in Social Responsiveness Score-2 (SRS-2) total (3.97, p <0.001) and Vineland Adaptive Behavior Scales-II (VABS-II) socialization standard (5.27, p = 0.002) scores.

Conclusion The results support that the GuessWhat mobile game is a viable approach for efficacious treatment of autism and further support the possibility that the game can be used in natural settings to increase access to treatment when barriers to care exist.

Keywords

digital therapeutics - mobile game - mobile health - AI-medicine - autism spectrum disorder - developmental disorders - behavioral therapy - clinical testing - smartphone - patient population - mental health

Protection of Human and Animal Subjects

The study was performed in compliance with the World Medical Association Declaration of Helsinki on Ethical Principles for Medical Research Involving Human Subjects and was reviewed by Stanford University's Institutional Review Board.


Supplementary Material



Publication History

Received: 13 June 2021

Accepted: 21 September 2021

Article published online:
17 November 2021

© 2021. The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/)

Georg Thieme Verlag KG
Rüdigerstraße 14, 70469 Stuttgart, Germany

 

  • References

  • 1 Boyle CA, Boulet S, Schieve LA. et al. Trends in the prevalence of developmental disabilities in US children, 1997-2008. Pediatrics 2011; 127 (06) 1034-1042
    CrossrefPubMedGoogle Scholar
  • 2 Baio J, Wiggins L, Christensen DL. et al. Prevalence of autism spectrum disorder among children aged 8 years—autism and developmental disabilities monitoring network, 11 sites, United States, 2014. MMWR Surveill Summ 2018; 67 (06) 1-23
    CrossrefPubMedGoogle Scholar
  • 3 Nicholas JS, Charles JM, Carpenter LA, King LB, Jenner W, Spratt EG. Prevalence and characteristics of children with autism-spectrum disorders. Ann Epidemiol 2008; 18 (02) 130-136
    CrossrefPubMedGoogle Scholar
  • 4 American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.), 2013.. Available at: https://doi.org/10.1176/appi.books.9780890425596
    CrossrefPubMedGoogle Scholar
  • 5 Kasari C, Freeman S, Paparella T. Joint attention and symbolic play in young children with autism: a randomized controlled intervention study. J Child Psychol Psychiatry 2006; 47 (06) 611-620
    CrossrefPubMedGoogle Scholar
  • 6 Charpentier J, Kovarski K, Houy-Durand E. et al. Emotional prosodic change detection in autism spectrum disorder: an electrophysiological investigation in children and adults. J Neurodev Disord 2018; 10 (01) 28
    CrossrefPubMedGoogle Scholar
  • 7 Dawson G, Webb SJ, McPartland J. Understanding the nature of face processing impairment in autism: insights from behavioral and electrophysiological studies. Dev Neuropsychol 2005; 27 (03) 403-424
    CrossrefPubMedGoogle Scholar
  • 8 Harms MB, Martin A, Wallace GL. Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies. Neuropsychol Rev 2010; 20 (03) 290-322
    CrossrefPubMedGoogle Scholar
  • 9 Lovaas OI. Behavioral treatment and normal educational and intellectual functioning in young autistic children. J Consult Clin Psychol 1987; 55 (01) 3-9
    CrossrefPubMedGoogle Scholar
  • 10 Dawson G, Jones EJ, Merkle K. et al. Early behavioral intervention is associated with normalized brain activity in young children with autism. J Am Acad Child Adolesc Psychiatry 2012; 51 (11) 1150-1159
    CrossrefPubMedGoogle Scholar
  • 11 Sandbank M, Bottema-Beutel K, Crowley S. et al. Project AIM: autism intervention meta-analysis for studies of young children. Psychol Bull 2020; 146 (01) 1-29
    CrossrefPubMedGoogle Scholar
  • 12 Fuller EA, Kaiser AP. The effects of early intervention on social communication outcomes for children with autism spectrum disorder: a meta-analysis. J Autism Dev Disord 2020; 50 (05) 1683-1700
    CrossrefPubMedGoogle Scholar
  • 13 Landa RJ. Efficacy of early interventions for infants and young children with, and at risk for, autism spectrum disorders. Int Rev Psychiatry 2018; 30 (01) 25-39
    CrossrefPubMedGoogle Scholar
  • 14 Zwaigenbaum L, Penner M. Autism spectrum disorder: advances in diagnosis and evaluation. BMJ 2018; 361: k1674
    CrossrefPubMedGoogle Scholar
  • 15 Gordon-Lipkin E, Foster J, Peacock G. Whittling down the wait time: exploring models to minimize the delay from initial concern to diagnosis and treatment of autism spectrum disorder. Pediatr Clin North Am 2016; 63 (05) 851-859
    CrossrefPubMedGoogle Scholar
  • 16 Cidav Z, Munson J, Estes A, Dawson G, Rogers S, Mandell D. Cost offset associated with early start Denver model for children with autism. J Am Acad Child Adolesc Psychiatry 2017; 56 (09) 777-783
    CrossrefPubMedGoogle Scholar
  • 17 Lee J. Mental health effects of school closures during COVID-19. Lancet Child Adolesc Health 2020; 4 (06) 421
    CrossrefPubMedGoogle Scholar
  • 18 Ning M, Daniels J, Schwartz J. et al. Identification and quantification of gaps in access to autism resources in the United States: an infodemiological study. J Med Internet Res 2019; 21 (07) e13094-e13094
    CrossrefPubMedGoogle Scholar
  • 19 Haber N, Voss C, Wall D. Making emotions transparent: Google Glass helps autistic kids understand facial expressions through augmented-reality therapy. IEEE Spectr 2020; 57: 46-52
    CrossrefPubMedGoogle Scholar
  • 20 Kline A. et al. Superpower Glass. GetMobile. Mobile Comp Comm 2019; 23: 35-38
    CrossrefPubMedGoogle Scholar
  • 21 Voss C, Washington P, Haber N. Superpower glass: delivering unobtrusive real-time social cues in wearable systems. Paper presented at: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. 1218–1226 (ACM)
    PubMedGoogle Scholar
  • 22 Washington P, Voss C, Haber N, Tanaka S. A wearable aid for the at-home therapy of children with autism. Paper presented at: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, ACM; 2016: 2348-2354
    PubMedGoogle Scholar
  • 23 Washington P, Voss C, Kline A. et al. SuperpowerGlass: A Wearable Aid for the At-Home Therapy of Children with Autism. Paper presented at: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 112; 2017
    PubMedGoogle Scholar
  • 24 Daniels J, Haber N, Voss C. et al. Feasibility testing of a wearable behavioral aid for social learning in children with autism. Appl Clin Inform 2018; 9 (01) 129-140
    Article in Thieme ConnectPubMedGoogle Scholar
  • 25 Voss C, Haber N, Washington P. et al. Designing a holistic at-home learning aid for autism. arXiv preprint, arXiv: 200204263. 2020
    Google Scholar
  • 26 Voss C, Schwartz J, Daniels J. et al. Effect of wearable digital intervention for improving socialization in children with autism spectrum disorder: a randomized clinical trial. JAMA Pediatr 2019; 173 (05) 446-454
    CrossrefPubMedGoogle Scholar
  • 27 Pena CL. CFR—Code of Federal Regulations Title 21. Silver Spring, MD: U.S. Food & Drug Administration; 2020
    Google Scholar
  • 28 Kollins SH, DeLoss DJ, Cañadas E. et al. A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial. Lancet Digit Health 2020; 2 (04) e168-e178
    CrossrefPubMedGoogle Scholar
  • 29 Chandrashekar P. Do mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile apps. mHealth 2018; 4: 6-6
    CrossrefPubMedGoogle Scholar
  • 30 Ly KH, Topooco N, Cederlund H. et al. Smartphone-supported versus full behavioural activation for depression: a randomised controlled trial. PLoS One 2015; 10 (05) e0126559
    CrossrefPubMedGoogle Scholar
  • 31 Lau HM, Smit JH, Fleming TM, Riper H. Serious games for mental health: are they accessible, feasible, and effective? A systematic review and meta-analysis. Front Psychiatry 2017; 7: 209-209
    PubMedGoogle Scholar
  • 32 Daniels J, Schwartz J, Haber N, Feinstein C. 5.13 design and efficacy of a wearable device for social affective learning in children with autism. J Am Acad Child Adolesc Psychiatry 2017; 56: S257
    CrossrefPubMedGoogle Scholar
  • 33 Anguera JA, Brandes-Aitken AN, Antovich AD, Rolle CE, Desai SS, Marco EJ. A pilot study to determine the feasibility of enhancing cognitive abilities in children with sensory processing dysfunction. PLoS One 2017; 12 (04) e0172616-e0172616
    CrossrefPubMedGoogle Scholar
  • 34 Daniels J, Schwartz JN, Voss C. et al. Exploratory study examining the at-home feasibility of a wearable tool for social-affective learning in children with autism. NPJ Digit Med 2018; 1: 32
    CrossrefPubMedGoogle Scholar
  • 35 Yerys BE, Bertollo JR, Kenworthy L. et al. Brief Report: pilot study of a novel interactive digital treatment to improve cognitive control in children with autism spectrum disorder and co-occurring ADHD symptoms. J Autism Dev Disord 2019; 49 (04) 1727-1737
    CrossrefPubMedGoogle Scholar
  • 36 Kalantarian H, Washington P, Schwartz J, Daniels J, Haber N, Wall DP. Guess What?: Towards Understanding Autism from Structured Video Using Facial Affect. J Healthc Inform Res 2019; 3: 43-66
    CrossrefPubMedGoogle Scholar
  • 37 Kalantarian H, Jedoui K, Washington P, Wall DP. A mobile game for automatic emotion-labeling of images. IEEE Trans Games 2020; 12 (02) 213-218
    CrossrefPubMedGoogle Scholar
  • 38 Kalantarian H. et al. in 2018 IEEE International Conference on Healthcare Informatics. ICHI 2018. New York, NY: IEEE Computer Society; 2018: 350-352
    Google Scholar
  • 39 Kalantarian H, Jedoui K, Washington P. et al. Labeling images with facial emotion and the potential for pediatric healthcare. Artif Intell Med 2019; 98: 77-86
    CrossrefPubMedGoogle Scholar
  • 40 Duda M, Daniels J, Wall DP. Clinical evaluation of a novel and mobile autism risk assessment. J Autism Dev Disord 2016; 46 (06) 1953-1961
    CrossrefPubMedGoogle Scholar
  • 41 Lovaas OI. Teaching Individuals with Developmental Delays: Basic Intervention Techniques. Pro-Ed; 2003
    Google Scholar
  • 42 Smith T. Discrete trial training in the treatment of autism. Focus Autism Other Dev Disabl 2001; 16: 86-92
    CrossrefPubMedGoogle Scholar
  • 43 Koegel LK, Koegel RL, Harrower JK, Carter CM. Pivotal response intervention I: Overview of approach. J Assoc Pers Severe 1999; 24: 174-185
    PubMedGoogle Scholar
  • 44 Ingersoll B, Schreibman L. Teaching reciprocal imitation skills to young children with autism using a naturalistic behavioral approach: effects on language, pretend play, and joint attention. J Autism Dev Disord 2006; 36 (04) 487-505
    CrossrefPubMedGoogle Scholar
  • 45 Thorp DM, Stahmer AC, Schreibman L. Effects of sociodramatic play training on children with autism. J Autism Dev Disord 1995; 25 (03) 265-282
    CrossrefPubMedGoogle Scholar
  • 46 Constantino JN, Gruber CP. Social Responsiveness Scale (SRS-2). 2nd ed.. Los Angeles, CA: Western Psychological Services; 2012
    Google Scholar
  • 47 Sparrow SS, Cicchetti DV, Balla DA. Vineland Adaptive Behavior Scales, Second Edition (Vineland-II). Survey Forms Manual. Circle Pines, MN: AGS Publishing; 2005. . Available at: https://doi.org/10.1037/t15164-000
    CrossrefGoogle Scholar
  • 48 Hardan AY, Hendren RL, Aman MG. et al. Efficacy and safety of memantine in children with autism spectrum disorder: results from three phase 2 multicenter studies. Autism 2019; 23 (08) 2096-2111
    CrossrefPubMedGoogle Scholar
  • 49 Chatham CH, Taylor KI, Charman T. et al. Adaptive behavior in autism: minimal clinically important differences on the Vineland-II. Autism Res 2018; 11 (02) 270-283
    CrossrefPubMedGoogle Scholar
  • 50 Holtz BE, Murray K, Park T. Serious games for children with chronic diseases: a systematic review. Games Health J 2018; 7 (05) 291-301
    CrossrefPubMedGoogle Scholar