Researchers are developing an artificial intelligence-powered app that analyzes daily behavior to help families and caregivers better communicate with children with autism and older adults with dementia.
As one of three organizations selected for funding by the Advanced Research Projects Agency for Health (ARPA-H), the Texas A&M University School of Public Health will collaborate on Phase I development of VoiceLove, a device designed to improve communication for children on the autism spectrum and older adults with dementia. The prototype will analyze speech and nonverbal behaviors to help caregivers and therapists identify behavior patterns and develop individualized treatment plans.
Dr. Junhyoung Kim, associate professor in the School of Public Health, is one of the principal investigators on the project. Kim said he wants the AI to focus on individualized analysis rather than one-size-fits-all recommendations.
People are also reading…
"Every child with autism is unique, and effective support should reflect that," he said. "Our project leverages artificial intelligence to understand each child’s individual behaviors, communication styles and preferences. The goal is to deliver personalized recommendations that help families, educators and clinicians work together more effectively, enabling more responsive, data-driven care and improving the health and well-being of children with autism."
Through the app, therapists and caregivers can securely record brief videos of a child interacting in everyday situations, capturing the child’s unique communication patterns, needs, interests and behaviors. The AI analyzes the data to identify individualized patterns and provide actionable insights. Healthcare providers can then use the insights to develop personalized intervention plans that support goals such as improving communication, promoting self-care, strengthening social engagement and enhancing overall developmental outcomes, Kim said.
"The key innovation behind this platform is its ability to understand each child individually and learn their unique preferences, needs, communication styles and strengths to deliver personalized recommendations," he said. "For people living with dementia, the platform is designed to enhance person-centered care by helping residents communicate their needs, preferences and daily experiences more effectively."
As caregivers continue using the app, the AI will be able to pick up on recurring behaviors and associations. Caregivers and therapists can also log observations and respond to daily prompts generated by the AI related to the participant’s communication abilities.
"Our vision is to create an AI platform that continuously learns from each child’s daily experiences," Kim said. "As the system identifies patterns in behaviors, preferences, and responses to different activities, it can provide therapists and caregivers with personalized recommendations that evolve over time. This adaptive approach helps explain why certain behaviors occur and supports more individualized, proactive care."
Kim said the research team plans to enroll a small group of children with autism and older adults living with dementia in an initial pilot study following Institutional Review Board approval. Participants will use the AI platform for approximately one month to evaluate its usability, feasibility and user experience. Based on the findings, the team will continue refining and optimizing the technology over the following year before expanding to larger-scale evaluations.
"While this technology is still in its early stages, we believe it has the potential to transform the way personalized care is delivered," Kim said. "By bringing together expertise in artificial intelligence, healthcare, behavioral science and human-centered design, we are creating a first-of-its-kind platform with the potential to improve the lives of children with autism and people living with dementia."
Others members of the research team include Dr. Marcia Ory, Regents and Distinguished professor in the Center for Community Health and Aging at the Texas A&M School of Public Health, and Dan Zhang, director of the Texas A&M Center on Disability and Development.
