People with autism often come at life from a different angle—seeing details others miss, focusing on patterns rather than faces, experiencing heightened or dimmed physical sensations. Although researchers have tracked some of the many ways the neurodevelopmental disorder alters perception of the world, the precise brain mechanisms involved remain obscure, says Boston University researcher Benjamin Scott . One reason: research often excludes people with more severe symptoms.
Scott and his colleagues have created a more inclusive approach, a video game that measures how people with autism understand and interpret information—and that can be played by those across the disorder's spectrum of symptom severity, including by people who are nonverbal. The researchers say it could spur fresh insights into how the autistic brain works and help refine the development and testing of new drugs and therapies.
Around 1 in 31 children in America have autism , according to the nonprofit Autism Speaks, with symptoms that affect communication and other social skills and that include restricted and repetitive behaviors. At the moment, scientists studying these issues often rely on subjective assessments from family members—particularly of people with significant communication issues—rather than input from the patients themselves. The game changes that.
"We found we can get these kids to engage and tell us, in their own language, how they're perceiving the world," says Scott, a BU College of Arts & Sciences assistant professor of psychological and brain sciences.
During a trial, he and his colleagues used the game to pinpoint a potential cause of some perceptual impairments: a phenomenon called "noisy evidence integration," which relates to how the brain handles and computes a flood of sensory information. The findings were published in Science Advances.
According to BU autism researcher Helen Tager-Flusberg , the ability to pull a broader range of kids into research is also exciting for families, who often want their children to participate in studies, but have frequently found them shut out because they can't complete research tasks.
"Understanding more about the kinds of difficulties autistic people have is always helpful," says Tager-Flusberg, director of the BU Center for Autism Research Excellence and a CAS professor emerita of psychological and brain sciences. She was one of Scott's coauthors on the paper, along with cognition and decision expert Joseph McGuire , a CAS associate professor of psychological and brain sciences.
"Importantly, the game was successful across the full range of the autism spectrum, including those falling in the profound autism category or with known genetic syndromes," she says. "We also demonstrated that we could successfully collect a considerable amount of both survey and experimental data remotely, which allowed us to include autistic people with quite varied backgrounds from all over the US."
How People with Autism Manage Sensory Input
The game is a hunt for gems. Players choose a character, then follow a treasure map to grab as many jewels as possible. As they work their way through the game, flashes appear on the edge of the screen—if one side sparkles more, it's hiding gems.
While the players are adding to their horde, researchers are tracking how well they spot the flashes, which vary in number, duration, and timing.
"We can collect some very detailed information about how you're making decisions, perceiving the world, and learning to play the game," says Scott. The researchers named the game Geode (for Gathering Evidence to Optimize DEcisions); it was programmed by Quan Do (CAMED'25)—now a postdoctoral scientist at Howard Hughes Medical Institute—with graphics help from an outside designer.
There are no instructions—players just jump in and get started, learning the gameplay and rules as they go. That's an important factor in leveling the playing field for people across the autism spectrum, says Scott, and is what allows children with severe communication-related symptoms to participate.
As part of the study, the researchers had more than 300 adolescents, all aged between 11 and 17, play the game. Just over 200 players had autism, covering the breadth of the disorder's spectrum; the remainder were neurotypical siblings.
Although most players—including those with profound autism symptoms—quickly grasped the game's rules and adjusted as it became harder, the learning curve differed significantly between those with and without autism. As the researchers adjusted game elements—like the timed light pulses—they saw that autistic people found it harder to utilize all the sensory evidence being thrown their way. Overall, the teens with autism took longer to learn how to play and had reduced accuracy compared to people without the neurodevelopmental disorder.
"The deficit seems to be in a component of perception called perceptual integration, where you are accumulating information over time to form a complex idea about the world," says Scott.
