Silly hats are an added bonus
University of Texas at Austin
Imagine playing a racing game like Mario Kart, using only
your brain to execute the complex series of turns in a lap.
This is not a video game fantasy, but a real program that
engineers at The University of Texas at Austin have created as part of research
into brain-computer interfaces to help improve the lives of people with motor
disabilities. More importantly, the researchers incorporated machine learning
capabilities with their brain-computer interface, making it a one-size-fits-all
solution.
Typically, these devices require extensive calibration for each user -- every brain is different, both for healthy and disabled users -- and that has been a major hurdle to mainstream adoption.
This new solution
can quickly understand the needs of an individual subject and self-calibrate
through repetition. That means multiple patients could use the device without
needing to tune it to the individual.
"When we think about this in a clinical setting, this technology will make it so we won't need a specialized team to do this calibration process, which is long and tedious," said Satyam Kumar, a graduate student in the lab of José del R. Millán, a professor in the Cockrell School of Engineering's Chandra Family Department of Electrical and Computer Engineering and Dell Medical School's Department of Neurology. "It will be much faster to move from patient to patient."
The research on the calibration-free interface is
published in PNAS Nexus.
The subjects wear a cap packed with electrodes that is
hooked up to a computer. The electrodes gather data by measuring electrical
signals from the brain, and the decoder interprets that information and
translates it into game action.
Millán's work on brain-computer interfaces helps users
guide and strengthen their neural plasticity, the ability of the brain to
change, grow and reorganize over time. These experiments are designed to
improve brain function for patients and use the devices controlled by
brain-computer interfaces to make their lives easier.
In this case, the actions were twofold: the car racing
game, and a simpler task of balancing the left and right sides of a digital
bar. An expert was trained to develop a "decoder" for the simpler bar
task that makes it possible for the interface to translate brain waves into
commands. The decoder serves as a base for the other users and is the key to
avoiding the long calibration process.
The decoder worked well enough that subjects trained
simultaneously for the bar game and the more complicated car racing game, which
required thinking several steps ahead to make turns.
The researchers called this work foundational, in that it
sets the stage for further brain-computer interface innovation. This project
used 18 subjects with no motor impairments. Eventually, as they continue down
this road, they will test this on people with motor impairments to apply it to
larger groups in clinical settings.
"On the one hand, we want to translate the BCI to
the clinical realm to help people with disabilities; on the other, we need to
improve our technology to make it easier to use so that the impact for these
people with disabilities is stronger," Millán said.
On the side of translating the research, Millán and his team continue to work on a wheelchair that users can drive with the brain-computer interface. At the South by Southwest Conference and Festivals this month, the researchers showed off another potential use of the technology, controlling two rehabilitation robots for the hand and arm.
This was not part
of the new paper but a sign of where this technology could go in the future.
Several people volunteered and succeeded in operating the brain-controlled robots
within minutes.
"The point of this technology is to help people, help them in their everyday lives," Millán said. "We'll continue down this path wherever it takes us in the pursuit of helping people."
