����APP

Brain-computer interface helps paralyzed man speak

A patient with his personal assistant and UC Davis neuroscientist Dr. Sergey Stavisky. UC Regents

Brain-computer interfaces can help people with paralysis to communicate by decoding neural signals into words. Several such brain-computer interfaces have recently been developed. Previous interfaces have had limited accuracy, with around a quarter of words being incorrectly decoded. They also required an extensive calibration period before they could be used.

A team of researchers, led by Drs. Nicholas Card, Sergey Stavisky, and David Brandman at the University of California, Davis, developed a brain-computer interface to accurately decode speech from neural signals with relatively little calibration. They tested the system in a 45-year-old man with amyotrophic lateral sclerosis (ALS). He had been experiencing ALS symptoms for five years, could not walk, depended on others for activities of daily living, and had severely slurred speech. The study, which was funded in part by NIH, appeared in the New England Journal of Medicine on August 14, 2024.

The research team implanted four arrays of 64 microelectrodes each into the participant’s brain along the left precentral gyrus. This area of the cerebral cortex is involved in coordinating muscle movements related to speech. Neural activity recorded by these electrodes was decoded by external computers in real time as the participant attempted to speak, using an artificial neural network. A screen displayed the predicted words and read aloud using text-to-speech software. The voice of the system was designed to resemble the participant’s pre-ALS speaking voice.

The system was turned on 25 days after the electrodes were implanted. The team calibrated the system for 30 minutes while the participant attempted to speak prompted sentences with a 50-word vocabulary. The system decoded more than 99% of the words correctly.

On the second day of testing, the team did an additional hour and a half of calibration and expanded the system’s vocabulary to 125,000 words. The system decoded more than 90% of words correctly.

Over the next several months, the team continued to work with the participant to improve system performance. Within 16 hours of use, the system could decode about 97.5% of words correctly. It maintained this level of accuracy more than eight months after the electrodes were first implanted. The participant used the device in conversation for a total of 248 hours during the course of the study, speaking at a rate of about 32 words per minute.

“This technology is transformative because it provides hope for people who want to speak but can’t,” Brandman says. “I hope that technology like this speech brain-computer interface will help future patients speak with their family and friends.”

—by Brian Doctrow, Ph.D.