Brain implant restores gestures, speech for some paralysis patients through virtual avatars

The National Institutes of Health (NIH) shared a new brain-computer interface (BCI) that allows patients who are paralyzed to convey speech and gestures at the same time. 

BCI for paralysis patients

Dig deeper:

Scientists at the University of California, San Francisco, used machine learning to read the unique brain waves that go along with speech and physical gestures in three patients, according to an NIH news release.

Using the BCI, patients were able to successfully translate their thoughts to two other participants.

What they're saying:

"Conversation is about much more than the words being spoken. It’s a multilayered, dynamic process involving the whole motor cortex," said corresponding author Edward Chang, M.D., a professor of neurological surgery at UCSF. "This proof-of-concept shows us it’s possible for a BCI to restore some of this freedom and flexibility."

Sensor implant in the brain 

With the use of electrocorticography (ECoG), a thin sensor strip implanted on the motor cortex of patients, computer models are able to decode the patient’s brain signals into a computer which controls an avatar seen on a computer screen. 

Big picture view:

In this new study, scientists discovered that the brain works differently when speaking and moving together than when doing them one at a time. By teaching computer decoders how the brain handles both actions at once, researchers can help people communicate in a much more natural, lifelike way.

What's next:

Scientists hope to test a fully implantable, wireless version for long-term use in the future. 

Science