Simultaneous speech and gesture decoding for multimodal communication in paralysis.

Neural signals from a single cortical implant enable simultaneous decoding of speech and gestures, improving communication options for people with paralysis.

• Why it matters: Restoring natural communication in individuals with paralysis is limited by current BCIs that decode speech or gestures separately, creating a need for integrated solutions.
• What they did: Researchers used high-density electrocorticography to record neural activity from three participants, developing decoders for upper-limb and orofacial movements, as well as speech and gestures, tested during isolated and combined attempts.
• The result: Training models on both isolated and simultaneous data enhanced decoding performance, demonstrating that a single cortical implant can support multi-effector control and advance more natural BCI-mediated communication.