The abstract is read at the publisher; the summary is JClub's.
Brain2voice 2.0 synthesizes highly intelligible real-time voice from intracortical neural signals, achieving 5.24% word error rate—an 8x intelligibility improvement over prior SOTA.
- Why it matters: Existing BCIs decode speech as text but cannot provide instantaneous voice, and current brain-to-voice output remains too unintelligible for real-world use.
- What they did: The multimodal Transformer decoder is trained on continuous, custom-tokenized acoustic targets plus phoneme targets using self-supervised and adversarial objectives, producing outputs every 10 ms.
- The result: On the prior intracortical brain-to-voice benchmark dataset, listeners achieved 5.24% word error rate (8x better than 43.75% prior SOTA), with raw phoneme error rate of 7%.
The findingWhy it mattersWhat they didThe result
AI summary of the abstract · may contain errors · not medical advice · read the paper.