VideoElephant logo x

Scientists create speech using brain recordings

  • Category science technology
  • Definition HD
  • Resolution 1280 x 720
  • Duration 00:00:51
  • Year 2019
  • Language English

Scientists create speech using brain recordings

New research from the University of California San Francisco found that brain recordings can be converted into speech.According to a paper published in the journal Nature, neuroscientists from UC San Francisco have developed a technology that can convert brain recordings into synthetic speech using a computer simulation model with lips, jaw, tongue, and larynx. The team recorded brain signals of subjects that already had electrode arrays implanted in their brains for previous medical procedures. Subjects would read sentences out loud while the researchers captured the signals through the electrodes.They then analyzed the audio and observed which muscles were activated at different points during speech.Using this information, they developed a simulation that would transform brain activity into muscle movements in a virtual vocal tract and in turn, turn the movements into a synthetic voice.RUNDOWN SHOWS:1. Computer simulation of brain waves turned into synthetic speech2. Subjects read out loud as the device records their voice3. Program analyzes audio waves and converts them to muscle movement4. Complete process of brain activity transformed into audioVOICEOVER (in English): "According to a paper published in the journal Nature, neuroscientists from UC San Francisco have developed a technology that can convert brain recordings into synthetic speech using a computer simulation model with lips, jaw, tongue, and larynx." "The team recorded brain signals of subjects that already had electrode arrays implanted in their brains for previous medical procedures. Subjects would read sentences out loud while the researchers captured the signals through the electrodes.""They then analyzed the audio and observed which muscles were activated at different points during speech.""Using this information, they developed a simulation that would transform brain activity into muscle movements in a virtual vocal tract and in turn, turn the movements into a synthetic voice."SOURCES: University of California San Franciscohttp://ucsf.edu/news/2019/04/414296/synthetic-speech-generated-brain-recordings

Interested in this content?