By Jason Arunn Murugesu
Andrew Ostrovsky/Getty Images
An artificial intelligence can accurately translate thoughts into sentences, at least for a limited vocabulary of 250 words. The system may bring us a step closer to restoring speech to people who have lost the ability because of paralysis.
Joseph Makin at the University of California, San Francisco, and his colleagues used deep learning algorithms to study the brain signals of four women as they spoke. The women, who all haveepilepsy, already had electrodes attached to their brainsto monitor seizures.
Each woman was asked to read aloud from a set of sentences as the team measured brain activity. The largest group of sentences contained 250 unique words.
The team fed this brain activity to a neural network algorithm, training it to identify regularly occurring patterns that could belinked to repeated aspects ofspeech, such as vowels or consonants. These patterns werethen fed to a second neural network, which tried to turn them into words to form a sentence.
Each woman repeated the sentences at least twice, and the final repetition didnt formpart ofthe training data, allowingthe researchers to test the system.
Each time a person speaks the same sentence, the brain activity associated will be similar but not identical. Memorising the brain activity of these sentences wouldnt help, so the network instead has to learn whats similar about them so that it can generalise to this final example, says Makin. Across the four women, the AIs best performance was an average translation error rate of 3 per cent.
Makin says that using a small number of sentences made it easier for the AI to learn which words tend to follow others.
Forexample, the AI was able to decode that the word Turner wasalways likely to follow the word Tina in this set of sentences, from brain activity alone.
The team tried decoding the brain signal data into individual words at a time, rather than whole sentences, but this increased the error rate to 38 per cent even for the best performance. So the network clearly is learning facts about which words go together, and not just which neural activity maps to which words, says Makin.
This will make it hard toscale up the system to a larger vocabulary because each new word increases the number of possible sentences, reducing accuracy.
Makin says 250 words could still be useful for people who cant talk. We want to deploy this in a patient with an actual speech disability, he says, although it is possible their brain activity may be different from that of the women in this study, making this more difficult.
Sophie Scott at University College London says we are a long way from being able to translate brain signal data comprehensively. You probably know around 350,000 words, so its still an incredibly restricted set of speech that theyre using, she says.
Journal reference: Nature Neuroscience, DOI: 10.1038/s41593-020-0608-8
Go here to see the original:
Mind-reading AI turns thoughts into words using a brain implant - New Scientist News
- Yes, Mr Cummings, energy efficiency is boring if you have a one inch deep mind - The Fifth Estate - July 7th, 2020
- Breaking News - Documentary "Stockton on My Mind" Debuts July 28 on HBO - The Futon Critic - July 7th, 2020
- The Importance and the Consequences of Writing a Will - The Wire - July 7th, 2020
- Deep cultural shifts required: open letter from 500 legal women calls for reform of way judges are appointed and disciplined - UNSW Newsroom - July 7th, 2020
- Married to the Military: Dont neglect your mental health - The Fayetteville Observer - July 7th, 2020
- Suddenly, The Investment Market Comes Out Of The Deep Freeze - Bisnow - July 7th, 2020
- In Conversation: Thandie Newton - Vulture - July 7th, 2020
- Backstory: Emergency by Any Other Name Cuts as Deep - The Wire - July 4th, 2020
- FAMILY MATTERS: Open eyes and mind to teen's ascent to adulthood - Eagle-Tribune - July 4th, 2020
- Experts see 'deep trouble' for Trump overcoming plummet in the polls - Missoula Current - July 4th, 2020
- Love that stifles... - Deccan Herald - July 4th, 2020
- The long road back from COVID-19 - The Boston Globe - July 4th, 2020
- The Ripple: Healing Divisive Minds and Grieving Hearts - Aledo Times Record - July 2nd, 2020
- Deep sea coral garden found in the unlikeliest of places - Metro.co.uk - July 2nd, 2020
- Georgia on my mind - The Parliament Magazine - July 2nd, 2020
- COVID-19 and Teletherapy May Be Changing How Much You Know About Your Therapist - Michigan Medicine - July 2nd, 2020
- A conversation about racism opened my eyes The Foothills Focus - Foothills Focus - July 2nd, 2020
- Eric and Wendy Schmidt back Cambridge University effort to equip researchers with A.I. skills - CNBC - June 29th, 2020
- Change Our Mind: it is your civic duty to buy performance estates - Top Gear - June 29th, 2020
- Research: Artificial neural networks are more similar to the brain than we thought - TNW - June 29th, 2020
- Moving forward by turning to the past: Oregon Historical Quarterly takes a deep dive into Oregons white supremacist roots - KGW.com - June 29th, 2020
- Trump's scorched-earth handling of environment extends to oceans too - Las Vegas Sun - June 29th, 2020
- Is that really everything you have to give? | Yon - Tallahassee Democrat - June 29th, 2020
- Why Facebook chose to open its first European A.I. lab in Paris and not London - CNBC - June 23rd, 2020
- Decoding the link between Artificial Neural Networks and Deep Learning Algorithms - Analytics Insight - June 23rd, 2020
- Deftones' 'White Pony': 10 Things We Learned From Chino Moreno - Revolver Magazine - June 23rd, 2020
- Stranger Things: David Harbour compares Hopper to Gandalf the White - lcbcradio.com - June 23rd, 2020
- #9 Ways How Meditation Can Strengthen Our Mind, Body, and Soul - Entrepreneur - June 23rd, 2020
- Which Type of Yoga Should You Try? - United News of Bangladesh - June 23rd, 2020
- If You Want to Change, Start from the Ground Up - SFGate - June 23rd, 2020
- The Ripple: Equality and Balance is an Inside Job - Newton Press Mentor - June 20th, 2020
- Matters of the mind: Impact of lockdown and Covid-19 on marriages - The Indian Express - June 20th, 2020
- Something to Muench on: In a word, priceless! - The Cross Timbers Gazette - June 20th, 2020
- What came to mind when I acted dead - Daily Trust - June 20th, 2020
- The race to develop AI chips heats up as Graphcore says it's shipped 'tens of thousands' - CNBC - June 9th, 2020
- Stay Home, Watch Horror: 5 Deep Space Horror Movies to Stream This Week - Bloody Disgusting - June 9th, 2020
- COVID-19 Pandemic Spurs Strong Demand for Cloud AI in Warehousing, Healthcare and Conversational AI - Olean Times Herald - June 9th, 2020
- Thanks To Renewables And Machine Learning, Google Now Forecasts The Wind - Forbes - June 2nd, 2020
- New York's state of mind: Part II -- Former TH reporter shares account of COVID-19 in Big Apple - telegraphherald.com - June 2nd, 2020
- Dalai Lama and UW expert share message of hope, determination, and education of the mind - University of Wisconsin-Madison - June 2nd, 2020
- The top ten Scottish bands ever (from the mind of Alan Partridge) Aidan Smith - The Scotsman - June 2nd, 2020
- 5 natural ways to boost your mental health during stressful times - wreg.com - June 2nd, 2020
- DeepMind's AI Can Predict the Progression of AMD Eye Condition - Analytics Insight - May 25th, 2020
- New AI from DeepMind and Google can detect a common cause of blindness - The Next Web - May 25th, 2020
- Best Deep Sleep Music To Calm Your Mind at Night - SheKnows - May 25th, 2020
- Crash mastered and all-time high in mind - Tradimo - May 25th, 2020
- 'This is my deep breath': New Jersey pro surfer returns to the water in Ventnor for the first time since coronavirus closed the beach - Press of... - May 25th, 2020
- Google wants to give 'superpowers' to clinicians. Today it's helping them find hotel rooms - FierceHealthcare - May 25th, 2020
- This free AI chatbot helps businesses fight COVID-19 misinformation - The Next Web - May 25th, 2020
- Orange Grove resident helps to heal your mind through sound - Rosebank Killarney Gazette - May 25th, 2020
- AI collaboration develops an 'early warning system' for AMD - AOP - May 25th, 2020
- Mind-Blowing Deep Cosmos Discovery: The Oldest Disk Galaxy From The Earliest Days Of The Universe - Dual Dove - May 25th, 2020
- Facebook's head of AI says Elon Musk 'has no idea what he is talking about' - Business Insider India - May 15th, 2020
- Elon Musk has a complex relationship with the A.I. community - CNBC - May 15th, 2020
- Mind the Digital Gap - World Coal - May 15th, 2020
- New "Mind the Gap" resource from IADSA focuses on threat to eye health from blue light - Nutritional Outlook - May 15th, 2020
- Lockdown really frees the mind to delve deep into thoughts of future - The National - May 15th, 2020
- 'Spring Rain' Is a Superb Graphic Memoir of the Vagaries of Mind and Memory - PopMatters - May 15th, 2020
- Henry Ford III is rising to top of dynasty in deep trouble - San Antonio Express-News - May 15th, 2020
- 6 Nutrition Tips to Help You Sleep Better and Run Faster - runnersworld.com - May 15th, 2020
- Plan2Explore adapts to exploration tasks without fine-tuning - VentureBeat - May 15th, 2020
- The Well Gardened Mind by Sue Stuart-Smith review unwinding with nature - The Guardian - May 6th, 2020
- Can the Modern Mind Find Peace Without Delusion? - On the elusiveness of gratitude and confidence in our times - Chabad.org - May 6th, 2020
- World Asthma Day 2020: Things asthma patients must keep in mind - The Indian Express - May 6th, 2020
- Deep-rooted canola holds on in the dry - Farm Weekly - May 6th, 2020
- Exploring the life and legacy of Selena, 25 years later - KHOU.com - May 6th, 2020
- Machine Learning Artificial intelligence Market 2020, Thrives the Growth at Impressive CAGR Over Forecast Period 2027 COVID-19 Impact on Global... - May 2nd, 2020
- Googles AI can adjust voice emotion, pitch, and speed with 30 minutes of data - VentureBeat - May 2nd, 2020
- The Original Pawleys Island Introduces the Comfort Collection Deep Seating Swing just in time for Mother's Day - PRNewswire - April 22nd, 2020
- 'Take Deep Breaths, Make Your Bed' Therapists Offer Tips for Maintaining Mental Health During the Coronavirus - Evanston RoundTable - April 22nd, 2020
- Putting AI to work against COVID-19 - PHG Foundation - April 22nd, 2020
- ''Like Free-Riding In Deep Snow - Inside The Mind Of A Red Bull Wingsuit Flyer - The Sportsman - April 12th, 2020
- How to meditate if you have never tried before - WHAS11.com - April 12th, 2020
- Apple, Google have teamed up to build system-level COVID-19 contact tracing, interoperable APIs for iOS, Android - MobiHealthNews - April 12th, 2020
- AUDIOBOOKS: Words, books and politics | - theberkshireedge.com - April 12th, 2020
- West Virginia peak now expected today, but Marsh says that doesn't mean back to normal right away - WV MetroNews - West Virginia MetroNews - April 12th, 2020
- DeepMinds AI models transition of glass from a liquid to a solid - VentureBeat - April 9th, 2020
- AI and the coronavirus fight: How artificial intelligence is taking on COVID-19 - ZDNet - April 9th, 2020
- Step away from the news and breathe - Waukon Standard - April 9th, 2020
- Companies are bracing for the toughest phase in business continuity: Karan Bajwa - Livemint - April 9th, 2020