AI researchers from institutes like Imperial College London, University of Cambridge, and Google DeepMind are looking to animals for inspiration on how to improve the performance of reinforcement learning systems. In a joint paper published in CellPress Reviews, entitled Artificial Intelligence and the Common Sense of Animals, the researchers argue that animal cognition provides useful benchmarks and methods of evaluation for reinforcement learning agents and it can also inform the engineering of tasks and environments.
AI researchers and engineers have long looked to biological neural networks for inspiration when designing algorithms, using principals from behavioral science and neuroscience to inform the structure of algorithms. Yet most of the cues AI researchers take from the neuroscience/behavior science fields are based on humans, with the cognition of young children and infants serving as the focal point. AI researchers have yet to take much inspiration from animal models, but animal cognition is an untapped resource that has the potential to lead to important breakthroughs in the reinforcement learning space.
Deep reinforcement learning systems are trained through a process of trial and error, reinforced with rewards whenever a reinforcement learning agent gets closer to completing a desired objective. This is very similar to teaching an animal to carry out a desired task by using food as a reward. Biologists and animal cognition specialists have carried out many experiments assessing the cognitive abilities of a variety of different animals, including dogs, bears, squirrels, pigs, crows, dolphins, cats, mice, elephants, and octopuses. Many animals exhibit impressive displays of intelligence, and some animals like elephants and dolphins may even have a theory of mind.
Looking at the body of research done regarding animal cognition might inspire AI researchers to consider problems from different angles. As deep reinforcement learning has become more powerful and sophisticated, AI researchers specializing in the field are seeking out new ways of testing the cognitive capabilities of reinforcement learning agents. In the research paper, the research team makes reference to the types of experiments carried out with primates and birds, mentioning that they aim to design systems capable of accomplishing similar types of tasks, giving an AI a type of common sense. According to the authors of the paper, they advocate an approach wherein RL agents, perhaps with as-yet-undeveloped architectures, acquire what is needed through extended interaction with rich virtual environments.
As reported by VentureBeat, the AI researchers argue that common sense isnt a trait unique to humans and that it is dependent upon an understanding of basic properties of the physical world, such as how an object occupies a point and space, what constraints there are on that objects movements, and an appreciation for cause and effect. Animals display these traits in laboratory studies. For instance, crows understand that objects are permanent things, as they are able to retrieve seeds even when the seed is hidden from them, covered up by another object.
In order to endow a reinforcement learning system with these properties, the researchers argue that they will need to create tasks that, when paired with the right architecture, will create agents capable of transferring learned principles to other tasks. The researchers argue that training for such a model should involve techniques that require an agent to gain understanding of a concept after being exposed to only a few examples, called few-shot training. This is in contrast to the traditional hundreds or thousands of trials that typically goes into the trial and error training of an RL agent.
The research team goes on to explain that while some modern RL agents can learn to solve multiple tasks, some of which require the basic transfer of learned principles, it isnt clear that RL agents could learn a concept as abstract at common sense. If there was an agent potentially capable of learning such a concept, they would need tests capable of ascertaining if an RL agent understood the concept of a container.
DeepMind in particular is excited to engage with new and different ways of developing and testing reinforcement learning agents. Recently, at the Stanford HAI conference that took place earlier in October, DeepMinds head of neuroscience research, Matthew Botvinick, urged machine learning researchers and engineers to collaborate more in other fields of science. Botvinick highlighted the importance of interdisciplinary work with psychologists and neuroscience for the AI field in a talk called Triangulating Intelligence: Melding Neuroscience, Psychology, and AI.
Go here to see the original:
Researchers Look To Animals To Give Reinforcement Learning Systems Common Sense - Unite.AI
- Mind Cure Announces Build-Out of Digital Therapeutics, iSTRYM: A Technology Platform for Mental Wellness Optimization & Psychedelic Research -... - January 6th, 2021
- Global Mindfulness Meditation Apps Market 2020-2025 (Impact of Covid-19) | Deep Relax, Smiling Mind, Inner Explorer, Inc., Committee for Children,... - January 6th, 2021
- Mind, Body and Soul: Shedding and growth - Ramona Sentinel - January 6th, 2021
- These Were Our Favorite Tech Stories From Around the Web in 2020 - Singularity Hub - January 6th, 2021
- The best products and tips for getting a better night's sleep - Fast Company - January 6th, 2021
- Dumb and dumber: The future of business AI depends on HI - ZDNet - January 6th, 2021
- AI Engineers Need to Think Beyond Engineering - Harvard Business Review - October 29th, 2020
- Alertness is an evergreen state of mind for the Jewish community - Security Magazine - October 29th, 2020
- M&A Plus Insurance - Please mind the gap: managing the timing considerations of warranty and indemnity insurance - Lexology - October 29th, 2020
- A deep recession should hurt Trump's reelection bid, but this isn't a usual downturn - CNN - October 29th, 2020
- Creators Of WBUR's 'Madness' Series Talk To Host Of CBC's 'Brainwashed' - WBUR - October 29th, 2020
- Latest Update 2020: Machine Learning Artificial intelligence Market by COVID19 Impact Analysis And Top Manufacturers: AIBrain, Amazon, Anki,... - October 29th, 2020
- Global Mindfulness Meditation Apps Market Expected To Reach Highest CAGR By 2026: Deep Relax, Smiling Mind, Inner Explorer, Inc., Committee for... - October 29th, 2020
- These Texas women arent flocking to Trump. They made up their minds weeks ago. - Houston Chronicle - October 29th, 2020
- Series on Mental Illness Present in Society - The Record Newspapers - TheRecordLive.com - October 29th, 2020
- How We Got Trump Voters to Change Their Mind - The Atlantic - October 27th, 2020
- The true dangers of AI are closer than we think - MIT Technology Review - October 27th, 2020
- An Old Dog's Tale: Wild visions fill the mind at election time - Chinook Observer - October 27th, 2020
- Mind the Gap - The Indian Express - October 27th, 2020
- Breaking News - HBO's "Crazy, Not Insane," A Provocative Look at the Minds of Serial Killers, Debuts November 18 - The Futon Critic - October 27th, 2020
- Family Hardship Helps Inspire Student's Sense of Wonder and Appreciation for the Mind and Body. - Bethel University News - October 27th, 2020
- Algorithmic bias - how do we tackle the underlying problem that inhibits the full potential of AI? - Diginomica - October 27th, 2020
- Enlightening New Book 'The New Prophet' Provides Deep Meditative Truths to Awaken the Heart - GlobeNewswire - October 27th, 2020
- The Deep Dark - The Indian Express - October 27th, 2020
- Technological innovations of AI in medical diagnostics - Health Europa - October 27th, 2020
- African Mental Health Summit to emphasize the importance of cultural understanding - MinnPost - October 27th, 2020
- The All-American Mind of a Militia Member - The New Republic - October 13th, 2020
- What Psychedelic Mushrooms Are Teaching Us About Human Consciousness - Discover Magazine - October 13th, 2020
- Words of wisdom: These books put the focus on the body and the mind - The Hindu - October 13th, 2020
- The state of AI in 2020: Biology and healthcare's AI moment, ethics, predictions, and graph neural networks - ZDNet - October 13th, 2020
- Not all self-help books workbut these 8 will actually rewire the way you think, live and do your job - CNBC - October 13th, 2020
- The Boys cast reflect on "mind-blowingly fun" season 2 finale - RadioTimes - October 13th, 2020
- How to Connect With the Co-Workers Youre Missing - The New York Times - October 13th, 2020
- I'm Thinking That I'm Too Stupid to Understand "I'm Thinking of Ending Things" - The Chicago Maroon - October 13th, 2020
- How AI And Blockchain Are Driving The Energy Transition - OilPrice.com - October 8th, 2020
- Things To Keep In Mind When Buying Dietary Supplements Online - Blog - The Island Now - October 8th, 2020
- Defining the Yellow mind The Manila Times - The Manila Times - October 8th, 2020
- Farewell Convolutions ML Community Applauds Anonymous ICLR 2021 Paper That Uses Transformers for Image Recognition at Scale - Synced - October 8th, 2020
- Grid AI, From the Makers of PyTorch Lightning, Emerges From Stealth With $18.6m Series A to Close the Gap Between AI Research and Production -... - October 8th, 2020
- Ask a Therapist: How Not to Drown in the Deluge of the Negativity That Is 2020 - southseattleemerald.com - October 8th, 2020
- Local organizations earn Oregon Arts Commission grant to deliver integral arts education - The Register-Guard - October 8th, 2020
- Do Your Employees Feel Safe Reporting Abuse and Discrimination? - Harvard Business Review - October 8th, 2020
- The State of AI in 2020 and Beyond - CDOTrends - October 8th, 2020
- Good Job, Whale - The Cut - September 24th, 2020
- What the strange case of horse mutilations in France reveals about our state of mind - The Guardian - September 24th, 2020
- Review: The Flaming Lips dig deep with American Head - The Rice Thresher - September 24th, 2020
- FREE Self Development Series: "Curbing Traffic Jam in the Mind" - Patch.com - September 24th, 2020
- Happy Gut, Happy Mind: how the state of your gut affects your mental health - Evening Standard - September 24th, 2020
- How DeepMind Algorithms Helped Improve the Accuracy of Google Maps? - Analytics Insight - September 15th, 2020
- Elon Musk's brain-computer startup is getting ready to blow your mind - ZDNet - September 15th, 2020
- Far from being anti-religious, faith and spirituality run deep in Black Lives Matter - The Conversation US - September 15th, 2020
- Nvidia's Arm takeover sparks concern in the UK, co-founder says it's 'a disaster' - CNBC - September 15th, 2020
- The Guardians GPT-3-written article misleads readers about AI. Heres why. - TechTalks - September 15th, 2020
- What Is Yoga Nidra? Health Essentials from Cleveland Clinic - Health Essentials from Cleveland Clinic - September 15th, 2020
- Deep Dive: What would it take to change UNCW's mind? [Free] - Port City Daily - September 14th, 2020
- Eternal Blizzard in the Tired Mind: Kaufman delves ever deeper into the human psyche - The Stanford Daily - September 14th, 2020
- SoftBanks Arm sale hits a snag as UK opposition party warns of risk to jobs and digital sovereignty - CNBC - September 14th, 2020
- Scientific Psi? Neuralink and the smarter brain - Covalence - September 14th, 2020
- How to regulate AI, according to the 1967 Outer Space Treaty - Quartz - September 14th, 2020
- Reporter's notebook/It's time to let the games begin - The Daily Times - September 14th, 2020
- DCPS students receive online instruction from teacher in Greece - The Owensboro Times - September 14th, 2020
- Expand your mind with access to over 1,000 lectures from Tim Ferriss, Malcolm Gladwell, and more - MarketWatch - August 28th, 2020
- Global Machine Learning Artificial intelligence Market 2025 To Expect Maximum Benefit and Growth Potential During this COVID 19 Outbreak: AIBrain,... - August 28th, 2020
- It plays with the mind - Bangalore Mirror - August 28th, 2020
- We criticize because we care - Observer Online - August 28th, 2020
- Exercising toward a healthy mind - Johns Hopkins News-Letter - August 28th, 2020
- 78 percent parents don't mind if children have to skip school year due to pandemic: Survey - EdexLive - August 28th, 2020
- TSMC and Graphcore Prepare for AI Acceleration on 3nm - AnandTech - August 28th, 2020
- Frank Njenga: Over 40 years of healing the mind - Business Daily - August 28th, 2020
- Emily Dickinson is the unlikely hero of our time - The Conversation US - August 28th, 2020
- Visiongain publishes Automation in Biopharma Industry 2020-2030 report - PR Newswire UK - August 26th, 2020
- Scoop: The Trump-Navarro mind meld on the FDA - Axios - August 26th, 2020
- Emily Dickinson is the unlikely hero of our time - Huron Daily Tribune - August 26th, 2020
- 5 ways to ease pain using the mind-body connection - Harvard Health Blog - Harvard Health - August 26th, 2020
- COVID-19: Heal Your Diseases and Illness with Your Subconscious Mind - CEOWORLD magazine - August 26th, 2020
- London's 'Tech City' may never be the same again after the coronavirus - CNBC - August 26th, 2020
- Environmental Sustainability And AI - Forbes - August 26th, 2020
- BetMGM Has Crazy 100-1 Odds On The Yankees or Nats To Go Deep Tonight - Crossing Broad - July 25th, 2020
- Chest-Deep' Wildflowers Are Blooming in Reds Meadow - NBC Southern California - July 25th, 2020
- The Man-Eater part 3 - Lake County Record-Bee - July 25th, 2020
Recent Comments