Neural networks can learn to solve all sorts of problems, from identifying cats in photographs to steering a self-driving car. But whether these powerful, pattern-recognizing algorithms actually understand the tasks they are performing remains an open question.
For example, a neural network tasked with keeping a self-driving car in its lane might learn to do so by watching the bushes at the side of the road, rather than learning to detect the lanes and focus on the roads horizon.
Researchers at MIT have now shown that a certain type of neural network is able to learn the true cause-and-effect structure of the navigation task it is being trained to perform. Because these networks can understand the task directly from visual data, they should be more effective than other neural networks when navigating in a complex environment, like a location with dense trees or rapidly changing weather conditions.
In the future, this work could improve the reliability and trustworthiness of machine learning agents that are performing high-stakes tasks, like driving an autonomous vehicle on a busy highway.
Because these brain-inspired machine-learning systems are able to perform reasoning in a causal way, we can know and point out how they function and make decisions. This is essential for safety-critical applications, says co-lead author Ramin Hasani, a postdoc in the Computer Science and Artificial Intelligence Laboratory (CSAIL).
Co-authors include electrical engineering and computer science graduate student and co-lead author Charles Vorbach; CSAIL PhD student Alexander Amini; Institute of Science and Technology Austria graduate student Mathias Lechner; and senior author Daniela Rus, the Andrew and Erna Viterbi Professor of Electrical Engineering and Computer Science and director of CSAIL. The research will be presented at the 2021 Conference on Neural Information Processing Systems (NeurIPS) in December.
An attention-grabbing result
Neural networks are a method for doing machine learning in which the computer learns to complete a task through trial-and-error by analyzing many training examples. And liquid neural networks change their underlying equations to continuously adapt to new inputs.
The new research draws on previous work in which Hasani and others showed how a brain-inspired type of deep learning system called a Neural Circuit Policy (NCP), built by liquid neural network cells, is able to autonomously control a self-driving vehicle, with a network of only 19 control neurons.
The researchers observed that the NCPs performing a lane-keeping task kept their attention on the roads horizon and borders when making a driving decision, the same way a human would (or should) while driving a car. Other neural networks they studied didnt always focus on the road.
That was a cool observation, but we didnt quantify it. So, we wanted to find the mathematical principles of why and how these networks are able to capture the true causation of the data, he says.
They found that, when an NCP is being trained to complete a task, the network learns to interact with the environment and account for interventions. In essence, the network recognizes if its output is being changed by a certain intervention, and then relates the cause and effect together.
During training, the network is run forward to generate an output, and then backward to correct for errors. The researchers observed that NCPs relate cause-and-effect during forward-mode and backward-mode, which enables the network to place very focused attention on the true causal structure of a task.
Hasani and his colleagues didnt need to impose any additional constraints on the system or perform any special set up for the NCP to learn this causality it emerged automatically during training.
Weathering environmental changes
They tested NCPs through a series of simulations in which autonomous drones performed navigation tasks. Each drone used inputs from a single camera to navigate.
The drones were tasked with traveling to a target object, chasing a moving target, or following a series of markers in varied environments, including a redwood forest and a neighborhood. They also traveled under different weather conditions, like clear skies, heavy rain, and fog.
The researchers found that the NCPs performed as well as the other networks on simpler tasks in good weather, but outperformed them all on the more challenging tasks, such as chasing a moving object through a rainstorm.
We observed that NCPs are the only network that pay attention to the object of interest in different environments while completing the navigation task, wherever you test it, and in different lighting or environmental conditions. This is the only system that can do this casually and actually learn the behavior we intend the system to learn, he says.
Their results show that the use of NCPs could also enable autonomous drones to navigate successfully in environments with changing conditions, like a sunny landscape that suddenly becomes foggy.
Once the system learns what it is actually supposed to do, it can perform well in novel scenarios and environmental conditions it has never experienced. This is a big challenge of current machine learning systems that are not causal. We believe these results are very exciting, as they show how causality can emerge from the choice of a neural network, he says.
In the future, the researchers want to explore the use of NCPs to build larger systems. Putting thousands or millions of networks together could enable them to tackle even more complicated tasks.
This research was supported by the United States Air Force Research Laboratory, the United States Air Force Artificial Intelligence Accelerator, and the Boeing Company.
Read the original here:
- SAP : Helping to Close the Computer Science Education Disparity - marketscreener.com - December 3rd, 2021
- Women of the Well House supports new campus programs: Indiana University Kokomo - IUK Newsroom - December 3rd, 2021
- Diving Into The Strange World Of Xenobots - Science Friday - December 3rd, 2021
- Silicon Valley beckoned, but he went home to Delaware - MIT News - December 3rd, 2021
- Two UB faculty receive NSF funding to study social media in disaster response - UB Now: News and views for UB faculty and staff - University at... - December 3rd, 2021
- Santa Reminds Us to Be Our Best Year Round - goskagit.com - December 3rd, 2021
- Announcing SWENext Award Recipients from WE21 - All Together - Society of Women Engineers - December 3rd, 2021
- App State researchers working to save honeybees with informatics - Watauga Democrat - December 3rd, 2021
- Hundreds of UC faculty named among the world's Highly Cited Researchers - University of California - December 3rd, 2021
- Kids, teens believe girls aren't interested in computer science, study shows - UW News - November 28th, 2021
- At UF, we are working together to provide Florida teachers and students with computer science skills | Column - Tampa Bay Times - November 28th, 2021
- Pakistani scientist ranked among top 1% computer science researchers - Geo News - November 28th, 2021
- Computer Scientist Gets Grant To Strengthen Software Protection - University of Texas at Dallas - November 28th, 2021
- Ahead of their time - The People's Defender - November 28th, 2021
- Computer Conservation - Harvard School of Engineering and Applied Sciences - November 28th, 2021
- Singapore's first free, teacher-less computer science programme to be launched by 2022 - The Straits Times - November 28th, 2021
- A chance to focus on an academic passion at Oxford - Harvard Gazette - November 28th, 2021
- Northern College hosts gaming tournament and hopes to attract future students with a new computer program - CTV News Northern Ontario - November 28th, 2021
- Student cyber competition team is fifth of 120 competing in DOE contest - UAH News - November 28th, 2021
- New algorithm could save lives: Predicts COVID-related intensive care unit resource use University of Copenhagen - EurekAlert - November 28th, 2021
- COVID-19: Vitamin D may be able to 'switch off' lung inflammation - Medical News Today - November 28th, 2021
- In MIT visit, Dropbox CEO Drew Houston '05 explores the accelerated shift to distributed work - MIT News - November 28th, 2021
- This SanDisk NVMe SSD deal is too good to pass up even if you don't need a new SSD - TechRadar - November 28th, 2021
- Where are all the hacktivists? - BCS - November 28th, 2021
- Save 97% off a course bundle that covers all things computer science - BleepingComputer - November 17th, 2021
- Cameron University's CU in Computing presentation to focus on Computer Science and Information Technology degree programs - Duncan Banner - November 17th, 2021
- Bias in Algorithms | The Inference Project - Yale News - November 17th, 2021
- Infosys Commits to 3-Year Investment in Thurgood Marshall College Fund - Yahoo Finance - November 17th, 2021
- The tech behind popular cryptocurrencies, explained - Popular Science - November 17th, 2021
- When will a robot write a novel? Harvard computer scientist shares his thoughts - Harvard Gazette - November 17th, 2021
- At SC21, Plenary Wrestles With the Ethics of Mainstreamed HPC - HPCwire - November 17th, 2021
- Governor Abbott Encourages Texas High Schoolers To Participate In CyberStart America - Office of the Texas Governor - November 17th, 2021
- USF physicists selected as finalists for the 'Nobel Prize of supercomputing' - University of South Florida - November 17th, 2021
- 4 universities nurturing tomorrow's women STEM experts - Study International News - November 17th, 2021
- SAS and Sphero Address Coding Needs of Students with Visual Impairments - T.H.E. Journal - November 17th, 2021
- Portland State University experiments with Attend Anywhere model - OPB News - November 17th, 2021
- The long term effects of sexism on women in STEM - Utahstatesman - November 13th, 2021
- Cameron University's CU in Computing presentation to focus on Computer Science and Information Technology degree programs - Chickasha Express Star - November 13th, 2021
- Certificate in computer science: What you need to know - ZDNet - November 13th, 2021
- Calling outstanding young researchers in mathematics and computer science! - EurekAlert - November 13th, 2021
- Governor Hutchinson's Weekly Address | Arkansas Takes the World Stage with New Technologies - Governor Asa Hutchinson - November 13th, 2021
- New CMU Robotics director says diversity is key to the institute's future - 90.5 WESA - November 13th, 2021
- Simulating Galaxy Formation in Mesmerizing Detail for Clues to the Universe - SciTechDaily - November 13th, 2021
- Collaboration on Data and Computational Sciences Announces 2021-2022 Projects to Advance Cancer Breakthroughs - HPCwire - November 13th, 2021
- Algorithms aren't fair. Robin Burke wants to change that - CU Boulder Today - November 13th, 2021
- Research Associate in Artificial Intelligence / Robotics, Multi-Agent Path Finding job with ROYAL HOLLOWAY, UNIVERSITY OF LONDON | 271630 - Times... - November 13th, 2021
- Report: Southeast New Mexico's rural school districts struggle in computer science - Carlsbad Current Argus - November 10th, 2021
- Washington People: Chenyang Lu - The Source - Washington University in St. Louis - Washington University in St. Louis Newsroom - November 10th, 2021
- GA Dept of Ed Awards Third Round of Grants to Build Computer Science Teacher Capacity - All On Georgia - November 10th, 2021
- Facebook Isn't Shutting Down Its Facial Recognition System After All - News @ Northeastern - News@Northeastern - November 10th, 2021
- Tableau to add new business science tools to analytics suite - TechTarget - November 10th, 2021
- Top 10 Best Women Programmers of All Time - Analytics Insight - November 10th, 2021
- This 26-year-old doubled his income by switching to computer scienceand using a key negotiating trick - CNBC - November 8th, 2021
- Partnership advances K-12 classrooms computer science classes to among the top in the nation - Beckley Register-Herald - November 8th, 2021
- WVU Today | WVU, W. Va. Dept. of Education partnership advances K-12 classrooms computer science classes to among the top in the nation - WVU Today - November 8th, 2021
- More Than Half of High Schools Now Offer Computer Science, But Inequities Persist - Education Week - November 8th, 2021
- West Virginia among top in the country for access to computer science education - My Buckhannon - November 8th, 2021
- $15 million to the University of Utah and $25 million to Utah Valley University will expand computer science programs - Salt Lake Tribune - November 8th, 2021
- Assistant Professor of Computer Science job with University of North Carolina at Greensboro | 401826 - The Chronicle of Higher Education - November 8th, 2021
- Free Tucson course teaches basics of computing to attract new workers - Arizona Daily Star - November 8th, 2021
- 'Ever Brighter' campaign a highlight at Homecoming - University of Miami - November 8th, 2021
- 3 Questions: Blending computing with other disciplines at MIT - MIT News - November 8th, 2021
- Data Analytics: How to prepare for the next big job of the future - Study International News - November 8th, 2021
- 2U Announces Partnership with the National University of Singapore, One of Asia's Top-Ranked Global Universities, to Expand Online Professional... - November 8th, 2021
- UMass Amherst College of Information and Computer Sciences to Unveil Major Private Gift and Significant New State Investment on Wednesday - UMass News... - October 26th, 2021
- $25M gift to help fund computer science, information building | The University Record - The University Record - October 26th, 2021
- Assistant Professor, Teaching in Computer Science job with DURHAM UNIVERSITY | 269406 - Times Higher Education (THE) - October 26th, 2021
- XJTLU now in ESI Top 1% in the world in 3 fields - WSAZ-TV - October 26th, 2021
- Mapping the mind's eye | ASU News - ASU Now - October 26th, 2021
- Hunger Drove Me into it; Computer Science Graduate into Fixing Nails for the Past 16 Years Says in Video Nigeria news - Legit.ng - October 26th, 2021
- Thriving, Where Business and Technology Meet | Maryland Smith - Robert H. Smith School of Business - October 26th, 2021
- New Vice Provost for Digital Education on innovating for educational equity - Stanford Report - Stanford University News - October 26th, 2021
- UA researchers set to take part in energy study - Arkansas Online - October 26th, 2021
- Bachelor's in Computer Science - October 14th, 2021
- Computer Science Courses, Subjects, Colleges, Syllabus ... - October 14th, 2021
- Bringing Computer Science to the Ocean with BluePlanetAI - News@Northeastern - October 14th, 2021
- Project aims to expand pool of computer science teachers and computer scientists - The Den - October 14th, 2021
- Research helps Blugold discover how computer science, health care intersect - University of Wisconsin System - October 14th, 2021
- Researchers receive grant to predict the mechanics of living cells - EurekAlert - October 14th, 2021
- University of Queensland Professor David Abramson Wins High Performance Computing Award - HPCwire - October 14th, 2021