Despite the enormous speed at processing reams of data and providing valuable output, artificial intelligence applications have one key weakness: Their brains are located at thousands of miles away.
Most AI algorithms need huge amounts of data and computing power to accomplish tasks. For this reason, they rely on cloud servers to perform their computations, and arent capable of accomplishing much at the edge, the mobile phones, computers and other devices where the applications that use them run.
In contrast, we humans perform most of our computation and decision-making at the edge (in our brain) and only refer to other sources (internet, library, other people) where our own processing power and memory wont suffice.
This limitation makes current AI algorithms useless or inefficient in settings where connectivity is sparse or non-present, and where operations need to be performed in a time-critical fashion. However, scientists and tech companies are exploring concepts and technologies that will bring artificial intelligence closer to the edge.
A lot of the worlds computing power goes to waste as thousands and millions of devices remain idle for a considerable amount of time. Being able to coordinate and combine these resources will enable us to make efficient use of computing power, cut down costs and create distributed servers that can process data and algorithms at the edge.
Distributed computing is not a new concept, but technologies like blockchain can take it to a new level. Blockchain and smart contracts enable multiple nodes to cooperate on tasks without the need for a centralized broker.
This is especially useful for Internet of Things (IoT), where latency, network congestion, signal collisions and geographical distances are some of the challenges we face when processing edge data in the cloud. Blockchain can help IoT devices share compute resources in real-time and execute algorithms without the need for a round-trip to the cloud.
Another benefit to using blockchain is the incentivization of resource sharing. Participating nodes can earn rewards for making their idle computing resources available to others.
A handful of companies have developed blockchain-based computing platforms. iEx.ec, a blockchain company that bills itself as the leader in decentralized high-performance computing (HPC), uses the Ethereum blockchain to create a market for computational resources, which can be used for various use cases, including distributed machine learning.
Golem is another platform that provides distributed computing on the blockchain, where applications (requestors) can rent compute cycles from providers. Among Golems use cases is training and executing machine learning algorithms. Golem also has a decentralized reputation system that allows nodes to rank their peers based on their performance on appointed tasks.
From landing drones to running AR apps and navigating driverless cars, there are many settings where the need to run real-time deep learning at the edge is essential. The delay caused by the round-trip to the cloud can yield disastrous or even fatal results. And in case of a network disruption, a total halt of operations is imaginable.
AI coprocessors, chips that can execute machine learning algorithms, can help alleviate this shortage of intelligence at the edge in the form of board integration or plug-and-play deep learning devices. The market is still new, but the results look promising.
Movidius, a hardware company acquired by Intel in 2016, has been dabbling in edge neural networks for a while, including developing obstacle navigation for drones and smart thermal vision cameras. Movidius Myriad 2 vision processing unit (VPU) can be integrated into circuit boards to provide low-power computer vision and image signaling capabilities on the edge.
More recently, the company announced its deep learning compute stick, a USB-3 dongle that can add machine learning capabilities to computers, Raspberry PIs and other computing devices. The stick can be used individually or in groups to add more power. This is ideal to power a number of AI applications that are independent of the cloud, such as smart security cameras, gesture controlled drones and industrial machine vision equipment.
Both Google and Microsoft have announced their own specialized AI processing units. However, for the moment, they dont plan to deploy them at the edge and are using them to power their cloud services. But as the market for edge AI grows and other players enter the space, you can expect them to make their hardware available to manufacturers.
Currently, AI algorithms that perform tasks such as recognizing images require millions of labeled samples for training. A human child accomplishes the same with a fraction of the data. One of the possible paths for bringing machine learning and deep learning algorithms closer to the edge is to lower their data and computation requirements. And some companies are working to make it possible.
Last year Geometric Intelligence, an AI company that was renamed to Uber AI Labs after being acquired by the ride hailing company, introduced a machine learning software that is less data-hungry than the more prevalent AI algorithms. Though the company didnt reveal the details, performance charts show that XProp, as the algorithm is named, requires much less samples to perform image recognition tasks.
Gamalon, an AI startup backed by the Defense Advanced Research Projects Agency (DARPA), uses a technique called Bayesian Program Synthesis, which employs probabilistic programming to reduce the amount of data required to train algorithms.
In contrast to deep learning, where you have to train the system by showing it numerous examples, BPS learns with few examples and continually updates its understanding with additional data. This is much closer to the way the human brain works.
BPS also requires extensively less computing power. Instead of arrays of expensive GPUs, Gamalon can train its models on the same processors contained in an iPad, which makes it more feasible for the edge.
Edge AI will not be a replacement for the cloud, but it will complement it and create possibilities that were inconceivable before. Though nothing short of general artificial intelligence will be able to rival the human brain, edge computing will enable AI applications to function in ways that are much closer to the way humans do.
This post is part of our contributor series. The views expressed are the author's own and not necessarily shared by TNW.
Read next: How to follow today's eclipse, even if you live outside the US
- Unlocking the Key to the Cloud - Security Boulevard - January 23rd, 2020
- What is the difference between SaaS and Cloud Computing - WhaTech - January 23rd, 2020
- Cloud Database and Database as a Service (DBaaS) Market Analysis on Top Key Vendors, Revenue Growth and Business Development Forecast 2017-2025 -... - January 23rd, 2020
- Helsinki-based UpCloud raises 18 million to rapidly grow its team and cloud computing services - Tech.eu - January 23rd, 2020
- Nextcloud Hub takes on Google Docs and Office 365 - ZDNet - January 23rd, 2020
- Google Cloud Run: What every IT Ops team should know - TechBeacon - January 23rd, 2020
- Microsoft's Nadella On Why The Future Is All About Cloud; Buyers Are Into TikTok's Self-Serve Ad Platform - AdExchanger - January 23rd, 2020
- Why Many Tech Companies are Turning to the Hybrid Cloud to Tackle Today's Business Challenges - Data Center Frontier - January 23rd, 2020
- Global Cloud Server Market 2020 By Analysis -Worldwide Opportunities, Revenue, Production, Demand and Geographical Forecast To 2025 Dagoretti News -... - January 23rd, 2020
- The trillionaires club: How big data, cloud and AI are powering the tech economy - SiliconANGLE - January 23rd, 2020
- Nebulon gets less nebulous, aims to replace SAN and hyperconverged storage - Blocks and Files - January 23rd, 2020
- Global Private Cloud Server Market Growth Opportunities, Challenges, Competitive Analysis And Forecast 2020-2025 - Expedition 99 - Expedition 99 - January 23rd, 2020
- Experts discuss industry response to multicloud - IT Brief New Zealand - January 23rd, 2020
- Data Governance And Smart Cities Are Helping Improve Quality Of Life In Japan - Forbes - January 23rd, 2020
- The Benefits of Identity Management for Healthcare Businesses - Solutions Review - January 23rd, 2020
- How the cloud went from 0 to 100 in ten years - Express Computer - January 23rd, 2020
- Suspect Wanted in May Shooting Arrested in St. Cloud - WJON News - January 23rd, 2020
- Wyze data leak: Key takeaways from server mistake that exposed information from 2.4M customers - GeekWire - January 1st, 2020
- Conquering the Cyber Security Challenges of the Cloud - CPO Magazine - January 1st, 2020
- City of Cottonwood now a certified sustainable business | Sedona.Biz - The Internet Voice of Sedona and The Verde Valley - Sedona.biz - January 1st, 2020
- A restaurant server got a massive tip and it is helping to change her life - KFOR Oklahoma City - January 1st, 2020
- Cloud Hopper Attacks Far More Extensive than First Thought - CloudWedge - January 1st, 2020
- 2019: The Year in Hyperscale - Data Center Frontier - January 1st, 2020
- Using the Windows Admin Center Azure services feature - TechTarget - January 1st, 2020
- Privacy scare leads Wyze to unpair all devices from Google Assistant and Alexa, you'll need to add them back (Update: Further responses) - Android... - January 1st, 2020
- 5 top tech predictions for 2020 and beyond - BusinessTech - January 1st, 2020
- Exposed databases are as bad as data breaches, and they're not going anywhere - CNET - December 28th, 2019
- From bookstore to cloud hosting: How Amazon 'took the lead' in the technology world - CBC.ca - December 28th, 2019
- Bare Metal Cloud Market Future Aspect Analysis and Current Trends by 2017 to 2025 - Market Research Sheets - December 28th, 2019
- Microsoft Stock Is Floating on a Cloud - Investorplace.com - December 28th, 2019
- How Important Is The Intelligent Cloud Segment To Microsofts Stock? - Forbes - December 28th, 2019
- Privacy scare leads Wyze to unpair all devices from Google Assistant and Alexa, you'll need to add them back - Android Police - December 28th, 2019
- To protect data and code in the age of hybrid cloud, you can always turn to Intel SGX - The Register - December 28th, 2019
- The silver lining in cloud for financial institutions - ITProPortal - December 28th, 2019
- Server Microprocessor Market Projected to Grow at an Impressive CAGR Of XX% Between 2017 2027 Bulletin Line - Bulletin Line - December 28th, 2019
- Listen to the boomers - or cloud could make you go bust - ITProPortal - December 28th, 2019
- Dr. Max Welling on Federated Learning and Bayesian Thinking - Synced - December 28th, 2019
- 7 crackpot technologies that might transform IT - CIO East Africa - December 28th, 2019
- Over 750,000 Applications for Copies of US Birth Certificates Left Exposed Online - Security Boulevard - December 14th, 2019
- For Cloud-native App Security, Few Companies Have Embraced DevSecOps - Security Boulevard - December 14th, 2019
- Amping Up The Arm Server Roadmap - The Next Platform - December 14th, 2019
- Over 750,000 Applications for US Birth Certificates Left Exposed Online - Security Boulevard - December 14th, 2019
- AWS outperforms rivals in test of cloud capabilities - TechRepublic - December 14th, 2019
- Hyperscale operators accounted for a third of all data center spending in first three quarters of 2019 - FierceTelecom - December 14th, 2019
- IoT news of the week for Dec. 13, 2019 - Stacey on IoT - December 14th, 2019
- Data Sovereignty: The imperative for action - DatacenterDynamics - December 14th, 2019
- Google Transfer Service makes moving your data to the cloud easier than ever - ITProPortal - December 14th, 2019
- Why Middle East startups are choosing the cloud - Khaleej Times - December 14th, 2019
- The 10 Hottest New Business And Enterprise Servers Of 2019 - CRN: Technology news for channel partners and solution providers - December 14th, 2019
- Pulseway Introduces the All New, Integrated Cloud Backup Solution - PR Web - December 14th, 2019
- Edge predictions for 2020: From SD-WAN and cloud interconnection to security - Small Business - December 14th, 2019
- Broadcom Launches Another Tomahawk Into The Datacenter - The Next Platform - December 14th, 2019
- Four Technologies That Are Changing The Way We Do Business - TechShout! - December 14th, 2019
- Meet the power players behind Microsoft's Azure cloud - Business Insider - December 8th, 2019
- Hyperscale Data Center Market - Global Outlook and Forecast 2019-2024: Adoption of Cloud-based Services and & Big Data Driving Hyperscale Data... - December 8th, 2019
- Inside Intel's billion-dollar transformation in the age of AI - Fast Company - December 8th, 2019
- Amazon's cloud business bombards the market with dozens of new features as it looks to preserve its lead - CNBC - December 8th, 2019
- What is Infrastructure-as-a-Service? Everything you need to know about IaaS - TechRadar - December 8th, 2019
- Report: Growing HCI Space Boosted by Cloud, AI - Virtualization Review - December 8th, 2019
- 20 VPS providers to shut down on Monday, giving customers two days to save their data - ZDNet - December 8th, 2019
- How AWS Plans to Speed Up the Cloud - Toolbox - December 8th, 2019
- Finally: AWS Gives Servers A Real Shot In The Arm - The Next Platform - December 8th, 2019
- 5 Top Features of the Cloud that can Benefit Your Small Business - Atlanta Small Business Network - December 8th, 2019
- Once-Reticent Utilities Accelerating Move to the Cloud - Transmission & Distribution World - December 8th, 2019
- Ampere preps an 80-core Arm processor for the cloud - Network World - December 8th, 2019
- Cisco Down Two Execs As One Reportedly Jumps To John Chambers-Backed Pensando - CRN: The Biggest Tech News For Partners And The IT Channel - December 8th, 2019
- Meet CIMON-2, a new and improved robotic AI astronaut - Astronomy Magazine - December 8th, 2019
- Qualcomms Snapdragon Tech Summit focuses on 5G AI chips and use cases - VentureBeat - December 8th, 2019
- Are All Russian Mobile Apps Really a Potential Counterintelligence Threat? This is What the Experts Say - Newsweek - December 8th, 2019
- Overcome these VMware Cloud on AWS migration challenges - TechTarget - December 8th, 2019
- Aptiv To Unveil Open Source Advanced Technology Architecture - Forbes - December 8th, 2019
- Bitcoin Ichimoku Cloud Analysis BTC Price Prediction When To Buy Bitcoin? - Nasdaq - December 8th, 2019
- FBI classifies FaceApp as counterintelligence threat, citing ties to Russian intelligence | TheHill - The Hill - December 2nd, 2019
- Tech co. with Glasgow office merges, rebrands - Delaware Business Times - December 2nd, 2019
- Gatsby Cloud and its Impact on the Headless CMS Space - CMSWire - December 2nd, 2019
- This Holiday Season, Give Your Data Center Manager the Gift of Clarity - Data Economy - December 2nd, 2019
- Unsecured Server with Private Data from Millions of SMS Messages Found Online - Security Boulevard - December 2nd, 2019
- Media Giant Meredith Corporation Selects Nasuni To Help Move Traditional On-Premises File Infrastructure To Amazon Web Services - PRNewswire - December 2nd, 2019
- Encapulsation means application migration is no longer the blocker to digital transformation - Business MattersBusiness Matters - December 2nd, 2019
- Cloud Server Market by 2023 Worldwide Growth Opportunities Recent Trends Forecast by Types and Application to 2023 - Space Market Research - December 2nd, 2019