DPU startup Fungible recently briefed Blocks & Files on its views regarding Intels Infrastructure Processing Unit. Co-founder and CEO Pradeep Sindhu said it was inadequate as a data centre cost saver, lacked imagination, and couldnt help solve the public clouds trillion-dollar paradox, also known as the Hotel California problem.
Intel launched its data processing unit (DPU) line recently, differentiating itself from DPU suppliers such as Fungible and Pensando, by calling its product an Infrastructure Processing Unit (IPU). While Fungible would agree processing infrastructure-centric instructions is the key need, it thinks Intels DPU vision is painfully inadequate and provides much smaller TCO benefits.
The basic difference between the Intel and Fungible approaches, in Blocks & Filess view, is that Intel is focussed on incremental improvements using Smart NICs such as Nvidias BlueField where Fungible is looking for up to 12x improvement.
Intel says it is the DPU market leader by virtue of its sales to hyperscaler data centre operators. Such operators have thousands of servers and switches, and tens of thousands of storage drives. They sell compute cycles, so any percentage gain in compute cycle capacity is worthwhile. A ten to 20 per cent improvement obtained by offloading network, security and storage functions to a SmartNIC means a significant increase in server utilisation, and hence revenues.
Sindhu mentioned Amazons Annapurna approach, in which Amazon took infrastructure processes that were running on X86 and put them on Arm. The Arm CPUs were not as powerful as X86 processors but, at $5/core, were much lower cost than X86 which cost $40/core an 8x improvement. By making that switch, AWS freed up X86 compute cycles, which it could sell to customers.
But Fungible wants more. Sindhu told us that he believes the infrastructure server processing burden is becoming a much bigger component of overall server CPU cycle utilisation. As application server populations in data centres increase and as non-server processing resources such as GPUs increase as well the amount of internal-to-the-data-centre infrastructure processing skyrockets. Sindhu said there is much more east-west data movement in such data centres than north-south data movement.
That means more and more network, storage and security processing tasks are the result of such data movement within and across the infrastructure. It is, he thinks, pointless for application servers to execute the myriad repetitive instructions needed for this work. Yes, it should be offloaded from the servers but not in a small-scale, incremental way with SmartNICs.
In our view, that is like putting lipstick on a pig.
Sindhu said The DPU concept is broader than Intels IPU concept, but he is happy to have Intel and Nvidia validating our vision.
He said Intels IPU concept lacks imaginative vision because Fungibles DPUs can do so much more than an Intel IPU. One example: legacy applications are compute-centric, so user-initiated computations should be executed close to where user data is stored. SQL primitives can be executed directly on DPUs (with SSDs plugged into them) with little data movement.
Sindhu talked about a second example: machine learning involves parameter-serving problems in which previous GPU results are put into Comma and the results distributed. These computations are best done in the network and on-the fly, he said. In other words, on the Fungible DPU.
What Intel actually has is an accelerator (crypto and others), not a DPU, plus a bunch of vanilla Atom cores. Just integrating them on the same die will not solve the problem.
DPU computations have four characteristics:
What is needed is a more or less complete offload of infrastructure-centric processing to dedicated processing chips, tailor-made with instructions and architecture specifically designed for IT infrastructure processing. Fungibles view is that its specialised CPU can process these infrastructure-centric computations far more efficiently than anything else out there.
In effect, an infrastructure-focussed data processing system, using DPUs, is deployed inside a data centre as a central hub with application CPUs using GPUs to carry out processing tasks that distract from their main purpose: running application code.
Sindhu said Nvidias Bluefield SmartNIC is a hardware implementation of NVMe-over Fabrics RoCE (RDMA over Converged Ethernet) protocol, with a ConnectX 5 chip (ROCE v2) and 8 and then 16 Arm cores. The issue he said, is that for RoCE its fine but for other computations its just another general purpose CPU. In short, its inefficient.
Intel and Nvidia are using 7nm designs, yet we beat the pants off them with our 16nm chip because we have a better architecture. Well move to 7nm and then on to 5nm, and no-one will be able to catch us.
Our FS1600 does close to 15 million IOPS. If you use two Xeons with the same SSDs youll get one million IOPS if youre lucky We can see our way 20 million IOPS with software improvements.
Fungible claims that hyperscalers and near-hyperscaler data centres can realise a 12x improvement in TCO by using its specialised chips and software. That consists of 4x improvement from eliminating resource silos and then 3x from improving efficiency.
A Fungible slide shows these two aspects of Fungibles TCO claim. The 3x efficiency improvement claim is shown by taking a nominal $100 of existing IT network, compute and storage infrastructure spend and claiming that the equivalent Fungible infrastructure spend spend with DPU column would be $36. Thats a 64 per cent reduction. Put another way, a $10M infrastructure spend without Fungible would be a $3.6M spend with Fungible a saving of $6.4M.
The slide includes a middle Spend Smart NIC column, which is where Intels IPU-based infrastructure would fit. It partially offloads the host server CPUs but doesnt affect the network and storage spend elements, resulting in a ten per cent TCO reduction a $1M saving in the case of the $10M infrastructure spend example above, with Fungible saving you $5.4M more..
The rather large storage spend saving with Fungible $40 down to $8 is from its data reduction and erasure coding, both meaning less capacity is needed for the same number of raw terabytes.
Sindhu says overall enterprise data centre IT equipment utilisation is less than eight per cent. AWSs data centre utilisation is 32 per cent. He says: Fungible can bring 10x better efficiency to enterprise data centres and 2 to 2.5x better efficiency than hyperscalers.
The Fungible marketing message is that its products let customers operate a data centre with higher efficiency than the hyperscalers themselves. That means tier-1 and tier-2 data centre operators are likely prospects for Fungible.
Equinix and other colocation centres are examples of potentially good targets for Fungible. But a lot of Equinix revenues comes from hyperscalers themselves, with systems such as direct connect brokerage. Equinix might not want to bite the hands that feed it.
Toby Owen, Fungibles VP for Product, said: I think a service provider (SP) would be a model for us that has a huge potential. A whole bunch of customers would rent AI/ML resources from SPs.
Sindhu referred to the Andreessen Horowitz Trillion Dollar Paradox article by Sarah Wang and Martin Lomax:
This said that cloud IT resources were cheap when companies started using them, but quite rapidly become high-cost after a few years. The chart above shows worldwide spending on on-premises data centres and the public cloud from 2010 to 2020, with the cloud growing past the on-premises spend.
Cloud spend puts so much pressure on a companys margins that its share price falls and its market capitalisation suffers. The article explains: Its becoming evident that while cloud clearly delivers on its promise early on in a companys journey, the pressure it puts on margins can start to outweigh the benefits, as a company scales and growth slows. Because this shift happens later in a companys life, it is difficult to reverse as its a result of years of development focused on new features, and not infrastructure optimisation.
Sindhu says that large public cloud customers end up in Hotel California:You can check out any time you like, but you can never leave!*
Wang and Casados conclusion is: We show (using relatively conservative assumptions) that across 50 of the top public software companies currently utilising cloud infrastructure, an estimated $100B of market value is being lost among them due to cloud impact on margins relative to running the infrastructure themselves.
Sindhus message is that a large business can save extensive amounts of money by repatriating public cloud IT infrastructure spend to its on-premises data centres, and equipping them with Fungibles DPU hardware and software. That way they get better than public cloud data centre efficiency and boost their market capitalisation even more.
* Hotel California lyrics Cass County Music, Red Cloud Music, Fingers Music. Songwriters: Don Henley, Glenn Frey, Don Felder. Source:Musixmatch
Read the original here:
Fungible can solve the public cloud Hotel California problem Blocks and Files - Blocks and Files
- Get ready for hybrid cloud with Azure Arc Jumpstart and ArcBox - TechRepublic - August 3rd, 2021
- Supercomputers are becoming another cloud service. Here's what it means - ZDNet - August 3rd, 2021
- The AWS Shared Responsibility Model: Everything You Need to Know - Security Boulevard - August 3rd, 2021
- Top 5 Benefits of Cloud Infrastructure Security - Security Boulevard - August 3rd, 2021
- Will Windows 365 Change the Future of PCs? | Internet News - InternetNews.com - August 3rd, 2021
- Digging into the Atos-Nimbix Deal: Big US HPC and Global Cloud Aspirations. Look out HPE? - HPCwire - August 3rd, 2021
- Advances in technology have led SanJac to offer a degree in cloud computing. - Illinoisnewstoday.com - August 3rd, 2021
- Customer trends require technology to leverage - Smart Business Network - August 3rd, 2021
- Google Cloud and SAP Take Companies to The Cloud in New Partnership - Somag News - August 3rd, 2021
- Here's What We Know About Google's Tensor Mobile Chip So Far - iPhone in Canada - August 3rd, 2021
- Top 10 Data Center Stories of the Month: July 2021 - Data Center Knowledge - August 3rd, 2021
- RMIT to Implement Dedicated Cloud Supercomputing Facility on AWS to Boost Research Capabilities - HPCwire - August 3rd, 2021
- Morphisec is Named A Finalist for the Top 10 Black Unicorns - PR Web - August 3rd, 2021
- Azure Sentinel in the Real World - Virtualization Review - August 3rd, 2021
- Sending data to the cloud, NC makes long-awaited election system updates - WRAL.com - August 1st, 2021
- Cloud Storage vs. Local Storage: Which Storage Solution is the Best for Your Business? - Enterprise Storage Forum - August 1st, 2021
- Key aspects of RPA in the cloud - TechTarget - August 1st, 2021
- Why the cloud is the best deployment solution - Security Boulevard - August 1st, 2021
- Now is the time for a federal cloud modernization moonshot - Brookings Institution - August 1st, 2021
- '$6 in every $10' spent on cloud infrastructure is with AWS, Microsoft, or Google - The Register - August 1st, 2021
- TTX tackles turnover in moving ERP to the cloud - CIO - August 1st, 2021
- Cloud Computing Server Market is to Witness Significant Growth between 2021-2027 with leading players IBM, Corporation,Rackspace, Microsoft... - August 1st, 2021
- The myth of privacy - The Express Tribune - August 1st, 2021
- Dont Fret Intel Macs Will Still Get This M1-Exclusive macOS 12 Feature - iDrop News - August 1st, 2021
- SSD belonging to Euro-cloud Scaleway was stolen from back of a truck, then turned up on YouTube - The Register - August 1st, 2021
- AWS growing so fast its revenue makes it bigger than Cisco or HP - The Register - August 1st, 2021
- The Register just found 300-odd Itanium CPUs on eBay - The Register - August 1st, 2021
- What is quantum computing? Everything you need to know about the strange world of quantum computers - Texasnewstoday.com - August 1st, 2021
- So you want to migrate to the cloud? - ITWeb - August 1st, 2021
- AMD 3rd Gen Epyc CPUs Put Intel Xeon SPs On Ice In The Datacenter - The Next Platform - August 1st, 2021
- Cloud security in 2021: A business guide to essential tools and best practices - ZDNet - July 23rd, 2021
- Supporting staff with cloud-based asset tracking - Modern Healthcare - July 23rd, 2021
- Data center accelerator market was valued at USD 13.7 billion in 2021 and is anticipated to - GlobeNewswire - July 23rd, 2021
- The Benefits of Cloud Object Storage for Higher Education - EdTech Magazine: Focus on Higher Education - July 23rd, 2021
- Leaked memo shows Oracles flagship cloud unit told employees to ramp up for 247 work on projects that insiders say have fallen behind schedule - Times... - July 23rd, 2021
- Insurance Applications in the Hundreds of Thousands Exposed - Lexology - July 23rd, 2021
- Multiple encryption flaws uncovered in Telegram messaging protocol - The Daily Swig - July 23rd, 2021
- MSPs upbeat but wary of increased competition - ComputerWeekly.com - July 23rd, 2021
- An insurtech startup exposed thousands of sensitive insurance applications TechCrunch Bestgamingpro - Best gaming pro - July 23rd, 2021
- Why the Bank of England has its head in the cloud over data security - The Guardian - July 21st, 2021
- Get Cloud Storage and VPN Protection in One Discounted Bundle - PCMag.com - July 21st, 2021
- AWS hosting: What is it, and how does it work? - Tom's Guide - July 21st, 2021
- What Is a Server and What Do Servers Do? - Server Watch - July 21st, 2021
- Qualcomm's Vision: The Future Of ... AI - Forbes - July 21st, 2021
- What Exactly Are Amazon Web Services? - Movies Games and Tech - July 21st, 2021
- Data Center Accelerator Market to Witness Huge Growth by 2027 scrutinized in the new analysis - WhaTech - WhaTech - July 21st, 2021
- Microsoft extends security updates for Windows and SQL Server 2012 and 2008 - The Register - July 21st, 2021
- Ushering in the Next Era of Innovation with Cloud-in-a-Box - RTInsights - July 21st, 2021
- ADLINK Joins the O-RAN ALLIANCE to Accelerate Network Interoperability and Enterprise Migration to 5G - PR Web - July 21st, 2021
- Thousands of companies compromised by REvil Ransomware the supply chain strikes again - Security Boulevard - July 21st, 2021
- Pivot3 gives up ghost as Quantum buys its assets to go deeper into video surveillance Blocks and Files - Blocks and Files - July 21st, 2021
- How is cloud computing revolutionising healthcare? - Healthcare Global - Healthcare News, Magazine and Website - July 18th, 2021
- An insurtech startup exposed thousands of sensitive insurance applications - TechCrunch - July 18th, 2021
- Benefits of cloud website hosting - ITProPortal - July 18th, 2021
- Sponsored post: Startups around the world are solving old problems with modern cloud services - TechCrunch - July 18th, 2021
- Is Micron Technology Stock Headed to $165 a Share? - The Motley Fool - July 18th, 2021
- Three things every business needs from hybrid cloud To match a company's diverse range of software - Fast Company - July 18th, 2021
- TOP 100: IBM makes big move toward transformation - Washington Technology - July 18th, 2021
- What Is a Container? | Understanding Containerization | SW - Server Watch - July 18th, 2021
- PaaS Rating: An Easier Way to Build Software Applications - Illinoisnewstoday.com - July 18th, 2021
- Bank of England to crack down on 'secretive' cloud computing services - Reuters - July 14th, 2021
- UPDATE 1-Bank of England to crack down on 'secretive' cloud computing services - Yahoo Finance - July 14th, 2021
- Microsoft Windows 365 moves your PC to the cloud - TechSpot - July 14th, 2021
- SmugMug Source Preview: Say Goodbye to NAS Servers and Hello to the Best Cloud Storage Yet - Fstoppers - July 14th, 2021
- 2021 State of the Cloud: No end in sight - Logistics Management - July 14th, 2021
- Consumer Cloud Subscription Market To See Massive Growth By 2026 | Google, Microsoft, Box The JC Star - The JC Star - July 14th, 2021
- Privilege Elevation for Workstations and Servers - Security Boulevard - July 14th, 2021
- Migrating to a simplified serverless cloud solution - ITWeb - July 14th, 2021
- Comarch's PowerCloud Gives IBM, Microsoft, And Google A Run For The Money - IT Jungle - July 14th, 2021
- Advisers should look to the Cloud for their IT solutions - FT Adviser - July 14th, 2021
- NVIDIA Aims to Bring AI to the 5G Edge - IT Business Edge - July 14th, 2021
- What is web hosting? What you need to know to choose the right provider - ITProPortal - July 14th, 2021
- Global Server Virtualization Software Market to Reach $10.4 Billion by 2026 - GlobeNewswire - July 14th, 2021
- Sophos Acquires Capsule8 To Bring Powerful And Lightweight Linux Server And Cloud Container Security To Its Adaptive Cybersecurity Ecosystem -... - July 14th, 2021
- Acromove introduces AcroTransfer - the Fastest, Most Secure, and Lowest Cost Service to Transfer Massive Amounts of Data (>25TB) - Business Wire - July 14th, 2021
- SolarWinds issues software update one it wrote for a change to patch hole exploited in the wild - The Register - July 14th, 2021
- After GigaOm's Radar comes Sonar, as it dives deeper into emerging tech Blocks and Files - Blocks and Files - July 14th, 2021
- Google Drive tips and tricks: 9 features you might have missed - CNET - July 12th, 2021
- Robin.io Platform on QCT Servers Accelerates Cloud-native Transformation - Business Wire - July 2nd, 2021
- Do the costs of the cloud outweigh the benefits? - The Economist - July 2nd, 2021