Computational storage brings processing power to storage. Its a response to the idea that conventional storage architecture hasnt kept up with todays data storage needs.
Moving data between storage and compute resources is inefficient. And as data volumes increase, it becomes more and more of a bottleneck. As the Storage Industry Networking Association (SNIA) has said: Storage architecture has remained mostly unchanged dating back to pre-tape and floppy.
That might be a slight exaggeration, but the principle that storage is separate from processing remains at the core of most enterprise IT systems. With advanced analytics, big data, AI, machine learning and streaming, this is a problem.
Some solutions are available. In-memory databases such as SAPs Hana cut the need to move data to and from storage. And server flash can bypass the conventional SAS and SATA interfaces between drive and CPU by connecting the controller and flash storage directly to the hosts PCI bus.
Computational storage goes further, however. The technology puts processing onto storage media. Solid-state storage is sufficiently fast that moving data processing closer to storage brings a big jump in performance. Applications such as Hadoop have already moved in this direction, through distributed processing.
Computational storage puts processing onto the storage media. This offloads processing from the CPU and reduces the storage-to-CPU bottleneck. Research by the University of California Irvine and NGD Systems suggests that eight- or nine-fold performance gains and energy savings are possible, with most systems offering at least a 2.2x improvement.
Computational storage is a storage subsystem that includes a number of processors, or CPUs, located on the storage media, or their controllers. These are known as computational storage drives (CSDs), which collectively provide computational storage services. The idea is to move processing to the data, not data to the processor.
The idea is to use the CSDs to pre-empt some of the workloads, so that less data is passed to the main CPU. In some cases, the CPU might need to carry out fewer tasks.
An example is an artificial intelligence (AI)-based surveillance system. A CSD at the edge, perhaps even in the camera itself, can carry out basic tasks such as analysing the image for intruders. Only positives are then fed to the main CPU and application, perhaps to run facial recognition.
When a computer needs to do calculations on a data set, the data needs to be read from storage into memory and then processed, says Andrew Larssen, an IT transformation expert at PA Consulting.
As storage sizes normally vastly exceed memory, the data has to be read in chunks. This slows down analytics and makes real-time analytics impossible for most data sets. By having processing capabilities directly in the storage layer, computational storage lets you avoid this.
Computational storage is typically based around an ARM Cortex or similar processor, located in front of the storage controller, usually NVMe-based. Some CSDs, though, use an integrated compute module and controller.
The computational storage system can also include ASICs or FPGA accelerators, depending on the intended application.
SNIA breaks down current computational storage systems into two broad categories fixed computational storage services (FCSS) and programmable computational storage services (PCSS).
FCSS are optimised for a specific and compute-intensive task, such as compression or encryption. PCSS can run a host operating system, typically Linux. Both systems have pros and cons: FCSS should provide the best performance and cost ratio; PCSS is more flexible. The architecture will also determine whether drivers or application programming interfaces (APIs) are needed, or whether an application could, potentially, run natively on the CSDs. The premise of the proposed Catalina system will allow CSDs, running Linux, to act as data nodes in a Hadoop cluster.
And a system might use just CSDs, or a mix of CSDs and conventional storage, although at present a mix is more likely.
Early applications for computational storage are areas where even a single processor can ease bottlenecks, and include data compression, encryption, and RAID management.
But the technology has evolved to create a wider range of use cases. In part, this is being driven by improvements in software and APIs that allow distributed workloads across a number of CSDs. This brings the greatest performance increases.
Use cases include computational edge, machine learning processing, real-time data analytics and HPC [high-performance computing], says Julia Palmer, a research vice-president at Gartner.
While this technology is nascent, it has potential to grow substantially. Gartner predicts that by 2024, more than 50% of enterprise-generated data will be created and processed outside the datacentre or cloud. Thats up from less than 10% in 2020.
Data streaming is another application where CSDs offer benefits.
The main advantage of computational storage is the performance increase, which can be significant. Applications that are data-intensive, rather than computationally intensive, stand to benefit most by removing the storage-to-processor bottleneck.
Applications that lend themselves to distributed processing will also perform better, as will those that rely on low latency to function well.
Carefully designed CSD systems also offer significant power savings.
Downsides include increasing the complexity of IT architecture, the need for APIs or for the host to be aware of computational storage services, and the additional costs of adding CPUs to storage devices or storage controllers.
Nor is computational storage a cure for all performance ills. A single-instance CSD provides only limited performance benefits. Applications that work across multiple nodes or can be reconfigured to work that way will perform best.
According to Tim Stammers of 451 Research, computational storage is set to become commonplace not least because growing data volumes have all but eaten up the performance advantages gained from the move to flash.
The computational storage market is still very much in development, but these are some of the key suppliers.
Eideticom
Canadian company Eideticoms NoLoad CSD is claimed to run in peer-to-peer mode without any processing from the host CPU. The supplier uses MVMe on PCI, powered by FPGAs. Its focus is on storage services, including data compression and deduplication.
Samsung
Of the mainstream storage suppliers, only Samsung has a product. Its SmartSSD was announced in 2018. It uses a Xilinx FPGA chip. Initial applications include compression, data deduplication and encryption.
Nyriad
Nyriad has an unusual background. Its products were developed initially for the Square Kilometer Array radio telescope. Nyriad developed a CSD that was driven by Nvidia GPUs and could handle data processing at 160TBps.
ScaleFlux
ScaleFlux was founded as a startup in 2014. Its CSDs can process workloads in situ, and its market is the hyperscalers and cloud operators.
NGD
NGD makes CSDs powered by ASICs containing ARM cores. Previously, it used FPGAs. They have been used in edge computing projects. The drives can also be used in non-computational mode as regular storage.
Visit link:
Computational storage: What is it and what are its key use cases? - ComputerWeekly.com
- CTERA Networks Partners with SYNNEX Corporation to Drive Market Demand for Hybrid Cloud Storage, Collaboration and ... [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Cloud storage exempt from Ninefold's uptime boost [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Virsto Named Finalist of 2012 Storage Virtualization & Cloud Awards [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Innovative Hybrid Cloud Storage Solutions Now Available From PROMISE Technology [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Box Talks Integration with BlackBerry 10 and Cloud Storage for Business - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- AG112's Weekly Technology Tutorials Ep.7 Cloud Storage - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Cloud Storage - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Google Cloud Storage Office Hours - 9/5/2012 - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- IBM Cloud Storage -- Future Directions - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Working with best FREE Cloud storage solution - MediaFire - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Best Cloud Storage | How Nate Made $450 His First Hour... - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Cloud Storage Services: Comparison - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Top 10 Free Cloud Storage Services of 2012 - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Cloud Storage Wars - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Secure and Comprehensive Cloud Storage for Health IT - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Free Cloud Storage! - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Microsoft SkyDrive Cloud Storage - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Top 16 Android Cloud Storage Apps Quick Breakdown - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Up to 48GB of FREE Cloud Storage, 14GB Guaranteed - Video [Last Updated On: October 5th, 2012] [Originally Added On: October 5th, 2012]
- Nasuni's CEO To Speak At Interop On The Secure Use Of Cloud Storage [Last Updated On: October 6th, 2012] [Originally Added On: October 6th, 2012]
- Oracle vs Amazon Cloud Storage: OpenWorld 2012 - Video [Last Updated On: October 6th, 2012] [Originally Added On: October 6th, 2012]
- Apple extends iCloud storage for another year [Last Updated On: October 7th, 2012] [Originally Added On: October 7th, 2012]
- Interush Introduces Convenient Cloud-Based Storage Service with Release of PHYTTER DOCK Application [Last Updated On: October 9th, 2012] [Originally Added On: October 9th, 2012]
- Get a free 15GB cloud-storage account from 4Sync [Last Updated On: October 9th, 2012] [Originally Added On: October 9th, 2012]
- Cloud Solutions Increase Customer Engagement and Retention [Last Updated On: October 9th, 2012] [Originally Added On: October 9th, 2012]
- Pogoplug offering 100GB of cloud storage to UK users for just £19.99 a year [Last Updated On: October 10th, 2012] [Originally Added On: October 10th, 2012]
- New vFoglight Storage 2.0 Provides Integrated Application to Disk Performance Monitoring [Last Updated On: October 10th, 2012] [Originally Added On: October 10th, 2012]
- Lunacloud Deploys Cloudian® To Grow Business, Offer S3 Compatible Cloud Storage [Last Updated On: October 11th, 2012] [Originally Added On: October 11th, 2012]
- New Cloud Storage Company, ZapDrive, Launches Today Offering 100 GB for $19.99/year. [Last Updated On: October 11th, 2012] [Originally Added On: October 11th, 2012]
- Otixo Adds Ubuntu One to Aggregated Cloud Storage Lineup [Last Updated On: October 11th, 2012] [Originally Added On: October 11th, 2012]
- Cloud Storage Reviews Announcement Video - Video [Last Updated On: October 11th, 2012] [Originally Added On: October 11th, 2012]
- Cloud storage outage strikes Macquarie Telecom [Last Updated On: October 11th, 2012] [Originally Added On: October 11th, 2012]
- Online-Storage.com is Now SIO.CO [Last Updated On: October 11th, 2012] [Originally Added On: October 11th, 2012]
- C2C Maximizes eMail Archiving Flexibility and Control With Support for the Hybrid Cloud [Last Updated On: October 11th, 2012] [Originally Added On: October 11th, 2012]
- OwnCloud: Build your own or manage your public cloud storage services [Last Updated On: October 12th, 2012] [Originally Added On: October 12th, 2012]
- Ubuntu's cloud storage service hits Mac in beta, with 5GB free [Last Updated On: October 12th, 2012] [Originally Added On: October 12th, 2012]
- Akitio Cloud Hybrid Review: Convenient NAS and USB Storage in One [Last Updated On: October 13th, 2012] [Originally Added On: October 13th, 2012]
- Symform Hires Senior Sales Executive to Build Global Partnerships as Distributed Cloud Storage Network Surpasses 5.5 ... [Last Updated On: October 15th, 2012] [Originally Added On: October 15th, 2012]
- Get an extra 25GB of storage in the Dropbox Great Space Race [Last Updated On: October 16th, 2012] [Originally Added On: October 16th, 2012]
- Microsoft Acquires StorSimple To Increase Cloud Storage Capabilities [Last Updated On: October 17th, 2012] [Originally Added On: October 17th, 2012]
- Inktank-Metacloud Partnership Enhances Fully Managed Private Cloud Solution With Enterprise-Class Storage [Last Updated On: October 17th, 2012] [Originally Added On: October 17th, 2012]
- Citrix and NetApp Collaborate to Simplify Cloud Storage [Last Updated On: October 17th, 2012] [Originally Added On: October 17th, 2012]
- Microsoft Acquires Leader In Cloud-integrated Storage [Last Updated On: October 17th, 2012] [Originally Added On: October 17th, 2012]
- Microsoft Buys StorSimple for Enterprise Cloud Storage [Last Updated On: October 18th, 2012] [Originally Added On: October 18th, 2012]
- FreedomPACS, Radiology PACS and Cloud Image Storage Provider, Releases Results of County Hospital Case Study ... [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Nirvanix Selects Brocade as Networking Backbone for Global Cloud Expansion [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Pogoplug offers unlimited cloud storage for $5 a month [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- NTT Communications Chooses Cloudian® S3 compatible Object Storage Platform for Multi Petabyte Cloud Storage as a Service [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- TwinStrata and Google to Host "Beyond Disaster Recovery: Integrating Cloud Storage into Your IT Strategy" Seminar [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Cloud Storage Reviews Outlines "How SugarSync Works" In Latest Guide [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Symform Challenges Users to Think Beyond Centralized Data Centers With Its 'Byte Me' Promotion [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Avere to tart up FTX with cloud storage gateway, mutterings foretell [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Deals WD My Book Live Personal Cloud Storage 2 TB Network Attached Best Price 2012 - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Create and Manage Your Own Cloud Storage Free - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Free Cloud Space 100GB - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- DuraCloud Brown Bag Series: How DuraCloud is Different From Amazon - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- PocketCloud Explore - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Free 1TB Cloud storage - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Store your files on WEB for free - Unlimited and better than dropbox - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- CloudBackupNow - Retention Policy (with audio) - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- CloudBackupNow - Retention Policy - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- CloudBackupNow - Primer II - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- ERP Data Capture animation - Video [Last Updated On: November 1st, 2012] [Originally Added On: November 1st, 2012]
- Cash rains DOWN on the Cloud - Nasuni trousers $20m [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- My PC Backup Review The Cloud Storage Service For You - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Samsung ATIV S Review - Phones 4u - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Trust Me mv - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Product Webinar: Collaborating and Exchanging Large Data at Distance with Faspex 3.0 - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- DT Daily: Facebook takes aim at Craigslist, Halo 4 reviews a - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- 2 MCSE Private Cloud Storage Basics - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Gladinet Cloud Enterprise Quick Start Guide - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Installing OfficeDrop Mac File Sync - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- OfficeDrop Mac File Sync - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Secure Cloud Storage - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Windows Phone 8: Lenese integrates apps in the camera app - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Graphic Video on Wuala Secure Cloud Storage from Paula Hansen and Chart Magic - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Hurricane Sandy Cheat Meal Run to Tastee Diner - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- Cloud Zow Review - Cloudzow Review | Marketing Secret Revealed - Video [Last Updated On: November 3rd, 2012] [Originally Added On: November 3rd, 2012]
- What is Cloud Storage? - Video [Last Updated On: November 4th, 2012] [Originally Added On: November 4th, 2012]
- Perfume - Chocolate Disco [ hide@BSB Battle In Feb. Remix ] - Video [Last Updated On: November 4th, 2012] [Originally Added On: November 4th, 2012]