Businesses realize that the cloud offers a lot more than digital infrastructure. Around the world, organizations are turning to the cloud to democratize data access, harness advanced AI and analytics capabilities, and make better data-driven business decisions.
But despite heavy investments to build data repositories, setting up advanced database management systems (DBMS), and building large data warehouses on-premises, many enterprises are still challenged with poor business outcomes, observed Anthony Deighton, chief product officer at Tamr.
Deighton was speaking at the Empowering the intelligent data-driven enterprise in the cloud event by Tamr and Google Cloud in conjunction with CDOTrends. Attended by top innovation executives, data leaders, and data scientists from Asia Pacific, the virtual panel discussion looked at how forward-looking businesses might kick off the next phase of data transformation.
Why a DataOps strategy makes sense
Despite this massive [and ongoing] revolution in data, customers still can't get a view of their customers, their suppliers, and the materials they use in their business. Their analytics are out-of-date, or their AI initiatives are using bad data and therefore making bad recommendations. The result is that people don't trust the data in their systems, said Deighton.
As much as we've seen a revolution in the data infrastructure space, we're not seeing a better outcome for businesses. To succeed, we need to think about changing the way we work with data, he explained.
And this is where a DataOps strategy comes into play. A direct play on the popular DevOps strategy for software development, DataOps relies on an automated, process-oriented methodology to improve data quality for data analytics. Deighton thinks the DevOps revolution in software development can be replicated with data through a continuous collaborative approach with best-of-breed systems and the cloud.
Think of Tamr working in the backend to clean and deliver this centralized master data in the cloud. Offering clean, curated sources to questions such as: Who are my customers? What products have we sold? What vendors do we do business with? What are my sales transactions? And of course, for every one of your [departments], there's a different set of these clean, curated business topics that are relevant to you.
Data in an intelligent cloud
But wont an on-premises data infrastructure work just as well? So what benefits does the cloud offer? Deighton outlined two distinct advantages to explain why he considers the cloud the linchpin of the next phase of data transformation.
You can store infinite amounts of data in the cloud, and you can do that very cost-effectively. It's far less costly to store data in the cloud than it is to try to store it on-premises, in [your own] data lakes, he said.
Another really powerful capability of Google Cloud is its highly scalable elastic compute infrastructure. We can leverage its highly elastic compute and the fact that the data is already there. And then we can run our human-guided machine learning algorithms cost-effectively and get on top of that data quickly.
Andrew Psaltis, the APAC Technology Practice Lead at Google Cloud, drew attention to the synergy between Tamr and Google Cloud.
You can get data into [Google] BigQuery in different ways, but what you really want is clean, high-quality data. That quality allows you to have confidence in your advanced analytics, machine learning, and to the entire breadth of our analytics and AI platform. We have an entire platform to enable you to collaborate with your data science team; we have the tooling to do so without code, packaged AI solutions, tools for those who prefer to write their code, and everywhere in between.
Bridging the data silos
A handful of polls were conducted as part of the panel event, which saw participants quizzed about their ongoing data-driven initiatives. When asked about how they are staffing their data science initiatives, the majority (46%) responded they have multiple teams across various departments handling their data science initiatives.
The rest are split between either having a central team collecting, processing, and analyzing data or a combination of a central team working with multiple project teams across departments.
Deighton observed that multiple work teams typically result in multiple data silos: Each team has their silo of data. Maybe the team is tied to a specific business unit, a specific product team, or maybe a specific customer sales team.
The way to break the data barriers is to bring data together in the cloud to give users a view of the data across teams, he says. And it may sound funny, but sometimes, the way to break the interpersonal barriers is by breaking the data barriers.
Your customers don't care how you are organized internally. They want to do business with you, with your company. If you think about it, not from the perspective of the team, but the customer, then you need to put more effort into resolving your data challenges to best serve your customers.
Making the move
When asked about their big data change initiatives for the next three years, the response is almost unanimous: Participants want to democratize analytics, build a data culture, and make decisions faster (86%). Unsurprisingly, the top roadblock is that IT takes too long to deliver the systems data scientists need (62%) and the cost of data solutions (31%).
The cloud makes sense, given how it enables better work efficiency, lowers operational expenses, and is inherently secure, said Psaltis. Workers are moving to the cloud, Psaltis noted as he shared an anecdote about an unnamed organization that loaded the cloud with up to a petabyte of data in relatively short order.
This was apparently done without the involvement or knowledge of the IT department. Perhaps it might be better if the move to the cloud is done under more controlled circumstances with the approval and participation of IT, says Psaltis.
Finally, it is imperative that data is cleaned and kept clean as it is migrated to the cloud. Simply moving it into the cloud isn't enough. Without cleaning the data first, you will end up with poor quality, disparate data in the cloud. Where each applications data sits within a silo, with more silos than before, and difficulty making quality business decisions, summed up Deighton.
Paul Mah is the editor of DSAITrends. A former system administrator, programmer, and IT lecturer, he enjoys writing both code and prose. You can reach him at[emailprotected].
Image credit: iStockphoto/Artystarty
See more here:
- Coatue Data Science Head Alex Izydorczyk Is Leaving the Company - Business Insider - November 25th, 2021
- Data Science Is a Key Weapon in the Fight Against Fraud - Built In - November 25th, 2021
- Grads from MIT, IITs, IIMs and other Renowned Varsities Working on Building LIVEY, a World-Class Data Science and AI-powered Healthcare Solution -... - November 25th, 2021
- Tim Kao: Infusing Data Science to Revolutionize the Functionalities of Navy and Marine Industries - Analytics Insight - November 25th, 2021
- COVID-19: Compliance to household mixing restrictions in England decreased with each lockdown - EurekAlert - November 25th, 2021
- Data science approaches to confronting the COVID-19 pandemic: a narrative review - DocWire News - November 25th, 2021
- Bayer and Microsoft partner to build new cloud-based digital tools - IT Brief New Zealand - November 25th, 2021
- Elizabeth Holmes testifies in Theranos trial & Athenahealth acquisition 2.0 - STAT - November 25th, 2021
- Who are the current generation of Chief Data Officers? - ComputerWeekly.com - November 25th, 2021
- Analysis in Government Awards 2021 Shortlist - GOV.UK - November 25th, 2021
- Pace receives NSF grant to expand data science instruction nationwide - Westfair Online - November 17th, 2021
- Snowflake Shapes the Future of Data Science with Python Support - Business Wire - November 17th, 2021
- UK Railroads Invest in Data Science, AI, and Machine Learning - Cities of the Future - November 17th, 2021
- Top Upcoming Data Science Webinars to Attend in 2021 - Analytics Insight - November 17th, 2021
- The Iconic CEO Erica Berchtold wants to use the science of data to convert you to online shopping - The Australian Financial Review - November 17th, 2021
- Immunosuppressants linked to severe reactions in people with common genetic profile - Stanford Medical Center Report - November 17th, 2021
- Why Genpact 'Dare in Reality' Is A Hackathon Not To Be Missed - Analytics India Magazine - November 17th, 2021
- TigerGraph expands its graph data library with 20 new algorithms - VentureBeat - November 17th, 2021
- Improving Your Odds of ML Success with MLOps - insideBIGDATA - November 17th, 2021
- Smarter Production and Data-Driven Insight | - Advanced Television - November 17th, 2021
- The Role of Women in Scalping up AI and Data Science - Analytics Insight - November 10th, 2021
- Debunking The Four Most Common Data Science Myths - Influencive - November 10th, 2021
- Olive Partners with ClosedLoop to Improve Care and Reduce Financial Risk for Patients - Yahoo Finance - November 10th, 2021
- Knowland Releases First-of-Its-Kind Future Event Activity Forecast - PRNewswire - November 10th, 2021
- The Question Weve Stopped Asking About Teen-Agers and Social Media - The New Yorker - November 10th, 2021
- Do You Want To Deploy Responsible AI In Your Organization? Join This Session To Operationalize Responsible AI - Analytics India Magazine - November 10th, 2021
- In-Demand skills research finds the US is one of the most competitive markets for skilled tech workers, but talent scarcity is a global issue -... - November 10th, 2021
- Data Science Master's Degree | 100% Online | University of ... - November 6th, 2021
- MSE in Data Science - November 6th, 2021
- Variable Names: Why They're a Mess and How to Clean Them Up - Built In - November 6th, 2021
- UVA Announces New Research Partnership at Intersection of Business and Data Science - UVA Today - November 6th, 2021
- Succeeding in Data Science Projects Inputs that Could Help You - Analytics Insight - November 6th, 2021
- Inspiring Innovation; New Short Talks Features Karl Schubert and Data Science Program - University of Arkansas Newswire - November 6th, 2021
- How to succeed around data science projects - Information Age - November 6th, 2021
- Training students at the intersection of power engineering and computer science WSU Insider - WSU News - November 6th, 2021
- California Tries to Close the Gap in Math, but Sets Off a Backlash - The New York Times - November 6th, 2021
- A look at some of the AI and ML expert speakers at the iMerit ML DataOps Summit - TechCrunch - November 6th, 2021
- Exploring, Monitoring and Modeling the Deep Ocean Are Goals of New Research - UT News - UT News | The University of Texas at Austin - November 6th, 2021
- UVA Science and Engineering Faculty Win 12 NSF Career Awards - University of Virginia - November 6th, 2021
- Microsoft Excel is still the data analytics gold standard. The pre-Black Friday sale can teach you fast. - The Next Web - November 6th, 2021
- Heard on the Street 10/28/2021 - insideBIGDATA - October 28th, 2021
- Insights on the Data Science Platform Global Market to 2027 - Featuring Microsoft, IBM and Google Among Others - Yahoo Finance - October 28th, 2021
- Ericsson helps Giga to map connectivity in more than a million schools - Ericsson - October 28th, 2021
- NIH awards nearly $75M to catalyze data science research in Africa - National Institutes of Health - October 26th, 2021
- Worldwide Data Science Platform Industry to 2027 - Increasing Adoption of Data-Driven Technologies by Enterprises Presents Opportunities - PRNewswire - October 26th, 2021
- Multi-institution project to train Kenyan experts to bring social determinants to bear on modeling health outcomes - Newswise - October 26th, 2021
- Takeda's Krista McKee on Shifting the Data Ecosystem - Bio-IT World - October 26th, 2021
- Stitch Fix CEO: 'Data science and algorithms are at the core' of the company - Oakland News Now - October 26th, 2021
- Miami Dade College to Host 10th Anniversary School of Science White Coat Ceremony and STEM Research Symposium - The Reporter - October 26th, 2021
- FDA takes hands-on approach to upskill workforce under data modernization action plan - Federal News Network - October 26th, 2021
- Global Data Science Platform Market (2021 to 2027) - by Component, Deployment, Organization Size, Function, Industry Vertical and Geography -... - October 26th, 2021
- Planning to study Data Science after Plus-Two? Heres what is on offer - Telegraph India - October 26th, 2021
- Consumer-facing Companies Still Have Few Incentives to Stop Data Breaches, and Thats a National Security Concern. - Council on Foreign Relations - October 26th, 2021
- Skills and online courses to become a Data Scientist, the top job role in the world by 2025 - India Today - October 26th, 2021
- Which degree is right for me: data science or digital health? - News - The University of Sydney - October 26th, 2021
- Data Science Leaders are Ruling the Corporate Industry for their Technical Talent as well as Management Expertise - Analytics Insight - October 26th, 2021
- Will Data Science be in Demand in the Future? - Entrepreneur - September 30th, 2021
- Promoting the Public Good | UVA Today - UVA Today - September 30th, 2021
- MetaCell launches innovative Cloud Hosting for life science and healthcare - Yahoo Finance - September 30th, 2021
- KDD 2021 Honors Recipients of the SIGKDD Best Paper Awards - Yahoo Finance - September 30th, 2021
- Analytics Insight Announces Big Data Analytics Companies of the Year - Yahoo Finance - September 30th, 2021
- R is better than Python. Try telling that to banks - eFinancialCareers - September 30th, 2021
- World AI & Data Science Conference to be held on October 13th, 2021 - Analytics Insight - September 27th, 2021
- How Data Science and Big Data are Shaping the Indian Food Industry in 2021? - Analytics Insight - September 27th, 2021
- mRNA Could Fight Diseases Such as Alzheimer's and Cancer, With Help of UVA Scientist - University of Virginia - September 27th, 2021
- Media advisory: Kevin Leicht to testify before congressional subcommittee about disinformation - University of Illinois News - September 27th, 2021
- Heard on the Street 9/27/2021 - insideBIGDATA - September 27th, 2021
- New Business Institute at UT Austin Will Specialize in Sports Analytics - Diverse: Issues in Higher Education - September 27th, 2021
- How AI is Transforming The Race Strategy Of Electric Vehicles - Analytics India Magazine - September 27th, 2021
- Argentine project analyzing how data science and artificial intelligence can help prevent the outbreak of Covid-19 | Chosen from more than 150... - September 25th, 2021
- Metropolitan Chicago Data-science Corps to partner with area organizations on projects - Northwestern University NewsCenter - September 25th, 2021
- Business of Sports Institute at UT McCombs School Founded by Gift from Accenture - UT News - UT News | The University of Texas at Austin - September 25th, 2021
- 'I Want The Folks in Our Society to Be Data Literate So That We Are Making Good Decisions Together for the Good of the World,' Says Professor... - September 25th, 2021
- Pandemic oversight board to preserve data analytics tools beyond its sunset date - Federal News Network - September 25th, 2021
- Increase the Readability of Your Python Script With 1 Simple Tool - Built In - September 25th, 2021
- On World Cancer Research Day, Illumina Highlights the Transformative Power of Genomics - Yahoo Finance - September 25th, 2021
- An Introduction to Portfolio Optimization in Python - Built In - September 25th, 2021
- Life sciences use of digital twins mirrors its application in other industries - MedCity News - September 25th, 2021
- The Top 3 Tools Every Data Scientist Needs - Built In - September 21st, 2021
- OpsRamp Introduces The Future of Incident Response: Harnessing Machine Learning and Data Science to Predict and Prevent IT Outages - Yahoo Finance - September 21st, 2021