In the history of big data, no one knows exactly how the term Big Data originated. It has been used since the 1990s. John R. Mashey, a Silicon Graphics professional, is credited with popularizing the term. It may surprise many that Big Data is not a term coined in recent years. Data analysis and techniques related to analysis were used by people over the course of centuries to help them make better decisions. The speed and volume of data generation have increased incredibly over the last two decades. It is now reached a level where it has sprung beyond measures of human comprehension.
Data analysis, analytics, and the concept of Big Data are all connected to data management. They rely on various features and techniques, including storing, extracting, and optimizing data stored in Relational Database Management Systems (RDBMS).
The key components in the first phase were database management and data warehousing. They provided the base for the further development of modern data analysis.
The process of advanced data collection and data analysis features began in early 2000. During this period, web traffic and online stores started proliferating. Leading organizations dealing with Big Data initiated the detailed analysis of customer behavior by researching aspects such as search logs, click rates, and location data. It also opened up a whole new world of possibilities.
HTTP-based web traffic helped drive efforts in proper analysis and storage of semi-structured and unstructured data. Organizations were keen to find solutions for the storage and analysis of standard structured data as well as new data types so that they could be analyzed efficiently. Additionally, the rapid growth of social media data greatly intensified the need for the right tools, techniques, and technologies to extract meaningful information from this unstructured data.
Organizations have to deal with the exceptional challenges posed by web-based unstructured content for data analysis, data analytics, and big data. An answer to this problem seems to emerge from mobile devices.
Mobile devices have the technology to analyze behavioral data. It also allows for storing and analyzing location-based data (GPS data). With mobile devices becoming smarter by the day, tracking various aspects of human behavior and arriving at definite conclusions is possible.
With internet speeds improving, making it possible to spew data at exponentially faster rates, the stage was set for the next giant leap in Big Data history.
With the introduction of the World Wide Web and the development of HTML, URLs, and HTTP, access to data became relatively easy and decidedly faster. In 1996, digital storage became an affordable way of storing information compared to storing data on paper. In addition the search engine system took shape in 1997 with the registration of Google as a domain name. The development of several other tech innovations also took place alongside. These included areas of machine learning, big data, and analytics. In 1999, a book published by Hal R. Varian and Peter Lyman made efforts to quantify the volume of digital information available across the globe.
The real big change in Big Data happened in the 21st century. Doug Laney from Gartner coined the term 3Vs of Big Data. He defined how volume, velocity, and variety impacted Big Data. Since then, other Vs., such as veracity, value, and variability, are also used in the Big Data context.
2005 saw the creation of Apache Hadoop, the open-source framework, by scientists Doug Cutting and Mike Cafarella. This framework is used to store and process large data sets. Soon after, in 2006, Amazon Web Services (AWS) began its web-based computing infrastructure services (cloud computing). It is also a dominant name in the current cloud services industry.
Some of the key developments that happened during this era are:
Edge computing is a new technology that defines the data management process for critical sectors of the economy. This kind of computing is done near the source of data collection rather than in the cloud or a centralized data center.
The explosive increase in the use of connected devices, the dependence on the cloud, and the upcoming edge computing revolution have played important roles in the growth of Big Data. Enhanced use of technologies such as Machine Learning, Artificial Intelligence, and IoT analytics have also contributed to the ability to process and analyze data. Over the years, we can expect major developments in Big Data, which will help accelerate the analytics process and boost the efficiency and ease of use of tools for leveraging Big Data.
Continued here:
A Quick Guide To The History of Big Data - Baseline
- Cloud computing and blue-sky thinking: An atmospheric scientist ... - Purdue University - May 25th, 2023 [May 25th, 2023]
- Singapore on track to reach cloud migration goals asks suppliers to re-apply - The Register - May 25th, 2023 [May 25th, 2023]
- Ampere Computing launches its custom chips aimed at cloud ... - Reuters - May 25th, 2023 [May 25th, 2023]
- Red Hat Summit's first day reveals key themes for the future of cloud ... - SiliconANGLE News - May 25th, 2023 [May 25th, 2023]
- Cloud Computing: Quality and Cataloging are Top Challenges ... - Formtek Blog - May 25th, 2023 [May 25th, 2023]
- Evolution of Cloud Security | Looking At Cloud Posture Management ... - SentinelOne - May 25th, 2023 [May 25th, 2023]
- Integrating Network Function Virtualization with the DevOps Pipeline ... - Open Source For You - May 25th, 2023 [May 25th, 2023]
- Global Cloud Computing in Banking Market Intelligence Report ... - Business Wire - May 25th, 2023 [May 25th, 2023]
- DaaS In Cloud Computing: Benefits And Risks - Dataconomy - May 25th, 2023 [May 25th, 2023]
- BASF strengthens R&D with more powerful supercomputer - BASF - May 25th, 2023 [May 25th, 2023]
- Alibaba approves cloud computing unit spin-off, prepares for grocery and logistics arms to go public - Yahoo Finance - May 25th, 2023 [May 25th, 2023]
- Public cloud contribution to UAE could reach $181bn by 2033 - Trade Arabia - May 25th, 2023 [May 25th, 2023]
- Women at Suncorp skill up with cloud training program - IT Brief Australia - May 25th, 2023 [May 25th, 2023]
- Oracle almost missed the bus on cloud. Can a late charge help it catch up with AWS, Azure, et al.? - Economic Times - May 25th, 2023 [May 25th, 2023]
- Global Edge Computing Technology Market Report 2023: Increasing Usage of 5G Network to Deliver Instant Communication Experiences Presents... - May 25th, 2023 [May 25th, 2023]
- Redington, Google Cloud partner to drive cloud transformation in ... - ITP.net - May 25th, 2023 [May 25th, 2023]
- Dow futures slip as Fitch places United States' AAA rating on negative watch: Live updates - CNBC - May 25th, 2023 [May 25th, 2023]
- Clore.ai Introduces Secure Cloud: Unprecedented Affordability and ... - Digital Journal - May 25th, 2023 [May 25th, 2023]
- Size of the Prize: Assessing the Market for Edge Computing in Space - Via Satellite - May 25th, 2023 [May 25th, 2023]
- Edge Computing Impact: What Does It Do? - Dataconomy - May 25th, 2023 [May 25th, 2023]
- Cloud Data Warehousing: Unleashing the Power of Azure and AWS - Experts Exchange - May 12th, 2023 [May 12th, 2023]
- Edge computing: 4 things to keep on your radar as your business cuts the edge - Times of India - May 12th, 2023 [May 12th, 2023]
- Managed IT Services in Raleigh: The 10 Biggest Cloud Migration ... - Digital Journal - May 12th, 2023 [May 12th, 2023]
- Oracle Teams with Wyndham to Bring OPERA Cloud to 2,000 ... - PR Newswire - May 12th, 2023 [May 12th, 2023]
- Microsoft Tops Cloud Computing Expectations; Alphabet Ad ... - Investopedia - May 2nd, 2023 [May 2nd, 2023]
- Worldwide public cloud end-user spent to hit $597.3bn in 2023 - Trade Arabia - May 2nd, 2023 [May 2nd, 2023]
- Cloud computing and security critical for business strategy in 2023 - Daily Host News - May 2nd, 2023 [May 2nd, 2023]
- Google Cloud partners with Polygon Labs, adding yet again to its growing roster of Web3 firms - Fortune - May 2nd, 2023 [May 2nd, 2023]
- Wireless sensor network project has history of success at SCSU St ... - St. Cloud State University - May 2nd, 2023 [May 2nd, 2023]
- Google Cloud posts first-ever operating profit despite slowing growth - CIO - May 2nd, 2023 [May 2nd, 2023]
- Mastering the Art of SOC Analysis Part 2 | Top Areas for Aspiring ... - SentinelOne - May 2nd, 2023 [May 2nd, 2023]
- Google Cloud boss Kurian's rocky path to profit: 'We were not in a very good situation' - CNBC - May 2nd, 2023 [May 2nd, 2023]
- Teradata Corp.: Leveraging Cloud Computing to Tackle Complex ... - Best Stocks - May 2nd, 2023 [May 2nd, 2023]
- NUSO Becomes a Cloud Peering Partner for Zoom Phone on ... - The Fast Mode - May 2nd, 2023 [May 2nd, 2023]
- Cloud-Based Quantum Computing Market worth $4,063 million by 2028 - Exclusive Report by MarketsandMarkets - Benzinga - May 2nd, 2023 [May 2nd, 2023]
- New cloud computing capabilities for streaming video - The Tech Panda - May 2nd, 2023 [May 2nd, 2023]
- LITEON Technology Reports Q1 2023 Sales of NT$34.2B - SMT 007 - May 2nd, 2023 [May 2nd, 2023]
- Microsoft Dominates in Cloud Computing Market - The Packet - May 2nd, 2023 [May 2nd, 2023]
- Why Modern BSS Is Crucial in Driving Operator CX and B2B ... - The Fast Mode - May 2nd, 2023 [May 2nd, 2023]
- Akamai Gets Richmond for Internal Promotion - Australia Cyber Security Magazine - May 2nd, 2023 [May 2nd, 2023]
- How to Reduce Risk in Cloud Computing - ITPro Today - April 11th, 2023 [April 11th, 2023]
- Alibaba To Enter The Chatbot Arena - Yahoo Finance - April 11th, 2023 [April 11th, 2023]
- New data shows digital skills are more needed than everAWS has 600+ free cloud courses that can help - About Amazon - April 11th, 2023 [April 11th, 2023]
- U.K.'s Cloud Computing Probe Could Push This Bearish ETF Higher - ETF Trends - April 11th, 2023 [April 11th, 2023]
- What is edge computing and how does it differ from traditional cloud ... - NASSCOM Community - April 11th, 2023 [April 11th, 2023]
- Bridging The Cloud Computing Skills Gap: Six Recommendations ... - Digital First Magazine - April 11th, 2023 [April 11th, 2023]
- Cloud Computing in Education Sector Market is expected to Exhibit ... - Digital Journal - April 11th, 2023 [April 11th, 2023]
- Enterprise Mobile Cloud Computing Market to Witness Astonishing ... - Digital Journal - April 11th, 2023 [April 11th, 2023]
- IoT Cloud Platform Market Is Expected To Reach USD 23.66 Billion ... - GlobeNewswire - April 11th, 2023 [April 11th, 2023]
- Xponance Inc. raises stake in Nutanix Inc. by 30.2%: A testament to ... - Best Stocks - April 11th, 2023 [April 11th, 2023]
- Cloud-native Software Market to Flourish with an Impressive CAGR ... - Digital Journal - April 11th, 2023 [April 11th, 2023]
- IC Manage Partners with Library Technologies to Accelerate Library ... - PR Newswire - April 11th, 2023 [April 11th, 2023]
- 4 Green IT Businesses Working to Reduce Computing's Impact on ... - InformationWeek - April 11th, 2023 [April 11th, 2023]
- How generative AI can hurt cloud operations - InfoWorld - April 9th, 2023 [April 9th, 2023]
- Microsoft stumps loyal fans by making OneDrive handle Outlook attachments - The Register - April 9th, 2023 [April 9th, 2023]
- Microsoft and Amazon face UK probe on cloud computing - Financial Times - April 9th, 2023 [April 9th, 2023]
- Why Businesses and Leaders Need to Think About Digital Value ... - CEOWORLD magazine - April 9th, 2023 [April 9th, 2023]
- Accenture and Microsoft help Unilever with huge cloud transition - CloudTech News - April 9th, 2023 [April 9th, 2023]
- GFT and CloudFrame help industries say 'cheerio' to COBOL - CloudTech News - April 9th, 2023 [April 9th, 2023]
- ServiceNow, Inc.: Leading the Way in Enterprise Cloud Computing ... - Best Stocks - April 9th, 2023 [April 9th, 2023]
- Cloud Computing Market in Healthcare Industry Demand will reach ... - Digital Journal - April 9th, 2023 [April 9th, 2023]
- What is FedRAMP High P-ATO? FedRAMP High Compliance and Certification Explained - Security Boulevard - April 9th, 2023 [April 9th, 2023]
- Cloud Native Identity and Access Management in Kubernetes - The New Stack - April 9th, 2023 [April 9th, 2023]
- Global Disaster Recovery-as-a-Service Market Expected to Grow ... - PR Newswire - April 9th, 2023 [April 9th, 2023]
- Global Hyperautomation Market to Reach $118.66 Billion by 2030: Increased Demand for Robotic Process Automation Technologies Drives Growth - Yahoo... - April 9th, 2023 [April 9th, 2023]
- Alibaba Cloud Partners with Jaguar Land Rover China - Pandaily - April 9th, 2023 [April 9th, 2023]
- Tech Stocks Have Been on Fire. Earnings Could Spell Trouble. - Barron's - April 9th, 2023 [April 9th, 2023]
- 3 common myths about sustainability and cloud computing - InfoWorld - April 5th, 2023 [April 5th, 2023]
- Amazon set to train 10,000 locals on cloud computing - Business Daily - April 5th, 2023 [April 5th, 2023]
- Amazon: Navigating The Cloud, AI, And Payments Revolution (NASDAQ:AMZN) - Seeking Alpha - April 5th, 2023 [April 5th, 2023]
- How cloud computing is transforming supply chains - DC Velocity - April 5th, 2023 [April 5th, 2023]
- Iowa's new cloud-computing deal costs nearly $40M over 10 years - The Gazette - April 5th, 2023 [April 5th, 2023]
- Petrobras' cloud computing investments set to grow 40% this year - BNamericas English - April 5th, 2023 [April 5th, 2023]
- Confidential Computing Eases Hesitancy Around Cloud Adoption - RTInsights - April 5th, 2023 [April 5th, 2023]
- Risks & Opportunities of Cloud Computing in the Fintech Sector - TechiExpert.com - April 5th, 2023 [April 5th, 2023]
- Security As A Service Market is Anticipated To Grow USD 46.24 ... - GlobeNewswire - April 5th, 2023 [April 5th, 2023]
- Versa Networks Wins 2023 Product of the Year Award for its Industry-Leading SASE Solution - Yahoo Finance - April 5th, 2023 [April 5th, 2023]
- Dresner Advisory Services Publishes 2023 Cloud Computing and ... - GlobeNewswire - April 5th, 2023 [April 5th, 2023]
- Adaptive Learning Global Market Report 2023: Growing Use of Cloud Computing Among Organizations and Educational Institutes to Motivate Learners to... - April 5th, 2023 [April 5th, 2023]
- The CNA market size is expected to grow from USD 5.9 billion in ... - GlobeNewswire - April 5th, 2023 [April 5th, 2023]