The fourth part of this series on integration of network function virtualization with the DevOps pipeline discusses open source cloud computing platforms in general, and OpenStack in particular.
It is very easy these days to deploy any server and make your service public through the internet. All you have to do is opt for paid hosting infrastructures such as Amazon Elastic Compute Cloud (EC2), Google Cloud Platform, Microsoft Azure, or any other from the many available. You can choose an internet-based system as per your requirement and thats it your service is online. You dont have to bother about what system is driving your application or how it is being hosted you just pay for the specifications you are using. This new model for providing computing services is called cloud computing.
Theres been a surge in the use of technology in the past decade, and todays applications ask for numerous computing and storage requirements. Since this demand cannot be catered to by in-house infrastructure, many companies are now looking for vendors of cloud services to fulfill this requirement. Other factors pushing their adoption include the reliability and robustness that the cloud provides, and the fact that applications using cloud services experience less downtime. Users dont have to care about where this infrastructure is deployed, because for them everything is available locally through the internet.With the availability of cloud services, organisations can now choose their hardware configurations based on their requirements, operating systems, middleware applications, and other platform-based tools. As the traffic on the application changes, the infrastructure can be easily up scaled or downscaled, while eliminating any cost associated with its internal deployment.
Cloud computing is usually viewed under three stacks of service models. These are: Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS). SaaS gives the capability to use an application over the cloud environment of a service provider. The application can be used via a web browser. PaaS allows the user to provision, facilitate, and run the applications over the cloud computing environment. In this environment, users need not worry about the infrastructure underneath. Its typically associated with developing and deploying the application and its configurations. IaaS provides its users with computation, networking, and storage resources in the cloud computing environment. The user has control over the operating system, storage, and deployed applications.
The open source community is also making numerous contributions to open source cloud computing projects. These projects are being developed to help deploy the cloud computing solutions and interfaces to manage the infrastructure underneath. An open source cloud promises no vendor lock-in, and endeavours seamless integration of applications deployed over different platforms. The source code is widely available for these cloud projects and adopters can modify it as per their requirements. Today, there is a growing concern about the confidentiality of data of organisations, and in-house open source cloud computing platforms help secure the perimeters of the data. A few common open source cloud computing projects are OpenStack, CloudStack, and OpenNebula.
One of the more popular open source cloud computing projects is OpenStack. It is deployed worldwide as Infrastructure-as-a-Service both in public and private clouds. OpenStack serves virtual machines and other computing resources to its users while abstracting the physical hardware it is deployed on. It controls large pools of resources, which include computation, networking, and storage. These resources are managed via APIs, which can be accessed through the command-line interface or the graphical user interface. OpenStack is well regarded as the operating system for cloud setup. Its features are not limited to the basic services of the cloud platform. It also provides orchestration, fault management, and service management, and ensures high availability for the user applications deployed over it.
Scalability and openness have always been the selling point of OpenStack. However, it has also made a great name in the IT industry and among researchers because of its unique landscape. OpenStack is an amalgam of various components that come together to provide cloud computing services. Its architecture offers plug-and-play scenarios, where components can be included within OpenStack based on users needs. It has a modular architecture (Figure 1) and provides various services such as computing, hardware life cycle, storage, networking, shared services, orchestration, workload provisioning, application life cycle, API proxies, and web front-ends. Basically, OpenStack is designed for administrators and researchers to deploy IaaS infrastructure while providing tools and services to manage virtual machines on top of existing resources.
Compute, networking, block storage, identity, image, object storage, and dashboard comprise major components of OpenStack (Figure 2). All these components collaborate to produce an environment that is viable and reliable for IaaS. The dashboard provides the user interface (UI) to all the other components of the system. Similarly, identity provides authentication (auth) services to all the installed components in the OpenStack cluster. The network section provides networking to the compute of OpenStack. Compute provides volumes to the running instances via block storage and uses the cloud images from object storage.
Compute: Nova is the project associated with the computation component of OpenStack. The main role of Nova is to manage the life cycle of virtual machines, which are initiated by OpenStack users. It is also responsible for managing CPU, memory usage, disk usage, and network interfaces on these virtual machines. Nova runs as a set of daemons on top of existing Linux servers to provide that service.
Networking: Neutron is a software-defined networking (SDN) project of OpenStack that is responsible for delivering networking as a service in virtual computing environments. Neutrons key responsibilities include providing IP addresses to virtual machines, subnets, topologies, and traffic routing. IP address allocation can be both static and dynamic. Users can also configure floating IPs to forward or reroute traffic. Neutron manages all networking facets for the virtual networking infrastructure (VNI) and the access layer aspects of the physical networking infrastructure (PNI) in the OpenStack environment.
Block storage: Cinder handles the block storage devices in OpenStack. It is responsible for providing APIs to users so they can manage and consume block storage on their virtual instances. It provides volumes to Nova virtual machines, ironic bare metal hosts, containers, and more while ensuring high availability, fault tolerance, recoverability, and open standards.Identity: Keystone is responsible for providing API client authentication, service discovery, and distributed multi-tenant authorisation by implementing OpenStacks identity API. It provides role-based access control for OpenStack components.
Image: Image service is provided by project Glance in OpenStack. With this service, users can upload and discover data assets that are meant to be used with other services. This currently includes images and metadata definitions. Glance manages virtual machines disk images, and provides image delivery to virtual machines as well as snapshot (backup) services.
Object storage: Swift in OpenStack provides object-level storage via a RESTful API. Swift is a highly available, distributed, eventually consistent object/blob store. Organisations can use it to store lots of data efficiently, safely, and cheaply.
Dashboard: The Horizon project provides administrators with a graphical user interface to administer OpenStack and its various components. Horizon is the canonical implementation of OpenStacks dashboard, which provides a web-based user interface to OpenStack services including Nova, Swift, Keystone, etc.
OpenStack is a combination of various systems and separately installed components. These services connect via APIs and provide users with useful resources like computing, networking, and storage. You can either install OpenStack via a script or individually install its various components.
DevStack: DevStack is an Ubuntu-based minimal installation of OpenStack. It follows a certain template and installs all the components and services. The installation given here is for the OpenStack experience and the development environment.
The local installation was done on an Ubuntu 20.04.4 LTS virtual machine, with 4 CPUs, 12GB of memory, and 150GB of storage.
First, lets update and upgrade our target platform:
We create a stack user who will be responsible for handling all the DevStack services on the created virtual machine. DevStack services should be run as a non-root user with sudo permissions. The following commands create a stack user with the appropriate permissions:
Well clone the DevStack repository and change the directory accordingly:
In the devstack directory, well have to make changes in the local.conf file and add passwords to the various services in DevStack:
And thats it; you have successfully configured DevStack. Its time to install the services, and run the following command:
Figure 3 showcases all the successful installations of DevStack and its various default services. The IP address can be used to visit the dashboard of DevStack. The figure also prompts the password and default users created.
Figure 4 shows the login page of the DevStack the user name and passwords can be obtained from the end of the installation script. The login page is produced by the Horizon service in OpenStack.
Figure 5 shows the default dashboard of OpenStack. The dashboard is produced via the Horizon component, where all the other services of OpenStack communicate their metadata, which is published on the dashboard. The Overview showcases the limited summaries of Compute, Volume, and Network. A default network and its related components are created by DevStack on installation.
Manual installation: Manual installation is a bit more complicated than the DevStack installation. Here, you have to individually handle the network and configurations on multiple nodes Compute, Controller and Block. Many services such as Etcd, Memcache, MySQL, and RabbitMQ are installed and configured to work on all the nodes. After the installation of basic services, all the OpenStack components are installed such as Identity, Glance, Neutron, Nova, and more.
The installation procedure is quite complex and involves a plethora of steps. The complete installation instructions are kept in the GitHub repository, and the link for the same can be found at https://github.com/shubhamaggarwal890/nginx-vod/blob/master/OpenStack-Manual.md.
Figure 6 shows the login page of the Ubuntu-based OpenStack; the user name, password, and domain are set by the administrator during the installation process. The login page is produced by Horizon service in OpenStack.
Figure 7 shows the default dashboard of OpenStack produced by the Horizon component. Here, all the other services of OpenStack communicate their metadata and it is published on the dashboard. Since in our installation of OpenStack we didnt install the Cinder component, which is responsible for storing the metadata of all the other components, the limited summaries of Compute, Volumes, and Network are not visible.
Figure 8 shows all the installed services contributing to the OpenStack system. Every service exposes endpoint APIs, which can be invoked by admin, internally and publically.
Figure 9 shows all the hypervisors attached to the OpenStack cluster. In the produced cluster, we went with one Compute node with type Quick Emulator (QEMU). The Hypervisor summary also shows the VCPUs used, along with other details such as RAM and storage size.
Figure 10 shows all the compute services running on their respective host nodes. The columns further detail the status and the current state of these services. The zone is the logical partition of the services.
One can argue that DevStack is easier to install than the manual installation of each service in OpenStack, as it handles all the components and their communication through an extensible script, bringing up the OpenStack environment in no time. But this type of installation has its own limitations. The DevStack environment cannot be tailored as per the administrators requirements. Moreover, DevStack is only for developer-based environments; such a cluster cannot and should not be deployed over production systems. To enable distributed systems and their communication, one must go for manual installation of OpenStack.
We saw that OpenStack abstracts most of the network functions, where we can deploy various networking functionalities through its dashboard or via the call of APIs. Traditionally, the setup of such an infrastructure would require the use of plenty of proprietary hardware. But today thats not the case, because with software-defined networking, all these networking functionalities have been virtualised as software.
See original here:
Integrating Network Function Virtualization with the DevOps Pipeline ... - Open Source For You
- Cloud computing and blue-sky thinking: An atmospheric scientist ... - Purdue University - May 25th, 2023 [May 25th, 2023]
- Singapore on track to reach cloud migration goals asks suppliers to re-apply - The Register - May 25th, 2023 [May 25th, 2023]
- Ampere Computing launches its custom chips aimed at cloud ... - Reuters - May 25th, 2023 [May 25th, 2023]
- Red Hat Summit's first day reveals key themes for the future of cloud ... - SiliconANGLE News - May 25th, 2023 [May 25th, 2023]
- Cloud Computing: Quality and Cataloging are Top Challenges ... - Formtek Blog - May 25th, 2023 [May 25th, 2023]
- Evolution of Cloud Security | Looking At Cloud Posture Management ... - SentinelOne - May 25th, 2023 [May 25th, 2023]
- Global Cloud Computing in Banking Market Intelligence Report ... - Business Wire - May 25th, 2023 [May 25th, 2023]
- DaaS In Cloud Computing: Benefits And Risks - Dataconomy - May 25th, 2023 [May 25th, 2023]
- BASF strengthens R&D with more powerful supercomputer - BASF - May 25th, 2023 [May 25th, 2023]
- Alibaba approves cloud computing unit spin-off, prepares for grocery and logistics arms to go public - Yahoo Finance - May 25th, 2023 [May 25th, 2023]
- Public cloud contribution to UAE could reach $181bn by 2033 - Trade Arabia - May 25th, 2023 [May 25th, 2023]
- Women at Suncorp skill up with cloud training program - IT Brief Australia - May 25th, 2023 [May 25th, 2023]
- Oracle almost missed the bus on cloud. Can a late charge help it catch up with AWS, Azure, et al.? - Economic Times - May 25th, 2023 [May 25th, 2023]
- Global Edge Computing Technology Market Report 2023: Increasing Usage of 5G Network to Deliver Instant Communication Experiences Presents... - May 25th, 2023 [May 25th, 2023]
- Redington, Google Cloud partner to drive cloud transformation in ... - ITP.net - May 25th, 2023 [May 25th, 2023]
- Dow futures slip as Fitch places United States' AAA rating on negative watch: Live updates - CNBC - May 25th, 2023 [May 25th, 2023]
- Clore.ai Introduces Secure Cloud: Unprecedented Affordability and ... - Digital Journal - May 25th, 2023 [May 25th, 2023]
- Size of the Prize: Assessing the Market for Edge Computing in Space - Via Satellite - May 25th, 2023 [May 25th, 2023]
- Edge Computing Impact: What Does It Do? - Dataconomy - May 25th, 2023 [May 25th, 2023]
- Cloud Data Warehousing: Unleashing the Power of Azure and AWS - Experts Exchange - May 12th, 2023 [May 12th, 2023]
- Edge computing: 4 things to keep on your radar as your business cuts the edge - Times of India - May 12th, 2023 [May 12th, 2023]
- Managed IT Services in Raleigh: The 10 Biggest Cloud Migration ... - Digital Journal - May 12th, 2023 [May 12th, 2023]
- Oracle Teams with Wyndham to Bring OPERA Cloud to 2,000 ... - PR Newswire - May 12th, 2023 [May 12th, 2023]
- Microsoft Tops Cloud Computing Expectations; Alphabet Ad ... - Investopedia - May 2nd, 2023 [May 2nd, 2023]
- Worldwide public cloud end-user spent to hit $597.3bn in 2023 - Trade Arabia - May 2nd, 2023 [May 2nd, 2023]
- Cloud computing and security critical for business strategy in 2023 - Daily Host News - May 2nd, 2023 [May 2nd, 2023]
- Google Cloud partners with Polygon Labs, adding yet again to its growing roster of Web3 firms - Fortune - May 2nd, 2023 [May 2nd, 2023]
- Wireless sensor network project has history of success at SCSU St ... - St. Cloud State University - May 2nd, 2023 [May 2nd, 2023]
- Google Cloud posts first-ever operating profit despite slowing growth - CIO - May 2nd, 2023 [May 2nd, 2023]
- Mastering the Art of SOC Analysis Part 2 | Top Areas for Aspiring ... - SentinelOne - May 2nd, 2023 [May 2nd, 2023]
- Google Cloud boss Kurian's rocky path to profit: 'We were not in a very good situation' - CNBC - May 2nd, 2023 [May 2nd, 2023]
- Teradata Corp.: Leveraging Cloud Computing to Tackle Complex ... - Best Stocks - May 2nd, 2023 [May 2nd, 2023]
- NUSO Becomes a Cloud Peering Partner for Zoom Phone on ... - The Fast Mode - May 2nd, 2023 [May 2nd, 2023]
- Cloud-Based Quantum Computing Market worth $4,063 million by 2028 - Exclusive Report by MarketsandMarkets - Benzinga - May 2nd, 2023 [May 2nd, 2023]
- New cloud computing capabilities for streaming video - The Tech Panda - May 2nd, 2023 [May 2nd, 2023]
- LITEON Technology Reports Q1 2023 Sales of NT$34.2B - SMT 007 - May 2nd, 2023 [May 2nd, 2023]
- Microsoft Dominates in Cloud Computing Market - The Packet - May 2nd, 2023 [May 2nd, 2023]
- Why Modern BSS Is Crucial in Driving Operator CX and B2B ... - The Fast Mode - May 2nd, 2023 [May 2nd, 2023]
- Akamai Gets Richmond for Internal Promotion - Australia Cyber Security Magazine - May 2nd, 2023 [May 2nd, 2023]
- How to Reduce Risk in Cloud Computing - ITPro Today - April 11th, 2023 [April 11th, 2023]
- Alibaba To Enter The Chatbot Arena - Yahoo Finance - April 11th, 2023 [April 11th, 2023]
- New data shows digital skills are more needed than everAWS has 600+ free cloud courses that can help - About Amazon - April 11th, 2023 [April 11th, 2023]
- U.K.'s Cloud Computing Probe Could Push This Bearish ETF Higher - ETF Trends - April 11th, 2023 [April 11th, 2023]
- What is edge computing and how does it differ from traditional cloud ... - NASSCOM Community - April 11th, 2023 [April 11th, 2023]
- Bridging The Cloud Computing Skills Gap: Six Recommendations ... - Digital First Magazine - April 11th, 2023 [April 11th, 2023]
- Cloud Computing in Education Sector Market is expected to Exhibit ... - Digital Journal - April 11th, 2023 [April 11th, 2023]
- Enterprise Mobile Cloud Computing Market to Witness Astonishing ... - Digital Journal - April 11th, 2023 [April 11th, 2023]
- IoT Cloud Platform Market Is Expected To Reach USD 23.66 Billion ... - GlobeNewswire - April 11th, 2023 [April 11th, 2023]
- Xponance Inc. raises stake in Nutanix Inc. by 30.2%: A testament to ... - Best Stocks - April 11th, 2023 [April 11th, 2023]
- Cloud-native Software Market to Flourish with an Impressive CAGR ... - Digital Journal - April 11th, 2023 [April 11th, 2023]
- A Quick Guide To The History of Big Data - Baseline - April 11th, 2023 [April 11th, 2023]
- IC Manage Partners with Library Technologies to Accelerate Library ... - PR Newswire - April 11th, 2023 [April 11th, 2023]
- 4 Green IT Businesses Working to Reduce Computing's Impact on ... - InformationWeek - April 11th, 2023 [April 11th, 2023]
- How generative AI can hurt cloud operations - InfoWorld - April 9th, 2023 [April 9th, 2023]
- Microsoft stumps loyal fans by making OneDrive handle Outlook attachments - The Register - April 9th, 2023 [April 9th, 2023]
- Microsoft and Amazon face UK probe on cloud computing - Financial Times - April 9th, 2023 [April 9th, 2023]
- Why Businesses and Leaders Need to Think About Digital Value ... - CEOWORLD magazine - April 9th, 2023 [April 9th, 2023]
- Accenture and Microsoft help Unilever with huge cloud transition - CloudTech News - April 9th, 2023 [April 9th, 2023]
- GFT and CloudFrame help industries say 'cheerio' to COBOL - CloudTech News - April 9th, 2023 [April 9th, 2023]
- ServiceNow, Inc.: Leading the Way in Enterprise Cloud Computing ... - Best Stocks - April 9th, 2023 [April 9th, 2023]
- Cloud Computing Market in Healthcare Industry Demand will reach ... - Digital Journal - April 9th, 2023 [April 9th, 2023]
- What is FedRAMP High P-ATO? FedRAMP High Compliance and Certification Explained - Security Boulevard - April 9th, 2023 [April 9th, 2023]
- Cloud Native Identity and Access Management in Kubernetes - The New Stack - April 9th, 2023 [April 9th, 2023]
- Global Disaster Recovery-as-a-Service Market Expected to Grow ... - PR Newswire - April 9th, 2023 [April 9th, 2023]
- Global Hyperautomation Market to Reach $118.66 Billion by 2030: Increased Demand for Robotic Process Automation Technologies Drives Growth - Yahoo... - April 9th, 2023 [April 9th, 2023]
- Alibaba Cloud Partners with Jaguar Land Rover China - Pandaily - April 9th, 2023 [April 9th, 2023]
- Tech Stocks Have Been on Fire. Earnings Could Spell Trouble. - Barron's - April 9th, 2023 [April 9th, 2023]
- 3 common myths about sustainability and cloud computing - InfoWorld - April 5th, 2023 [April 5th, 2023]
- Amazon set to train 10,000 locals on cloud computing - Business Daily - April 5th, 2023 [April 5th, 2023]
- Amazon: Navigating The Cloud, AI, And Payments Revolution (NASDAQ:AMZN) - Seeking Alpha - April 5th, 2023 [April 5th, 2023]
- How cloud computing is transforming supply chains - DC Velocity - April 5th, 2023 [April 5th, 2023]
- Iowa's new cloud-computing deal costs nearly $40M over 10 years - The Gazette - April 5th, 2023 [April 5th, 2023]
- Petrobras' cloud computing investments set to grow 40% this year - BNamericas English - April 5th, 2023 [April 5th, 2023]
- Confidential Computing Eases Hesitancy Around Cloud Adoption - RTInsights - April 5th, 2023 [April 5th, 2023]
- Risks & Opportunities of Cloud Computing in the Fintech Sector - TechiExpert.com - April 5th, 2023 [April 5th, 2023]
- Security As A Service Market is Anticipated To Grow USD 46.24 ... - GlobeNewswire - April 5th, 2023 [April 5th, 2023]
- Versa Networks Wins 2023 Product of the Year Award for its Industry-Leading SASE Solution - Yahoo Finance - April 5th, 2023 [April 5th, 2023]
- Dresner Advisory Services Publishes 2023 Cloud Computing and ... - GlobeNewswire - April 5th, 2023 [April 5th, 2023]
- Adaptive Learning Global Market Report 2023: Growing Use of Cloud Computing Among Organizations and Educational Institutes to Motivate Learners to... - April 5th, 2023 [April 5th, 2023]
- The CNA market size is expected to grow from USD 5.9 billion in ... - GlobeNewswire - April 5th, 2023 [April 5th, 2023]