Introduction to Cloud Computing (CSC467)

Unit 3: Cloud Virtualization Technology

1
Chapter Overview
Topics
• Introduction to Virtualization,
• Different types of Virtualization,
• Implementation Levels of Virtualization Structures,
• Benefits of Virtualization,
• Server Virtualization,
• Virtualization Software,
• Types of Hypervisor,
• Load Balancing,
• Infrastructure Requirement for Virtualization

2
• Introduction to Virtualization,
• Different types of Virtualization,
• Implementation Levels of Virtualization
Structures,
• Benefits of Virtualization,

3
Overview of Virtualization Techniques
• Virtualization is the "creation of a
virtual (rather than actual) version of
something, such as a server, a
desktop, a storage device, an
operating system or network
resources".
• In other words, Virtualization is a
technique, which allows to share a
single physical instance of a
resource or an application among
multiple customers and
organizations.
• It does by assigning a logical name
to a physical storage and providing a
pointer to that physical resource
when demanded.
4
Overview of Virtualization Techniques
What is the concept behind the Virtualization?
• Creation of a virtual machine over existing operating system and hardware is known as Hardware
Virtualization.
• A Virtual machine provides an environment that is logically separated from the underlying
hardware.
• The machine on which the virtual machine is going to create is known as Host Machine and that
virtual machine is referred as a Guest Machine
• This virtual machine is managed by a software or firmware, which is known as hypervisor.
Difference between Virtualization and Cloud
• Though cloud technology requires the concept of virtualization. Virtualization is a technology - it can also be treated
as software that can manipulate hardware. At the same time, cloud computing is a service that is the result of
manipulation.
• Virtualization is the foundation element of cloud computing, whereas Cloud technology is the delivery of shared
resources as a service-on-demand via the internet.
• Cloud is essentially made-up of the concept of virtualization.

5
Overview of Virtualization Techniques
Hypervisor
• The hypervisor is a firmware or low-level
program that acts as a Virtual Machine
Manager.
• There are two types of hypervisor:
• Type 1 hypervisor executes on bare system.
The type1 hypervisor does not have any host
operating system because they are installed on
a bare system.
• Eg. LynxSecure, RTS Hypervisor, Oracle VM, Sun xVM
Server, VirtualLogic VLX
• Type 2 hypervisor is a software interface that
emulates the devices with which a system
normally interacts.
• Eg. Containers, KVM, Microsoft Hyper V, VMWare
Fusion, Virtual Server 2005 R2, Windows Virtual PC
and VMWare workstation 6.0.

6
Overview of Virtualization Techniques
Security Rings and Privilege Modes

Least Privileged Mode

(user level instructions)

Most Privilege Mode

(supervisor mode or kernel
mode)

7
Different Types of Virtualization
Types of Virtualizations
1. Hardware Virtualization.
a. Full Virtualization
b. Paravirtualization (OS Assisted Virtualization)
c. Emulation Virtualization
2. Software Virtualization.
3. Operating System Virtualization.
4. Server Virtualization.
a. Hypervisor
b. Full Virtualization
c. Para Virtualization
d. Operating System Virtualization
e. Hardware Assisted Virtualization
f. Kernel-Level Virtualization
5. Storage Virtualization.
6. Network Virtualization
7. Desktop Virtualization 8
Different Types of Virtualization
Hardware Virtualization
• The hypervisor manages shared physical resources of the hardware between the guest operating
systems and host operating system. The physical resources become abstracted versions in
standard formats regardless of the hardware platform. The abstracted hardware is represented as actual
hardware. Then the virtualized operating system looks into these resources as they are physical entities.
• Virtualization means abstraction. Hardware virtualization is accomplished by abstracting the physical
hardware layer by use of a hypervisor or VMM (Virtual Machine Monitor).
• When the virtual machine software or VMM or hypervisor software is directly installed on the
hardware system is known as hardware virtualization.
• The main job of hypervisor is to control and monitoring the processor, memory and other hardware
resources.
• After virtualization of hardware system, we can install different operating system on it and run different
applications on those OS.
• Usage of Hardware Virtualization
• It is mainly used for the server platforms, because controlling virtual machines is much easier than
controlling a physical server.

9
Different Types of Virtualization
Advantages of Hardware Virtualization
1. More Efficient Resource Utilization:
• Physical resources can be shared among virtual machines.
2. Lower Overall Costs Because Of Server Consolidation:
• Co-existence of multiple operating systems on a single hardware platform drops significantly
the number of servers, rack space, and power consumption.
3. Increased Uptime Because Of Advanced Hardware Virtualization Features:
• The modern hypervisors provide highly arranged operations that maximize the abstraction of
the hardware and help to ensure the maximum uptime.
4. Increased IT Flexibility:
• It helps for quick deployment of server resources in a managed and consistent ways.

10
Different Types of Virtualization
Types of Hardware Virtualization
• Full Virtualization
• The hypervisor completely simulates the
underlying hardware
• Guest software does not require any modification
to run.
• Full virtualization uses a combination of direct
execution and binary translation. This allows
direct execution of non-sensitive CPU
instructions, whereas sensitive CPU instructions
are translated on the fly.
• To improve performance, the hypervisor
maintains a cache of the recently translated
instructions.
• VMware’s ESXi server uses this technique to
achieve server virtualization.

11
Different Types of Virtualization
Types of Hardware Virtualization
• Paravirtualization (OS Assisted
Virtualization)
• The hypervisor doesn’t simulate
underlying hardware
• The guest software run their own isolated
domains.
• The guest OS uses hypercalls to execute
sensitive CPU instructions
• VMware vSphere is highly developed
infrastructure that offers a management
infrastructure framework for virtualization.
• It virtualizes the system, storage and
networking hardware.
• The open-source Xen project uses the
paravirtualization technique. 12
Different Types of Virtualization
Types of Hardware Virtualization
• Emulation Virtualization
• The virtual machine simulates the hardware and hence
becomes independent of it.
• The guest operating system does not require modification
• A software connector is required to access hardware
• Requires interpreter to translate the source code

13
Different Types of Virtualization
Software Virtualization
• As soon as the Hardware Virtualization process gets
complete, the Software Virtualization begins its task.
Software Virtualization helps users to install multiple
Operating Systems on one system.
• Managing applications and distribution becomes a
typical task for IT departments. Installation mechanism
differs from application to application. Some programs
require certain helper applications or frameworks and
these applications may have conflict with existing
applications.
• Software virtualization is just like a virtualization but
able to abstract the software installation procedure and
create virtual software installations.
• Virtualized software is an application that will be
"installed" into its own self-contained unit.
• Example of software virtualization is VMware software,
virtual box etc.
14
Different Types of Virtualization
Advantages of Software Virtualization
1. Client Deployments Become Easier:
• Copying a file to a workstation or linking a file in a network then we can easily install virtual
software.
2. Easy to manage:
• To manage updates becomes a simpler task. we need to update at one place and deploy the
updated virtual application to the all clients.
3. Software Migration:
• Without software virtualization, moving from one software platform to another platform takes
much time for deploying and impact on end user systems. With the help of virtualized software
environment, the migration becomes easier.

15
Different Types of Virtualization
Operating System Virtualization
• With the help of OS virtualization nothing
is pre-installed or permanently loaded on
the local device and no-hard disk is
needed.
• Everything runs from the network using a
kind of virtual disk. This virtual disk is
actually a disk image file stored on a
remote server, SAN (Storage Area
Network) or NAS (Network Attached
Storage).
• The client will be connected by the
network to this virtual disk and will boot
with the Operating System installed on
the virtual disk.

16
Different Types of Virtualization
How does OS Virtualization work?
• The first component is the OS Virtualization server. This server is the center point in the OS
Virtualization infrastructure. The server manages the streaming of the information on the virtual disks
for the client and also determines which client will be connected to which virtual disk (using a database,
this information is stored). Also, the server can host the storage for the virtual disk locally or the server
is connected to the virtual disks via a SAN (Storage Area Network). In high availability environments
there can be more OS Virtualization servers to create no redundancy and load balancing. The server
also ensures that the client will be unique within the infrastructure.
• Secondly, there is a client which will contact the server to get connected to the virtual disk and asks for
components stored on the virtual disk for running the operating system.
• The available supporting components are database for storing the configuration and settings for the
server, a streaming service for the virtual disk content, a (optional) TFTP service and a (also optional)
Preboot Execution Environment (PXE) boot service for connecting the client to the OS Virtualization
servers.
• As the virtual disk contains an image of a physical disk from the system that will reflect to the
configuration and the settings of those systems which will be using the virtual disk. When the virtual
disk is created then that disk needs to be assigned to the client that will be using this disk for starting.
The connection between the client and the disk is made through the administrative tool and saved
within the database.
17
Different Types of Virtualization
When a client has a assigned disk, the machine can be
started with the virtual disk using the following process as
displayed in the given below Figure:
1. Connecting to the OS Virtualization server: First we start
the machine and set up the connection with the OS
Virtualization server. Most of the products offer several
possible methods to connect with the server. One of the
most popular and used methods is using a PXE service, but
also a boot strap is used a lot (because of the
disadvantages of the PXE service). Although each method
initializes the network interface card (NIC), receiving a
(DHCP-based) IP address and a connection to the server.
2. Connecting the Virtual Disk: When the connection is
established between the client and the server, the server will
look into its database for checking the client is known or
unknown and which virtual disk is assigned to the client.
When more than one virtual disk are connected then a boot
menu will be displayed on the client side. If only one disk is
assigned, that disk will be connected to the client which is
mentioned in step number 3.
18
Different Types of Virtualization
3. VDisk connected to the client: After the desired virtual
disk is selected by the client, that virtual disk is
connected through the OS Virtualization server. At the
back-end, the OS Virtualization server makes sure that
the client will be unique (for example computer name
and identifier) within the infrastructure.
4. OS is "streamed" to the client: As soon the disk is
connected the server starts streaming the content of the
virtual disk. The software knows which parts are
necessary for starting the operating system smoothly, so
that these parts are streamed first. The information
streamed in the system should be stored somewhere
(i.e. cached). Most products offer several ways to cache
that information. For examples on the client hard disk or
on the disk of the OS Virtualization server.
5. Additional Streaming: After that the first part is
streamed then the operating system will start to run as
expected. Additional virtual disk data will be streamed
when required for running or starting a function called by
the user (for example starting an application available
within the virtual disk).
19
Different Types of Virtualization
Advantages of OS Virtualization
1. OS virtualization usually imposes little or no overhead.
2. OS Virtualization is capable of live migration
3. It can also use dynamic load balancing of containers between nodes and a cluster.
4. The file level copy-on-write (CoW) mechanism is possible on OS virtualization which makes
easier to back up files, more space-efficient and simpler to cache than the block- level copy-on-
write schemes.

20
Different Types of Virtualization
Virtual Disks in OS Virtualization
• The client will be connected via the network to the virtual disk & will boot the OS installed on
virtual disk. Two types of virtual disks are there for implementation.
• These are:
1. Private Virtual Disk: is used by one client only like that of a local hard disk. Users can
save information on the virtual disk based on the rights assigned. So as the client restart
the system, the settings are retained just like working with physical local hard disk.
2. Shared/Common Virtual Disk: It is used by multiple clients at the same time. The
changes are saved in a special cache & these caches gets cleaned as the user restarts or
shutdowns the system. In other words, when a client is booting up, it will use the default
configuration available on the virtual disk.

21
• Server Virtualization,
• Virtualization Software,
• Types of Hypervisor,
• Load Balancing,
• Infrastructure Requirement for Virtualization

22
Different Types of Virtualization
Server Virtualization
• Server Virtualization is the process of dividing a physical server into several virtual servers,
called virtual private servers. Each virtual private server can run independently.
• The concept of Server Virtualization widely used in the IT infrastructure to minimizes the costs
by increasing the utilization of existing resources.
• Types of Server Virtualization
1. Hypervisor
2. Full Virtualization
3. Para Virtualization
4. Hardware-Assisted Virtualization
5. Operating System Virtualization
6. Kernel-Level Virtualization

23
Different Types of Virtualization
Types of Server Virtualization
1. Hypervisor
• In the Server Virtualization, Hypervisor plays
an important role. It is a layer between the
operating system (OS) and hardware.
• There are two types of hypervisors.
a. Type 1 hypervisor (also known as
bare metal or native hypervisors)
b. Type 2 hypervisor (also known as
hosted or Embedded hypervisors)
• The hypervisor is mainly used to perform
various tasks such as allocate physical
hardware resources (CPU, RAM, etc.) to
several smaller independent virtual
machines, called "guest" on the host
machine.

24
Different Types of Virtualization
Types of Server Virtualization
2. Full Virtualization
• Full Virtualization uses a hypervisor to
directly communicate with the CPU and
physical server. It provides the best
isolation and security mechanism to the
virtual machines.
• The biggest disadvantage of using
hypervisor in full virtualization is that a
hypervisor has its own processing needs,
so it can slow down the application and
server performance.
• VMWare ESX server is the best example
of full virtualization.

25
Different Types of Virtualization
Types of Server Virtualization
3. Para Virtualization
• Para Virtualization is quite similar to
the Full Virtualization.
• The advantage of using this
virtualization is that it is easier to use,
Enhanced performance, and does not
require emulation overhead.
• Xen primarily and UML use the Para
Virtualization.
• The difference between full and pare
virtualization is that, in para
virtualization hypervisor does not need
too much processing power to manage
the OS.

26
Different Types of Virtualization
Types of Server Virtualization
4. Hardware-Assisted Virtualization
• Hardware Assisted Virtualization was
presented by AMD and Intel.
• It is also known as Hardware
virtualization, AMD virtualization, and
Intel virtualization.
• It is designed to increase the
performance of the processor.
• The advantage of using Hardware
Assisted Virtualization is that it requires
less hypervisor overhead.

27
Different Types of Virtualization
Types of Server Virtualization
5. Operating System Virtualization
• Operating system virtualization is also called
as system-lever virtualization.
• It is a server virtualization technology that
divides one operating system into multiple
isolated user-space called virtual
environments.
• The biggest advantage of using server
visualization is that it reduces the use of
physical space, so it will save money.
• Linux OS Virtualization and Windows OS
Virtualization are the types of Operating
System virtualization.
• FreeVPS, OpenVZ, and Linux Vserver are
some examples of System-Level Virtualization.

28
Different Types of Virtualization
Types of Server Virtualization
6. Kernel-Level Virtualization
• Kernel-level virtualization is one of the
most important types of server
virtualization.
• It is an open- source virtualization
which uses the Linux kernel as a
hypervisor.
• The advantage of using kernel
virtualization is that it does not require
any special administrative software
and has very less overhead.
• User Mode Linux (UML) and Kernel-
based virtual machine are some
examples of kernel virtualization.

29
Different Types of Virtualization
Advantages of Server Virtualization
1. Independent Restart - In Server Virtualization, each server can restart independently and does not affect the
working of other virtual servers.
2. Low Cost - Server Virtualization can divide a single server into multiple virtual private servers, so it reduces the cost
of hardware components.
3. Disaster Recovery - It is one of the best advantages of Server Virtualization. In Server Virtualization, data can
easily and quickly move from one server to another and these data can be stored and retrieved from anywhere.
4. Faster deployment of resources - Server virtualization allows us to deploy our resources in a simpler and faster
way.
5. Security - It allows uses to store their sensitive data inside the data centers.
Disadvantages of Server Virtualization
1. The biggest disadvantage of server virtualization is that when the server goes offline, all the websites that are
hosted by the server will also go down.
2. There is no way to measure the performance of virtualized environments.
3. It requires a huge amount of RAM consumption.
4. It is difficult to set up and maintain.
5. Some core applications and databases are not supported virtualization.
6. It requires extra hardware resources.
30
Different Types of Virtualization
Uses of Server Virtualization
• Server Virtualization is used in the testing and development environment.
• It improves the availability of servers.
• It allows organizations to make efficient use of resources.
• It reduces redundancy without purchasing additional hardware components.

31
Different Types of Virtualization
Storage Virtualization
Storage virtualization is a major component for storage servers, in the
form of functional RAID (Redundant Array of Independent disks) levels
and controllers.
Operating systems and applications with device can access the disks
directly by themselves for writing. The controllers configure the local
storage in RAID groups and present the storage to the operating system
depending upon the configuration.
However, the storage is abstracted and the controller is determining how
to write the data or retrieve the requested data for the operating system.
Advantages of Storage Virtualization
1. Data is stored in the more convenient locations away from the
specific host. In the case of a host failure, the data is not
compromised necessarily.
2. The storage devices can perform advanced functions like replication,
reduplication, and disaster recovery functionality.
3. By doing abstraction of the storage level, IT operations become more
flexible in how storage is provided, partitioned, and protected.
32
Different Types of Virtualization
Network Virtualization
• Network virtualization is a method of combining the available
resources in a network to consolidate multiple physical networks,
divide a network into segments or create software networks between
virtual machines (VMs).
• IT managers that use network virtualization can administrate their
environment as a single software-based network. Network
virtualization is intended to optimize network speed, reliability,
flexibility, scalability and security. It is said to be especially useful in
networks that experience sudden, large and unforeseen surges in
usage.
Types of network virtualization:
• Software-defined networking (SDN) virtualizes hardware that controls
network traffic routing.
• Network function virtualization (NFV) virtualizes hardware appliances
that provide network-specific functions easier to configure and
manage, e.g., firewall, etc.

33
Different Types of Virtualization
Advantages of Network Virtualization:
1. More productive IT environments (i.e., efficient scaling).
2. Improved security and recovery times.
3. Faster in application delivery.
4. More efficient networks.
5. Reduced overall costs.
Disadvantages of Network Virtualization :
1. Increased upfront costs (investing in virtualization software).
2. Need to license software.
3. There may be a learning curve if IT managers are not experienced.
4. Not every application and server will work in a virtualized environment.
5. Availability can be an issue if an organization can’t connect to their virtualized data.

34
Different Types of Virtualization
Desktop Virtualization
• Desktop virtualization provides a way for users to
maintain their individual desktops on a single, central
server. The users may be connected to the central
server through a LAN, WAN or over the Internet.
• Desktop virtualization has many benefits, including a
lower total cost of ownership (TCO), increased
security, reduced energy costs, reduced downtime and
centralized management.
• Limitations of desktop virtualization include difficulty in
maintenance and set up of printer drivers; increased
downtime in case of network failures; complexity and
costs involved in Virtual Desktop Infrastructure (VDI)
deployment and security risks in the event of improper
network management.

35
Different Types of Virtualization
Benefits of Desktop Virtualization
1. Resource Management:
• Desktop virtualization helps IT departments get the most out of their hardware investments by consolidating most of
their computing in a data center. Desktop virtualization then allows organizations to issue lower-cost computers and
devices to end users because most of the intensive computing work takes place in the data center. By minimizing
how much computing is needed at the endpoint devices for end users, IT departments can save money by buying
less costly machines.
2. Remote Work:
• Desktop virtualization helps IT admins support remote workers by giving IT central control over how desktops are
virtually deployed across an organization’s devices. Rather than manually setting up a new desktop for each user,
desktop virtualization allows IT to simply deploy a ready-to-go virtual desktop to that user’s device. Now the user can
interact with the operating system and applications on that desktop from any location and the employee experience
will be the same as if they were working locally.
3. Security:
• Desktop virtualization software provides IT admins centralized security control over which users can access which
data and which applications. If a user’s permissions change because they leave the company, desktop virtualization
makes it easy for IT to quickly remove that user’s access to their persistent virtual desktop and all its data—instead of
having to manually uninstall everything from that user’s devices. And because all company data lives inside the data
center rather than on each machine, a lost or stolen device does not post the same data risk. If someone steals a
laptop using desktop virtualization, there is no company data on the actual machine and hence less risk of a breach.
36
Benefits of Virtualization
Benefits of Virtualization
• Virtualization can increase IT agility, flexibility, and scalability while creating
significant cost savings. Workloads get deployed faster, performance and
availability increase and operations become automated, resulting in IT that's
simpler to manage and less costly to own and operate.
• Additional benefits include:
• Reduce capital and operating costs.
• Minimize or eliminate downtime.
• Increase IT productivity, efficiency, agility and responsiveness.
• Provision applications and resources faster.
• Enable business continuity and disaster recovery.
• Simplify data center management.
• Build a true Software-Defined Data Center

37
Implementation Levels of Virtualization
• It is not simple to set up virtualization. Our
computer runs on an operating system that
gets configured on some particular (Virtualize one app)
hardware. It is not feasible or easy to run a
different operating system using the same
(Make use of the API that is from
hardware. the libraries at a user level)

• To do this, we will need a hypervisor. Now,

what is the role of the hypervisor? It is a (Create a layer that is abstract bet
ween the OS and the application)
bridge between the hardware and the virtual
operating system, which allows smooth
functioning.
(Level of Hardware)
• Virtualization can be implemented at various
operational levels, as given below:
• Instruction Set Architecture (ISA) level
• Hardware Level (ISA Emulation)
• Operating System Level
• Library Support Level
• Application Level
38
Implementation Levels of Virtualization
1. Instruction Set Architecture Level (ISA)
• ISA virtualization can work through ISA emulation.
• This is used to run many legacy codes that were written for a different configuration of hardware.
These codes run on any virtual machine using the ISA.
• With this, a binary code that originally needed some additional layers to run is now capable of
running on the x86 machines and can also be tweaked to run on the x64 machine.
• For the basic emulation, an interpreter is needed, which interprets the source code and then
converts it into a hardware format that can be read. This then allows processing.
2. Hardware Abstraction Level (HAL)
• It lets the virtualization perform at the level of the hardware.
• This makes use of a hypervisor which is used for functioning.
• At this level, the virtual machine is formed, and this manages the hardware using the process of
virtualization. It allows the virtualization of each of the hardware components, which could be the
input-output device, the memory, the processor, etc.
• Multiple users will not be able to use the same hardware and also use multiple virtualization
instances at the very same time. This is mostly used in the cloud-based infrastructure.

39
Implementation Levels of Virtualization
3. Operating System Level
• At the level of the operating system, the virtualization model is capable of creating a layer that is
abstract between the operating system and the application.
• This is an isolated container that is on the operating system and the physical server, which makes use
of the software and hardware. Each of these then functions in the form of a server.
• When there are several users, and no one wants to share the hardware, then this is where the
virtualization level is used. Every user will get his virtual environment using a virtual hardware resource
that is dedicated.
4. Library Level
• The operating system is cumbersome, and this is when the applications make use of the API that is from
the libraries at a user level.
• API hooks make it possible as it controls the link of communication from the application to the system.
5. Application Level
• The application-level virtualization is used when there is a desire to virtualize only one application
• One does not need to virtualize the entire environment of the platform.
• This is generally used when we run virtual machines that use high-level languages. The application will
sit above the virtualization layer, which in turn sits on the application program.
40
 Load Balancing
Load balancing in Cloud Computing
• Load balancing is an essential technique used in
cloud computing to optimize resource utilization
and ensure that no single resource is
overburdened with traffic.
• It is a process of distributing workloads across
multiple computing resources, such as servers,
virtual machines, or containers, to achieve better
performance, availability, and scalability.
• Load balancing helps to improve the overall
performance and reliability of cloud-based
applications by ensuring that resources are used
efficiently and that there is no single point of
failure (SPOF).
• It also helps to scale applications on demand and
provides high availability and fault tolerance to
handle spikes in traffic or server failures.

41
 Load Balancing
Load Balancing Techniques:
1. Network Load Balancing:
• This technique is used to balance the network traffic across multiple servers or instances.
• It is implemented at the network layer and ensures that the incoming traffic is distributed
evenly across the available servers.
2. Application Load Balancing:
• This technique is used to balance the workload across multiple instances of an application.
• It is implemented at the application layer and ensures that each instance receives an equal
share of the incoming requests.
3. Database Load Balancing:
• This technique is used to balance the workload across multiple database servers.
• It is implemented at the database layer and ensures that the incoming queries are
distributed evenly across the available database servers.

42
 Load Balancing
Advantages:
• Improved Performance: Load balancing helps to distribute the workload across multiple resources, which reduces the load
on each resource and improves the overall performance of the system.
• High Availability: Load balancing ensures that there is no single point of failure in the system, which provides high availability
and fault tolerance to handle server failures.
• Scalability: Load balancing makes it easier to scale resources up or down as needed, which helps to handle spikes in traffic
or changes in demand.
• Efficient Resource Utilization: Load balancing ensures that resources are used efficiently, which reduces wastage and helps
to optimize costs.
Disadvantages:
• Complexity: Implementing load balancing in cloud computing can be complex, especially when dealing with large-scale
systems. It requires careful planning and configuration to ensure that it works effectively.
• Cost: Implementing load balancing can add to the overall cost of cloud computing, especially when using specialized
hardware or software.
• Single Point of Failure: While load balancing helps to reduce the risk of a single point of failure, it can also become a single
point of failure if not implemented correctly.
• Security: Load balancing can introduce security risks if not implemented correctly, such as allowing unauthorized access or
exposing sensitive data.
43
Load Balancing
Types of Load balancing
solutions
1. Software-based load balancers:
• Software-based load balancers run on
standard hardware (desktop, PCs) and
standard operating systems.
2. Hardware-based load balancer:
• Hardware-based load balancers are
dedicated boxes which include
Application Specific Integrated Circuits
(ASICs) adapted for a particular use.
• ASICs allows high speed promoting of
network traffic and are frequently used
for transport-level load balancing
because hardware-based load
balancing is faster in comparison to
software solution.

44
 Load Balancing
Major Examples of Load Balancers –
1. Direct Routing Requesting Dispatching Technique:
• In this, load balancer takes an interface constructed with the virtual IP address that accepts request packets
and it directly routes the packet to the selected servers.
• A real server and load balancer share the virtual IP address.
2. Dispatcher-Based Load Balancing Cluster:
• A dispatcher does smart load balancing by utilizing server availability, workload, capability and other
user-defined criteria to regulate where to send a TCP/IP request.
• The dispatcher module of a load balancer can split HTTP requests among various nodes in a cluster.
3. Linux Virtual Load Balancer:
• The load balancer itself is the primary entry point of server cluster systems and can execute Internet
Protocol Virtual Server (IPVS), which implements transport-layer load balancing in the Linux kernel also
known as Layer-4 switching.
• It is an opensource enhanced load balancing solution used to build extremely scalable and extremely
available network services such as HTTP, POP3, FTP, SMTP, media and caching and Voice Over Internet
Protocol (VoIP).

45
Load Balancing
Load Balancing as a Service (LBaaS)

46
Virtual Infrastructure
Virtual Infrastructure
• Virtual infrastructure is a collection of software-
defined components that make up an enterprise
IT environment.
• It provides the same IT capabilities as physical
resources, but with software, so that IT teams
can allocate these virtual resources quickly and
across multiple systems, based on the varying
needs of the enterprise.
• By decoupling physical hardware from an
operating system, a virtual infrastructure can
help organizations achieve greater IT resource
utilization, flexibility, scalability and cost
savings.
• These benefits are especially helpful to small
businesses that require reliable infrastructure
but can’t afford to invest in costly physical
hardware.
47
Virtual Infrastructure
Virtual Infrastructure Components
• Virtualized compute:
• This component offers the same capabilities as physical servers, but with the ability to be
more efficient.
• Through virtualization, many operating systems and applications can run on a single
physical server, whereas in traditional infrastructure servers were often underutilized.
• Virtual compute also makes newer technologies like cloud computing and containers
possible.
• Virtualized storage:
• This component frees organizations from the constraints and limitations of hardware by
combining pools of physical storage capacity into a single, more manageable repository.
• By connecting storage arrays to multiple servers using storage area networks,
organizations can bolster their storage resources and gain more flexibility in provisioning
them to virtual machines.

48
Virtual Infrastructure
Virtual Infrastructure Components
• Virtualized networking and security:
• This component decouple networking services from the underlying hardware and allows
users to access network resources from a centralized management system.
• Key security features ensure a protected environment for virtual machines, including
restricted access, virtual machine isolation and user provisioning measures.
• Management solution:
• This component provides a user-friendly console for configuring, managing and
provisioning virtualized IT infrastructure, as well automating processes.
• A management solution allows IT teams to migrate virtual machines from one physical
server to another without delays or downtime, while enabling high availability for
applications running in virtual machines, disaster recovery and back-up administration.

49
Virtual Infrastructure
Benefits of Virtual Infrastructure
1. Cost savings: By consolidating servers, virtualization reduces capital and operating costs
associated with variables such as electrical power, physical security, hosting and server
development.
2. Scalability: A virtual infrastructure allows organizations to react quickly to changing customer
demands and market trends by ramping up on CPU utilization or scaling back accordingly.
3. Increased Productivity: Faster provisioning of applications and resources allows IT teams to
respond more quickly to employee demands for new tools and technologies. The result:
increased productivity, efficiency and agility for IT teams, and an enhanced employee
experience and increased talent retention rates without hardware procurement delays.
4. Simplified Server Management: From seasonal spikes in consumer demand to unexpected
economic downturns, organizations need to respond quickly. Simplified server management
makes sure IT teams can spin up, or down, virtual machines when required and re-provision
resources based on real-time needs.

50
Virtual Infrastructure
Virtual Infrastructure Requirement
• From design to disaster recovery, there are certain virtual infrastructure requirements
organizations must meet to reap long-term value from their investment.
1. Plan ahead: When designing a virtual infrastructure, IT teams should consider how
business growth, market fluctuations and advancements in technology might impact
their hardware requirements and reliance on compute, networking and storage resources.
2. Look for ways to cut costs: IT infrastructure costs can become unwieldly if IT teams don’t
take the time to continuously examine a virtual infrastructure and its deliverables. Cost-
cutting initiatives may range from replacing old servers and renegotiating vendor
agreements to automating time-consuming server management tasks.
3. Prepare for failure: Despite its failover hardware and high availability, even the most
resilient virtual infrastructure can experience downtime. IT teams should prepare for worst-
case scenarios by taking advantage of monitoring tools, purchasing extra hardware and
relying on clusters to better manage host resources.

51
Virtual Infrastructure
Virtual Infrastructure Architecture
• Host: A virtualization layer that manages resources and other services for virtual machines. Virtual machines
run on these individual hosts, which continuously perform monitoring and management activities in the
background. Multiple hosts can be grouped together to work on the same network and storage subsystems,
culminating in combined computing and memory resources to form a cluster. Machines can be dynamically
added or removed from a cluster.
• Hypervisor: A software layer that enables one host computer to simultaneously support multiple virtual
operating systems, also known as virtual machines. By sharing the same physical computing resources, such
as memory, processing and storage, the hypervisor stretches available resources and improves IT flexibility.
• Virtual Machine: These software-defined computers encompass operating systems, software programs and
documents. Managed by a virtual infrastructure, each virtual machine has its own operating system
called a guest operating system. The key advantage of virtual machines is that IT teams can provision
them faster and more easily than physical machines without the need for hardware procurement. Better yet,
IT teams can easily deploy and suspend a virtual machine, and control access privileges, for greater security.
These privileges are based on policies set by a system administrator.
• User Interface: This front-end element means administrators can view and manage virtual infrastructure
components by connecting directly to the server host or through a browser- based interface.

52
Questions

53
Questions
1. What is para-virtualization? How virtualization is used to enforce cloud computing services? 2074
2. Explain the cloud data center and its application. 2072
3. Discuss about the planning needed for building the Services Oriented Architecture. 2071(II)
4. What is data center virtualization? Discuss the building blocs of data centers. 2076
5. What do we mean by Service Oriented Architecture (SOA). How can we characterize Service Oriented Architecture? 2073
6. What are the Managed Services Providers(MSP)? Discuss the evolution of MSP Model to Cloud Computing. 2071(II)
7. What do we mean by Service Oriented Architecture (SOA). How cloud services get benefited by SOA? 2071(I)
8. Explain the data center virtualization. 2069
9. What are the Managed Service Providers (MSP). Discuss the evolution of MSP Model to cloud computing. 2071(I)
10. Explain the Service Oriented Architecture (SOA) and its characteristics. 2072
11. What are the Managed Service Providers (MSP). Discuss the evolution of MSP Model to cloud computing. 2073
12. Mention the similarities and dissimilarities between managed service providers cloud service providers. How
organizations can get benefited by virtualizing the data centers? 2074
13. What do we mean by service oriented architectures (SOA)? How can we characterize SOA?
14. "Virtualization is the key to cloud computing", justify this statement with proper arguments. How hypervisors are used in
cloud computing services? 2071(II)
15. What is service oriented architecture? Mention its role in building cloud systems. 2076
16. What do we mean by service oriented architecture(SOA)? Explain with example. 2069
17. What is the need for data center virtualization? What are the benefits of data center virtualization? 2071(I)
18. How data center virtualization is done? Discuss the various building blocks of data center. 2075

54
Questions
18. Define virtualization. What is the role of virtualization in cloud computing? 2073
19. Why cloud services are designed based on the loosely coupled component principle of Service Oriented
Architecture(SOA)? How SOA is used in designing cloud services? 2074
20. Define SOA. How cloud services can be benefited by using the concepts of service Oriented Architecture? 2075
21. Discuss about the planning needed for building the service oriented architecture.

55
The End

56