Network Services


Home » Courses » Networking in Public Cloud Deployments » Network Services

You have to be registered for this online course, or have this course selected as part of an active Expert Subscription to access all course materials.

Network Services

Public cloud environments have numerous built-in network services, from network load balancers to application load balancers, web proxies, application firewalls, and content delivery network (CDN).

This module starts with the load balancing basics and describes network services available in AWS and Azure environments.

2:06:12 Load Balancing and Scale-Out Architectures

Load balancing is the foundational technology of any scale-out application architecture. This section describes a wide variety of load balancing approaches, from server-based technologies to dedicated load balancing appliances.

Load Balancing and Scale-Out Application Architectures 3.9M 2013-04-19
Introduction to Scalability and Load Balancing 9:28 2014-05-17
Single Server Solutions 12:30 2014-05-17
Scale-Out Application Architectures 21:07 2014-05-17
Scaling Database Servers 11:16 2014-05-17
DNS and Anycast Load Balancing 7:53 2014-05-17
Load Balancers 101 9:50 2014-05-17
Common Load Balancer Features 13:57 2014-05-17
Advanced Load Balancer Features 11:24 2014-05-17
Server-Based Load Balancing 11:19 2014-05-17
Global Load Balancing 12:35 2014-05-17
Scalability and Load Balancing - Conclusions 4:53 2014-05-17

More Information

Introduction to modern network load balancing and proxying

Deploying Load Balancing Services

You will probably want to focus your work on either AWS or Azure. Please watch the materials describing the public cloud provider you want to use during the course.

1:49:23 AWS Load Balancing Mechanisms

AWS provides a variety of load balancing mechanisms, from local L4 load balancing (Network Load Balancing) and HTTP (Application) load balancing to service insertion with Gateway Load Balancer, global load balancing with DNS, and anycast IP addresses.

Elastic Load Balancing 14:29 2022-12-21
Network Load Balancer 10:15 2022-12-21
Application Load Balancer 9:13 2022-12-21
Route 53 and CloudFront 15:47 2022-12-21
Route 53 ARC Zonal Shift 10:36 2023-11-27
Global Accelerator 17:40 2022-12-21
Gateway Load Balancer 27:21 2021-04-27

Automation Examples

Network Load Balancer Example

4:02 From the Design Clinic

Scale-Out Cloud DMZ 4:02 2022-05-30
Create an Application Load Balancer
Create a Network Load Balancer
Getting Started with Global Accelerator
What is a Gateway Load Balancer?

Gateway Load Balancer Blog Posts

Introducing AWS Gateway Load Balancer
AWS Gateway Load Balancer: Supported architecture patterns
Integrate your custom logic or appliance with AWS Gateway Load Balancer
Scaling network traffic inspection using AWS Gateway Load Balancer
Centralized inspection architecture with AWS Gateway Load Balancer and AWS Transit Gateway
GWLB Deployment Patterns

New AWS Features

Application Load Balancer supports TLS 1.3
AWS Gateway Load Balancer supports IPv6 traffic
Network Load Balancer Supports UDP
Application Load Balancer supports advanced request routing
CloudFront supports origin failover
Application Load Balancer as a target for Network Load Balancer
Application Load Balancers now support turning off cross zone load balancing per target group
AWS Gateway Load Balancer launches new option to rebalance flows when target fails or deregisters
Amazon Route 53 launches Geolocation and Latency-Based Routing for Private DNS

Sample Solutions

Building a high available Anycast service using AWS Global Accelerator

2:52:47 Azure Load Balancing Mechanisms

Azure provides numerous TCP/UDP and HTTP load balancing services, including Azure Load Balancer, Azure Application Gateway, and Azure Front Door. You can also use DNS-based load balancing with Azure Traffic Manager, or HTTP caching with Azure CDN. All these services are described in this section.

Introduction to Load Balacing and Scale-Out Architectures

If you're not familiar with load balancinc concepts, you might want to watch this part of Data Center Infrastructure for Networking Engineers before proceeding into the details of Azure services.

Azure Load Balancing Functionality 24:39 2022-11-28
Zone Awareness in Azure Load Balancing 5:44 2021-03-24

59:37 Azure Load Balancer

Azure Load Balancer is an intra-region transparent TCP/UDP load balancer.

Azure Load Balancer Overview 17:14 2021-03-24
Azure Load Balancer Details 13:55 2021-03-24
NAT Rules 9:39 2021-03-24
Floating IP Addresses 5:17 2021-03-24

This is one of those features that should never be used... but if you have to deal with it, you might find this short video useful.

High-Availability Ports 9:27 2021-03-24

The only sensible use case for high-availability ports is a networking virtual appliance (example: firewall) with numerous TCP/UDP ports. In all other scenarios, please try to find a less complex solution.

Cross-Region Load Balancing 4:05 2021-03-24

35:25 Azure Application Gateway

Azure Application Gateway is an intra-region HTTP(S) reverse proxy (load balancer)

Azure Application Gateway Overview 11:26 2021-03-24
Deploying and Configuring Azure Application Gateway 15:05 2021-03-24
Azure Application Gateway Load Balancing Details 8:54 2021-03-24

27:33 Azure Front Door and CDN

Azure Front Door and Azure CDN are global caching HTTP proxies/load balancers

Azure Front Door 13:28 2021-03-24
Azure Front Door Request Routing 9:47 2021-03-24
Azure CDN 4:18 2021-03-24

19:49 Azure Traffic Manager

Azure Traffic Manager is a global DNS-based load balancer

Azure Traffic Manager Overview 6:38 2021-03-24
Traffic Manager Request Routing 13:11 2021-03-24

New Azure Features

Enhancements to Azure Web Application Firewall

Advanced Network Services Topics

29:15 Deploying Network Virtual Appliances

Deploying redundant network virtual appliances in a public cloud virtual network is one of the hardest challenges you'll have to tackle in your public cloud networking journey.

Most network services appliances rely on tricks like layer-2 forwarding, IP address sharing, or static routing toward floating next-hop address to implement seamless failover. None of those tricks work in a typical public cloud environment... but don't despair; this section will outline most of the challenges you'll be facing, and give you a few design alternatives.

Network Virtual Appliance Challenges 16:04 2020-03-18
Sample High-Availability Designs 13:11 2020-03-18
Slide Deck 7.4M 2020-03-16
You started this section on %started% Mark completed