Should a load-balancer choose the path

Should a load-balancer choose the path Should a load-balancer choose the path - Start

2015-12-10 71K 71 0 0

Should a load-balancer choose the path - Description

as well as the server?. Nikhil Handigol. Stanford University. Joint work with Nick . McKeown. and . Ramesh. . Johari. Datacenter. Wide-area. Enterprise. Can’t choose path :’(. LOAD-BALANCER. Client. ID: 220563 Download Presentation

Download Presentation

Should a load-balancer choose the path




Download Presentation - The PPT/PDF document "Should a load-balancer choose the path" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.



Presentations text content in Should a load-balancer choose the path

Slide1

Should a load-balancer choose the pathas well as the server?

Nikhil Handigol

Stanford University

Joint work with Nick

McKeown

and

Ramesh

Johari

Slide2

Datacenter

Wide-area

Enterprise

Slide3

Can’t choose path :’(

LOAD-BALANCER

Client

Servers

Slide4

Outline and goals

A new architecture for distributed load-balancing

joint (server, path) selection

Demonstrate a nation-wide prototype

Interesting preliminary results

Slide5

I’m here to ask for your help!

Slide6

Data Path (Hardware)

Control Path

OpenFlow

OpenFlow

Controller

OpenFlow Protocol (SSL)

Control Path

Slide7

Custom Hardware

Custom Hardware

Custom Hardware

Custom Hardware

Custom Hardware

OS

OS

OS

OS

OS

Network OS

Feature

Feature

Software Defined Networking

Feature

Feature

Feature

Feature

Feature

Feature

Feature

Feature

Feature

Feature

7

Slide8

Load Balancing is just

Smart Routing

Slide9

Custom Hardware

Custom Hardware

Custom Hardware

Custom Hardware

Custom Hardware

Network OS

Load-balancing logic

Load-balancing as a network primitive

Load-balancing decision

Load-balancing decision

Load-balancing decision

Load-balancing decision

Load-balancing decision

9

Slide10

Aster*

x

Controller

Slide11

Slide12

http://

www.openflow.org

/videos

Slide13

So far…

A new architecture for distributed load-balancing

joint (server, path) selection

Aster*

x

– a nation-wide prototype

Promising results that joint (server, path) selection might have great benefits

Slide14

What next?

Slide15

How big is the pie?

Characterizing and quantifying the performance of joint (server, path) selection

Slide16

Load-balancing Controller

MININET-RT

Slide17

Internet

Load-balancing Controller

Slide18

Clients

CDN

ISP

Model

Slide19

Parameters

Topology

Intra-AS topologies

BRITE (2000 topologies)

CAIDA (1000 topologies)

Rocketfuel

(~100

topos

.)

20-50 nodes

Uniform link capacity

Slide20

Parameters

Servers

5-10 servers

Random placement

Service

Simple HTTP service

Serving 1 MB file

Additional server-side computation

Slide21

Parameters

Clients

3-5 client locations

Random placement

Request pattern

Poisson process

Mean rate: 5-10

req

/sec

Slide22

Load-balancing strategies?

Slide23

Simple but suboptimal

Complex but optimal

Design space

Disjoint-Shortest-Path

Joint

Disjoint-Traffic-Engineering

Slide24

Anatomy of a request-response

Client

Load-Balancer

Server

Response Time

Deliver

Retrieve

Choose

Request

Response 1

st

byte

Response last byte

Last byte

ack

Slide25

Disjoint-Shortest-Path

CDN selects the least loaded server

Load = retrieve + deliver

ISP independently selects the shortest path

Slide26

Disjoint-Traffic-Engineering

CDN selects the least loaded server

Load = retrieve + deliver

ISP independently selects path to minimize max load

Max bandwidth headroom

Slide27

Joint

Single controller jointly selects the best (server, path) pair

Total latency = retrieve + estimated deliver

Slide28

Disjoint-Shortest-Path

vs Joint

Disjoint-Shortest-Path

performs ~2x worse than

Joint

Slide29

Disjoint-Traffic-Engg. vs Joint

Disjoint-Traffic-Engineering

performs almost as well as

Joint

Slide30

Is Disjoint truly disjoint?

Client

Load-Balancer

Server

Response Time

Deliver

Retrieve

Choose

Request

Response 1

st

byte

Response last byte

Last byte

ack

Server response time contains network information

Slide31

The bottleneck effect

A single bottleneck resource along the path determines the performance.

Slide32

Clients

CDN

ISP

The CDN-ISP game

Slide33

The CDN-ISP game

System load monotonically decreases

Both push system in the same direction

Slide34

Summary of observations

Disjoint-SP is ~2x worse than Joint

Disjoint-TE performs almost as well as Joint

(despite decoupling of server selection and traffic engineering)

Game theoretic analysis supports the empirical observation

Slide35

Questions for you!

How should I change the model to mimic a real CDN?

Slide36

Questions for you!

How can I get real data?

What network topologies should I use?

How should I decide the no. of servers and their location?

How should I decide the client request pattern?

Slide37

Questions for you!

How can I try it out in your network?

Elastic Load Balancing in EC2

Amazon

CloudFront

Slide38

Conclusion

A new architecture for distributed load-balancing

joint (server, path) selection

Aster*

x

- a nation-wide prototype

Interesting preliminary results

Future – Evaluation with real data

Slide39

Let’s chat more!

Slide40

Extra slides…

Slide41

Sample topologies

BRITE

CAIDA

Slide42

Disjoint-SP

vs

Ideal

Slide43

Disjoint-TE

vs

Ideal


About DocSlides
DocSlides allows users to easily upload and share presentations, PDF documents, and images.Share your documents with the world , watch,share and upload any time you want. How can you benefit from using DocSlides? DocSlides consists documents from individuals and organizations on topics ranging from technology and business to travel, health, and education. Find and search for what interests you, and learn from people and more. You can also download DocSlides to read or reference later.