Nordic infrastructure for Research & Education - PDF document

NORDUnet Nordic infrastructure for Res
NORDUnet Nordic infrastructure for Research & Education GLIF Automated GOLE Pilot Project and NSI LHCONE Meeting Jan 30/31, 2012 Lawrence Berkeley Labs, US Jerry Sobieski (NORDUnet) NORDUnet Nordic infrastructure for Research & Education Outline •Purpose of this presentation is to present the GLIF Automated GOLE facility to the LHCONE community •And to propose the facility for testing and evaluation of the LHChbE “open exchange” architecture •Outline: –GLIF Automated GOLE Pilot Project: •What is it? how does it work? •2012 Goals f

or GOLEs –Network Service Interface
or GOLEs –Network Service Interface: •What is it? how does it work? Why should LHCONE care? –AutomatedGOLE as a proving ground for LHCONE NORDUnet Nordic infrastructure for Research & Education The Automated GOLE Fabric USLHCnet PSNC JGN-X MANLAN NetherLight Cern UvA CzechLight KRLight AIST KDDI Labs StarLight ESnet Cal Tech GLORIAD GEANT ACE Nordunet The GLIF Automated GOLE Pilot Project was initiated in 2010 to provide a global fabric of Open Lightpath Exchanges for the express purpose of maturing dynamic provisioning soft

ware, demonstrating the value of GOLEs
ware, demonstrating the value of GOLEs to emerging network service models, and to develop a set of BCP for these services. NORDUnet Nordic infrastructure for Research & Education What is the AG “Fabric“? •The Automated GOLE fabric includes many facilities: –Exchange toints (& “distributed” facilities) –Inter-exchange transport links –Networks •GhLEs link networks together ͙ –Organizations that are willing to contribute people, facilities, hdw/sfw, etc. –Users/applications entities –͙ NORDUnet Nordic infrastructure for Re

search & Education Pionier.ets Pozna
search & Education Pionier.ets Poznan AutoBAHN NetherLight.ets Amsterdam DRAC StarLight.ets Chicago OpenNSA/Argia GEANT.ets Paris AutoBAHN NorthernLight.ets Copenhagen OpenNSA AIST.ets Tsukuba G-LAMBDA-A bSI betworks (“A”=Aggregator) NSI peerings (SDPs) unless otherwise indicated these are vlans 1780-1783 KRLight.ets Daejeon DynamicKL US LHCnet KDDI-Labs.ets Fujimino G-LAMBDA-K ACE KRLight + GLORIAD JGN-X NORDUnet + SURFnet Pionier GEANT JGNX.ets Tokyo G-LAMBDA-K CzechLight.ets Prague DRAC

ESnet.ets Chicago OSCARS UvALight.
ESnet.ets Chicago OSCARS UvALight.ets University of Amsterdam DRAC A A A A A A CESNET Current AutomatedGOLE + NSI Demo NetworkSupercomputing 2011 NORDUnet Nordic infrastructure for Research & Education Automation by NSI: •Software Implementations –OpenNSA – NORDUnet (Copenhagen, DK) –OpenDRAC – SURFnet (Amsterdam, NL) –G-LAMBDA-A - AIST (Tsukuba, JP) –G-LAMBDA-K – KDDI Labs (Fujimino, JP) –AutoBAHN – GEANT (Poznan, PL) –DynamicKL – KISTI (Daejeon, KR) –OSCARS* –

ESnet (Berkeley, US) •Hardware/NR
ESnet (Berkeley, US) •Hardware/NRMs covered: –Wuniper / “JunOS” ͗ L2 & MPLS provisioning - OpenNSA –Brocade: L2 switching - AutoBAHN, OpenNSA(CY12Q1) –Ciena (Nortel) SDH & L2 switching – OpenDRAC –Dell L2, NTT optical: G-LAMBDA-A –Force10: L2 switching – OpenNSA (CY12Q1) –Argia: L2 Switching - OpenNSA –Ciena NMS – DRAC (TBD) NORDUnet Nordic infrastructure for Research & Education 2011 AutoGOLE Progress… •2011 Fall accomplishments: –GLIF Summer W/S (Sep, Rio de Janeiro) •The

“Rio Plugfest” -First demonstra
“Rio Plugfest” -First demonstration of NSI standards based software –Migrated GOLE fabric from FENIUS to NSI •AutoGOLE and NSI WG are working now very closely: consensus, dev͘, testing͙ –Future Internet Assembly (Oct, Poznan) •First NSI/hardware provisioning across subset of the GLIF AutoGOLE facilities –Supercomputing 2011 (Nov, Seattle) •Full AutoGOLE +NSI/hardware + Visualization tools NORDUnet Nordic infrastructure for Research & Education AutoGOLE Objectives for 2012… •Keep NSI/Automated GOLE operationally available –

ready for testing, [some] demos,͙
ready for testing, [some] demos,͙ •aore bSI feature development, deployment, test ͙ –Hardware Backends: Force10, Brocade, OpenFLOW, transport layers –Several participating facilities are awaiting hSCARS+bSI completion͙ –Expanded [pre-production] deployment of AutoBAHN+NSI over/within the AutoGOLE environment •Robustness – incorporate alternate paths: –X-EU: NDN-�UvA, PIONIER (eta CY12Q1) –X-NA: StarLight-�SEA (eta CY12Q1) –X-ATL: NDN-�StarLight (eta CY12Q2) –P-Wave (eta ~Q3?), –X-PAC:

DAE-TOK? LAX-DAE? HKG?
DAE-TOK? LAX-DAE? HKG? SIN? SYD? BEJ? NORDUnet Nordic infrastructure for Research & Education •Expand participation (pre-production service evaluation): –GLORIAD-US (SEA: eta CY12Q1) –WIX (WDC eta CY12Q2) –P-Wave/PNWG and RNP beginning testing now, in AG by ~H2 (?) –Would like to see: •ION, Esnet, USLHCnet, AMPATH, •Build toward production BCPs: –NORDUnet plans a production bSI capability in CY2012͙ –SURFnet plans a production bSI capability in CY2012͙ –Anticipate others to do likewise as se

rvice models mature –Need to addre
rvice models mature –Need to address *service* design and configuration •Applications: •NEXPRES – EVLBI (testing from OSO to JIVE in CY12Q1) •CO-Universe – HD video •LHCONE – HEP •hthers in works (under the radar) and still looking for others ͙ AutoGOLE Objectives for 2012… NORDUnet Nordic infrastructure for Research & Education 2012 Events •AutoGOLE project uses major conferences to set targets/milestones for introducing new/additional features –Features/capabilities are incrementally rolled out and demonstrated at thes

e events – certain features sets i
e events – certain features sets in Spring, others in Fall. –Spring features will include enhanced topology management, enhanced connectivity/reach,͙ –Call demonstrations will feature early bSI v2͘0 implementations͙ •Internet2 SMM Washington D.C. Apr 2012 •Future Internet Assembly Aalborg,DK May 2012 •TERENA Reykjavik, IS May 2012 ͙Summer, then͗ •NORDUnet Conference (at least *we* think this is a major conference) Oslo Sep 2012 •GLIF 2012 Chicago,US Oct 2012 •Supercomputing 2012 Salt Lake City, US Nov 2012

NORDUnet Nordic infrastructu
NORDUnet Nordic infrastructure for Research & Education Pionier.ets Poznan AutoBAHN StarLight.ets Chicago OpenNSA/Argia GEANT.ets Paris AutoBAHN NorthernLight.ets Copenhagen OpenNSA AIST.ets Tsukuba G-LAMBDA-A bSI betworks (“A”=Aggregator) NSI peerings (SDPs) unless otherwise indicated these are vlans 1780-1783 KRLight.ets Daejeon DynamicKL KDDI-Labs.ets Fujimino G-LAMBDA-K ACE KRLight + GLORIAD JGN-X Pionier GEANT JGNX.ets Tokyo G-LAMBDA-K CzechLight.ets Prague DRAC ESnet.ets Chicago OSC

ARS UvALight.ets University of Ams
ARS UvALight.ets University of Ams. DRAC A A A A A CESNET A B C A A GLORIAD.ets Seattle OpenNSA D WIX.ets Washington OpenNSA NetherLight.ets Amsterdam DRAC US LHCnet NORDUnet + SURFnet CERN.ets Geneva DRAC MANLAN.ets New York NORDUnet Nordic infrastructure for Research & Education •“betwork Service Interface” is a framework for inter-domain provisioning of connection-oriented services. •NSI is being standardized within the Open Grid Forum (OGF) –The NSI Framework document was issued in 2010-Dec.

–The NSI Connection Service Protocol
–The NSI Connection Service Protocol v1.0draft was issued 2011-Aug and is being finalized. –NSI-CS v2 eta 2012-H2 –NSI Topology eta 2012-H2 NORDUnet Nordic infrastructure for Research & Education NSI Framework •The NSI Framework –Technology agnostic (!!) –The bSI architecture describes a generalized notion of a “Connection Service” ͙i͘e͘ these are not VLAbs, or SDH circuits, or LSts, ports, or switches͙ –NSI does not expect or require specific intra-domain transport technologies –It is secure by design, giving each agent full au

thority over their local processes and
thority over their local processes and policies –Allows the connection “Service” to be defined by those users and providers that will be using and supporting it. •The “bSI Cramework”͗ –It specifies an abstract model of a network “Connection” –It specifies an abstract bSI “Topology” model over which Connections are established –It defines a “betwork Service Agent” (bSA) that represents each network service region, and participant in the protocol –It specifies a high level protocol between NSAs to enable inter-domain service management.

NORDUnet Nordic infrastructure for Res
NORDUnet Nordic infrastructure for Research & Education A Basic Overview: NSI protocol C Domain C B Requesting Agent (RA) Network Resource Manager Provider Agent (PA) NRM Network Services Interface NSA Network Services Agent (NSA) NSA bSI “betwork Service” Domain B Domain A A Application NSA NORDUnet Nordic infrastructure for Research & Education The Network Service Agent •A Network Service Agent is associated with every NSI Network domain: –It acts as Provider Agent (PA) when receiving service requests from other NSAs (peer netw

orks or user clients) –It can act a
orks or user clients) –It can act as a Requesting Agent (RA) to farm out portions of the resource management to other NSAs (networks) –It interacts with an internal Network Resource Manager (NRM) to reserve network resources within its own network domain (this interaction is NRM specific.) •bSAs “aggregators” decompose a request into segments that can then be delegated to other domains Curacao Bonaire Aruba A Application NSA Aggregator NSA PA PA RA RA RA PA NORDUnet Nordic infrastructure for Research & Education NSI Connection S

ervice •The NSI Connection Service
ervice •The NSI Connection Service (NSI-CS) is the first protocol defined under the NSI Framework –NSI-CS specifies a set of basic primitives and functional capabilities that create and manage a NSI Connection through its life cycle. •NSI-CS Features: –Supports: Reserve, Provision, Release, Terminate, and Query primitives. –Supports conventional “chain” signaling but also incorporates novel “tree” signaling - providing greater flexibility and control to the Requesting Agent –Allows book-ahead scheduling of connections. –Allows ser

vice providers to define common service
vice providers to define common service specifications to aid in end to end service interoperability NORDUnet Nordic infrastructure for Research & Education How NSI-CS Works… RM RM NSA RM NSA NSA NSA Appl RA PA The user application NORDUnet Nordic infrastructure for Research & Education NSI Request Segmentation PA 1 2 3 4 5 6 1 2 3 4 5 6 uRA PA PA A B C D M B C D A B C D Chain model Tree model A Z A Z A Z 1 2 3 4 5 6 3rd party request 3 4 5 6 1 2 A

B C D 7 8 Chain model Tree m
B C D 7 8 Chain model Tree model Chain model Tree model NORDUnet Nordic infrastructure for Research & Education Bonaire Aruba P0 X0 P1 L1 X1 P0 P2 P1 P2 P0 X0 P1 L1 X1 P1 P2 P0 P2 P4 P5 Bonaire Aruba Abstract NSI Topology Model The NSI model assigns authoritative ownership of all physical components to one network or the other. Conventional physical infrastructure – Networks, switches, ports, and links The physical topology is translated to a derivative “resource graph” consisting of resou

rces, and stitching relations Technolo
rces, and stitching relations Technology agnostic inter-domain Service Termination toints (“STt”s) are defined and mapped logically to internal physical components. External relations are NSI Service Demarcation toints (“SDt”s)͘ Bonaire Aruba Bonaire:B1 Aruba:A0 Aruba:A1 Bonaire:B0 STP Bonaire:B2 STP Aruba:A2 SDP By hiding all internal structure and only exposing inter-domain STPs and their peering SDP relations, we arrive at the basic NSI Topology Model of networks, STPs, and the SDPs that indicate inter-domain adjacency. P1

X1 P0 P2 P0 X0 P1 P2
X1 P0 P2 P0 X0 P1 P2 Bonaire Aruba L1 B1 A0 A1 B0 B2 A2 P5 P4 NORDUnet Nordic infrastructure for Research & Education The NSI Demo at SC2011 The Playground NORDUnet Nordic infrastructure for Research & Education Initial Monitoring & Visualization A 1.Reservation Request 2.Segmentation of Reservation to children 3.Reservation confirmed 4.ConnectionID registered with Query Agent 5.Query Agent walks tree to discover Path and Polls for state (10 sec interval) 6.Path and state info returned to vizualization app

. 7.Viz app renders realtime ima
. 7.Viz app renders realtime image 1 2 3 4 5 6 QA NSA Client RA NSA Aggregator NSA PA VZ NORDUnet Nordic infrastructure for Research & Education Initial monitoring & visualization “Automated Earth” viz (Takatoshi Ikeda, KDDI-Labs) “Status aonitor” viz (Tomohiro Kudoh, AIST) NORDUnet Nordic infrastructure for Research & Education Pointers •Visualization •AIST Java status monitor: http://163.220.30.174:8070/monitor.jnlp •KDDI Labs Google earth plugin: http://kote-ps-1.ps.jgn-x.jp/ps/autoearth-ns

i/ •KDDI Labs Google earth kml:
i/ •KDDI Labs Google earth kml: http://kote-ps-1.ps.jgn-x.jp/ps/autoearth-nsiAutoMAP.kml NORDUnet Nordic infrastructure for Research & Education NSI Development & Road Map •OGF NSI-CS version 1.0 is in final draft now •Demos: –Sep 2011: First NSI CS Interop Plugfest – GLIF 2011 Rio de Janeiro, BR –Oct 2011: First NSI Transport Provisioning Future Internet Assembly 2011 Poznan, PL –Nov 2011: Global NSI + AutoGOLE Demonstration Supercomputing 2011 Seattle, US •NSI Version 2.0 objectives and feature set is being defined in 2012-Q

1, for draft delivery in H2 timeframe͙
1, for draft delivery in H2 timeframe͙ –NSI Topology – dynamic distributed topology exchange. Required to automated the local maintenance of local topology and to enable scalable global pathfinding. –NSI Performance Verification – An architecture for automated service verification and fault localization/remediation –Common Service Definitions – Enabling interoperable transport services NORDUnet Nordic infrastructure for Research & Education Key Endorsements NSI is gaining very broad support. I once made a connection thiis long using NSI CS

v1.0 Rio plugfest participants
v1.0 Rio plugfest participants NORDUnet Nordic infrastructure for Research & Education OGF NSI Working Group •The OGF NSI WG is an Open working group •This means if you have ideas you would like to see incorporated into the NSI framework and/or protocols, please get active in the process: •Contact one of the active WG members and pick their brain •Join the mailing list, lurk and get up to speed, then join the calls͙ •Contribute – ask, comment, propose͙help us sort thru the issues to achieve clarity within the group and consensus within the broad