Heidi Picher Dempsey Internet2 Annual Meeting April 8 2014 wwwgeninet GENI provides a virtual lab for networking and distributed systems research and education GENI started with exploratory rapid prototyping 5 years ago ID: 477165
Download Presentation The PPT/PDF document "Testbeds as a Service: GENI" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Testbeds as a Service: GENI
Heidi Picher Dempsey
Internet2 Annual Meeting
April 8
,
2014
www.geni.net
Slide2
GENI provides a virtual lab for networking and distributed systems research and education
GENI started with exploratory, rapid prototyping 5 years ago
GENI
design assumes federation of autonomously owned and operated systemsYearly prototyping cycle for an idea: develop, integrate and operateExperimenters use the testbed while we are building it outEven prototypes have “activist” users, and must evolve to satisfy those users or fade away. Two of five original design frameworks predominate now.“Horizontal” dataplane slicing as a service (or sometimes just engineered)“Vertical” control plane APIs to negotiate and allocate resources
Funds
in hand
Needs
fundingSlide3
GENI: Infrastructure for Experimentation
GENI provides
compute, network, and wireless
resources that can be connected in
experimenter-specified Layer 2 topologies.Slide4
GENI: Infrastructure for Experimentation
GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.Slide5
Multiple GENI Experiments run Concurrently
Resources can be
shared
between slices
Experiments live in
isolated “slices”Slide6
GENI is “Deeply Programmable”
I install software I want
throughout
my network slice (into routers, switches,
…) or control switches using OpenFlowExperimenters can set up custom topologies, protocols and switching of flowsSlide7
United States GENI Resources
Flexible network / cloud research
infrastructure
Over 1800 users (March, 2014)52 racks installed/in progress10 WiMAX (50 LTE planned)VMs, bare metal nodes, SDN switches (OpenFlow 1.0), software routing or OVS OpenFlow, WiMAX/LTE base stations and clients all available to experimenters.
MetroResearchBackbonesInternetISP
Regional NetworksCampusg
g
gLegendGENI-enabled hardwareLayer 3Control PlaneLayer 2Data PlaneSlide8
International Federation Activities
International Federation API for clearinghouse functions.
Supported for multiple clearinghouses.
Joint GENI/FIRE (US/EU) capability demonstrated this year (not operating yet)GENI dataplane slices extend to other research networks by special arrangement now (Japan, Korea, Australia) Shared monitoring prototype planned for 2014Investigating/prototyping standards for experimenter-driven dataplane resource negotiation and provisioningNSI, OSCARS
GENI StitchingSDN ExchangesSlide9
Campus Requirements for Shared Services
Sites provide
space, power, security (as with other campus IT resources
)Provide at least 1Gbps OpenFlow/SDN path from rack to campus boundary *Provide connection from rack to on-campus resources (varies by campus, usually SDN)*Operate with up-to-date GENI-specified software (e.g. AM API, OpenStack) Provide no-cost access to rack resources for GENI authorized users at other campusesProvide points of contact for GENI response team (see http://groups.geni.net/geni/attachment/wiki/ComprehensiveSecurityPgm/Aggregate Provider Agreement v3.pdf )
** No STP or MAC learningSlide10
Process Requirements for Shared Services
Standard installation
processes
http://groups.geni.net/geni/wiki/GENIRacksHome/RacksChecklistStatus System Acceptance TestingProduction: InstaGENI, ExoGENI
Provisional: Dell (OpenGENI), Cisco Shared site resource and access detailshttp://groups.geni.net/geni/wiki/GeniAggregateSlide11
Process Requirements (cont.)
Site
confirmation tests with logs and RSPECs
http://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks/ConfirmationTestStatushttp://groups.geni.net/geni/wiki/GENIRacksHome/ExogeniRacks/ConfirmationTestStatusEmergency Stop and Legal, Law Enforcement and Regulatory Event Coordination (GMOC at Indiana University)Shared monitoring infrastructure and shared operations (6 major ops groups)Slide12
University of Kentucky Ops Monitoring
Dashboard of CollectorSlide13
Network Engineering Requirements for Shared Services
L2 dataplane engineering
campuses, regional, core and international networksmany vendors and technologies 1-100GBE interfaces (GENI shares with other R&E projects)
Shared or exclusive experimenter VLANs on interfaces depending on experiment (mostly exclusive)SDN (OpenFlow 1.0) switches with experimenter’s and sometimes R&E network’s controllers (many vendors, varying implementation of standards)Standard Internet control plane Internet2 AL2S cross-connects and IONhttp://groups.geni.net/geni/wiki/GENIOESSTopologiesPerformance - IONtoAL2SPerformanceSlide14
Network Engineering (continued)
GENI
dynamic stitching
available at 12 racks via Internet2 IONhttp://groups.geni.net/geni/wiki/GeniNetworkStitchingSitesOver 16,000 stitched slivers since November, 2013OESS GENI Stitching Aggregate coming soonStitching operations monitoring prototyping with MAX, Internet2Slide15
Slice credentials
Software: Clearinghouse
and Aggregates
Clearinghouse:
manages users, projects and slicesStandard credentials shared via custom API or new Common CH APIGENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CHAggregate: provides resources to GENI experimentersTypically owned and managed by an organizationSpeaks the GENI Aggregate Manager API (AM API)http://groups.geni.net/geni/wiki/GAPI_AM_API_V3 most recent versionhttp://trac.gpolab.bbn.com/gcf download reference implementation (gcf), OMNI command line clientExamples: PlanetLab, Emulab, GENI racks on various campusesCreate & Register Slice
ResearcherAggregate Manager API - listResources - createSliver …AggregateManager
Aggregate Resources
usersslicesclearinghouseprojectsToolSlide16
GENI Slivers
Sliver: One
or more resources provided by an
aggregatee.g. Bare machines, virtual machines, VLANs
Backbone #1
Backbone #2
Campus
#3
Campus
#2
Access
#1
Commercial
Clouds
Corporate
GENI suites
Other-Nation
Projects
Research
Testbed
Campus
My GENI Slice
My slice contains
slivers from many
aggregates
.Slide17
Software: RSpecs
RSpecs
: Lingua franca for describing and requesting resources
“Machine language” for negotiating resources between experiment and aggregateExperimenter tools eliminate the need for most experimenters to write or read Rspec
<?xml version="1.0" encoding="UTF-8"?><rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node></rspec>RSpec for requesting a single nodeSlide18
Reserving Resources using
RSpecs
and the AM API Experimenter tools and aggregates talk to each other using resource specifications (RSpecs) and the GENI Aggregate Manager API (GENI AM API)Advertisement RSpec: What does an aggregate have?
Request RSpec: What does the experimenter want?Manifest RSpec: What does the experimenter have?AggregateManagerExperimenterToolListResources(…)Advertisement RSpecCreateSliver(Request RSpec, …)Manifest RSpec
ListResources(SliceName, …)Manifest RSpecWhat do you have?I have …I would like …You have …What do I have?You have …Slide19
GENI Design Activities
Open to all
http://groups.geni.net/geni/wiki/GeniDesign
Mailing lists http://lists.geni.net/mailman/listinfogeni-annouce@geni.net most generalRegular calls and design reviews announced through interest group mailing listsIRC/chat (mostly operations)http://groups.geni.net/geni/wiki/HowTo/ConnectToGENIChatRoomGENI Engineering Conferences (3 per year)June 21-24, 2014 University of California, Davis (Travel grants available)