Experimenter Paul Ruth RENCI UNC Chapel Hill pruthrenciorg ADCIRC Storm Surge Model Finite Element Very high spatial resolution 12M triangles Efficient MPI implementation scales to thousands of cores ID: 412316
Download Presentation The PPT/PDF document "GEC21 Experimenter/Developer Roundtable" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
GEC21 Experimenter/Developer Roundtable(Experimenter)
Paul Ruth
RENCI / UNC Chapel Hill
pruth@renci.orgSlide2
ADCIRC Storm Surge Model
Finite Element
Very high spatial resolution (~1.2M triangles)
Efficient MPI implementation, scales to thousands of cores
Typically use 256-1024 cores for forecasting applicationsUsed for coastal flooding simulationsFEMA flood insurance studiesForecasting systemsResearch applications Slide3
ADCIRC Storm Surge Model on GENI
Slice attributes
38 VMs (152 compute cores)6 GENI racksCustom image replicated across testbedsExoGENI
Groups Storage (1 TB)InstaGENI
Shared VLANsXen VMs (4 core, 4 GB memory, 30 GB storage)Inter-domain GENI StitchingExoGENI Stitching3Slide4
Demo GENI Slice
4
…
…
Condor Scheduler
iSCSI
Storage
…
…
NFS
NFS
NFS
NFS
W
W
W
W
W
W
W
W
OVS
InstaGENI
ExoGENISlide5
Demo GENI Slice
5
…
…
Condor Scheduler
iSCSI
Storage
…
…
NFS
NFS
NFS
NFS
W
W
W
W
W
W
W
W
OVS
Not just one slice!
3 slices
1
Stitcher
call
4 Omni calls
InstaGENI
ExoGENISlide6
Demo GENI Slice
6
InstaGENI
ExoGENISlide7
Slice 1: ADCIRC-CORE
7
…
Condor Scheduler
iSCSI
Storage
…
NFS
NFS
NFS
NFS
W
W
W
W
OVS
1
call to the
stitcher
5
GENI calls by the
stitcher
GENI Calls:
ExoSM
Ion
GPO-IG
ILL-IG
WI-IG
InstaGENI
ExoGENISlide8
Shared VLANs
8
…
Condor Scheduler
iSCSI
Storage
…
NFS
NFS
NFS
NFS
W
W
W
W
OVS
Perform Operational Action:
Create Shared VLANS
InstaGENI
ExoGENISlide9
Slice 2: Wisconsin Group
9
…
…
Condor Scheduler
iSCSI
Storage
…
NFS
NFS
NFS
NFS
W
W
W
W
W
W
OVS
InstaGENI
ExoGENISlide10
Slice 2:
Illinois Group
10
…
…
Condor Scheduler
iSCSI
Storage
…
…
NFS
NFS
NFS
NFS
W
W
W
W
W
W
W
W
OVS
InstaGENI
ExoGENISlide11
Complete Slice(s)
11
…
…
Condor Scheduler
iSCSI
Storage
…
…
NFS
NFS
NFS
NFS
W
W
W
W
W
W
W
W
OVS
InstaGENI
ExoGENISlide12
Experiences
Happy that it works at all!
GENI StitchingFailures can cascadeLimited to one stitch per slice per ExoGENI site.Can restart complicated ExoGEN
sliceInstaGENIS
low booting compute nodesYay! Bigger nodes (4 cores, 30 GB disks)Shared VLANs are awkwardsToolsNone of the tools can visualize all aspects of slices12Slide13
GEC21 Experimenter/Developer Roundtable(Developer)
Victor
OrlikowskiDuke Universityvjo@duke.eduSlide14
ORCA 5Recovery
Should not be seen by users
Restart and redeploy ExoGENI services without effecting running slices.Storage on bare metalHybrid modeDistributed actor registry
14Slide15
Rspec Extension
Storage
~5 TB of sliverable storage on most racksAdd an iSCSI target to a slice
Can now be used with Rspecs
15<node client_id="egS-storage"
component_manager_id="urn:publicid:IDN+exogeni.net:rcivmsite+authority+am" exclusive="false">
<sliver_type name="storage"> <
storage:storage
resource_type
="LUN"
do_format
="true"
fs_param
="-F -b 1024"
fs_type
="ext4"
mnt_point
="/
mnt
/storage" capacity="100"/>
</
sliver_type>
<interface client_id
="egS-storage:if0"/> </node>Slide16
RSpec Extension: Groups
M
ultiple nodes with shared specificationSame: image, instance type, location, networksTemplated postboot scripts customize the nodes
16
<node client_id="eg-node" component_manager_id
="urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am" exclusive="false"> <
sliver_type name="XOMedium"> <
disk_image
name="http://
geni-images.renci.org
/images/standard/centos/centos6.3-v1.0.11.xml" version="776f4874420266834c3e56c8092f5ca48a180eed"/>
</
sliver_type
>
<
nodegroup:nodegroup
count
=“10"
/>
<
/
node
>Slide17
Thanks
17