Technicals amp Usability David Champion Computation Institute amp Enrico Fermi Institute University of Chicago ATLAS Connect Overview A combined job submission environment and storage platform ID: 478925
Download Presentation The PPT/PDF document "ATLAS Connect" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
ATLAS ConnectTechnicals & Usability
David Champion
Computation Institute
& Enrico Fermi
Institute
University of ChicagoSlide2
ATLAS Connect OverviewA combined job submission environment and storage platformLow entry overhead
simple signup
easy sponsorship procedure
Ready-to-use toolsGrowth — straightforward connectivity to:existing tier2 and tier3 facilitiesready to integrate with future sitesSlide3
ATLAS Connect AudienceCurrent tier3 sites with limited resources for cluster managementTier3 sites with capacity or throughput needs
can benefit from direct resource sharing with other sites
can connect short-lived cycle pools
leverage other sites’ bandwith through computational localityFuture Tier3 working groups
lower startup cost by leaning upon shared infrastructureSlide4
Architectural Overview
Flocked Tier2s
Flocked Tier3s
Campus Grids
connect.usatlas.org
portal
login
FaxBox
PanDA
Courtesy of
Rob GardnerSlide5
ComponentsWeb gateway: http://
connect.usatlas.org
/
Identity/Access portal (via web site)FAXbox: storage nexusLogin node: ssh://
login.usatlas.orgSlide6
Web GatewayProvides central access gateway
ATLAS Connect facilities
documentation
user & resource managementanalyticsNew user signup → Identity & Access Portal
Hub for future featuresSlide7
Identity and Access Portal
Define identity external to home institutions
a
bility to co-locate user activities at one site, regardless of originno dependency on scoped identity@domain names
(users may change institutions)
i
ntegration with third-party compute and data services (e.g. Globus)Slide8
Identity and Access Portal
Access mechanisms that
are
based on home identityInCommon authentication via CILogonexisting SSH and x.509 identity, depending on context
Role management
Institution
ATLAS working groupsSlide9
FAXbox
Storage nexus integrating multiple access protocols
Federated ATLAS
XRootD (FAX)HTTPFilesystemParrot/ChirpSlide10
Login ServerSSH accessRSA keys provided in advance via user portalo
r password
Web access through JavaScript vt100 emulation
Direct local or xrdcp access to FAXbox dataSlide11
Login ServerJob management:Condor submission frontendBackends
Condor flocking to MWT2, tier3 clusters, other campus grids
Remote submission via BOSCO to Condor or other queuing systems
Job metadata insertion to analytics toolsavailable via web gatewaySlide12
High-Level WorkflowSlide13
Sequence of StepsUser visits ATLAS Connect siteUser signs up (see attached workflow screenshots)
User requests institutional group membership
Approver validates group join request
(possibly involving contact with site principals)User is joined into groupAfter 3-5 minutes, credentials authorizedUser may
ssh
or web connect to
login.usatlas.orgSlide14
User Management ViewsSlide15
Views: Web Gateway
http://
connect.usatlas.org
/Slide16
Views: Profile Management
http://connect.usatlas.org/
▶ Connect ▶ My ProfileSlide17
Views: Key Management
http://connect.usatlas.org/
▶ Connect ▶ My
Profile ▶ Manage IdentitiesSlide18
Views: User’s Groups
http://
connect.usatlas.org
/ ▶ Connect ▶ My Profile ▶ My GroupsSlide19
Views: All ATLAS Groups
http://connect.usatlas.org/group-summary
Slide20
AnalyticsSlide21
AnalyticsCycleServerAdobe Flash-based utilization metrics & graphingAccounting
Summart
(Gratia)
Job breakdown by project, institution, userSlide22
Analytics: CycleServer
http://connect.usatlas.org/
▶
Resources ▶ ATLAS Connect UserSlide23
Analytics: CycleServer
http://connect.usatlas.org/
▶
Resources ▶ ATLAS Connect UserSlide24
Analytics: Accounting Summary
http://connect.usatlas.org/
▶
Resources ▶ Accounting SummarySlide25
Questions?Slide26
Signup Workflow
AppendixSlide27Slide28Slide29Slide30
Signup WorkflowInCommonSlide31Slide32Slide33Slide34
Signup WorkflowInCommonexisting Globus accountSlide35Slide36Slide37
Signup WorkflowInCommonno Globus accountSlide38Slide39Slide40Slide41Slide42Slide43
Signup WorkflowNo InCommonSlide44Slide45Slide46Slide47Slide48
Signup WorkflowJoining ATLAS ConnectSlide49Slide50Slide51Slide52Slide53