26092014 PilotYoda RunJobHPCEvent Finished getJob tested Finished stageIn tested Finished getEventRanges tested Merge with Yodatesting Using downloaded TAG file to started Yodatested send more then 5 event ranges can get some outputs Token Extractor will exit when it ge ID: 792412
Download The PPT/PDF document "Pilot-Yoda Wen Guan, Paul Nilsson" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Pilot-Yoda
Wen Guan, Paul Nilsson
26.09.2014
Slide2Pilot-Yoda
RunJobHPCEvent
Finished
getJob
(tested)
Finished
stageIn
(tested)
Finished
getEventRanges
(tested)
Merge with Yoda(testing)
Using downloaded TAG file to started Yoda(tested, send more then 5 event ranges can get some outputs. Token Extractor will exit when it gets “No more events”)
Need to create TAG file(working)
Need to hold on “No more events”, otherwise
TokenExtractor
will exit.(working)
HPCManager
, it will manage to submit jobs to HPC and poll jobs(prototype)
qsub
to submit jobs
qstat
to poll jobs
Checking the
yoda
dump file to find new outputs and move the dump file to
bak
StageOut
outputs to
objectstore
(prototype, not tested yet)
Slide3Pilot-Yoda
Frontend
submit job poll jobpoll outputs HPCManager
getJob(from Panda) stageIngetEventRangesgetOutputs(from HPCmanager)stageOut RunJobHPCEvent
HPC Cluster
HPCJob
YodaRank 0
Droid
Rank 1
EventServerJobManager
Droid
Rank n
EventServerJobManage
r
Share File system
Input Files, PFC
job.pickle,events.pickle
outputs
outputs
Tested
prototype
prototype
Need to hold “No more event”
Need to add TAG creating
Slide4Pilot-Yoda
Issues on Hopper
Not familiar with
cray
.
Voms
-proxy-
init
or grid-proxy-
init cannot be foundNo permission to access
Vakho’s Athena versionNeeded env to start pilotexport OSG_GRID=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/x86_64/emi/current/?export VO_ATLAS_SW_DIR=/cvmfs/atlas.cern.ch/repo/sw ?