Raju Todd Elsethagen Eric Stephan 1 Pacific Northwest National Laboratory Richland WA Provenance Goals Provenance Overarching Goals Provide thorough results explanation Reuse repeat or reproduce workflows ID: 808166
Download The PPT/PDF document "Provenance Research Bibi" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Provenance Research
Bibi Raju, Todd Elsethagen, Eric Stephan
1
Pacific Northwest National Laboratory, Richland, WA
Slide2Provenance Goals
Provenance Overarching
GoalsProvide thorough results explanationReuse, repeat, or reproduce workflowsEnable performance
optimization
Provenance Work in FY15
Developed a provenance capture ontologyProvenance infrastructure build outScalable provenance capture mechanismDeveloped a Client API that aids in production of provenance
2
Slide3Provenance for Reproducibility and Performance Provenance
Provenance for
ReproducibilityWork towards achieving numerical, experimental
and
execution reproducibility.
Performance ProvenanceAugment/replace existing strategies with the Open Provenance Model-based WorkFlow Performance Provenance (OPM-WFPP):Capture empirical performance information from workflows and systemsLinks provenance information and performance metrics3
Input
Appl
.
Input
Appl.
Output
WFM
WFM
WFM
Output
Storage
Network
Core
Inter
connect
Core
Network
Storage
Protocol
OS
Protocol
Protocol
OS
Access Protocol
Workflow
System Software
Systems
Access Protocol
Slide4Status
Roadmap for FY16
Incorporate time-series
system environment metrics
store (In Progress)
Add provenance capture mechanism that can handle the high-velocity provenance information – scalability (In Progress)Develop different language bindings for ProvEn Client API Design services supporting the harvesting of provenance from native source typesPerformance metrics reporting user interface
4
Slide5ACME – IPPD – Panorama Collaboration
Joint route forward, where the Panorama Pegasus workflow
is used to implement an ACME workflow and capture provenance. ACME workflow with ASCR Integrated
end-to-end Performance Prediction and Diagnosis for Extreme Scientific
Workflows (IPPD)
provenance model adapted for ACMEIPPD developed provenance store instance for ACME. 5
Slide6Thank You!
bibi.raju@pnnl.gov
6