Two Demos four booths mdtmFTP 100GE Networks demo DOE booth StarLight booth Realtime scientific data streaming using ADIOS mdtmFTP demo DOE booth SG ACRC booth StarLight booth Internet2 booth ID: 654848
Download Presentation The PPT/PDF document "MDTM@SC16 MDTM@SC16 - Overview" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
MDTM@SC16Slide2
MDTM@SC16 - Overview
Two Demos @ four booths
“mdtmFTP @ 100GE Networks”
demo
@DOE booth, @StarLight booth
“Real-time scientific data streaming using
ADIOS+mdtmFTP
”
demo
@DOE booth, @SG ACRC booth, @StarLight booth, @Internet2 booth
One Paper
“mdtmFTP and its Evaluation @ ESNET SDN
Testbed”
DOE program managers are well aware of our SC’16 activitiesSlide3
MDTM@SC16 - Teams
FNAL Team
Wenji Wu, Liang Zhang, Phil
DeMar
Collaborators
ONRL(US): Scott
Klasky
, Jason Wang, Jong
Youl
Choi
ACRC (SG): Gabriel
Noaje
, Jonathan Low, Lim Seng
ESNET(US): Brian Tierney, Eric
Pouyoul
StarLight: Joe
Membretti
, Jim-
hao
Chen
Internet2: Susan
EvettSlide4
MDTM@SC16 - Demo 1
“mdtmFTP @ 100GE Networks” demo@SC16
Demo mdtmFTP high-performance data transfer capability
Demo booths: DOE, StarLight
Demo team: FNAL, ESnet, StarLight, iCAIR, NERSCSlide5
MDTM@SC16 - Demo 1
“mdtmFTP @ 100GE Networks” demo@SC16
mdtmFTP achieved ~85Gbs disk-to-disk 👍Slide6
MDTM@SC16 – Demo 2
“Real-time scientific data streaming using
ADIOS+mdtmFTP
” demo@SC16
Demo mdtmFTP data streaming capability
Demo booths: DOE, StarLight, Singapore NSCC, Internet2
Demo team: FNAL, ORNL, Singapore ACRC, ESnetSlide7
MDTM@SC16 – Demo 2
We demonstrate remote data processing capability of large and high-throughput science experiment through cross-Pacific wide area networks and show how we can manage science workflow executions remotely by using ORNL ADIOS data management system and FNAL mdtmFTP data transfer system.
In this demo, we show a fusion data processing workflow, called Gas Puff Imaging (GPI) analysis, to detect and trace blob movements during fusion experiment. We send GPI data streams from Singapore to Fermilab for near-real time analysis. ADIOS manages analysis workflows and mdtmFTP transports stream data
.Slide8
MDTM@SC16 – Demo 2
http
://mdtm.fnal.gov/downloads/sc16/MDTM_demo.mp4
Demo Movie:Slide9
MDTM@SC16 - Paper
A mdtmFTP paper titled “mdtmFTP and its evaluation at ESnet SDN testbed” was presented at SC16 Innovative Networks for Data Intensive Science (INDIS) workshop
http://
mdtm.fnal.gov/Documents&Publications.html
NSF program manger (Kevin Thompson,
kthompso@nsf.gov)
liked our work and wanted to apply the MDTM concepts to his research projects.
A researcher from KLM sent an email: “I
am looking forward to test mdtmFTP in scenario's such as a distributed HDFS and replicating data between multiple datacenters for Disaster Recovery
.”
a NASA network engineer also wanted to test and evaluate mdtmFTP