Information data servers and data products for the Pacific regional association J Potemra briefing to Z Willis UH Manoa July 2009 PacIOOS Development PacIOOS focus is development ID: 811275
Download The PPT/PDF document "Data Services for PacIOOS" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
Data Services for PacIOOS
Information, data servers and data productsfor the Pacific regional association
J.
Potemra
briefing to Z. Willis, UH
Manoa
, July 2009
Slide2PacIOOS Development
PacIOOS focus is development of Regional Association for the region
HIOOS
focus is as a pilot project for
PacIOOS
Designed around component systems
Data management is one component, but a cross-cutting one
Data management needs, capacity and requirements are very different between Hawaii and larger Pacific region
Slide3Catalyst Project 4:
MarineEcosystems
Catalyst Project 2:
Coastal
Resiliency
Catalyst Project 3:
Water
Quality
Catalyst Project 1:Ocean stateforecast
Sensor 1
Sensor 2
Sensor n
Observing SystemComponent 1
Product m
Product 3
Product 2
Product 1
User group 1
research
User group 2
education
User group 3
planning
User group 4operational
User group 5general
Modeling System
Sensor 1
Sensor 2
Sensor n
Observing SystemComponent n
Sensor 1
Sensor 2
Sensor n
Observing System
Component 2
Observing Array
Products
Projects
User Groups
Slide4Catalyst Project 4:
MarineEcosystems
Catalyst Project 2:
Coastal
Resiliency
Catalyst Project 3:
Water
Quality
Catalyst Project 1:Ocean stateforecast
Sensor 1
Sensor 2
Sensor n
Observing System
Component 1
Product m
Product 3
Product 2
Product 1
Modeling System
Sensor 1
Sensor 2
Sensor n
Observing System
Component n
Sensor 1
Sensor 2
Sensor n
Observing System
Component 2
Observing Array
Products
Projects
Role of “PI’s” is to:
design and develop this system;
provide a scientifically q/c’d data stream to the Data Management System
Slide5Product m
Product 3
Product 2
Product 1
User group 1
research
User group 2
education
User group 3
planning
User group 4
operational
User group 5general
Products
User Groups
Role of Education/Outreach (and really everyone):
Identify users
Identify useful products
Identify preferred form and format of product delivery
Slide6Catalyst Project 4:
MarineEcosystems
Catalyst Project 2:
Coastal
Resiliency
Catalyst Project 3:
Water
Quality
Catalyst Project 1:Ocean stateforecast
Sensor 1
Sensor 2
Sensor n
Observing SystemComponent 1
Product m
Product 3
Product 2
Product 1
User group 1
research
User group 2
education
User group 3
planning
User group 4operational
User group 5general
Modeling System
Sensor 1
Sensor 2
Sensor n
Observing SystemComponent n
Sensor 1
Sensor 2
Sensor n
Observing System
Component 2
Observing Array
Products
Projects
User Groups
Role of Data Management:
Archive data
Provide networking infrastructure for product delivery
links between boxes
Slide7Role of data management
PacIOOS (HIOOS) is being developed
as an
end-to-end
system
--> data issues are
multi-facetedInstrument to shoreDisk storage to scientistData servers
allowing web access to usersData servers to client softwareData to data productsUser-driven data products will be critical in the region
Slide8Instrument to shore
Cell phone modem, IRIDIUM, direct connectDisk to scientist
ftp, copy,
OPeNDAP
Web access to users
LAS,
Dchart, ERDDAP
Binary access (data server to client s/w)OPeNDAP, SOSData to data product…..
Slide9Data Management Tenets
Meta dataData archiveData discoveryData browseData transport (data delivery); binary access
Slide10PacIOOS vs
HIOOSBoth limited by data of appropriate scalesPacific region more climate-related, long-term, planning/management issues
Hawaii wants real-time and forecast, high spatial resolution data; rapid access
There are data sets in the Pacific region, but not cataloged, easily accessible
Metadata
Data discovery
Data archiveHawaii, on the other handData delivery
Slide11Issues
Data by itself is not a product; a product in the IOOS context fuses data and knowledge
Goal is operational system; role of research can thus be in product development (among other things,
e.g
., system design and development)
Identify users
Identify desired productsIdentify desired formats (delivery method)
Data Management system will provide the solution
Slide12Challenges
Drastically different data streams; servers could depend on data types (biological data, video, etc.)
Starting close to zero
Customers, delivery mechanisms largely unknown
Many data sources
Creativity in producing data products
Provide model-data interfaceOperational 24/7
?Resources in terms of appropriate technical skills
Slide13Plan
Web services for informationTraditional web pagesData product dissemination
Providing access to data via data servers
Data archiving
Raw storage of data
Data servers (IOOS “standards”)
Web-based browsing toolsOPeNDAPWCS for gridded dataSOS for point/non-gridded data
Slide14Data & Products
HIOOS Assets, observations, models, data servers, maps
Slide15Featured Products
Slide16HiOOS Data Streams
Component
Location/inst
Variables
Data streams
Near-shore sensors
NS-01 (WYC)
T, s, chl, turbKilo
NaluPDNS-02 (HYC)T, s, chl
, turbKilo NaluP
DNS-03 (Waikiki)T, s, chl
, turbPKilo
Nalu10m siteT, sKilo Nalu
d10m T-chain
TKilo Nalu
d10m ADCP
currentsKilo Nalu (3 mon)
d10m FLNT
water qualKilo Nalu (4/09)
Pd20m T-chain
TKilo Nalud
20m ADCPcurrentsKilo Nalu
PdWave buoy?
wavesKilo NaluPWater Quality
WQB-AWT, s, chl, turbIntSen
PWQB-KN
T, s, chl, turbIntSenP
Event Response
Slide17HiOOS Data Streams (cont’d)
Component
Location/inst
Variables
Data streams
Ocean Gliders
SG-114
(2 mission)T,s,currentsSOEST
DSG-139 (4 mission)T,s,currentsSOEST
DHF RadiosBarber’s Pointcurrents
Kaka’ako
currentsKoko Head
currentsCoastal resiliencyWaikiki
topo
Waimeatopo
Makapu’u
topo
Kaka’akotopo
Acoustic tracking
Acoustic monitoring
A
Slide18HiOOS Data Streams (cont’d)
Component
Location/inst
Variables
Data streams
Waves/water
level
WB-106 (Waimea)waves
CDIPPWB-098 (Mokapu)waves
CDIPP
WB-146 (Lanai)wavesCDIPP
Tide gauge (8)Sea levelUHSLC
PDCamera (Waimea
)UHSLCP
Camera (Waikiki)
UHSLCP
Models (atm)Pacific
wind, rain, THIOOSD
Hawaiian Islandswind, rain, THIOOS
PDModels (wave)Pacific
wavesOREP
Hawaiian IslandswavesOREP
South ShorewavesOREP
Slide19HiOOS Data Streams (cont’d)
Component
Location/inst
Variables
Data streams
Models (
ocn
)Pacific (NRL)T, s, curr, clevAPDRC
PDHawaii Isle (ROMS)T, s,
curr, clevHIOOSP
DTidescurr, clev
APDRCPD
Slide20Data Products (example 1)
Slide21Slide22Data Products (example 2)
Slide23Data Servers
OPeNDAPGDSTDS
Visual browse
LAS
DCHART
(google map)OGCWMS
WCS
Slide24