April 30 th 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse Outline Update DW Overview amp Development Data Request Status Visualization tools Image browser ID: 565459
Download Presentation The PPT/PDF document "3SAQS Technical Workshop" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.
Slide1
3SAQS Technical WorkshopApril 30th, 2015Data WarehouseCurrent and Future Development
Intermountain West Data WarehouseSlide2
OutlineUpdate - DW Overview & Development Data Request StatusVisualization toolsImage browser linkModel-to-obs toolEmissions review toolDynamic Geospatial Model visualization tool
ENVIRON
Source Apportionment
tool ENVIRON site FunctionalityData Request FormPrototype data selection formCategory ManagementInventory ManagementForum & email notificationsWrap-up and action items
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide3
OutlineUpdate - DW Overview & Development Data Request StatusVisualization toolsImage browser linkModel-to-obs tool
Emissions review
tool
Dynamic Geospatial Model visualization toolENVIRON Source Apportionment tool ENVIRON site
Functionality
Data Request Form
Prototype data selection formCategory ManagementInventory ManagementForum & email notificationsWrap-up and action items
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide4
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015IWDW OverviewSlide5
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015IWDW OverviewSlide6
DW Development UpdateProject ManagementQ1 2015Data Requests; Inventory Management; Data DeliveryDocumentationData & Information ManagementQ2 2015 through 2016Visualization tool development (modeling I/O & analysis)Modeling platform reviewExpanded documentation and “easy-to-reference” information
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide7
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide8
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide9
OutlineUpdate - DW Overview & Development Data Request StatusVisualization toolsImage browser linkModel-to-obs tool
Emissions review
tool
Dynamic Geospatial Model visualization toolENVIRON Source Apportionment tool ENVIRON site
Functionality
Data Request Form
Prototype data selection formCategory ManagementInventory ManagementForum & email notificationsWrap-up and action items
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide10
Data Request Summary – pg. 1
Request
Requestor
Data
Supporting Docs
Request
Submitted
3-State Steward
Action
Direct Interest Studies for WSAQS Cooperators
Methane/VOC Control Sensitivity Study
Tammy Thompson CIRA
2008 Emissions
Scope of Work
Yes
Emissions Inventory Data Summary for 2008
Tammy Thompson CIRA
2008 Emissions
None
Yes
Mike Barna
Filled 4/24/2015
Source Apportionment Modeling for Nitrogen in Greater Yellowstone Area (GYA)
Tammy Thompson CIRA
2011 Emissions
(
unreleased
)
Project Plan
Yes
Mike Barna
National Park AQRV
Todd McDonnell
E&S Environmental Chemistry
2011 Emissions
(
unreleased
)
None
Yes
Routes to Sustainability for Natural Gas Development and Water and Air Resources in the Rocky Mountain Region - Sensitivity Analysis
Shannon Capps University of Colorado, Boulder
2008b
Base year
Platform
(partial)
Modeling Protocol and Timeline
Yes
Kevin Briggs
Filled 4/24/2015
Comparison of source contributions to nitrogen deposition at Class 1&2 areas in the Western U.S.
Tammy Thompson CIRA
2008b Emissions and CAMx inputs
None
No
WRAP TSS Emission Tool Updates – 2011a emissions displays
Cassie Archuleta Air Resource Specialists
2011a Emissions (
unreleased
)
None
No
Tom Moore
Inventory--categories and methodology consistent with previous WRAP inventories for regional haze from 2004 and 2008 (reasonable progress)
Daniel Bon CDPHE
2008b Base year
Platform
None
(may be taken care under Archuleta request above)
Yes
Tom Moore
Will fulfill via TSS after update w/2011 emissionsSlide11
Data Request Summary – pg. 2
Request
Requestor
Data
Supporting Docs
Request
Submitted
3-State Steward
Action
NEPA Studies
Hiawatha Regional Energy Development Project (HREDP) Environmental Impact Statement
Ralph Morris ENVIRON
2008b NEPA
Platform
None
No
Charis Tuers
Converse County Development Environmental Impact Statement (EIS)
Chao-Jung Chien AECOM
2008b NEPA
Platform
None
Yes
Ryan McCammon
Fulfilled
3/18/2015
Outside Requests (
applicability to WSAQS Cooperators not clear
)
Colorado Oil and Gas Sensitivity Analyses
James Wilkinson Golder Associates Inc.
2008b NEPA
Platform
None
Yes
Update of a USFS Fire handbook
Suresh Ratnam University of Southern California
Base2020_08a
None
No
Improving Ozone modeling in Uintah Basin
Huy Tran Utah State University
2008b Emissions and utilities
None
Yes incomplete
Analysis of FRAPPÉ and DISCOVER-AQ 2014 campaigns
Gabriele Pfister NCAR
2011a Emissions and utilities
(
unreleased
)
None
YesSlide12
Responding to Data RequestsProcess needs for operating the Data Warehouse noted so far:the identities, roles, and responsibilities of cooperating agency “stewards” need to be clarifiedthe necessary level of documentation and applicability to the overall goals of the cooperators; andthe form of a “release” of a platform and its component data, including the associated use recommendation.Slide13
Pending Project Proposals with no data requestsInformation or Data Request Proposal
Requestor
Start Date
Data
Request
Submitted
Fulfillment ApproachAction
Emissions QA 2011 Base A
Gail Tonnesen EPA Region 8
10/1/2014
None
No
Internal project report completed
Ozone spatial plots for 2011 MPE
Gail Tonnesen EPA Region 8
10/16/2014
None
No
Display capability on DW in development
PEM integration with SMOKE/CMAQ
Private consultant
11/11/2014
None
No
Cancelled
2011a Modeling Sensitivities
Zac Adelman UNC-IE
9/1/2014
None
No
Conducted as internal DW modeling study analysis
PMDETAIL
Ralph Morris ENVIRON
12/1/2014
None
No
Pending, will
utilize
files
from
DW and PMDETAIL project
2020 Future Case Sensitivity
Mike Barna National Park Service, Air Resource Division
1/23/2015
None
No
Pending
Slide14
OutlineUpdate - DW Overview & Development Data Request StatusVisualization toolsImage browser link
Model-to-obs
tool
Emissions review toolDynamic Geospatial Model visualization toolENVIRON Source Apportionment
tool
ENVIRON
site FunctionalityData Request FormPrototype data selection formCategory ManagementInventory Management
Forum
& email notifications
Wrap-up and action items
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide15
Image Browserhttp://views.cira.colostate.edu/tsdw/Tools/ImageBrowser.aspx?pathid=TsdwPlotsRootDisplays large image sets delivered by data providerPossible Next StepsImprove navigation (fewer mouse clicks)Display meta dataBrowse multiple image sets side by sideSlide16
Model-To-Obs Toolhttp://views.cira.colostate.edu/TSDW/modeling/modelobscomparison_iwdw.aspxCompare model values to observed values by networkPossible Next StepsPlatform selectionAdditional filtering capabilitiesSlide17
Emissions Review Toolhttp://views.cira.colostate.edu/tsdw/Emissions/ReviewTool.aspxView modeled emissions by source category, state, county, and SCCPossible Next stepsRefactor data base to correctly label and aggregate parameters and source categoriesExpand SCC visualization capabilitiesSlide18
Dynamic Geospatial Model Visualizationhttp://views.cira.colostate.edu/tsdw_Dev/Maps/ModelDataGIS.aspx
Displays model output data with overlaid monitor dataSlide19
Dynamic Geospatial Model VisualizationArcSDE (Spatial Database Engine) with SQL ServerStores/Serves rasters of model dataStores/Serves raster attributesData can be accessed remotely by ArcGIS usersArcServerProvides web services which render data stored in SDEWeb Services consumed by web applications such as the data warehouseSlide20
Dynamic Geospatial Model VisualizationAdvantagesMap ProjectionUniform color scaleMonitor data overlayEase of combining multiple featuresSharing data with other GIS usersSlide21
Dynamic Geospatial Model VisualizationDisadvantagesMore Pre-processingData duplicationInfrastructure heavy (ArcServer, ArcSDE)Slide22
Dynamic Geospatial Model VisualizationPossible Next stepsParameterize, platform, species, layer, time windowAdditional Monitor dataAdditional featuresCitiesRoadsAutomate preprocessing, execute on demandSlide23
Source Apportionment Toolhttp://ims.environcorp.com/aqms_testDevelopments/StatusReceived prototype from EnvironDatabase up and runningPossible Next stepsDeploy prototype user interface on CIRA systems
Integrate user interface with main warehouse system
Integrate database with main warehouse DB
Automate data ingestionSlide24
OutlineUpdate - DW Overview & Development Data Request StatusVisualization toolsImage browser link
Model-to-obs
tool
Emissions review toolDynamic Geospatial Model visualization toolENVIRON Source Apportionment
tool
ENVIRON
site FunctionalityData Request FormPrototype data selection formCategory ManagementInventory ManagementForum & email notifications
Wrap-up and action items
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015Slide25
Data Request FormAutomated FTP fulfillmentOne click FTP user creation and data accessCreate/Update FTP user accountEnable FTP access to requested data without duplication of dataTwo Successful deliveries via FTPImage Browser uses FTP fulfillment to serve imagesSlide26
Data Request Formhttp://views.cira.colostate.edu/tsdw_dev/DataRequest/PlatformSelection.aspxComponent SelectionFlattened treeMore descriptive informationAlternative to category treeSlide27
Data Request FormPossible Next StepsIntegrate component selection with request formPossibly separate project proposal from data requestContinue to evolve approval and stewardship policies and proceduresIntegrate data release status and/or evaluation levelNotification email clean-upSlide28
Category ManagementCreate/Remove/Edit Data CategoriesFile Items in categoryMeta DataBrowse file systemData Management ReportsMissing dataPossible Next stepsAdditional reporting as needed
Better
display of category/file meta data parameters
File/Category historySlide29
Inventory ManagementMD5 checksums stored in relational databaseHistory of file meta datafile sizemod timechecksumData Recovery toolNext StepsIncorporate detailed meta data scraperAutomation of Checksum computationReporting
Report
changes to data requestors
File level data statusSlide30
Forum & Email Notificationshttp://views.cira.colostate.edu/tsdw/Forum/Slide31
OutlineUpdate - DW Overview & Development Data Request StatusVisualization toolsImage browser link
Model-to-obs
tool
Emissions review toolDynamic Geospatial Model visualization toolENVIRON Source Apportionment
tool
ENVIRON
site FunctionalityData Request FormPrototype data selection formCategory ManagementInventory Management
Forum
& email notifications
Wrap-up and action items
3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015