GOES-R Program Calibration and Validation Robert A. Iacovazzi, Jr - PowerPoint Presentation

GOES-R Program Calibration and Validation Robert A. Iacovazzi, Jr.* (1), Edward C. Grigsby (1), Steve Goodman (2), Changyong Cao (3), Jaime Daniels (3), and Kathleen McIntyre (1) NASA (1), NOAA/NESDIS/GOES-R (2), and NOAA/NESDIS/STAR (3) E-mail-Robert.A.Iacovazzi@nasa.gov Physical Address - NASA GSFC, Code 410.0, 8800 Greenbelt Rd, Greenbelt, MD 20771 PRE-LAUNCH INSTRUMENT CALIBRATION and L1B ALGORITHM DEVELOPMENT Government Validation of Vendor Cal TestingGOES-R Flight Project and Calibration Working Group (CWG)Give feedback regarding vendor cal test plans and readinessAnalyze vendor cal test reports for fidelityUS National Institute of Standards and Technology (NIST)Support design of Système international d'unités (SI) traceable calibrations of ABI and EXISEstablish SI-traceability to primary standards through NIST supported testingIndependently validate mission-critical component performance, e.g., SRFReview vendor cal plans and test setups to ensure they meet NIST best practices Laboratory Instrument Calibration (Cal)Verify instrument cal and product requirements are satisfiedDetermine values of semi-static L1b algorithm input parametersEnsure instrument performance is well understood and documented Radiometric Characterization & CalibrationSpectral Response Function (SRF)Image Navigation & RegistrationSpatial Resolution & ResponseResponse linearity and dynamic rangeSignal-to-Noise, NEDN, and Coherent NoiseRadiometric repeatability to a stable and uniform sceneIrradiance to radiance transfer (VNIR)External/Internal calibration target comparison (TIR)Polarization (VNIR)Optical and electronic cross talkIn-flight electronic calibrationBloomingQuantization step sizeHot, marginal and dead pixelsEnvelopeUniformity over the focal plane detector arrayOut-of-band responseUncertaintyInference of possible SRF shiftsSystem-level and integrated component-level consistency Navigation (including star sensing)Frame-to-frame, within frame, swath-to-swath, and channel-to-channel registrationSystem modulation transfer functionSpatial response uniformity (e.g., response vs. scan angle)Ringing from a sharp edgeNear and far field scatterGhostingPointing knowledge Instrument manufacturers design and perform cal tests, and this table lists cal-related ABI testing carried out by Exelis. L1b Tiger Team Mandate Proactively identify and mitigate risks associated with implementing L1b algorithms L1b Tiger Team Meetings Instr. Vendor L1b Dev Gov’t Instr Manager Gov’t CWG/Flight L1b Validaton L1b Alg and Test Data and RFA Responses Portal RFA & RFA Responses L1b Alg Reviews and RFA Gov’t GS Manager L1b Alg and Test Data and RFA Responses RFA & RFA Responses L1b Alg and Test Data and RFA Responses L1b Alg and Test Data and RFA Responses L1b algorithm implementation process (RFA – Request for Action) Key L1b Algorithm Quality AssuranceEvaluate L1b algorithm completenessIdentify, track, and resolve L1b algorithm issuesAssess Ground Segment vendor L1b algorithm implementationDevelop instrument calibration data and product metadata definitions GS Vendor L1b Implem On-Board Cal Devices Vicarious Targets Space-based Inter-Calibration ABI IR Cal (NEDT[@300K]: 0.1K all but 13.3 mm, 0.3K for 13.3 mm) – BlackbodyVNIR Cal (SNR 300:1 @ 100% Albedo) - Solar DiffuserSelf-Emission - Space ViewElectronics Linearity - Electronic StimulusVNIR Cal - Moon, Stars, Deserts, Test Sites, Deep Convective Clouds (DCCs), Rayliegh Scattering, etc. MTF, B2B Reg - MoonVNIR/IR Cal - GEO and LEO ImagersSpectral Cal – Hyperspectral SoundersGLMNoneResponse Cal - DCCs, Deserts, Sun-glintResponse Cal - GEO and LEO ImagersEXISResponse Linearity - Light SourcesDark Measurements and Flatfields - Off-point MechanismElectronics Linearity - Electronic StimulusResponse Flatfield - SunResponse Cal – GEO Solar SensorsSUVIAliveness - Light SourceDark Measurements and Flatfields - Off-point MechanismOut-of-band Rejection - Glass/Analysis Filters Electronics Linearity - Electronic StimulusResponse Flatfield - SunResponse Cal - EXIS and other GEO Solar Sensors (e.g., SDO/EVE)SEISSElectronics Linearity - Electronic StimulusNoneResponse Cal – GEO Particle SensorsMAGElectronics Linearity - Electronic StimulusNoneResponse Cal - GEO Mag Sensors POST-LAUNCH CALIBRATION/VALIDATION (CAL/VAL) GOES-R observatory on-orbit cal/val assets Calibration – Processes to transform raw GOES-R instrument data into L1b measurements … the fundamental building blocks for all L2+ products. Validation - Provides user confidence that GOES-R data can be used for their intended purpose, e.g., weather forecasting or numerical weather prediction. Example comparison between GOES-R CWG and Vendor cal test analyses: Ratio of CWG to Exelis cal coefficients for ABI reflective channels. Before (left) and after (right) Government-Vendor reconciliation of scan mirror reflectance value used in ABI test data analysis. Post-Launch Testing (PLT) Cal/Val Validate that i nstrument cal and product performance supports a system that meets its intended purpose in its intended environment as outline in the GOES-R Concept of OperationsResolve instrument cal and product performance anomalies to the degree possible as they ariseCreate a “state-of-the-cal” snapshot for long-term instrument/product performance trending GOES-13 Hemispheric Image Tiles Product quality evaluation Ch. 2 Ch. 3 Ch. 5 Ch. 4 O n-board calibration system evaluation Determine and Correct Scan- A ngle Dependent Radiance (e.g., Beaucom et al., Proceedings of SPIE, 1999) Instrument Noise, Blackbody Temp and Cal Slope Monitoring GOES-13 eclipse season stray light before fix (left) and after fix (right) (Courtesy of J. Paul Douglas, OSPO) On-orbit calibration and L1b anomaly resolution GOES-10 Ch. 4A