Validated Maturity Science Review for JPSS Algorithm – Calibration & Validation Overview

Validated MaturityScience Review For {JPSS Algorithm} Presented by {Name} Date: {YYYY/MM/DD} 1 JPSS Calibration/Validation Maturity Review

Outline Algorithm Cal/Val Team Members Product Requirements Evaluation of algorithm performance to specification requirements Evaluation of the effect of required algorithm inputs Quality flag analysis/validation Error Budget Identification of Processing Environment Users & User Feedback Documentations (Science Maturity Check List) Conclusion Path Forward 2 JPSS Calibration/Validation Maturity Review

{JPSS Algorithm} Cal/Val Team (1 slide) Algorithm Cal/Val Team Members Name Organization Major Task 3 JPSS Calibration/Validation Maturity Review

Requirements (1 slide) Product performance requirements from JPSS L1RD supplement (threshold) versus observed/validated Attribute Threshold Observed/validated Geographic coverage Vertical Coverage Vertical Cell Size Horizontal Cell Size Mapping Uncertainty Measurement Range Measurement Accuracy Measurement Precision Measurement Uncertainty 4 JPSS Calibration/Validation Maturity Review

Additional Requirements (1 slide) For IDPS products: Additional requirements from JPSS Ground System Requirements Document (GSRD) Volume 2 - Science Products Specification List of GSRD Vol 2 requirements For ESPC products: Additional requirements from JPSS ESPC Requirements Document (JERD) Volume 2 - Science Requirements List of JERD Vol 2 requirements 5 JPSS Calibration/Validation Maturity Review

JPSS Data Products Maturity Definition JPSS/GOES-R Data Product Validation Maturity Stages COMMON DEFINITIONS (Nominal Mission) 1. Beta o Product is minimally validated, and may still contain significant identified and unidentified errors. o Information/data from validation efforts can be used to make initial qualitative or very limited quantitative assessments regarding product fitness-for-purpose. o Documentation of product performance and identified product performance anomalies, including recommended remediation strategies, exists. 2. Provisional o Product performance has been demonstrated through analysis of a large, but still limited (i.e., not necessarily globally or seasonally representative) number of independent measurements obtained from selected locations, time periods, or field campaign efforts. o Product analyses are sufficient for qualitative, and limited quantitative, determination of product fitness-for-purpose. o Documentation of product performance, testing involving product fixes, identified product performance anomalies, including recommended remediation strategies, exists. o Product is recommended for potential operational use (user decision) and in scientific publications after consulting product status documents. 3. Validated o Product performance has been demonstrated over a large and wide range of representative conditions (i.e., global, seasonal). o Comprehensive documentation of product performance exists that includes all known product anomalies and their recommended remediation strategies for a full range of retrieval conditions and severity level. o Product analyses are sufficient for full qualitative and quantitative determination of product fitness-for-purpose. o Product is ready for operational use based on documented validation findings and user feedback. o Product validation, quality assurance, and algorithm stewardship continue through the lifetime of the instrument. 6 JPSS Calibration/Validation Maturity Review

Evaluation of algorithm performance to specification requirements (3-5 slides) Findings/Issues from Provisional Review Improvements since Provisional Review Algorithm Improvements LUT / PCT updates Cal/Val Activities for evaluating algorithm performance: Test / ground truth data sets Validation strategy / method Validation results 7 JPSS Calibration/Validation Maturity Review

Evaluation of the effect of required algorithm inputs (2-5 slides) Required Algorithm Inputs Primary Sensor Data Ancillary Data Upstream algorithms LUTs / PCTs Evaluation of the effect of required algorithm inputs Study / test cases Results 8 JPSS Calibration/Validation Maturity Review

Quality flag analysis/validation (2-5 slides) Defined Quality Flags Variable Description Value Quality flag analysis/validation Test / example / ground truth data sets Analysis/validation results Analysis/validation plan 9 JPSS Calibration/Validation Maturity Review

Error Budget (1 slide) Compare analysis/validation results against requirements, present as a table. Error budget limitations should be explained. Describe prospects for overcoming error budget limitations with future improvement of the algorithm, test data, and error analysis methodology. Attribute Analyzed L1RD Threshold Analysis/Validati on Result Error Summary Support Artifacts 10 JPSS Calibration/Validation Maturity Review

Identification of Processing Environment (1 slide) IDPS or ESPC (e.g., NDE, Okeanos) build (version) number and effective date Algorithm version Version of LUTs used Version of PCTs used Description of environment used to achieve validated maturity stage 11 JPSS Calibration/Validation Maturity Review

Users & User Feedback (1-2 slide) User list Feedback from users User readiness dates for ingest of data and bringing data to operations Downstream product list Reports from downstream product teams on the dependencies and impacts 12 JPSS Calibration/Validation Maturity Review

Documentations (Check List, 1 slide) Science Maturity Check List Yes ? ReadMe for Data Product Users Algorithm Theoretical Basis Document (ATBD) Algorithm Calibration/Validation Plan (External/Internal) Users Manual System Maintenance Manual (for ESPC products) Peer Reviewed Publications (Demonstrates algorithm is independently reviewed) Regular Validation Reports (at least. annually) (Demonstrates long-term performance of the algorithm) 13 JPSS Calibration/Validation Maturity Review

Conclusion (1 slide) Cal/Val results summary: Team recommends algorithm validated maturity Caveats 14 JPSS Calibration/Validation Maturity Review

Path Forward (1-2 slide) Planned further improvements Planned Cal/Val activities / milestones 15 JPSS Calibration/Validation Maturity Review