Data Processing Updates and Challenges for EPIC Science Team Meetings
Explore the latest data processing updates and challenges discussed at the EPIC Science Team meetings, covering product availability, data flow, issues, concerns, and reprocessing information for Level 2 data. Stay informed about the progress and future plans of the EPIC project.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
EPIC Level 2 Data Processing Marshall Sutton/Code 586 1 DSCOVR EPIC and NISTAR Science Team Meeting September 15-16, 2018 Goddard Space Flight Center
Level 2 Product Availability As of September 13, 2018 2 Granules Available on ASDC 16,327 16,299 791 16,396 14,185 Processed Granules % CompleteTotal L1B Start Date End Date granules UV AEROSOL TO3 SO2 O3SO2AI CLOUD 6/27/15 6/17/15 12/3/15 6/12/15 8/18/15 9/9/18 9/9/18 7/26/18 9/9/18 9/9/18 16485 16300 99% 100% N/A 100% 98% 17,073 16,541 14,531 Atm. Correction Vegetation 6/13/15 7/11/15 9/6/18 9/6/18 15,170 15170 15,170 15,170 100% 100% Total Available on ASDC 18 terabytes of data! 93,519
Data Flow 3 ASDC SPOCC Level 2 Products (FTP) EPIC L1 Files (FTP) EPIC L1 Files rsync NCCS ROSES Science Teams Level 2 Processing Level 2 Products EPIC L1 Files (secure rsync) (backup) Atmospherically Corrected Enhanced RGB images (FTP) EPIC website
Data Flow (MAIAC & VESDR) 4 NCCS SPOCC MAIAC Processing (Dong Huang) EPI L1 Files rsync MAIAC L2 Files dhuang3 VESDR Processing Cataloguing and Metadata EPIC L1 Files (secure rsync) (backup) msutton1 ASDC
Data Flow (Cloud and Aerosol UV version 2) 5 ASDC SPOCC Level 2 Products (FTP) EPIC L1 Files (FTP) EPIC L1 Files rsync NCCS ROSES Science Teams Level 2 Processing Level 2 Products EPIC L1 Files (secure rsync) (backup) External Data Sources
Issues and Concerns 6 NCCS Awaiting allocation for next year Used 50% of NCCS allocation for the year. Aerosol UV Version 01 Processing is nominal. Version 02 Pipeline complete, waiting for Version 02 to be released. TO3 Nominal O3SO2AI Nominal SO2 - Nominal Cloud Memory problem WRT NCCS lead to a backlog of files.
Issues and Concerns 7 MAIAC Monthly processing for now. Daily processing script should arrive soon. VESDR Dependent on MAIAC processing.
Reprocessing with Version 03 of Level 1 data 8 Will begin once L1 v03 is available Need approval from each team to start. Teams must decide whether to replace Level 2 files processed with version 02 If new version of L2 outputs, team must submit a new product record to the ASDC.
9 Questions???????
