
FV3GFS Workflow Elements for Cycled Data Assimilation Systems
Explore the essential workflow elements for a cycled data assimilation system using the FV3GFS model. This comprehensive guide covers key components, contributions from experts, training materials, and repository details for enhancing environmental modeling capabilities.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
FV3GFS Workflow Elements for a Cycled DA System Rahul Mahajan* rahul.mahajan@noaa.gov Environmental Modeling Center National Centers for Environmental Prediction Contributions from: Fanglin Yang, Terry McGuinness, Daryl Kleist, Catherine Thomas, and Russ Treadon NEMS FV3GFS Community Modeling System Training and Tutorial: Planning and Preparation Meeting, 19-20 July, 2017, GFDL 1 1
Global Model Parallel Sequencing GDAS GFS pslot/ config.* pslot.xml pslot.db prep prep Ensemble - - - eobs anal anal next cycle +06h Rocoto manages task dependencies eomgN fcst fcst eupd ecen post post efcsN vrfy vrfy epos arch arch earc
FV3GFS Superstructure SVN Repository https://svnemc.ncep.noaa.gov/projects/fv3gfs trunk - gfs_workflow.v15.0.0 - global_shared.v15.0.0 - gdas.v15.0.0 - gfs.v15.0.0 gfs_workflow.v15.0.0 - bin - exp - exp_fv3gfs - fv3gfs - jobs - scripts - ush - util global_shared.v15.0.0 - docs - exec - fix - modulefiles - parm - scripts - sorc - ush gdas.v15.0.0 - - gfs.v15.0.0 - - 3
https://svnemc.ncep.noaa.gov/projects/fv3gfs/trunk/global_shared.v15.0.0https://svnemc.ncep.noaa.gov/projects/fv3gfs/trunk/global_shared.v15.0.0 ush fv3gfs_driver_chgres.sh fv3gfs_chgres.sh sorc global_chgres.fd fre-nctools.fd fv3nc2nemsio.fd regrid_nemsio.fd calc_increment.fd scripts exglobal_fcst_nemsfv3gfs.sh.ecf fv3gfs_nc2nemsio.sh fv3gfs_regrid_nemsio.sh fv3gfs_remap.sh drive_makeprepbufr.sh parm parm_fv3diag diag_table diag_table_da diag_table_history variable_table.txt variable_table_da.txt fix fix_fv3/ C192 C384 C768 fix_am 4
https://svnemc.ncep.noaa.gov/projects/fv3gfs/trunk/gfs_workflow.v15.0.0https://svnemc.ncep.noaa.gov/projects/fv3gfs/trunk/gfs_workflow.v15.0.0 gfs_workflow.v15.0.0 - bin - exp - exp_fv3gfs - fv3gfs - config - docs - env - jobs - ush - jobs - scripts - ush - util configuration files documentation machine environments task scripts utilities to setup experiment & workflow 5
https://svnemc.ncep.noaa.gov/projects/fv3gfs/trunk/gfs_workflow.v15.0.0/fv3gfshttps://svnemc.ncep.noaa.gov/projects/fv3gfs/trunk/gfs_workflow.v15.0.0/fv3gfs config - config.anal - config.arch - config.base - config.earc - config.ecen - config.efcs - config.eobs - config.epos - config.eupd - config.fcst - config.fv3 - config.post - config.prep - config.prepbufr - config.resources - config.vrfy jobs - - - - - - - - - - - - - env - - anal.sh arch.sh earc.sh ecen.sh efcs.sh eobs.sh eomg.sh epos.sh eupd.sh fcst.sh post.sh prep.sh vrfy.sh THEIA.env WCOSS_C.env ush - - - - - - cube2grb.ksh rocoto.py setup_expt.py setup_workflow.py setup_workflow_fcst.py shellvars.py docs - - - - - compile doxyfile mainpage.h html pdf 6
Get, Set and Go FV3GFS workflow setup and execution instructions The current workflow will be replaced by CROW (unified workflow) in the future (see Samuel Trahan s presentation) 7
configuration para_config is no more! a number of config.$function are used, e.g. config.base master level file with machine specific paths, higher level experiment setup options, options common to more than 1 tasks, etc config.$task task specific configuration file config.fv3 model default options for different resolutions config.resources job card related variables, e.g. walltime, node and task count, memory etc
FV3GFS Input and Output Cold START (New experiment) gfs_ctrl.nc sfc_ctrl.nc gfs_data.tileX.nc sfc_data.tileX.nc Created by CHGRES using operational GFS IC as input Also for ensemble members Written out at 1 hour interval Forecast history fv3_historyd.tileX.nc fv3_history2d.tileX.nc RESTART coupler.res fv_core.res.nc fv_core.res.tileX.nc fv_srf_wnd.res.tileX.nc fv_tracer.res.tileX.nc sfc_data.tileX.nc Written out at next analysis time 9
INPUT/ INPUT/ cycling fv3.x t 00 01 02 03 04 05 06 07 08 09 RESTART/ fv_history.tileX.nc fv_history2d.tileX.nc regrid_nemsio.x sfcf00 sfcf03 sfcf06 sfcf09 atmf00 atmf03 atmf06 atmf09 gsi.x atmanl calc_increment.x atminc
regrid_nemsio.x, calc_increment.x GSI requires a rectangular grid cannot work with native FV3 grid. External utility regrid_nemsio.x regrids native grid history files to Gaussian grid nemsio ( GFS look-alike ) files. GSI thinks background forecast is from GFS and creates an analysis External utility calc_increment.x calculates increment on Gaussian grid and writes out to netCDF file for model FV3 model ingests Gaussian-grid increments, interpolates to native grid and adds to restart fields on the fly
static B matrix in GSI Static background-error covariance matrix not yet developed for FV3. Use GFS version.
Stochastic Physics and Initialization Representing model uncertainty is critical in DA GSI Hybrid EnVar and EnKF rely heavily on stochastic physics to provide representative ensemble spread within the assimilation window. Stochastic physics port from GFS to NEMSFV3 is under review. Mitigation Increase multiplicative (relaxation to prior spread) inflation coefficient from 0.85 to 1.1. IAUdevelopment is under progress to provide initialization
FV3GFS Post-processing For Forecast For Data Assimilation 1. fregrid is used to merge six netCDF 1. DA analysis increments are computed on files on tiles for each group to a file the Gaussian grid, and passed to the on global lat-lon grid at 0.25-deg model. Interpolation of Gaussian grid resolution increments to model native grid is 2. fv3gfs_nc2nemsio.sh is used to handled inside the model. convert the global netCDF file to 2. A different diag_table_da table from nemsio format (e.g. forecast is used to produce diagnostic gfs.t00z.atmf009.nemsio) history files. Then 3. NCEP_POST reads in the nemsio file fv3gfs_regrid_nemsio.sh is used to on lat-lon grid to produce products convert six netCDF tiles to global Gaussian for verification and downstream grid in nemsio format. applications. 3. NCEP_POST reads in nemsio files on Gaussian grid to produce products 14
Capability/ Inability of Workflow? Post-processing: Workflow creates all necessary pressure grib files for downstream products including verification and diagnostics Verification and Diagnostics: Basic verification ability with the workflow Archive: Archiving is enabled only to restart experiments and do a posteriori diagnostics Portability Easily portable to a new machine or cluster
I/O and Post-Processing will change after NEMS FV3GFS Write Component is complete. Interpolation to Gaussian grid will be carried out within the Write Component using ESMF regridding tools. Final history output from the model can be in either nemsio or netCDF format 16
Real-time FV3GFS cycled DA v0.1 C768 deterministic + C384 ensemble, 64 Layer (top at 0.2 hPa) 32-bit dycore, non-hydro, non-mono Initialized with NEMS GFS analyses WCOSS Cray production machine white space NEMS FV3: 64 nodes, 2 threads All other components, as per current operations No stochastic physics, uses multiplicative inflation only No NSST No initialization (DFI or IAU) 17