Note
Go to the end to download the full example code
Ensemble-Stat: WoFS
model_application/precipitation/EnsembleStat_fcstWOFS_obsWOFS.conf
Scientific Objective
Comparing the Warn on Forecast System (WoFS) ensemble to the MRMS observed variable field to understand its forecasting abilities. Specifically focusing on accumulated precipitation at different neighborhood distances and accumulation thresholds to provide meaningful analysis output that can provide direction to future WoFS improvement.
Datasets
Forecast dataset: WoFS Ensemble
METplus Components
This use case runs PCP-Combine on each ensemble member, then runs Ensemble-Stat on the output. Finally, it runs Grid-Stat on the output from Ensemble-Stat
METplus Workflow
The following tools are used for each run time: PCPCombine, EnsembleStat, GridStat
This example loops by initialization time. For each initialization time it will process the 1 hour forecast lead
Run times:
Init: 2020-06-15_17Z
Forecast lead: 1 hour
METplus Configuration
METplus first loads all of the configuration files found in parm/metplus_config, then it loads any configuration files passed to METplus via the command line with the -c option, i.e. -c parm/use_cases/model_applications/precipitation/EnsembleStat_fcstWOFS_obsWOFS.conf
[config]
# Documentation for this use case can be found at
# https://metplus.readthedocs.io/en/latest/generated/model_applications/precipitation/EnsembleStat_fcstWOFS_obsWOFS.html
# For additional information, please see the METplus Users Guide.
# https://metplus.readthedocs.io/en/latest/Users_Guide
###
# Processes to run
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#process-list
###
PROCESS_LIST = PcpCombine, EnsembleStat, GenEnsProd, GridStat
###
# Time Info
# LOOP_BY options are INIT, VALID, RETRO, and REALTIME
# If set to INIT or RETRO:
# INIT_TIME_FMT, INIT_BEG, INIT_END, and INIT_INCREMENT must also be set
# If set to VALID or REALTIME:
# VALID_TIME_FMT, VALID_BEG, VALID_END, and VALID_INCREMENT must also be set
# LEAD_SEQ is the list of forecast leads to process
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#timing-control
###
LOOP_BY = INIT
INIT_TIME_FMT = %Y%m%d%H%M
INIT_BEG = 202006151700
INIT_END = 202006151700
INIT_INCREMENT = 3600
LEAD_SEQ = 1
###
# File I/O
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#directory-and-filename-template-info
###
# PCPCombine
FCST_PCP_COMBINE_INPUT_DIR = {INPUT_BASE}/model_applications/precipitation/WOFS/ensemble
FCST_PCP_COMBINE_INPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}
FCST_PCP_COMBINE_OUTPUT_DIR = {OUTPUT_BASE}/{MODEL}/pcp_combine
FCST_PCP_COMBINE_OUTPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/ENS_MEM_{custom?fmt=%s}/wofs{custom?fmt=%s}_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
# GenEnsProd
GEN_ENS_PROD_INPUT_DIR = {FCST_PCP_COMBINE_OUTPUT_DIR}
GEN_ENS_PROD_INPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/ENS_MEM_??/wofs??_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
GEN_ENS_PROD_OUTPUT_DIR = {OUTPUT_BASE}/{MODEL}/ensemble_stat
GEN_ENS_PROD_OUTPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/gen_ens_prod_{MODEL}_PCP_{init?fmt=%H%M}_{lead?fmt=%H%M}00L_A1_{init?fmt=%Y%m%d}_{valid?fmt=%H%M}00V_ens.nc
# EnsembleStat
FCST_ENSEMBLE_STAT_INPUT_DIR = {FCST_PCP_COMBINE_OUTPUT_DIR}
FCST_ENSEMBLE_STAT_INPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/ENS_MEM_??/wofs??_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
OBS_ENSEMBLE_STAT_GRID_INPUT_DIR = {INPUT_BASE}/model_applications/precipitation/WOFS/OBS
OBS_ENSEMBLE_STAT_GRID_INPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/mrms_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
ENSEMBLE_STAT_OUTPUT_DIR = {OUTPUT_BASE}/{MODEL}/ensemble_stat
ENSEMBLE_STAT_OUTPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}
# GridStat
FCST_GRID_STAT_INPUT_DIR = {GEN_ENS_PROD_OUTPUT_DIR}
FCST_GRID_STAT_INPUT_TEMPLATE = {GEN_ENS_PROD_OUTPUT_TEMPLATE}
OBS_GRID_STAT_INPUT_DIR = {OBS_ENSEMBLE_STAT_GRID_INPUT_DIR}
OBS_GRID_STAT_INPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/mrms_PCP_{init?fmt=%Y%m%d}_{init?fmt=%H%M}_{valid?fmt=%H%M}_A1.nc
GRID_STAT_VERIFICATION_MASK_TEMPLATE = {INPUT_BASE}/model_applications/precipitation/WOFS/domain/WOFS_domain_{init?fmt=%Y%m%d}.nc
GRID_STAT_OUTPUT_DIR = {OUTPUT_BASE}/{MODEL}/grid_stat
GRID_STAT_OUTPUT_TEMPLATE = {init?fmt=%Y%m%d?shift=-44100}/{init?fmt=%H%M}/
###
# Field Info
# https://metplus.readthedocs.io/en/latest/Users_Guide/systemconfiguration.html#field-info
###
MODEL= WOFS
OBTYPE = MRMS_QPE
# GenEnsProd
ENS_VAR1_NAME = APCP_01
ENS_VAR1_LEVELS = "(*,*)"
ENS_VAR1_THRESH = >=12.7, >=25.4, >=50.8
# EnsembleStat
FCST_ENSEMBLE_STAT_VAR1_NAME = APCP_01
FCST_ENSEMBLE_STAT_VAR1_LEVELS = "(*,*)"
FCST_ENSEMBLE_STAT_VAR1_THRESH = >=12.7, >=25.4, >=50.8
OBS_ENSEMBLE_STAT_VAR1_NAME = GaugeCorrQPE01H_01
OBS_ENSEMBLE_STAT_VAR1_LEVELS = "(*,*)"
OBS_ENSEMBLE_STAT_VAR1_THRESH = {FCST_ENSEMBLE_STAT_VAR1_THRESH}
# GridStat
FCST_GRID_STAT_VAR1_NAME = APCP_01_A1_ENS_NMEP_ge12.7_NBRHD1_NEAREST1
FCST_GRID_STAT_VAR1_LEVELS = "(*,*)"
FCST_GRID_STAT_VAR1_OPTIONS = prob = TRUE
FCST_GRID_STAT_VAR1_THRESH = >=0.0, >=0.05, >=0.15, >=0.25, >=0.35, >=0.45, >=0.55, >=0.65, >=0.75, >=0.85, >=0.95, >=1.0
#
FCST_GRID_STAT_VAR2_NAME = APCP_01_A1_ENS_NMEP_ge25.4_NBRHD1_NEAREST1
FCST_GRID_STAT_VAR2_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR2_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR2_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR3_NAME = APCP_01_A1_ENS_NMEP_ge50.8_NBRHD1_NEAREST1
FCST_GRID_STAT_VAR3_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR3_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR3_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR4_NAME = APCP_01_A1_ENS_NMEP_ge12.7_NBRHD25_NEAREST1
FCST_GRID_STAT_VAR4_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR4_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR4_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR5_NAME = APCP_01_A1_ENS_NMEP_ge25.4_NBRHD25_NEAREST1
FCST_GRID_STAT_VAR5_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR5_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR5_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR6_NAME = APCP_01_A1_ENS_NMEP_ge50.8_NBRHD25_NEAREST1
FCST_GRID_STAT_VAR6_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR6_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR6_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR7_NAME = APCP_01_A1_ENS_NMEP_ge12.7_NBRHD81_NEAREST1
FCST_GRID_STAT_VAR7_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR7_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR7_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR8_NAME = APCP_01_A1_ENS_NMEP_ge25.4_NBRHD81_NEAREST1
FCST_GRID_STAT_VAR8_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR8_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR8_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR9_NAME = APCP_01_A1_ENS_NMEP_ge50.8_NBRHD81_NEAREST1
FCST_GRID_STAT_VAR9_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR9_OPTIONS = {FCST_GRID_STAT_VAR1_OPTIONS}
FCST_GRID_STAT_VAR9_THRESH = {FCST_GRID_STAT_VAR1_THRESH}
FCST_GRID_STAT_VAR10_NAME = APCP_01_A1_ENS_NMEP_ge12.7_NBRHD1_NEAREST1
FCST_GRID_STAT_VAR10_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR10_OPTIONS = prob = FALSE
FCST_GRID_STAT_VAR10_THRESH = >=0.5
FCST_GRID_STAT_VAR11_NAME = APCP_01_A1_ENS_NMEP_ge25.4_NBRHD1_NEAREST1
FCST_GRID_STAT_VAR11_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR11_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR11_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
FCST_GRID_STAT_VAR12_NAME = APCP_01_A1_ENS_NMEP_ge50.8_NBRHD1_NEAREST1
FCST_GRID_STAT_VAR12_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR12_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR12_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
FCST_GRID_STAT_VAR13_NAME = APCP_01_A1_ENS_NMEP_ge12.7_NBRHD25_NEAREST1
FCST_GRID_STAT_VAR13_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR13_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR13_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
FCST_GRID_STAT_VAR14_NAME = APCP_01_A1_ENS_NMEP_ge25.4_NBRHD25_NEAREST1
FCST_GRID_STAT_VAR14_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR14_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR14_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
FCST_GRID_STAT_VAR15_NAME = APCP_01_A1_ENS_NMEP_ge50.8_NBRHD25_NEAREST1
FCST_GRID_STAT_VAR15_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR15_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR15_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
FCST_GRID_STAT_VAR16_NAME = APCP_01_A1_ENS_NMEP_ge12.7_NBRHD81_NEAREST1
FCST_GRID_STAT_VAR16_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR16_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR16_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
FCST_GRID_STAT_VAR17_NAME = APCP_01_A1_ENS_NMEP_ge25.4_NBRHD81_NEAREST1
FCST_GRID_STAT_VAR17_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR17_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR17_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
FCST_GRID_STAT_VAR18_NAME = APCP_01_A1_ENS_NMEP_ge50.8_NBRHD81_NEAREST1
FCST_GRID_STAT_VAR18_LEVELS = {FCST_GRID_STAT_VAR1_LEVELS}
FCST_GRID_STAT_VAR18_OPTIONS = {FCST_GRID_STAT_VAR10_OPTIONS}
FCST_GRID_STAT_VAR18_THRESH = {FCST_GRID_STAT_VAR10_THRESH}
OBS_GRID_STAT_VAR1_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR1_LEVELS = "(*,*)"
OBS_GRID_STAT_VAR1_THRESH = >=12.7
OBS_GRID_STAT_VAR2_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR2_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR2_THRESH = >=25.4
OBS_GRID_STAT_VAR3_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR3_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR3_THRESH = >=50.8
OBS_GRID_STAT_VAR4_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR4_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR4_THRESH = >=12.7
OBS_GRID_STAT_VAR5_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR5_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR5_THRESH = >=25.4
OBS_GRID_STAT_VAR6_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR6_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR6_THRESH = >=50.8
OBS_GRID_STAT_VAR7_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR7_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR7_THRESH = >=12.7
OBS_GRID_STAT_VAR8_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR8_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR8_THRESH = >=25.4
OBS_GRID_STAT_VAR9_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR9_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR9_THRESH = >=50.8
OBS_GRID_STAT_VAR10_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR10_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR10_THRESH = >=12.7
OBS_GRID_STAT_VAR11_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR11_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR11_THRESH = >=25.4
OBS_GRID_STAT_VAR12_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR12_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR12_THRESH = >=50.8
OBS_GRID_STAT_VAR13_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR13_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR13_THRESH = >=12.7
OBS_GRID_STAT_VAR14_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR14_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR14_THRESH = >=25.4
OBS_GRID_STAT_VAR15_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR15_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR15_THRESH = >=50.8
OBS_GRID_STAT_VAR16_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR16_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR16_THRESH = >=12.7
OBS_GRID_STAT_VAR17_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR17_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR17_THRESH = >=25.4
OBS_GRID_STAT_VAR18_NAME = GaugeCorrQPE01H_01
OBS_GRID_STAT_VAR18_LEVELS = {OBS_GRID_STAT_VAR1_LEVELS}
OBS_GRID_STAT_VAR18_THRESH = >=50.8
###
# PcpCombine Settings
# https://metplus.readthedocs.io/en/latest/Users_Guide/wrappers.html#pcpcombine
###
FCST_PCP_COMBINE_RUN = TRUE
FCST_PCP_COMBINE_INPUT_DATATYPE = GRIB
FCST_PCP_COMBINE_METHOD = USER_DEFINED
FCST_PCP_COMBINE_BUCKET_INTERVAL = 1
FCST_PCP_COMBINE_INPUT_DATATYPE = GRIB
FCST_PCP_COMBINE_FIELD_NAME = APCP
FCST_PCP_COMBINE_INPUT_ACCUMS = 1
PCP_COMBINE_SKIP_IF_OUTPUT_EXISTS = TRUE
PCP_COMBINE_CUSTOM_LOOP_LIST = 01, 02, 03, 04, 05, 06, 07, 08, 09, 10, 11, 12, 13, 14, 15, 16, 17, 18
FCST_PCP_COMBINE_COMMAND = -sum 00000000_000000 1 {valid?fmt=%Y%m%d}_{valid?fmt=%H%M}00 1 -pcpdir {FCST_PCP_COMBINE_INPUT_DIR}/{FCST_PCP_COMBINE_INPUT_TEMPLATE} -pcprx wofs -field 'name="APCP";level="A1";'
###
# GenEnsProd Settings
# https://metplus.readthedocs.io/en/latest/Users_Guide/wrappers.html#genensprod
###
GEN_ENS_PROD_N_MEMBERS = 18
GEN_ENS_PROD_ENS_THRESH = 1.0
GEN_ENS_PROD_REGRID_TO_GRID = FCST
GEN_ENS_PROD_REGRID_METHOD = BUDGET
GEN_ENS_PROD_REGRID_WIDTH = 2
GEN_ENS_PROD_REGRID_VLD_THRESH = 1.0
GEN_ENS_PROD_NBRHD_PROB_WIDTH = 1, 3, 5, 7, 9
GEN_ENS_PROD_NBRHD_PROB_SHAPE = SQUARE
GEN_ENS_PROD_NBRHD_PROB_VLD_THRESH = 1.0
GEN_ENS_PROD_NMEP_SMOOTH_VLD_THRESH = 1.0
GEN_ENS_PROD_NMEP_SMOOTH_SHAPE = SQUARE
GEN_ENS_PROD_NMEP_SMOOTH_METHOD = NEAREST
GEN_ENS_PROD_NMEP_SMOOTH_WIDTH = 1
GEN_ENS_PROD_ENSEMBLE_FLAG_LATLON = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_MEAN = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_STDEV = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_MINUS = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_PLUS = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_MIN = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_MAX = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_RANGE = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_VLD_COUNT = TRUE
GEN_ENS_PROD_ENSEMBLE_FLAG_FREQUENCY = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_NEP = FALSE
GEN_ENS_PROD_ENSEMBLE_FLAG_NMEP = TRUE
###
# EnsembleStat Settings
# https://metplus.readthedocs.io/en/latest/Users_Guide/wrappers.html#ensemblestat
###
ENSEMBLE_STAT_N_MEMBERS = 18
ENSEMBLE_STAT_ENS_THRESH = 1.0
ENSEMBLE_STAT_REGRID_TO_GRID = FCST
ENSEMBLE_STAT_REGRID_METHOD = BUDGET
ENSEMBLE_STAT_REGRID_WIDTH = 2
ENSEMBLE_STAT_REGRID_VLD_THRESH = 1.0
FCST_ENSEMBLE_STAT_INPUT_GRID_DATATYPE = NETCDF
OBS_ENSEMBLE_STAT_INPUT_GRID_DATATYPE = NETCDF
ENSEMBLE_STAT_MESSAGE_TYPE =
ENSEMBLE_STAT_OUTPUT_FLAG_ECNT = STAT
ENSEMBLE_STAT_OUTPUT_FLAG_RPS = NONE
ENSEMBLE_STAT_OUTPUT_FLAG_RHIST = STAT
ENSEMBLE_STAT_OUTPUT_FLAG_PHIST = STAT
ENSEMBLE_STAT_OUTPUT_FLAG_ORANK = STAT
ENSEMBLE_STAT_OUTPUT_FLAG_SSVAR = STAT
ENSEMBLE_STAT_OUTPUT_FLAG_RELP = STAT
ENSEMBLE_STAT_NC_ORANK_FLAG_LATLON = TRUE
ENSEMBLE_STAT_NC_ORANK_FLAG_MEAN = TRUE
ENSEMBLE_STAT_NC_ORANK_FLAG_RAW = TRUE
ENSEMBLE_STAT_NC_ORANK_FLAG_RANK = TRUE
ENSEMBLE_STAT_NC_ORANK_FLAG_PIT = TRUE
ENSEMBLE_STAT_NC_ORANK_FLAG_VLD_COUNT = TRUE
ENSEMBLE_STAT_NC_ORANK_FLAG_WEIGHT = FALSE
ENSEMBLE_STAT_OUTPUT_PREFIX = {MODEL}_PCP_{init?fmt=%H%M}_{lead?fmt=%H%M}00L_A1
###
# GridStat Settings
# https://metplus.readthedocs.io/en/latest/Users_Guide/wrappers.html#gridstat
###
GRID_STAT_REGRID_TO_GRID = FCST
FCST_GRID_STAT_INPUT_GRID_DATATYPE = NETCDF
OBS_GRID_STAT_INPUT_GRID_DATATYPE = NETCDF
GRID_STAT_NEIGHBORHOOD_SHAPE = SQUARE
GRID_STAT_NEIGHBORHOOD_WIDTH = 1, 3, 5
GRID_STAT_OUTPUT_PREFIX = {MODEL}_PCP_{init?fmt=%H%M}_A1
MET Configuration
METplus sets environment variables based on user settings in the METplus configuration file. See How METplus controls MET config file settings for more details.
YOU SHOULD NOT SET ANY OF THESE ENVIRONMENT VARIABLES YOURSELF! THEY WILL BE OVERWRITTEN BY METPLUS WHEN IT CALLS THE MET TOOLS!
If there is a setting in the MET configuration file that is currently not supported by METplus you’d like to control, please refer to: Overriding Unsupported MET config file settings
EnsembleStatConfig_wrapped
Note
See the EnsembleStat MET Configuration section of the User’s Guide for more information on the environment variables used in the file below:
////////////////////////////////////////////////////////////////////////////////
//
// Ensemble-Stat configuration file.
//
// For additional information, see the MET_BASE/config/README file.
//
////////////////////////////////////////////////////////////////////////////////
//
// Output model name to be written
//
${METPLUS_MODEL}
//
// Output description to be written
// May be set separately in each "obs.field" entry
//
${METPLUS_DESC}
//
// Output observation type to be written
//
${METPLUS_OBTYPE}
////////////////////////////////////////////////////////////////////////////////
//
// Verification grid
//
${METPLUS_REGRID_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// May be set separately in each "field" entry
//
${METPLUS_CENSOR_THRESH}
${METPLUS_CENSOR_VAL}
cat_thresh = [];
nc_var_str = "";
//ens_member_ids =
${METPLUS_ENS_MEMBER_IDS}
//control_id =
${METPLUS_CONTROL_ID}
////////////////////////////////////////////////////////////////////////////////
//prob_cat_thresh =
${METPLUS_PROB_CAT_THRESH}
//prob_pct_thresh =
${METPLUS_PROB_PCT_THRESH}
//eclv_points =
${METPLUS_ECLV_POINTS}
////////////////////////////////////////////////////////////////////////////////
//
// Forecast and observation fields to be verified
//
fcst = {
${METPLUS_FCST_FILE_TYPE}
${METPLUS_ENS_THRESH}
${METPLUS_VLD_THRESH}
${METPLUS_FCST_FIELD}
}
obs = {
${METPLUS_OBS_FILE_TYPE}
${METPLUS_OBS_FIELD}
}
////////////////////////////////////////////////////////////////////////////////
//
// Point observation filtering options
// May be set separately in each "obs.field" entry
//
${METPLUS_MESSAGE_TYPE}
sid_exc = [];
//obs_thresh = [ NA ];
${METPLUS_OBS_THRESH}
//obs_quality_inc =
${METPLUS_OBS_QUALITY_INC}
//obs_quality_exc =
${METPLUS_OBS_QUALITY_EXC}
${METPLUS_DUPLICATE_FLAG}
obs_summary = NONE;
obs_perc_value = 50;
${METPLUS_SKIP_CONST}
//
// Observation error options
// Set dist_type to NONE to use the observation error table instead
// May be set separately in each "obs.field" entry
//
obs_error = {
${METPLUS_OBS_ERROR_FLAG}
dist_type = NONE;
dist_parm = [];
inst_bias_scale = 1.0;
inst_bias_offset = 0.0;
min = NA; // Valid range of data
max = NA;
}
//
// Mapping of message type group name to comma-separated list of values.
//
message_type_group_map = [
{ key = "SURFACE"; val = "ADPSFC,SFCSHP,MSONET"; },
{ key = "ANYAIR"; val = "AIRCAR,AIRCFT"; },
{ key = "ANYSFC"; val = "ADPSFC,SFCSHP,ADPUPA,PROFLR,MSONET"; },
{ key = "ONLYSF"; val = "ADPSFC,SFCSHP"; }
];
//
// Ensemble bin sizes
// May be set separately in each "obs.field" entry
//
${METPLUS_ENS_SSVAR_BIN_SIZE}
${METPLUS_ENS_PHIST_BIN_SIZE}
////////////////////////////////////////////////////////////////////////////////
//
// Climatology data
//
//climo_mean = {
${METPLUS_CLIMO_MEAN_DICT}
//climo_stdev = {
${METPLUS_CLIMO_STDEV_DICT}
//
// May be set separately in each "obs.field" entry
//
${METPLUS_CLIMO_CDF_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Point observation time window
//
${METPLUS_OBS_WINDOW_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Verification masking regions
//
mask = {
${METPLUS_MASK_GRID}
${METPLUS_MASK_POLY}
sid = [];
llpnt = [];
}
////////////////////////////////////////////////////////////////////////////////
//
// Confidence interval settings
//
${METPLUS_CI_ALPHA}
////////////////////////////////////////////////////////////////////////////////
//
// Interpolation methods
//
${METPLUS_INTERP_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Statistical output types
//
${METPLUS_OUTPUT_FLAG_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Gridded verification output types
// May be set separately in each "obs.field" entry
//
${METPLUS_NC_ORANK_FLAG_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Random number generator
//
rng = {
type = "mt19937";
seed = "1";
}
////////////////////////////////////////////////////////////////////////////////
//grid_weight_flag =
${METPLUS_GRID_WEIGHT_FLAG}
${METPLUS_OUTPUT_PREFIX}
//version = "V9.0";
////////////////////////////////////////////////////////////////////////////////
tmp_dir = "${MET_TMP_DIR}";
${METPLUS_MET_CONFIG_OVERRIDES}
GridStatConfig_wrapped
Note
See the GridStat MET Configuration section of the User’s Guide for more information on the environment variables used in the file below:
////////////////////////////////////////////////////////////////////////////////
//
// Grid-Stat configuration file.
//
// For additional information, see the MET_BASE/config/README file.
//
////////////////////////////////////////////////////////////////////////////////
//
// Output model name to be written
//
// model =
${METPLUS_MODEL}
//
// Output description to be written
// May be set separately in each "obs.field" entry
//
// desc =
${METPLUS_DESC}
//
// Output observation type to be written
//
// obtype =
${METPLUS_OBTYPE}
////////////////////////////////////////////////////////////////////////////////
//
// Verification grid
//
// regrid = {
${METPLUS_REGRID_DICT}
////////////////////////////////////////////////////////////////////////////////
//censor_thresh =
${METPLUS_CENSOR_THRESH}
//censor_val =
${METPLUS_CENSOR_VAL}
cat_thresh = [];
cnt_thresh = [ NA ];
cnt_logic = UNION;
wind_thresh = [ NA ];
wind_logic = UNION;
eclv_points = 0.05;
//nc_pairs_var_name =
${METPLUS_NC_PAIRS_VAR_NAME}
nc_pairs_var_suffix = "";
//hss_ec_value =
${METPLUS_HSS_EC_VALUE}
rank_corr_flag = FALSE;
//
// Forecast and observation fields to be verified
//
fcst = {
${METPLUS_FCST_FILE_TYPE}
${METPLUS_FCST_FIELD}
}
obs = {
${METPLUS_OBS_FILE_TYPE}
${METPLUS_OBS_FIELD}
}
////////////////////////////////////////////////////////////////////////////////
//
// Climatology mean data
//
//climo_mean = {
${METPLUS_CLIMO_MEAN_DICT}
//climo_stdev = {
${METPLUS_CLIMO_STDEV_DICT}
//
// May be set separately in each "obs.field" entry
//
//climo_cdf = {
${METPLUS_CLIMO_CDF_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Verification masking regions
//
// mask = {
${METPLUS_MASK_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Confidence interval settings
//
ci_alpha = [ 0.05 ];
boot = {
interval = PCTILE;
rep_prop = 1.0;
n_rep = 0;
rng = "mt19937";
seed = "";
}
////////////////////////////////////////////////////////////////////////////////
//
// Data smoothing methods
//
//interp = {
${METPLUS_INTERP_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Neighborhood methods
//
nbrhd = {
field = BOTH;
// shape =
${METPLUS_NBRHD_SHAPE}
// width =
${METPLUS_NBRHD_WIDTH}
// cov_thresh =
${METPLUS_NBRHD_COV_THRESH}
vld_thresh = 1.0;
}
////////////////////////////////////////////////////////////////////////////////
//
// Fourier decomposition
// May be set separately in each "obs.field" entry
//
//fourier = {
${METPLUS_FOURIER_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Gradient statistics
// May be set separately in each "obs.field" entry
//
gradient = {
dx = [ 1 ];
dy = [ 1 ];
}
////////////////////////////////////////////////////////////////////////////////
//
// Distance Map statistics
// May be set separately in each "obs.field" entry
//
//distance_map = {
${METPLUS_DISTANCE_MAP_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Statistical output types
//
//output_flag = {
${METPLUS_OUTPUT_FLAG_DICT}
//
// NetCDF matched pairs output file
// May be set separately in each "obs.field" entry
//
// nc_pairs_flag = {
${METPLUS_NC_PAIRS_FLAG_DICT}
////////////////////////////////////////////////////////////////////////////////
// Threshold for SEEPS p1 (Probability of being dry)
//seeps_p1_thresh =
${METPLUS_SEEPS_P1_THRESH}
////////////////////////////////////////////////////////////////////////////////
//grid_weight_flag =
${METPLUS_GRID_WEIGHT_FLAG}
tmp_dir = "${MET_TMP_DIR}";
// output_prefix =
${METPLUS_OUTPUT_PREFIX}
////////////////////////////////////////////////////////////////////////////////
${METPLUS_MET_CONFIG_OVERRIDES}
Running METplus
This use case can be run two ways:
Passing in EnsembleStat_fcstWOFS_obsWOFS.py then a user-specific system configuration file:
run_metplus.py -c /path/to/METplus/parm/use_cases/model_applications/precipitation/EnsembleStat_fcstWOFS_obsWOFS.conf -c /path/to/user_system.conf
Modifying the configurations in parm/metplus_config, then passing in EnsembleStat_fcstWOFS_obsWOFS.conf:
run_metplus.py -c /path/to/METplus/parm/use_cases/model_applications/precipitation/EnsembleStat_fcstWOFS_obsWOFS.conf
The former method is recommended. Whether you add them to a user-specific configuration file or modify the metplus_config files, the following variables must be set correctly:
INPUT_BASE - Path to directory where sample data tarballs are unpacked (See Datasets section to obtain tarballs). This is not required to run METplus, but it is required to run the examples in parm/use_cases
OUTPUT_BASE - Path where METplus output will be written. This must be in a location where you have write permissions
MET_INSTALL_DIR - Path to location where MET is installed locally
Example User Configuration File:
[dir]
INPUT_BASE = /path/to/sample/input/data
OUTPUT_BASE = /path/to/output/dir
MET_INSTALL_DIR = /path/to/met-X.Y
NOTE: All of these items must be found under the [dir] section.
Expected Output
A successful run will output the following both to the screen and to the logfile:
INFO: METplus has successfully finished running.
Refer to the value set for OUTPUT_BASE to find where the output data was generated. Output for this use case will be found in WOFS/grid_stat (relative to OUTPUT_BASE) The following folder/file combination will be created:
20200615/1700/grid_stat_WOFS_PCP_1700_A1_000000L_20200615_180000V_pairs.nc
20200615/1700/grid_stat_WOFS_PCP_1700_A1_000000L_20200615_180000V.stat
Keywords
Note
EnsembleStatToolUseCase
PrecipitationAppUseCase
GRIB2FileUseCase
EnsembleAppUseCase
Navigate to the METplus Quick Search for Use Cases page to discover other similar use cases.
sphinx_gallery_thumbnail_path = ‘_static/precipitation-EnsembleStat_fcstWOFS_obsWOFS.png’
Total running time of the script: (0 minutes 0.000 seconds)