Note
Click here to download the full example code
5.2.3.6. MODE: Hail Verification
model_applications/ convection_allowing_model/ MODE_fcstHRRR_obsMRMS_Hail_GRIB2.conf
Scientific Objective
To provide statistical inforation on the forecast hail size compared to the observed hail size from MRMS MESH data. Using objects to verify hail size avoids the “unfair penalty” issue, where a CAM must first generate convection to have any chance of accurately predicting the hail size. In addition, studies have shown that MRMS MESH observed hail sizes do not correlate one- to-one with observed sizes but can only be used to group storms into general categories. Running MODE allows a user to do this.
Datasets
Forecast dataset: HRRRv4 data
Observation dataset: MRMS
METplus Components
This use case runs MODE to create object statistics on forecast hail size from the HRRR version 4 model and the observed MRMS MESH hail size.
METplus Workflow
The MODE tool is run for each time. This example loops by valid time. It processes 2 valid times, listed below.
METplus Configuration
METplus first loads all of the configuration files found in parm/metplus_config, then it loads any configuration files passed to METplus via the command line with the -c option, i.e. -c parm/use_cases/model_applications/convection_allowing_models/MODE_fcstHRRR_obsMRMS_Hail_GRIB2.conf
[config]
LOOP_BY = valid
VALID_TIME_FMT = %Y%m%d%H
# Start time for METplus run
VALID_BEG = 2019052902
# End time for METplus run
VALID_END = 2019052903
# Increment between METplus runs in seconds. Must be >= 60
VALID_INCREMENT = 3600
LOOP_ORDER = processes
PROCESS_LIST = Mode
LEAD_SEQ_MAX = 36
LEAD_SEQ_MIN = 12
FCST_IS_PROB = false
# list of forecast generation to process
INIT_SEQ = 0
MODE_QUILT = True
MODE_CONV_RADIUS = 4
MODE_CONV_THRESH = >=0.5
MODE_MERGE_THRESH = >=0.0
MODE_MERGE_FLAG = NONE
MODE_FCST_CENSOR_THRESH = >0&&<0.75
MODE_FCST_CENSOR_VAL = -9999.0
MODE_FCST_FILTER_ATTR_NAME = AREA
MODE_FCST_FILTER_ATTR_THRESH = >=4
MODE_OBS_CENSOR_THRESH = >0&&<0.75
MODE_OBS_CENSOR_VAL = -9999.0
MODE_OBS_FILTER_ATTR_NAME = AREA
MODE_OBS_FILTER_ATTR_THRESH = >=4
MODE_MATCH_FLAG = NO_MERGE
MODE_MAX_CENTROID_DIST = 400.0/grid_res
MODE_MASK_POLY_FLAG = BOTH
MODE_WEIGHT_INTEN_PERC_VALUE = 99
MODE_TOTAL_INTEREST_THRESH = 0.5
# Forecast Reflectivity Variable Information
MODEL = HRRRv4_HAILCAST
FCST_VAR1_NAME = HAIL
FCST_VAR1_LEVELS = L0
FCST_VAR1_OPTIONS = convert(x) = x / 0.0254
# MRMS Reflecivitiy Variable Information
OBTYPE = MRMS
OBS_VAR1_NAME = MESHMax60min
OBS_VAR1_LEVELS = Z500
OBS_VAR1_OPTIONS = convert(x) = MM_to_IN(x);
#CONFIG_DIR={PARM_BASE}/use_cases/model_applications/convection_allowing_models/MODE_fcstHRRR_obsMRMS_Hail_GRIB2
#MODE_CONFIG_FILE = {CONFIG_DIR}/MODEConfig_hailcast
MODE_CONFIG_FILE = {PARM_BASE}/met_config/MODEConfig_wrapped
MODE_REGRID_TO_GRID = FCST
MODE_REGRID_METHOD = MAX
MODE_REGRID_WIDTH = 2
[dir]
# Directory for HRRR data
FCST_MODE_INPUT_DIR = {INPUT_BASE}/model_applications/convection_allowing_models/hrrr_esrl
# Directory of the MRMS obs
OBS_MODE_INPUT_DIR = {INPUT_BASE}/model_applications/convection_allowing_models/hrrr_esrl
# Output Data
MODE_OUTPUT_DIR = {OUTPUT_BASE}/hailtest
METPLUS_CONF = {MODE_OUTPUT_DIR}/metplus_final.conf
[filename_templates]
# Forecast Filename Templates:
FCST_MODE_INPUT_TEMPLATE = {init?fmt=%Y%m%d}/hrrr_esrl_{init?fmt=%Y%m%d%H}f{lead?fmt=%HHH}.grib2
#OBS_MODE_INPUT_TEMPLATE = {valid?fmt=%Y}/{valid?fmt=%m}/{valid?fmt=%d}/mrms.MESH_Max_60min.{valid?fmt=%Y%m%d}_{valid?fmt=%H%M%S}.grib2
OBS_MODE_INPUT_TEMPLATE = {valid?fmt=%Y%m%d}/mrms.MESH_Max_60min.{valid?fmt=%Y%m%d}_{valid?fmt=%H%M%S}.grib2
MODE_VERIFICATION_MASK_TEMPLATE = {FCST_MODE_INPUT_DIR}/{init?fmt=%Y%m%d}_hrefv2_subdomainmask.nc
MET Configuration
METplus sets environment variables based on user settings in the METplus configuration file. See How METplus controls MET config file settings for more details.
YOU SHOULD NOT SET ANY OF THESE ENVIRONMENT VARIABLES YOURSELF! THEY WILL BE OVERWRITTEN BY METPLUS WHEN IT CALLS THE MET TOOLS!
If there is a setting in the MET configuration file that is currently not supported by METplus you’d like to control, please refer to: Overriding Unsupported MET config file settings
Note
See the MODE MET Configuration section of the User’s Guide for more information on the environment variables used in the file below:
////////////////////////////////////////////////////////////////////////////////
//
// MODE configuration file.
//
// For additional information, see the MET_BASE/config/README file.
//
////////////////////////////////////////////////////////////////////////////////
//
// Output model name to be written
//
${METPLUS_MODEL}
//
// Output description to be written
//
${METPLUS_DESC}
//
// Output observation type to be written
//
${METPLUS_OBTYPE}
////////////////////////////////////////////////////////////////////////////////
//
// Verification grid
//
${METPLUS_REGRID_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Approximate grid resolution (km)
//
// grid_res =
${METPLUS_GRID_RES}
////////////////////////////////////////////////////////////////////////////////
//
// Run all permutations of radius and threshold
//
${METPLUS_QUILT}
//
// Forecast and observation fields to be verified
//
fcst = {
${METPLUS_FCST_FIELD}
${METPLUS_FCST_CENSOR_THRESH}
${METPLUS_FCST_CENSOR_VAL}
${METPLUS_FCST_CONV_RADIUS}
${METPLUS_FCST_CONV_THRESH}
${METPLUS_FCST_VLD_THRESH}
${METPLUS_FCST_FILTER_ATTR_NAME}
${METPLUS_FCST_FILTER_ATTR_THRESH}
${METPLUS_FCST_MERGE_THRESH}
${METPLUS_FCST_MERGE_FLAG}
}
obs = {
${METPLUS_OBS_FIELD}
${METPLUS_OBS_CENSOR_THRESH}
${METPLUS_OBS_CENSOR_VAL}
${METPLUS_OBS_CONV_RADIUS}
${METPLUS_OBS_CONV_THRESH}
${METPLUS_OBS_VLD_THRESH}
${METPLUS_OBS_FILTER_ATTR_NAME}
${METPLUS_OBS_FILTER_ATTR_THRESH}
${METPLUS_OBS_MERGE_THRESH}
${METPLUS_OBS_MERGE_FLAG}
}
////////////////////////////////////////////////////////////////////////////////
//
// Handle missing data
//
mask_missing_flag = BOTH;
//
// Match objects between the forecast and observation fields
//
//match_flag =
${METPLUS_MATCH_FLAG}
//
// Maximum centroid distance for objects to be compared
//
//max_centroid_dist =
${METPLUS_MAX_CENTROID_DIST}
////////////////////////////////////////////////////////////////////////////////
//
// Verification masking regions
//
//mask = {
${METPLUS_MASK_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Fuzzy engine weights
//
//weight = {
${METPLUS_WEIGHT_DICT}
////////////////////////////////////////////////////////////////////////////////
//
// Fuzzy engine interest functions
//
interest_function = {
${METPLUS_INTEREST_FUNCTION_CENTROID_DIST}
${METPLUS_INTEREST_FUNCTION_BOUNDARY_DIST}
${METPLUS_INTEREST_FUNCTION_CONVEX_HULL_DIST}
angle_diff = (
( 0.0, 1.0 )
( 30.0, 1.0 )
( 90.0, 0.0 )
);
aspect_diff = (
( 0.00, 1.0 )
( 0.10, 1.0 )
( 0.75, 0.0 )
);
corner = 0.8;
ratio_if = (
( 0.0, 0.0 )
( corner, 1.0 )
( 1.0, 1.0 )
);
area_ratio = ratio_if;
int_area_ratio = (
( 0.00, 0.00 )
( 0.10, 0.50 )
( 0.25, 1.00 )
( 1.00, 1.00 )
);
curvature_ratio = ratio_if;
complexity_ratio = ratio_if;
inten_perc_ratio = ratio_if;
}
////////////////////////////////////////////////////////////////////////////////
//
// Total interest threshold for determining matches
//
//total_interest_thresh =
${METPLUS_TOTAL_INTEREST_THRESH}
//
// Interest threshold for printing output pair information
//
print_interest_thresh = 0.0;
////////////////////////////////////////////////////////////////////////////////
//
// Plotting information
//
met_data_dir = "MET_BASE";
fcst_raw_plot = {
color_table = "MET_BASE/colortables/met_default.ctable";
plot_min = 0.0;
plot_max = 0.0;
colorbar_spacing = 1;
}
obs_raw_plot = {
color_table = "MET_BASE/colortables/met_default.ctable";
plot_min = 0.0;
plot_max = 0.0;
colorbar_spacing = 1;
}
object_plot = {
color_table = "MET_BASE/colortables/mode_obj.ctable";
}
//
// Boolean for plotting on the region of valid data within the domain
//
plot_valid_flag = FALSE;
//
// Plot polyline edges using great circle arcs instead of straight lines
//
plot_gcarc_flag = FALSE;
////////////////////////////////////////////////////////////////////////////////
//
// NetCDF matched pairs, PostScript, and contingency table output files
//
ps_plot_flag = TRUE;
//nc_pairs_flag = {
${METPLUS_NC_PAIRS_FLAG_DICT}
ct_stats_flag = TRUE;
////////////////////////////////////////////////////////////////////////////////
shift_right = 0; // grid squares
////////////////////////////////////////////////////////////////////////////////
${METPLUS_OUTPUT_PREFIX}
//version = "V10.0";
////////////////////////////////////////////////////////////////////////////////
${METPLUS_MET_CONFIG_OVERRIDES}
Running METplus
This use case can be run two ways:
Passing in MODE_fcstHRRRE_obsMRMS_Hail_GRIB2.conf then a user-specific system configuration file:
run_metplus.py -c /path/to/METplus/parm/use_cases/model_applications/convection_allowing_models/MODE_fcstHRRRE_obsMRMS_Hail_GRIB2.conf -c /path/to/user_system.conf
Modifying the configurations in parm/metplus_config, then passing in MODE_fcstHRRRE_obsMRMS_Hail_GRIB2.conf:
run_metplus.py -c /path/to/METplus/parm/use_cases/model_applications/convection_allowing_models/MODE_fcstHRRRE_obsMRMS_Hail_GRIB2.conf
The former method is recommended. Whether you add them to a user-specific configuration file or modify the metplus_config files, the following variables must be set correctly:
INPUT_BASE - Path to directory where sample data tarballs are unpacked (See Datasets section to obtain tarballs). This is not required to run METplus, but it is required to run the examples in parm/use_cases
OUTPUT_BASE - Path where METplus output will be written. This must be in a location where you have write permissions
MET_INSTALL_DIR - Path to location where MET is installed locally
Example User Configuration File:
[dir]
INPUT_BASE = /path/to/sample/input/data
OUTPUT_BASE = /path/to/output/dir
MET_INSTALL_DIR = /path/to/met-X.Y
NOTE: All of these items must be found under the [dir] section.
Expected Output
A successful run will output the following both to the screen and to the logfile:
INFO: METplus has successfully finished running.
Refer to the value set for OUTPUT_BASE to find where the output data was generated. Output for this use case will be found in hailtest (relative to OUTPUT_BASE) and will contain the following files:
mode_260000L_20190529_020000V_010000A_cts.txt mode_260000L_20190529_020000V_010000A_obj.nc mode_260000L_20190529_020000V_010000A_obj.txt mode_260000L_20190529_020000V_010000A.ps mode_270000L_20190529_030000V_010000A_cts.txt mode_270000L_20190529_030000V_010000A_obj.nc mode_270000L_20190529_030000V_010000A_obj.txt mode_270000L_20190529_030000V_010000A.ps
Keywords
sphinx_gallery_thumbnail_path = ‘_static/convection_allowing_models-MODE_fcstHRRRE_obsMRMS_Hail_GRIB2.png’
Note
MODEToolUseCase, ConvectionAllowingModelsAppUseCase, GRIB2FileUseCase, RegriddingInToolUseCase, NOAAHWTOrgUseCase, NCAROrgUseCase, DiagnosticsUseCase
Total running time of the script: ( 0 minutes 0.000 seconds)