Calibrating 2 m Temperature Forecast for the Regional Ensemble Prediction System at NMC
-
摘要: 采用非齐次高斯回归 (NGR) 技术对国家气象中心区域集合预报系统的2 m温度预报结果开展了一阶偏差和二阶离散度的校准研究。对预报结果比较详尽的检验分析表明:校准后的2 m温度预报可靠性和预报技巧均显著提高,表现为校准后集合预报成员的均方根误差与离散度更为接近;原Talagrand直方图中的“L”形分布现象得到有效改善;Brier评分、最小连续分级概率评分 (CRPS) 明显减小,相对作用特征 (ROC) 面积增大,说明校准后的2 m温度预报表现出更好的预报技能。此外,NGR技术与自适应误差订正技术的对比试验表明,NGR在消除集合平均偏差和提高集合离散度两个方面均有优势。
-
关键词:
- 集合预报;
- 偏差校准;
- 非齐次高斯回归 (NGR);
- 检验评分
Abstract: It's known that ensemble forecasts provide a flow-dependent sample of the probability distribution of possible future atmospheric states instead of the single and deterministic prediction. Ideally, the probability of any event could be skillfully estimated directly from the relative event frequency in the ensemble. Unfortunately, although the quality of ensemble prediction systems (EPS) has been improved greatly, the direct output of EPS generally is subject to the systematic deficiencies, especially for surface variables. They are under-dispersive and lack of reliability. Therefore, statistical post-processing methods have been developed to improve direct model output. The nonhomogeneous Gaussian regression (NGR) is used to calibrate 2 m temperature forecast of the regional EPS at NMC/CMA. The NGR is the statistical correction method with the first and the second moment (mean bias and dispersion) for Gaussian-distributed continuous variable. This method is based on the multiple linear regression technique and provides a predictive probability density function (PDF) in terms of the normal distribution. The method of minimum continuous ranked probability score (CRPS) estimation is used to fit the regression coefficients of PDF. It can be found that NGR method can greatly improve 2 m temperature forecast compared with the raw ensemble output, and the improvement is as follows: The mean bias is reduced and the spread of ensemble members is increased reasonably; the L-shaped Talagrand diagram of the direct ensemble output has been improved and the calibration reduces the number of outliers, especially in the 9th bin; the probabilistic scores (the brier score, continuous ranked probability score, area under relative operating characteristic curves) all show the significant forecast skill improvement in the calibrated forecasts.In addition, the sensitive study is performed to investigate the effect of the training length, and the results show that the training length plays a minor role, at least for the chosen verification period. Finally, the comparison by using the time-decaying average bias correction method and NGR is performed, showing that NGR not only has advantages in reducing ensemble mean bias and increasing ensemble spread, but improves the forecast skill in terms of probabilistic scores. -
图 1 2008年7月20日12:00起报的2 m温度集合平均 (预报时效为30 h) 与观测场之差的空间分布
(a) 校准前,(b) 校准后
Fig. 1 Distribution of the difference of 30-hour 2 m temperation forecast at 1200 UTC 20 July 2008
(a) the difference between ensemble averge of model direct output and observation, (b) the difference between calibrated ensemble average and observation
-
[1] Carter G M, Dallavalle J P, Glahn H R. Statistical forecasts based on the National Meteorological Center's numerical weather prediction system. Wea Forecasting, 1989, 4: 401-412. doi: 10.1175/1520-0434(1989)004<0401:SFBOTN>2.0.CO;2 [2] Vislocky R L, Fritsch J M. Performance of an advanced MOS system in the 1996-97 national collegiate weather forecasting contest. Bull Amer Meteor Soc, 1997, 78:2851-2857. doi: 10.1175/1520-0477(1997)078<2851:POAAMS>2.0.CO;2 [3] Raftery A E, Gneiting T, Balabdaoui F, et al. Using Bayesian model averaging to calibrate forecast ensembles. Mon Wea Rev, 2005, 133:1155-1174. doi: 10.1175/MWR2906.1 [4] Gneiting T, Raftery A E, Westveld A H, et al. Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation. Mon Wea Rev, 2005, 133:1098-1118. doi: 10.1175/MWR2904.1 [5] Hamill T M, Whitaker J S, Wei X. Ensemble reforecasting: Improving medium range forecast skill using retro-spective forecasts. Mon Wea Rev, 2004, 132:1434-1447. doi: 10.1175/1520-0493(2004)132<1434:ERIMFS>2.0.CO;2 [6] Hamill T M, Whitaker J S. Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon Wea Rev, 2006, 134: 3209-3229. doi: 10.1175/MWR3237.1 [7] Hamill T M, Whitaker J S. Ensemble calibration of 500-hPa geopotential height and 850-hPa and 2-m temperatures using reforecasts. Mon Wea Rev, 2007, 135:3273-3280. doi: 10.1175/MWR3468.1 [8] Hamill T M, Whitaker J S, Mullen S L. Reforecasts: An important dataset for improving weather predictions. Bull Amer Meteor Soc, 2006, 87:33-46. doi: 10.1175/BAMS-87-1-33 [9] Cui B, Toth Z, Zhu Y, et al. The Trade-off in Bias Correction Between Using the Latest Analysis/Modeling System with a Short, Versus an Older System with a Long Archive. Proc First THORPEX Int Science Symp, Montreal, Canada, World Meteorological Organization, 2006:281-284. [10] 林春泽, 智协飞, 韩艳, 等.基于TIGGE资料的地面气温多模式超级集合预报研究.应用气象学报, 2009, 20(6):706-712. doi: 10.11898/1001-7313.20090608 [11] 马清, 龚建东, 李莉, 等.超级集合预报的误差订正与集成研究.气象, 2008, 34(3):42-48. doi: 10.7519/j.issn.1000-0526.2008.03.007 [12] Kunii M, Saito K, Seko H, et al. Verifications and intercomparisons of mesoscale ensemble prediction systems in B08RDP. Tellus, 2011, 63A: 531-549. doi: 10.1088/1742-6596/454/1/012073/pdf [13] Alexander Kann, Wittmann Christpoh, Wang Yong. Calibrating 2 m temperature of limmited-area ensember forecasts using high-resolution analysis. Mon Wea Rew, 2009, 137:3373-3387. doi: 10.1175/2009MWR2793.1 [14] 邓国, 龚建东, 邓莲堂, 等.国家级区域集合预报系统研发和性能检验.应用气象学报, 2010, 21(5):513-523. doi: 10.11898/1001-7313.20100501 [15] Nelder J A, Mead R. A simplex method for function minimization. Comput J, 1965, 7:308-313. doi: 10.1093/comjnl/7.4.308 [16] Hagedorn R, Hamill T M, Whitaker J S. Probabilistic forecast calibration using ECMWF and GFS ensemble reforecasts. Part Ⅰ: Temperature. Mon Wea Rev, 2008, 136: 2608-2619. doi: 10.1175/2007MWR2410.1 [17] 皇甫雪官.国家气象中心集合数值预报检验评价.应用气象学报, 2002, 13(1):29-36. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20020103&flag=1