Wang Min, Li Xiaoli, Fan Guangzhou, et al. Calibrating 2 m temperature forecast for the regional ensemble prediction system at NMC. J Appl Meteor Sci, 2012, 23(4): 395-401.
Citation: Wang Min, Li Xiaoli, Fan Guangzhou, et al. Calibrating 2 m temperature forecast for the regional ensemble prediction system at NMC. J Appl Meteor Sci, 2012, 23(4): 395-401.

Calibrating 2 m Temperature Forecast for the Regional Ensemble Prediction System at NMC

  • Received Date: 2011-08-05
  • Rev Recd Date: 2012-05-10
  • Publish Date: 2012-08-31
  • It's known that ensemble forecasts provide a flow-dependent sample of the probability distribution of possible future atmospheric states instead of the single and deterministic prediction. Ideally, the probability of any event could be skillfully estimated directly from the relative event frequency in the ensemble. Unfortunately, although the quality of ensemble prediction systems (EPS) has been improved greatly, the direct output of EPS generally is subject to the systematic deficiencies, especially for surface variables. They are under-dispersive and lack of reliability. Therefore, statistical post-processing methods have been developed to improve direct model output. The nonhomogeneous Gaussian regression (NGR) is used to calibrate 2 m temperature forecast of the regional EPS at NMC/CMA. The NGR is the statistical correction method with the first and the second moment (mean bias and dispersion) for Gaussian-distributed continuous variable. This method is based on the multiple linear regression technique and provides a predictive probability density function (PDF) in terms of the normal distribution. The method of minimum continuous ranked probability score (CRPS) estimation is used to fit the regression coefficients of PDF. It can be found that NGR method can greatly improve 2 m temperature forecast compared with the raw ensemble output, and the improvement is as follows: The mean bias is reduced and the spread of ensemble members is increased reasonably; the L-shaped Talagrand diagram of the direct ensemble output has been improved and the calibration reduces the number of outliers, especially in the 9th bin; the probabilistic scores (the brier score, continuous ranked probability score, area under relative operating characteristic curves) all show the significant forecast skill improvement in the calibrated forecasts.In addition, the sensitive study is performed to investigate the effect of the training length, and the results show that the training length plays a minor role, at least for the chosen verification period. Finally, the comparison by using the time-decaying average bias correction method and NGR is performed, showing that NGR not only has advantages in reducing ensemble mean bias and increasing ensemble spread, but improves the forecast skill in terms of probabilistic scores.
  • Fig. 1  Distribution of the difference of 30-hour 2 m temperation forecast at 1200 UTC 20 July 2008

    (a) the difference between ensemble averge of model direct output and observation, (b) the difference between calibrated ensemble average and observation

    Fig. 2  RMSE and ensemble spread of 2 m temperature

    Fig. 3  Talagrand diagrams of raw and calibrated 2 m temperature (forecast lead time is 6 hours)

    Fig. 4  BS of raw and calibrated 2 m temperature

    Fig. 5  CRPS of raw and calibrated 2 m temperature

    Fig. 6  Area under ROC curves for 2 m temperature

    Fig. 7  CRPS of 2 m temperature from different training length

    Fig. 8  CRPS of 2 m temperature from different spread rescaling

    Fig. 9  RMSE of 2 m temperature

    Fig. 10  BS of 2 m temperature

    Fig. 11  CRPS of 2 m temperature

    Fig. 12  Area under ROC curves for 2 m temperature

  • [1]
    Carter G M, Dallavalle J P, Glahn H R. Statistical forecasts based on the National Meteorological Center's numerical weather prediction system. Wea Forecasting, 1989, 4: 401-412. doi:  10.1175/1520-0434(1989)004<0401:SFBOTN>2.0.CO;2
    Vislocky R L, Fritsch J M. Performance of an advanced MOS system in the 1996-97 national collegiate weather forecasting contest. Bull Amer Meteor Soc, 1997, 78:2851-2857. doi:  10.1175/1520-0477(1997)078<2851:POAAMS>2.0.CO;2
    Raftery A E, Gneiting T, Balabdaoui F, et al. Using Bayesian model averaging to calibrate forecast ensembles. Mon Wea Rev, 2005, 133:1155-1174. doi:  10.1175/MWR2906.1
    Gneiting T, Raftery A E, Westveld A H, et al. Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation. Mon Wea Rev, 2005, 133:1098-1118. doi:  10.1175/MWR2904.1
    Hamill T M, Whitaker J S, Wei X. Ensemble reforecasting: Improving medium range forecast skill using retro-spective forecasts. Mon Wea Rev, 2004, 132:1434-1447. doi:  10.1175/1520-0493(2004)132<1434:ERIMFS>2.0.CO;2
    Hamill T M, Whitaker J S. Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon Wea Rev, 2006, 134: 3209-3229. doi:  10.1175/MWR3237.1
    Hamill T M, Whitaker J S. Ensemble calibration of 500-hPa geopotential height and 850-hPa and 2-m temperatures using reforecasts. Mon Wea Rev, 2007, 135:3273-3280. doi:  10.1175/MWR3468.1
    Hamill T M, Whitaker J S, Mullen S L. Reforecasts: An important dataset for improving weather predictions. Bull Amer Meteor Soc, 2006, 87:33-46. doi:  10.1175/BAMS-87-1-33
    Cui B, Toth Z, Zhu Y, et al. The Trade-off in Bias Correction Between Using the Latest Analysis/Modeling System with a Short, Versus an Older System with a Long Archive. Proc First THORPEX Int Science Symp, Montreal, Canada, World Meteorological Organization, 2006:281-284.
    林春泽, 智协飞, 韩艳, 等.基于TIGGE资料的地面气温多模式超级集合预报研究.应用气象学报, 2009, 20(6):706-712. doi:  10.11898/1001-7313.20090608
    马清, 龚建东, 李莉, 等.超级集合预报的误差订正与集成研究.气象, 2008, 34(3):42-48. doi:  10.7519/j.issn.1000-0526.2008.03.007
    Kunii M, Saito K, Seko H, et al. Verifications and intercomparisons of mesoscale ensemble prediction systems in B08RDP. Tellus, 2011, 63A: 531-549. doi:  10.1088/1742-6596/454/1/012073/pdf
    Alexander Kann, Wittmann Christpoh, Wang Yong. Calibrating 2 m temperature of limmited-area ensember forecasts using high-resolution analysis. Mon Wea Rew, 2009, 137:3373-3387. doi:  10.1175/2009MWR2793.1
    邓国, 龚建东, 邓莲堂, 等.国家级区域集合预报系统研发和性能检验.应用气象学报, 2010, 21(5):513-523. doi:  10.11898/1001-7313.20100501
    Nelder J A, Mead R. A simplex method for function minimization. Comput J, 1965, 7:308-313. doi:  10.1093/comjnl/7.4.308
    Hagedorn R, Hamill T M, Whitaker J S. Probabilistic forecast calibration using ECMWF and GFS ensemble reforecasts. Part Ⅰ: Temperature. Mon Wea Rev, 2008, 136: 2608-2619. doi:  10.1175/2007MWR2410.1
    皇甫雪官.国家气象中心集合数值预报检验评价.应用气象学报, 2002, 13(1):29-36.
  • 加载中
  • -->



    Article views (3881) PDF downloads(1606) Cited by()
    • Received : 2011-08-05
    • Accepted : 2012-05-10
    • Published : 2012-08-31


    DownLoad:  Full-Size Img  PowerPoint