Performance Evaluation of CMA-BJ V2.0 System for Precipitation Forecast in North China

Zhang Shuting; Zhong Jiqin; Lu Bing; Huang Xiangyu; Chen Min; Zhang Xinyu; Quan Jiping

doi:10.11898/1001-7313.20230201

Vol.34, NO.2, 2023

Turn off MathJax

Article Contents

Article Navigation > Journal of Applied Meteorological Science > 2023 > 34(2): 129-141

Zhang Shuting, Zhong Jiqin, Lu Bing, et al. Performance evaluation of CMA-BJ V2.0 System for precipitation forecast in North China. J Appl Meteor Sci, 2023, 34(2): 129-141. DOI: 10.11898/1001-7313.20230201.

Citation:

Zhang Shuting, Zhong Jiqin, Lu Bing, et al. Performance evaluation of CMA-BJ V2.0 System for precipitation forecast in North China. J Appl Meteor Sci, 2023, 34(2): 129-141. DOI: 10.11898/1001-7313.20230201.

Citation:

PDF( 29626 KB)

Performance Evaluation of CMA-BJ V2.0 System for Precipitation Forecast in North China

DOI: 10.11898/1001-7313.20230201

Institute of Urban Meteorology, CMA, Beijing 100089

Received Date: 2022-11-01
Rev Recd Date: 2023-01-10
Publish Date: 2023-03-31

Abstract

Abstract

To meet the requirement of numerical weather forecast for local severe convective weather, especially disastrous weather and extreme weather events, based on CMA-BJ V2.0 system, many works have been implemented, including increasing the model vertical layer to 59 layers, testing different physical parameterization schemes, assimilating unconventional local dense data such as wind profile radar and the near surface data, developing rapid cycle technology, and applying the incremental analysis update initialization technique of large-scale dynamic hybrid scheme for forecast field. By integrating all the jobs mentioned, the rapid analysis and forecast system CMA-BJ V2.0 has been established and put into operational run since June 2021 with 1 h time interval. A large number of tests and evaluations on multiple versions of the CMA-BJ numerical forecast system have been carried out. It is confirmed that the forecast skills of the model are improving year by year. There are still some problems in the forecast, such as heavy precipitation, high percentage of effective precipitation hours, and large deviation in the forecast of weak precipitation. Based upon 24 h precipitation forecast and 24 h hourly precipitation forecast information in North China on each day of the 2021 flood season (June to September), the comprehensive performance of CMA-BJ V2.0 forecast system with different resolutions (3 km and 9 km) is carefully evaluated and analyzed in terms of accumulation, percentage of effective precipitation hours, precipitation intensity, and daily cycle characteristics. The results show that both 9 km and 3 km resolutions can forecast the precipitation level and the rainfall area well and capture the regional distribution characteristics of precipitation with daily average precipitation greater than 8 mm well, but the forecast of precipitation level is larger than the observation. The forecast of hourly precipitation and the daily cycle of percentage of effective precipitation hours in North China is generally consistent with the observation, but the forecast of the peak in the evening is strong. The hourly precipitation is overestimated due to false alarms. For 3 km resolution forecast, the trend of percentage of effective precipitation hours is more similar to the observation. The magnitudes are closer to the observation than 9 km resolution forecast. 9 km resolution forecasts have better forecasting ability for weak precipitation processes, while 3 km resolution forecast is better at strong precipitation processes. The forecast results of a typical precipitation case in North China on 21 July 2021 are consistent with the test results of the average of the whole flood season: The model of both resolutions can better forecast the precipitation process, but the amount and percentage of effective precipitation hours is overestimated.
- CMA-BJ V2.0 forecasting system;
- deviation characteristics;
- quantitative precipitation forecast assessment

FullText(HTML)

References(36)

Figures and Tables

Fig. 1 Domain and terrain height (the shaded) of CMA-BJ V2.0

DownLoad: Full-Size Img PowerPoint

Fig. 2 Observed and predicted daily precipitation in the summer of 2021

DownLoad: Full-Size Img PowerPoint

Fig. 3 Observed and predicted percentage of effective precipitation hours varying with daily precipitation over North China in the summer of 2021

DownLoad: Full-Size Img PowerPoint

Fig. 4 Observed and predicted percentage of effective precipitation hours in the summer of 2021

DownLoad: Full-Size Img PowerPoint

Fig. 5 Observed and predicted precipitation intensity in the summer of 2021

DownLoad: Full-Size Img PowerPoint

Fig. 6 Daily evolution (the shaded) and diurnal cycle (the curve) of observed and predicted hourly precipitation over North China in the summer of 2021

DownLoad: Full-Size Img PowerPoint

Fig. 7 Daily evolution (the shaded) and diurnal cycle (the curve) of observed and predicted hourly percentage of effective precipitation hours over North China in the summer of 2021

DownLoad: Full-Size Img PowerPoint

Fig. 8 Observed and predicted peak precipitation time in the summer of 2021

DownLoad: Full-Size Img PowerPoint

Fig. 9 Observed and predicted 24 h accumulated precipitation from 0800 BT 21 Jul to 0800 BT 22 Jul in 2021

DownLoad: Full-Size Img PowerPoint

Fig. 10 Time series of observed and predicted hourly precipitation(a) and hourly percentage of effective precipitation hours(b) from 0800 BT 21 Jul to 0800 BT 22 Jul in 2021

DownLoad: Full-Size Img PowerPoint

Table 1 Root mean square error and correlation coefficient between observation and forecast with 9 km and 3 km resolutions

变量	分类	均方根误差		空间相关系数
变量	分类	9 km分辨率预报	3 km分辨率预报	9 km分辨率预报	3 km分辨率预报
平均日降水量/mm		1.38	1.48	0.71	0.70
有效降水时次占比/%	雨日	14.23	8.98	0.59	0.45
有效降水时次占比/%	强降水日	2.20	2.40	0.62	0.60
降水强度/(mm·d^-1)	雨日	3.57	3.17	0.68	0.67
降水强度/(mm·d^-1)	强降水日	15.67	13.43	0.23	0.29

DownLoad: Download CSV

References

[1]	Chyi D, He L F, Wang X M, et al. Fine observation characteristics and thermodynamic mechanisms of extreme heavy rainfall in Henan on 20 July 2021. J Appl Meteor Sci, 2022, 33(1): 1-15. doi: 10.11898/1001-7313.20220101
[2]	Chen H M, Li P X, Zhao Y. A review and outlook of verification and evaluation of precipitation forecast at convection-permitting resolution. Adv Meteor Sci Tech, 2021, 11(3): 155-164. doi: 10.3969/j.issn.2095-1973.2021.03.018
[3]	Bi B G, Dai K, Wang Y, et al. Advances in techniques of quantitative precipitation forecast. J Appl Meteor Sci, 2016, 27(5): 534-549. doi: 10.11898/1001-7313.20160503
[4]	Li Z, Chen J, Ma Z S, et al. Deviation distribution features of CMA-GFS cloud prediction. J Appl Meteor Sci, 2022, 33(5): 527-540. doi: 10.11898/1001-7313.20220502
[5]	Prein A, Langhans F, Fosser W, et al. A review on regional convection-permitting climate modeling: Demonstrations, prospects, and challenges. Rev Geo, 2015, 53(2): 323-361.
[6]	Xu L C, Wang J J, Huang L P. Evaluation of QPF of GRAPES-Meso4.0 model at convection-permitting resolution. Acta Meteor Sinica, 2017, 75(6): 851-876. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB201706001.htm
[7]	Barnaby S, Love A, Matthews J, et al. The diurnal cycle of precipitation over the Maritime Continent in a high-resolution atmospheric model. Quart J Roy Meteor Soc, 2011, 137(657): 934-947. doi: 10.1002/qj.809
[8]	Seity Y, Brousseau P, Malardel S, et al. The AROME-France convective-scale operational model. Mon Wea Rev, 2011, 139(3): 976-991. doi: 10.1175/2010MWR3425.1
[9]	Koo M S, Hong S Y. Diurnal variations of simulated precipitation over East Asia in two regional climate models. J Geophys Res, 2010, 115(5): D05105.
[10]	Dai A. Precipitation characteristics in eighteen coupled climate models. J Climate, 2006, 19(18): 4605-4630. doi: 10.1175/JCLI3884.1
[11]	Xie S, Sun X G, Zhang S P, et al. Precipitation forecast correction in South China based on SVD and machine learning. J Appl Meteor Sci, 2022, 33(3): 293-304. doi: 10.11898/1001-7313.20220304
[12]	Zhang B, Zheng Y Y, Shen F F, et al. Characteristics and simulation of a torrential rainstorm over southern Jiangsu in 2017 revealed by a high-resolution numerical model. J Meteor Sci, 2021, 41(3): 386-397. https://www.cnki.com.cn/Article/CJFDTOTAL-QXKX202103011.htm
[13]	Liu Y J, Huang Q Q, Zhang H B, et al. Refined assessment of wind environment over Winter Olympic competition zone based on large eddy simulation. J Appl Meteor Sci, 2022, 33(2): 129-141. doi: 10.11898/1001-7313.20220201
[14]	Duan Y P, Wang D H, Liu Y. Radar analysis and numerical simulation of strong convective weather for "Oriental Star" depression. J Appl Meteor Sci, 2017, 28(6): 666-677. doi: 10.11898/1001-7313.20170603
[15]	Huang L P, Chen D H, Deng L T, et al. Main technical improvements of GRAPES_Meso V4.0 and verification. J Appl Meteor Sci, 2017, 28(1): 25-37. doi: 10.11898/1001-7313.20170103
[16]	Chen H M, Yuan W H, Li J, et al. A possible cause for different diurnal variations of warm season rainfall as shown in station observations and TRMM 3B42 data over the southeastern Tibetan Plateau. Adv Atmos Sci, 2012, 29(1): 193-200.
[17]	Wang Z W, Liang X D, Fan S Y. Impact of spatial resolution on precipitation forecast score in numerical weather prediction models. Torrential Rain Disaster, 2016, 35(1): 10-16. https://www.cnki.com.cn/Article/CJFDTOTAL-HBQX201601002.htm
[18]	Roberts N M, Lean H W. Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Mon Wea Rev, 2008, 136(1): 78-97. http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=983EA56CC6B5BE7DF20EBAF6177C91EB?doi=10.1.1.656.5400&rep=rep1&type=pdf
[19]	Tang W Y, Zheng Y G, Zhang X W. FSS-based evaluation on convective weather forecasts in North China from high resolution models. J Appl Meteor Sci, 2018, 29(5): 513-523. doi: 10.11898/1001-7313.20180501
[20]	Christopher D, Barbara B, Randy B. Object-based verification of precipitation forecasts. Part Ⅰ: Methodology and application to mesoscale rain areas. Mon Wea Rev, 2006, 134: 1772-1784.
[21]	Christopher D, Barbara B, Randy B. Object-based verification of precipitation forecasts. Part Ⅱ: Application to convective rain systems. Mon Wea Rev, 2006, 134: 1785-1795.
[22]	Wernli H, Paulat M, Hagen M. SAL-A novel quality measure for the verification of quantitative precipitation forecasts. Mon Wea Rev, 2008, 136(11): 4470-4487.
[23]	Chen J, Liu C H, Chen F J, et al. A new verification method for heavy rainfall forecast based on predictability Ⅰ: Synthetic predictability index of heavy rainfall in China. Acta Meteor Sinica, 2019, 77(1): 15-27. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB201901002.htm
[24]	Chen F J, Chen J, Wei Q, et al. A new verification method for heavy rainfall forecast based on predictability Ⅱ: Verification method and test. Acta Meteor Sinica, 2019, 77(1): 28-42. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB201901003.htm
[25]	Chen F J, Chen J. The application experiment of a new score for precipitation verification based on the SEEPS principle. Adv Meteor Sci Tech, 2015, 5(5): 6-13. https://www.cnki.com.cn/Article/CJFDTOTAL-QXKZ201505006.htm
[26]	Yu R C, Li J, Chen H M, et al. Progress in studies of the precipitation diurnal variation over contiguous China. Acta Meteor Sinica, 2014, 72(5): 948-968. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB201405012.htm
[27]	Gan Y T, Chen H M, Li J. Evaluation of the performance of kilometer scale numerical operation forecast model for warm season precipitation forecasting in Taishan region. Acta Meteor Sinica, 2021, 79(5): 750-768. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB202105003.htm
[28]	Fan S Y, Chen M, Zhong J Q, et al. Performance tests and evaluations of Beijing local high-resolution rapid update cycle system. Torrential Rain Disaster, 2009, 28(2): 119-125. https://www.cnki.com.cn/Article/CJFDTOTAL-HBQX200902005.htm
[29]	Lu B, Sun J S, Zhong J Q, et al. Analysis of characteristic bias in diurnal precipitation variation forecasts and possible reasons in a regional forecast system over Beijing Area. Acta Meteor Sinica, 2017, 75(2): 248-259. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB201702005.htm
[30]	Lu B, Zhong J Q, Wang W, et al. Influence of near real-time green vegetation fraction data on numerical weather prediction by WRF over North China. J Meteor Res, 2021, 35(3): 505-520.
[31]	Wang Y H, Bica B. Precipitation extrapolation nowcasting in Beijing-Tianjin-Hebei under different weather backgrounds. J Appl Meteor Sci, 2022, 33(3): 270-281. doi: 10.11898/1001-7313.20220302
[32]	He H Z, Zhang F Q. Diurnal variations of warm-season precipitation over Northern China. Mon Wea Rev, 2010, 138(4): 1017-1025.
[33]	Wang Y. Evaluation of quantitative precipitation forecasting of multiple NWP models in summer of 2004. J Appl Meteor Sci, 2006, 17(3): 316-324. http://qikan.camscma.cn/article/id/20060357
[34]	Lu B, Wang W, Yang Y, et al. Updated soil map and soil hydrologic parameters for WRF and their influences over North China during the warm season. Acta Meteor Sinica, 2019, 77(6): 1028-1040. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB201906005.htm
[35]	Yang Y, Lu B, Wang W, et al. Impacts of cumulus parameterization schemes on the summertime precipitation forecast in China based on the WRF model. Acta Meteor Sinica, 2021, 79(4): 612-625. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB202104006.htm
[36]	Zhang X Y, Chen M, Sun J Z, et al. Improvement and application of the ground observation data assimilation scheme in WRF-DA. Acta Meteor Sinica, 2021, 79(1): 104-118. https://www.cnki.com.cn/Article/CJFDTOTAL-QXXB202101008.htm