设为首页
加入收藏
Design of CMA S2S Data Archive Center and Key Technology
-
摘要: 中国气象局S2S（Sub-seasonal to Seasonal）数据归档中心建设是中国气象局承担世界气象组织（WMO）的世界天气研究计划（WWRP）和世界气候研究计划（WCRP）任务，由国家气象信息中心负责设计和实现。该文介绍了S2S数据归档中心建设中涉及的数据交换、数据检查及处理、数据归档存储及数据服务门户全流程系统设计和实现。针对各业务中心生产的S2S数据配置差异较大造成数据交换、同步较难这一问题，采用基于FTP（file transfer protocol）的数据推送和基于ECMWF（European Center for Medium-range Weather Forecasts）WebAPI主动数据下载相结合的方式，说明数据交换、同步方法和策略。由于S2S数据量巨大难以高效管理服务，已设计统一的数据组织形式和存储规则，实现根据数据检索条件解析获取数据存储位置，提供便捷的数据检索下载服务。自2015年11月15日中国气象局S2S数据门户系统对外开放，目前数据门户系统已有超过18个国家的300个用户注册并下载数据。Abstract: S2S, sub-seasonal to seasonal prediction project, is a WWRP/THORPEX-WCRP joint research project established to improve forecast skill and understanding on the sub-seasonal to seasonal time scale, and promote its uptake by operational centers and exploitation by the applications community. To achieve many of these goals, the establishment of an extensive data base of sub-seasonal (up to 60 days) forecasts and reforecasts (sometimes known as hindcasts) is advocated. Managing an extensive data base for the sub-seasonal time scale is a challenging task for the diverse characteristic of these forecasts (e.g., start dates, length of the forecasts, average periods, and updating frequency of forecasts).Open access to forecast data and user interface friendly data bases are important requirements for construction of S2S archiving data. CMA, one of two S2S data archive centers, is responsible for collecting S2S data from all data providers, performing basic quality check, archiving and storing data, and providing data service. The traditional FTP and a simple data downloading program based on ECMWF WebAPI is used to collecting data provided by all eleven S2S data centers. The data synchronization with another archive center of ECMWF is implemented by applying the combination strategies of common routine data transfer through FTP, ECMWF WebAPI based data download for missing reforecast data, and transferring missing real-time data copied from tapes directly by MARS system command. The file of compressed format TAR and GRIB2 is checked by executing command of tar and grib_get and its return value. A program based on the tigge_check command provided by GRIB_API is also developed to check the attribute of GRIB2 data, since all S2S data are saved as GRIB2 format. Through using GRIB_API command of grib_filter and designing a unified data form organized by a single center, a single date and a single meteorological parameter field, the unified S2S data are created to store in the online storage system which makes fast retrieval of data possible and open access. In the meantime, the unified form of S2S data file could be easily obtained their real storage addresses by their file names. The S2S data portal provides both free text and faceted search method to access forecast and reforecast data in the format of GRIB2 and NetCDF through online converting the data format.CMA S2S archive center is in operation since 15 November 2015. With the availability of data of all data providers, the construction of S2S archive center will be continued to improve the in-time of data integrity and data access methods.
-
Key words:
- S2S;
- ensemble forecast;
- hindcast;
- on the fly
-
图 1 S2S数据收集归档服务流程
Fig. 1 The flow of S2S project data collecting, archiving, and service
表 1 S2S数据生产中心及其模式运行系统配置
Table 1 Centers that provide data to the S2S project together with the configuration of their systems
模式 预报时长/d 分辨率 近实时集合预报 回算集合预报 成员 频次 类型 预报时段 成员 频次 BoM 0~60 T47L17 33 2次/周 固定 1981—2013年 33 6次/月 CMA 0~60 T106L40 4 1次/d 固定 1994—2014年 4 1次/d ECCC 0~35 0.6°×0.6°L40 21 1次/周 动态 1995—2014年 4 1次/周 ECMWF 0~46 T639-319L91 51 2次/周 动态 过去20年 11 2次/周 HMCR 0~63 1.1°×1.4°L28 20 1次/周 动态 1985—2010年 10 1次/周 ISAC 0~32 0.75°×0.56°L54 40 1次/周 固定 1981—2010年 1 6次/月 JMA 0~34 T319L60 25 2次/周 固定 1981—2010年 5 3次/月 KMA 0~60 N216L85 4 1次/d 动态 1996—2009年 3 4次/月 CNRM 0~61 T255L91 51 1次/月 固定 1993—2014年 15 2次/月 NCEP 0~44 T126L64 16 1次/d 固定 1999—2010年 4 1次/d UKMO 0~60 N216L85 4 1次/d 动态 1996—2009年 3 4次/月 
下载: 导出CSV
表 2 S2S数据收集情况
Table 2 Status of S2S data acquisition
中心 实时预报 回算预报 每次数据量/GB 产生频次 接收起始日期 数据量/GB 每次数据量/GB 产生频次 预报时长/a 接收起始日期 接收数据量/GB CMA 1.2 1次/d 2015-01-01 718 1.2 1次/d 21 01-01 9198 ECMWF 8 2次/周 2015-03-05 1236 16 2次/周 20 04-23 12 2次/周 2015-05-14 50 2次/周 05-25 4575 NCEP 2.7 1次/d 2015-04-29 954 7.8 1次/d 12 03-31 2800 JMA 3.3 2次/周 2015-06-09 224 3次/月 32 01-01 900 BoM 3.6 2次/周 2015-04-19 362 2.75 6次/月 33 01-01 7400 CNRM 22 1次/月 2015-04-01 405 2次/月 22 01-01 3300 KMA 0.89 1次/d 2016-01-05 106 9.66 4次/月 14 01-01 114 HMCR 5.3 1次/周 2015-11-25 151 1次/周 26 ECCC 2.7 1次/周 2016-07-07 16 10.2 1次/周 20 07-07 60 UKMO 1.6 1次/d 2015-12-01 316 27.6 4次/月 23 03-01 687 ISAC 6.6 1次/周 2015-11-23 241 1次/5 d 32
下载: 导出CSV
表 3 各中心S2S数据年增量
Table 3 Increasing volume of S2S data by year
中心 实时预报/GB 回算预报/GB CMA 445 ECMWF 1248 5200 NCEP 986 JMA 343 BoM 374 CNRM 264 KMA 325 HMCR 276 ECCC 140 UKMO 584 ISAC 343
下载: 导出CSV
-
[1] Hoskins B.The potential for skill across the range of the seamless weather-climate prediction problem:A stimulus for our science.Quart J Roy Meteor Soc, 2013, 139:573-584. doi: 10.1002/qj.v139.672 [2] Vitart F, Ardilouze C, Bonet A, et al.The sub-seasonal to seasonal prediction (S2S) project database.Bull Amer Meteor Soc, 2017, 98:163-173, DOI: 10.1175/BAMS-D-16-0017.1. [3] 齐艳军, 容新尧.次季节-季节预测的应用前景与展望.气象科技进展, 2014, 4(3):74-75. http://www.cnki.com.cn/Article/CJFDTOTAL-QXKZ201403021.htm [4] 任宏利, 吴捷, 赵崇博, 等.MJO预报研究进展.应用气象学报, 2015, 26(6):658-668. doi: 10.11898/1001-7313.20150602 [5] Bougeault P, Toth Z, Bishop C, et al.The THORPEX interactive grand global ensemble (TIGGE).Bull Amer Met Soc, 2010, 91:1059-1072. doi: 10.1175/2010BAMS2853.1 [6] Richard S, Masayuki K, Piers B, et al.The TIGGE project and its achievements.Bull Amer Meteor Soc, 2016, 1, DOI: 10.1175/BAMS-D-13-00191.1. [7] 卞晓丰.交互式全球集合预报产品数据管理应用研究.科研信息化技术与应用, 2013, 4(6):64-70. http://www.cnki.com.cn/Article/CJFDTOTAL-KYXH201306008.htm [8] 沈文海, 赵芳, 高华云, 等.国家级气象资料存储检索系统的建立.应用气象学报, 2004, 15(6):727-736. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20040690&flag=1 [9] 李集明, 沈文海, 王国复.气象信息共享平台及其关键技术研究.应用气象学报, 2006, 17(5):621-628. doi: 10.11898/1001-7313.20060505 [10] 高峰, 王国复, 喻雯, 等.气象数据文件快速下载服务系统的设计与实现.应用气象学报, 2010, 21(2):243-249. doi: 10.11898/1001-7313.20100215 [11] 马渝勇, 徐晓莉, 宋智, 等.省级气象信息共享系统的设计与实现.应用气象学报, 2011, 22(4):505-512. doi: 10.11898/1001-7313.20110414 [12] 李永生, 曾沁, 徐美红, 等.基于Hadoop的数值预报产品服务平台设计与实现.应用气象学报, 2015, 26(1):122-128. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20150113&flag=1 [13] 熊安元, 赵芳, 王颖, 等.全国综合气象信息共享系统的设计与实现.应用气象学报, 2015, 26(4):500-512. doi: 10.11898/1001-7313.20150412 [14] WMO.Guide to the WMO Table Driven Code Form Used for the Representation and Exchange of Regularly Spaced Data In Binary Form:FM 92 GRIB Edition 2.[2016-07-15].http://www.wmo.int/pages/prog/www/WMOCodes/Guides/GRIB/GRIB2_062006.pdf. [15] Access MARS-ECMWF WebAPI.[2016-07-15].https://software.ecmwf.int/wiki/display/WEBAPI/Access+MARS. [16] 肖华东, 孙婧, 张玺, 等.MARS软件在数值预报模式产品数据管理中的应用.应用气象学报, 2016, 26(2):247-256. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20150213&flag=1 [17] ECMWF Operations Department.MARS Use Guide.[2016-07-15].http://www.ecmwf.int/publication/manuals/mars/guide/userguide.pdf. [18] ECMWF S2S Home.[2016-07-15].https://software.ecmwf.int/wiki/display/S2S/Project. -
图(3) / 表(3)
计量
- 摘要浏览量: 4544
- HTML全文浏览量: 1317
- PDF下载量: 378
- 被引次数: 0
