He Wenchun, Gao Feng, Xu Yan, et al. Design and implementation of special data service system for climate monitoring. J Appl Meteor Sci, 2012, 23(5): 624-630.
Citation: He Wenchun, Gao Feng, Xu Yan, et al. Design and implementation of special data service system for climate monitoring. J Appl Meteor Sci, 2012, 23(5): 624-630.

Design and Implementation of Special Data Service System for Climate Monitoring

  • Received Date: 2011-09-26
  • Rev Recd Date: 2012-04-16
  • Publish Date: 2012-10-31
  • Currently, the national meteorological data service systems have basically met the demand of operational systems and scientific research. But, as the deep development of the meteorological operations, it's urgent to develop special data services to meet the specific requirements. For instance, the special data service system for climate monitoring is designed and implemented.The system is made up of one supporting database and four modules: Data-update monitoring, special dataset producing, data serving and task scheduling modules. The supporting database is in charge of fetching meteorological data from basic databases and storing information for the system operation. The data-update monitoring module detects the status of data updating with the strategies designed for each dataset, and triggers the special dataset producing module. The special dataset producing module produces datasets with scientific and practical methods, including analyzing, filtering, arranging, making statistics and standardizing of original data. The data serving module provides two ways for service: Data pushing and downloading via FTP. The task scheduling module dispatches the other modules according to business rules, realizes a complete operational flow perfectly by implementing three scheduling modes: Real-time scheduling, exception handling, and manual calling.The system is developed based on SSH architecture, DWR technology and configuration management. SSH involves three open-source products: Struts, Spring and Hibernate, which separately implement three layers of the system: Web representation layer, business logic layer and data access layer. The web representation layer provides a web platform for data manager submitting manual calling of producing datasets with the method of synchronous and asynchronous interaction, realized by using Struts and DWR. The business logical layer is based on Spring product, which implements all of the four operational modules, and implements the calling interface for the web representation layer. The data access layer provides data fetching interface by creating views of data in basic databases and encapsulating data access objects with Hibernate. In addition, the skills of configuration management, including the business configuring and the third-party software configuring, enhance the flexibility and scalability of the system.The system is a successful attempt on special meteorological data service. After being put into operation, it produces thirteen real-time updating special datasets, and serves climate monitoring systems very well. The specific dataset producing method, complete strategy of task scheduling, management skills of configuration, and the technical framework of the system provide a widely reference and promotional value for other special meteorological data service systems' design and implementation.
  • Fig. 1  Framework of Special Data Service System for Climate Monitoring

    Fig. 2  Job scheduling flow

    Fig. 3  The technical architecture of Special Data Service System for Climate Monitoring

    Table  1  The parameters of special dataset processing

    参数种类 参数名称 参数取值示例
    专题数据集信息 数据集代码 SURF_CLI_CHN_SNO_DAY
    数据集名称 中国地面气候资料日值积雪数据集
    存储子目录 SURF_CLI_CHN_SNO_DAY/YYYY
    数据文件名称 SURF_CLI_CHN_SNO_DAY-YYYYMMDD.TXT
    数据集每个文件的时间范围及单位 1 d
    源数据集信息 源数据集代码 SURF_CLI_CHN_MUL_DAY
    源数据集每次的更新量及单位 1个月
    源数据集更新的滞后时间及单位 3个月
    源数据集更新检查首次启动的时间模式 YYYYMM12HHMISS
    源数据集更新检查的间隔时间及单位 1 d
    源数据集更新检查的最多次数 15
    DownLoad: Download CSV
  • [1]
    高峰, 王国复, 喻雯, 等.气象数据文件快速下载服务系统的设计与实现.应用气象学报, 2010, 21(2):243-249. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20100215&flag=1
    [2]
    王国复, 李集明, 邓莉, 等.中国气象科学数据共享服务网总体设计.应用气象学报, 2004, 15(增刊):10-16. http://www.cnki.com.cn/Article/CJFDTotal-YYQX2004S1002.htm
    [3]
    李集明.基于Internet面向社会公益性共享的气象科学数据存储检索策略研究.气象科技, 2007, 35(4):590-592. http://www.cnki.com.cn/Article/CJFDTOTAL-QXKJ200704030.htm
    [4]
    李集明, 沈文海, 王国复.气象信息共享平台及其关键技术研究.应用气象学报, 2006, 17(5):621-628. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=200605105&flag=1
    [5]
    李集明, 王国复.气象数据库系统总体设计综述.气象科技, 2007, 35(增刊):1-5. http://www.cnki.com.cn/Article/CJFDTOTAL-QXKJ2007S1002.htm
    [6]
    沈文海, 赵芳, 高华云, 等.国家级气象资料存储检索系统的建立.应用气象学报, 2004, 15(6):727-736. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20040690&flag=1
    [7]
    李刚.轻量级J2EE企业应用实战——Struts+Spring+Hibernate整合开发.北京:电子工业出版社, 2007. http://www.cnki.com.cn/Article/CJFDTOTAL-SYQY201603027.htm
    [8]
    Zammetti F. Practical DWR 2 Projects. New York: Springer. 2008.
    [9]
    刘绿柳, 孙林海, 廖要明, 等.基于DERF的SD方法预测月降水和极端降水日数.应用气象学报, 2011, 22(1):77-85. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20110108&flag=1
    [10]
    中国气象局.地面气象观测规范.北京:气象出版社, 2003. http://www.cnki.com.cn/Article/CJFDTOTAL-SYQY201603027.htm
    [11]
    国家气象中心. 全国地面气候资料 (1961—1990) 统计方法. 1990.
    [12]
    中国气象局. 地面气候资料30年整编常规项目及其统计方法. 2004.
    [13]
    Crane D, Pascarello E, James D. Ajax in Action. New York: Manning Publications, 2005.
    [14]
    Brown D, Davis C M, Stanlick S. Struts 2 in Action. New York: Manning Publications, 2008.
    [15]
    Walls C, Breidenbach R. Spring in Action. New York: Manning Publications, 2008.
    [16]
    Bauer C, King G. Hibernate in Action. California: O'reilly & Associates, Inc, 2005.
    [17]
    Broemmer D. J2EE Best Practices: Java Design Patterns, Automation, and Performance. New Jersey: John Wiley & Sons Inc, 2002.
    [18]
    Chopra V, Eaves J, Jones R, et al. Beginning JavaServer Pages. New Jersey: John Wiley & Sons Inc, 2005.
    [19]
    Buschmann F, Mcunier R, Rohnert H, et al. Pattern-oriented Software Architecture: A System of Patterns. New Jersey: John Wiley & Sons Inc, 1996.
    [20]
    Walmsley P. Definitive Xml Schema. New Jersey: Prentice Hall, 2005.
    [21]
    Abbey M, Corey M, Abramson I. Oracle9i: A Beginner's Guide. New Jersey: McGraw-Hill, 2002.
    [22]
    Apache FTPServer. [2011-02-18].http://mina.apache.org/FTPserver/.
    [23]
    Cavaness C. Quartz Job Scheduling Framework: Building Open Source Enterprise Applications. New Jersey: Prentice Hall, 2005.
  • 加载中
  • -->

Catalog

    Figures(3)  / Tables(1)

    Article views (2862) PDF downloads(1253) Cited by()
    • Received : 2011-09-26
    • Accepted : 2012-04-16
    • Published : 2012-10-31

    /

    DownLoad:  Full-Size Img  PowerPoint