设为首页
加入收藏
Design and Implementation of Special Data Service System for Climate Monitoring
-
摘要: 为了满足气候监测业务日益突出的个性化资料需求，设计和开发了气候监测业务专题数据服务系统。在分析用户资料需求的基础上，重点介绍了系统的设计思路和实现技术。该系统由1个专题数据支撑库和4个功能模块组成，包括资料更新发现、专题数据集制作、数据服务和任务调度，其中，专题数据集制作方法和3种任务调度模式是系统设计的核心。系统实现采用SSH (Struts Spring Hibernate) 框架，按数据访问层、业务逻辑层和交互表现层进行分层实现；同时，结合DWR (Direct Web Remoting) 技术实现了同步异步交互方式，使用灵活的配置管理加强系统的可扩展性。系统投入运行后，已制作出13个专题数据集，提供了良好的数据服务。Abstract: Currently, the national meteorological data service systems have basically met the demand of operational systems and scientific research. But, as the deep development of the meteorological operations, it's urgent to develop special data services to meet the specific requirements. For instance, the special data service system for climate monitoring is designed and implemented.The system is made up of one supporting database and four modules: Data-update monitoring, special dataset producing, data serving and task scheduling modules. The supporting database is in charge of fetching meteorological data from basic databases and storing information for the system operation. The data-update monitoring module detects the status of data updating with the strategies designed for each dataset, and triggers the special dataset producing module. The special dataset producing module produces datasets with scientific and practical methods, including analyzing, filtering, arranging, making statistics and standardizing of original data. The data serving module provides two ways for service: Data pushing and downloading via FTP. The task scheduling module dispatches the other modules according to business rules, realizes a complete operational flow perfectly by implementing three scheduling modes: Real-time scheduling, exception handling, and manual calling.The system is developed based on SSH architecture, DWR technology and configuration management. SSH involves three open-source products: Struts, Spring and Hibernate, which separately implement three layers of the system: Web representation layer, business logic layer and data access layer. The web representation layer provides a web platform for data manager submitting manual calling of producing datasets with the method of synchronous and asynchronous interaction, realized by using Struts and DWR. The business logical layer is based on Spring product, which implements all of the four operational modules, and implements the calling interface for the web representation layer. The data access layer provides data fetching interface by creating views of data in basic databases and encapsulating data access objects with Hibernate. In addition, the skills of configuration management, including the business configuring and the third-party software configuring, enhance the flexibility and scalability of the system.The system is a successful attempt on special meteorological data service. After being put into operation, it produces thirteen real-time updating special datasets, and serves climate monitoring systems very well. The specific dataset producing method, complete strategy of task scheduling, management skills of configuration, and the technical framework of the system provide a widely reference and promotional value for other special meteorological data service systems' design and implementation.
-
图 1 气候监测业务专题数据服务系统结构
Fig. 1 Framework of Special Data Service System for Climate Monitoring
图 3 气候监测业务专题数据服务系统技术架构
Fig. 3 The technical architecture of Special Data Service System for Climate Monitoring
表 1 专题数据集参数配置表
Table 1 The parameters of special dataset processing
参数种类 参数名称 参数取值示例 专题数据集信息 数据集代码 SURF_CLI_CHN_SNO_DAY 数据集名称 中国地面气候资料日值积雪数据集 存储子目录 SURF_CLI_CHN_SNO_DAY/YYYY 数据文件名称 SURF_CLI_CHN_SNO_DAY-YYYYMMDD.TXT 数据集每个文件的时间范围及单位 1 d 源数据集信息 源数据集代码 SURF_CLI_CHN_MUL_DAY 源数据集每次的更新量及单位 1个月 源数据集更新的滞后时间及单位 3个月 源数据集更新检查首次启动的时间模式 YYYYMM12HHMISS 源数据集更新检查的间隔时间及单位 1 d 源数据集更新检查的最多次数 15 
下载: 导出CSV
-
[1] 高峰, 王国复, 喻雯, 等.气象数据文件快速下载服务系统的设计与实现.应用气象学报, 2010, 21(2):243-249. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20100215&flag=1 [2] 王国复, 李集明, 邓莉, 等.中国气象科学数据共享服务网总体设计.应用气象学报, 2004, 15(增刊):10-16. http://www.cnki.com.cn/Article/CJFDTotal-YYQX2004S1002.htm [3] 李集明.基于Internet面向社会公益性共享的气象科学数据存储检索策略研究.气象科技, 2007, 35(4):590-592. http://www.cnki.com.cn/Article/CJFDTOTAL-QXKJ200704030.htm [4] 李集明, 沈文海, 王国复.气象信息共享平台及其关键技术研究.应用气象学报, 2006, 17(5):621-628. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=200605105&flag=1 [5] 李集明, 王国复.气象数据库系统总体设计综述.气象科技, 2007, 35(增刊):1-5. http://www.cnki.com.cn/Article/CJFDTOTAL-QXKJ2007S1002.htm [6] 沈文海, 赵芳, 高华云, 等.国家级气象资料存储检索系统的建立.应用气象学报, 2004, 15(6):727-736. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20040690&flag=1 [7] 李刚.轻量级J2EE企业应用实战——Struts+Spring+Hibernate整合开发.北京:电子工业出版社, 2007. http://www.cnki.com.cn/Article/CJFDTOTAL-SYQY201603027.htm [8] Zammetti F. Practical DWR 2 Projects. New York: Springer. 2008. [9] 刘绿柳, 孙林海, 廖要明, 等.基于DERF的SD方法预测月降水和极端降水日数.应用气象学报, 2011, 22(1):77-85. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20110108&flag=1 [10] 中国气象局.地面气象观测规范.北京:气象出版社, 2003. http://www.cnki.com.cn/Article/CJFDTOTAL-SYQY201603027.htm [11] 国家气象中心. 全国地面气候资料 (1961—1990) 统计方法. 1990. [12] 中国气象局. 地面气候资料30年整编常规项目及其统计方法. 2004. [13] Crane D, Pascarello E, James D. Ajax in Action. New York: Manning Publications, 2005. [14] Brown D, Davis C M, Stanlick S. Struts 2 in Action. New York: Manning Publications, 2008. [15] Walls C, Breidenbach R. Spring in Action. New York: Manning Publications, 2008. [16] Bauer C, King G. Hibernate in Action. California: O'reilly & Associates, Inc, 2005. [17] Broemmer D. J2EE Best Practices: Java Design Patterns, Automation, and Performance. New Jersey: John Wiley & Sons Inc, 2002. [18] Chopra V, Eaves J, Jones R, et al. Beginning JavaServer Pages. New Jersey: John Wiley & Sons Inc, 2005. [19] Buschmann F, Mcunier R, Rohnert H, et al. Pattern-oriented Software Architecture: A System of Patterns. New Jersey: John Wiley & Sons Inc, 1996. [20] Walmsley P. Definitive Xml Schema. New Jersey: Prentice Hall, 2005. [21] Abbey M, Corey M, Abramson I. Oracle9i: A Beginner's Guide. New Jersey: McGraw-Hill, 2002. [22] Apache FTPServer. [2011-02-18].http://mina.apache.org/FTPserver/. [23] Cavaness C. Quartz Job Scheduling Framework: Building Open Source Enterprise Applications. New Jersey: Prentice Hall, 2005. -
图(3) / 表(1)
计量
- 摘要浏览量: 2851
- HTML全文浏览量: 1009
- PDF下载量: 1253
- 被引次数: 0
