分布式气象元数据同步系统的探索研究
Distributed Synchronization System of Meteorological Metadata: An Exploratory Development
-
摘要: WMO对未来信息系统提出了包括提供在线元数据、数据目录服务和提高元数据定义、收集、归档和交换的标准化水平在内的总体需求,正在建设的“新一代天气雷达信息共享平台”也对解决气象元数据在气象宽带网环境下的全网同步问题提出了现实要求。该文首先从现有气象元数据标准着手阐述同步系统所承载主体——气象元数据在数据发现、数据应用及服务、数据展示和信息冗余度方面的不足,提出相应的改进措施,并对同步系统的数据一致性模型以及OAI PMH元数据同步协议等同步机制进行研究,分析FIFO、单调读和单调写等几种典型一致性模型的特点和适用范围以及OAI PMH协议的可行性,给出同步系统的总体设计思路,针对由总体设计思路形成的原型系统进行试验。分析试验结果数据表明:气象元数据全网同步系统原型基本满足符合WMO核心元数据标准的气象元数据在广域网分布环境下的多节点同步交换需求。Abstract: The current meteorological information system will be unable to meet the telecommunicating, storing and computing requirements of enormous weather radar data in the near future. Therefore, the New Generation Weather Radar Information Sharing Platform (WRISP) has been planned, the main target of which is sharing the meteorological data countrywide. The project should begin with sharing and exchanging the meteorological metadata, then it's imperative to set up a meteorological metadata synchronization system across WAN. A research is conducted on some related conceptions such as meteorological metadata, synchronization protocol of metadata and data consistency, etc. Meteorological metadata, as the subject carried on the synchronization system is interpreted including its characters and defects, then methods are provided to improve it. Mechanism of metadata synchronization, models of data consistency, and metadata harvesting protocols such as OAI PMH are analyzed and feasibility studies are carried out. The general design thought of the synchronization system, which consists of topological design, conceptive model, data flow and technical architecture is proposed. Two performance tests are taken on the test prototype, and the obtained data is evaluated and leads to a preliminary conclusion. The meteorological metadata synchronization system on the meteorological dedicated WAN described in the prototype is a distributed data exchange platform. It's able to synchronize and exchange the metadata conformed to the WMO Core Metadata Profile among multiple nodes under the distributed WAN environment, and ensures the FIFO and monotonic write consistency as well. The prototype may help to promote the research on WIS and build a cornerstone of WRISP which facilitate the sharing of the meteorological data nationwide.
-
Key words:
- meteorological metadata;
- synchronization;
- OAI PMH;
- WIS
-
表 1 OAI-PMH协议动词
Table 1 The protocol verbs of OAI-PMH
-
[1] WMO Informati on System.http:∥www.wmo.int/pages/prog/www/WIS-Web/home.html. [2] 国家气象信息中心. 新一代天气雷达信息共享平台建设可行性研究报告. 北京: 中国气象局, 2006 : 7-32. [3] 李集明, 沈文海, 王国复.气象信息共享平台及其关键技术研究.应用气象学报, 2006, 17(5):621-628. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=200605105&flag=1 [4] 王国复, 徐枫, 吴增祥.气象元数据标准与信息发布技术研究.应用气象学报, 2005, 16(1):114-121. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20050115&flag=1 [5] Foreman S J.WMO Core Prof ile of the ISO 19115 Met adat aSt andard.C BS, Teco-WIS, 2006. [6] 崔伟, 汪诗林.分布式系统中数据同步机制的研究与实现.计算机工程与设计, 2007, 28(10):2259-2261. http://www.cnki.com.cn/Article/CJFDTOTAL-SJSJ200710004.htm [7] Liu M L.分布式计算原理与应用 (影印版).北京:清华大学出版社, 2004 :361-401. [8] Andrew S Tanenbaum, Maarten Van Steen. 分布式系统: 原理与范型. 杨剑峰, 常晓波, 李敏, 译. 北京: 清华大学出版社, 2002 : 229-254. [9] Open Archives Initiative.http:∥www.openarchives.org/. [10] 陈红亮, 程文青, 吴砥.基于Web服务的数据同步机制的研究与应用.计算机技术与发展, 2006, 16(9):160-162. http://www.cnki.com.cn/Article/CJFDTOTAL-WJFZ200609054.htm [11] 陈敏. 基于MDC数据网格信息服务系统元数据管理的研究. 武汉: 武汉理工大学, 2006. [12] 宋江旺. 基于元数据的下一代网络环境自适应业务提供技术研究. 南京: 南京邮电大学, 2006. [13] 郑志蕴, 徐玮, 宋瀚涛, 等.网格环境下基于OAI的数字图书馆互操作机制.计算机工程, 2006, 32(10):37-39. http://www.cnki.com.cn/Article/CJFDTOTAL-JSJC200610012.htm [14] Van de Sompel H, Nelson M L, Lagoze C, et al.Resource Harvesting within the OAI-PMH. Framework.D-Lib Magaz ine, 2004, 10(12), doi:10.1045/december2004-vandesompel. [15] 袁丽莉. 分布式异构数据融合技术及其在旅游中的应用. 杭州: 浙江大学, 2006. [16] SIMDAT Meteorology Activity.http:∥www.ecmwf.int/services/grid/simdat/. [17] Eric Newcomer, Greg Lomow.Understanding SOA with web Services, New Jersey:Addison Wesley Professional, 2005. [18] Eric Pulier, Hugh Taylor, Understanding Enterprise SOA, Connectieut:Manning Publications Co, 2006 :58-158.