分布式气象元数据同步系统的探索研究

Distributed Synchronization System of Meteorological Metadata: An Exploratory Development

  • 摘要: WMO对未来信息系统提出了包括提供在线元数据、数据目录服务和提高元数据定义、收集、归档和交换的标准化水平在内的总体需求,正在建设的“新一代天气雷达信息共享平台”也对解决气象元数据在气象宽带网环境下的全网同步问题提出了现实要求。该文首先从现有气象元数据标准着手阐述同步系统所承载主体——气象元数据在数据发现、数据应用及服务、数据展示和信息冗余度方面的不足,提出相应的改进措施,并对同步系统的数据一致性模型以及OAI PMH元数据同步协议等同步机制进行研究,分析FIFO、单调读和单调写等几种典型一致性模型的特点和适用范围以及OAI PMH协议的可行性,给出同步系统的总体设计思路,针对由总体设计思路形成的原型系统进行试验。分析试验结果数据表明:气象元数据全网同步系统原型基本满足符合WMO核心元数据标准的气象元数据在广域网分布环境下的多节点同步交换需求。

     

    Abstract: The current meteorological information system will be unable to meet the telecommunicating, storing and computing requirements of enormous weather radar data in the near future. Therefore, the New Generation Weather Radar Information Sharing Platform (WRISP) has been planned, the main target of which is sharing the meteorological data countrywide. The project should begin with sharing and exchanging the meteorological metadata, then it's imperative to set up a meteorological metadata synchronization system across WAN. A research is conducted on some related conceptions such as meteorological metadata, synchronization protocol of metadata and data consistency, etc. Meteorological metadata, as the subject carried on the synchronization system is interpreted including its characters and defects, then methods are provided to improve it. Mechanism of metadata synchronization, models of data consistency, and metadata harvesting protocols such as OAI PMH are analyzed and feasibility studies are carried out. The general design thought of the synchronization system, which consists of topological design, conceptive model, data flow and technical architecture is proposed. Two performance tests are taken on the test prototype, and the obtained data is evaluated and leads to a preliminary conclusion. The meteorological metadata synchronization system on the meteorological dedicated WAN described in the prototype is a distributed data exchange platform. It's able to synchronize and exchange the metadata conformed to the WMO Core Metadata Profile among multiple nodes under the distributed WAN environment, and ensures the FIFO and monotonic write consistency as well. The prototype may help to promote the research on WIS and build a cornerstone of WRISP which facilitate the sharing of the meteorological data nationwide.

     

/

返回文章
返回