Application of the WAN Acceleration Technologies to FY-3 Satellite Data Transmission
-
摘要: 风云三号 (FY-3) 极轨气象卫星数据传输系统需通过广域网链路,将海量卫星观测数据从卫星接收站快速传送到资料处理中心。该文研究广域网加速技术,解决广域网链路中传输气象卫星海量观测数据延迟高、带宽利用低等难题。文中针对FY-3气象卫星观测数据传输量大、时效要求高的特点,分别分析了数据压缩、数据缓存和协议优化3种不同加速技术对卫星数据的传输优化效果,并根据分析结果提出了一种适用于气象卫星数据的广域网传输加速架构。该架构结合3种不同加速技术设计了TCP代理模块、数据段索引模块和HS-TCP传输模块以及相应算法分别实现了数据压缩与缓存和协议优化等功能。通过测试和实际运行表明:在该加速架构下卫星数据广域网传输速率提高了50%~243%。Abstract: FY-3 series is a new generation of polar-orbiting meteorological satellite which is much more powerful than FY-1 series. As the first research and development satellite of FY-3 series, FY-3A meteorological satellite carries 11 kinds of instruments with more than 90 observation and probing channels, and it has the capabilities of global sounding, global imaging of the earth's surfaces and natural color imagery with a higher spatial resolution of 250 m. The size of the raw data files for one pass of FY-3 meteorological satellite is almost 100 times as FY-1. There are 4 domestic ground stations set up in China, and they are located in Beijing, Guangzhou, Urumqi and Jiamusi respectively. These 4 ground stations are responsible for receiving the FY-3 satellite observation data and transferring them to the data processing center which is located inside the building of National Satellite Meteorological Center in Beijing. It is really a big challenge for the data transmission system of the FY-3 satellite to transfer the massive meteorological satellite observation data efficiently and timely from the ground stations to the data processing center.The WAN acceleration technique is studied to solve the problems such as high delay in transmission of massive satellite observation data and little bandwidth utilization during WAN link. To deal with the data transfer characteristics of FY-3 properly, massive observation data and high-timeliness requirement for instance, the transmission optimization effects of three different acceleration techniques, including data compression, cache and TCP protocol optimization on meteorological satellite data are analyzed respectively. According to the analysis results, a WAN data transmission acceleration architecture which is suitable to FY-3 satellite observation data transmission is illustrated and presented to break the bottleneck of data transmission through WAN. This architecture combines TCP proxy module, segment index module and HS-TCP transfer module by integrating three different acceleration techniques to realize the key functions such as data compression, cache and protocol optimization. Experimental and operational practices show that this WAN data transmission acceleration architecture results in impressive acceleration, and FY-3 satellite data transmission rate through the WAN is accelerated up to 50%—243%.
-
表 1 直接传输和加速传输需求和性能对比
Table 1 Comparisons of requirements and performance between direct transmission and optimized transmission
传输方式 链路带宽需求 应用复杂度需求 数据传输时效/min HRPT MPT DPT 广域网链路直接传输 98 Mbps 采用8~10个逻辑链路共同传输 5 5 20 广域网链路优化加速传输 65 Mbps 采用3个逻辑链路共同传输 1 4 20 -
[1] 杨军, 董超华, 卢乃锰, 等.中国新一代极轨气象卫星——风云三号.气象学报, 2009, 67(4):501-509. doi: 10.11676/qxxb2009.050 [2] 谷松岩, 王振占, 李靖, 等.风云三号A星微波湿度计主探测通道辐射特效.应用气象学报, 2010, 21(3): 335-342. doi: 10.11898/1001-7313.20100309 [3] 丁伟.广域网成为"云计算"发展的瓶颈所在.通讯世界, 2009(8):32-33. http://www.cnki.com.cn/Article/CJFDTOTAL-TXSJ200908018.htm [4] 赵立成, 关彤.网络编程实现气象卫星资料的传输.应用气象学报, 2003, 14(4):395-401. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20030449&flag=1 [5] 王建新, 彭娜.广域网加速技术研究综述.电信快报, 2009(5):11-14. http://www.cnki.com.cn/Article/CJFDTOTAL-DXKB200905006.htm [6] 黄晨晖.面向应用加速的两阶段数据压缩流程.电脑开发与应用, 2010(9):15-17. http://www.cnki.com.cn/Article/CJFDTOTAL-DNKF201009007.htm [7] Wirbel L. WAN optimizer also does app acceleration. Electronic Engineering Times, 2005(1381): 32-36. [8] [2010-8-6]. Jacobson V. RFC 1323, TCP Extensions for High Performance. http://datatracker.ietf.org/doc/rfc1323/. [9] [2010-8-6]. Floyd S. RFC 3742, Limited Slow-Start for TCP with Large Congestion Windows. http://datatracker.ietf.org/doc/rfc3742/. [10] [2010-8-6].Floyd S. RFC 3649, High Speed TCP for Large Congestion Windows. http://datatracker.ietf.org/doc/rfc3649/. [11] 梅松.一种新的采用TCP封装的IPSec广域网加速通信研究.计算机工程与科学, 2010(7):4-7. http://www.cnki.com.cn/Article/CJFDTOTAL-JSJK201007001.htm [12] Fowler D G. Application of Acceleration Technology to Military Sealift Command Afloat WAN Infrastructure//MILCOM 2006. Washington D C, United States, 2007: 1-7. [13] 彭伟文, 王建新, 彭娜.广域网中RPC应用加速网关的研究与实现.计算技术与自动化, 2009(4): 107-111. http://www.cnki.com.cn/Article/CJFDTOTAL-JSJH200904029.htm [14] Wirbel L. New wrinkle rolls in WAN acceleration. Electronic Engineering Times, 2005(1389): 36-42. https://www.researchgate.net/publication/296541636_New_wrinkle_rolls_in_WAN_acceleration [15] 董燕, 孙恩昌, 孙艳华, 等.基于傅里叶模型的最佳网络流量预测.计算机应用研究, 2010(4): 1419-1421. http://www.cnki.com.cn/Article/CJFDTOTAL-JSYJ201004058.htm [16] 朱爱军.风云三号气象卫星数据传输体制分析.应用气象学报, 2006, 17(4):494-501. doi: 10.11898/1001-7313.20060417 [17] 方翔, 王新.小波变换在气象卫星云图压缩中的应用.应用气象学报, 2010, 21(4):424-432. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20100405&flag=1 [18] 吴乐南, 范天锡, 王大昌, 等.气象卫星云图数据的高效无失真压缩.应用气象学报, 1996, 7(1):103-107. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=19960114&flag=1 [19] 李煜晖, 朱山风, 段上为, 译. 多媒体数字压缩原理与标准. 北京: 电子工业出版社, 2000.