Wei Lan, Lin Manyun, Zhao Xiangang, et al. Application of the WAN acceleration technologies to FY-3 satellite data transmission. J Appl Meteor Sci, 2012, 23(1): 121-128.
Citation: Wei Lan, Lin Manyun, Zhao Xiangang, et al. Application of the WAN acceleration technologies to FY-3 satellite data transmission. J Appl Meteor Sci, 2012, 23(1): 121-128.

Application of the WAN Acceleration Technologies to FY-3 Satellite Data Transmission

  • Received Date: 2011-05-03
  • Rev Recd Date: 2011-10-13
  • Publish Date: 2012-02-29
  • FY-3 series is a new generation of polar-orbiting meteorological satellite which is much more powerful than FY-1 series. As the first research and development satellite of FY-3 series, FY-3A meteorological satellite carries 11 kinds of instruments with more than 90 observation and probing channels, and it has the capabilities of global sounding, global imaging of the earth's surfaces and natural color imagery with a higher spatial resolution of 250 m. The size of the raw data files for one pass of FY-3 meteorological satellite is almost 100 times as FY-1. There are 4 domestic ground stations set up in China, and they are located in Beijing, Guangzhou, Urumqi and Jiamusi respectively. These 4 ground stations are responsible for receiving the FY-3 satellite observation data and transferring them to the data processing center which is located inside the building of National Satellite Meteorological Center in Beijing. It is really a big challenge for the data transmission system of the FY-3 satellite to transfer the massive meteorological satellite observation data efficiently and timely from the ground stations to the data processing center.The WAN acceleration technique is studied to solve the problems such as high delay in transmission of massive satellite observation data and little bandwidth utilization during WAN link. To deal with the data transfer characteristics of FY-3 properly, massive observation data and high-timeliness requirement for instance, the transmission optimization effects of three different acceleration techniques, including data compression, cache and TCP protocol optimization on meteorological satellite data are analyzed respectively. According to the analysis results, a WAN data transmission acceleration architecture which is suitable to FY-3 satellite observation data transmission is illustrated and presented to break the bottleneck of data transmission through WAN. This architecture combines TCP proxy module, segment index module and HS-TCP transfer module by integrating three different acceleration techniques to realize the key functions such as data compression, cache and protocol optimization. Experimental and operational practices show that this WAN data transmission acceleration architecture results in impressive acceleration, and FY-3 satellite data transmission rate through the WAN is accelerated up to 50%—243%.
  • Fig. 1  The WAN acceleration architecture of meteorological satellite data transmission

    Fig. 2  Segment index module

    Fig. 3  Comparison of three categories of data transmission acceleration effects under different bandwidths

    Fig. 4  Comparison of the data transfer rate through each optimization method

    Fig. 5  The influences of bandwidth expansion on data transfer rate

    Fig. 6  The data transmission system of FY-3

    Fig. 7  Optimized WAN throughput

    Fig. 8  Optimized LAN throughput

    Table  1  Comparisons of requirements and performance between direct transmission and optimized transmission

    传输方式 链路带宽需求 应用复杂度需求 数据传输时效/min
    HRPT MPT DPT
    广域网链路直接传输 98 Mbps 采用8~10个逻辑链路共同传输 5 5 20
    广域网链路优化加速传输 65 Mbps 采用3个逻辑链路共同传输 1 4 20
    DownLoad: Download CSV
  • [1]
    杨军, 董超华, 卢乃锰, 等.中国新一代极轨气象卫星——风云三号.气象学报, 2009, 67(4):501-509. doi:  10.11676/qxxb2009.050
    [2]
    谷松岩, 王振占, 李靖, 等.风云三号A星微波湿度计主探测通道辐射特效.应用气象学报, 2010, 21(3): 335-342. doi:  10.11898/1001-7313.20100309
    [3]
    丁伟.广域网成为"云计算"发展的瓶颈所在.通讯世界, 2009(8):32-33. http://www.cnki.com.cn/Article/CJFDTOTAL-TXSJ200908018.htm
    [4]
    赵立成, 关彤.网络编程实现气象卫星资料的传输.应用气象学报, 2003, 14(4):395-401. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20030449&flag=1
    [5]
    王建新, 彭娜.广域网加速技术研究综述.电信快报, 2009(5):11-14. http://www.cnki.com.cn/Article/CJFDTOTAL-DXKB200905006.htm
    [6]
    黄晨晖.面向应用加速的两阶段数据压缩流程.电脑开发与应用, 2010(9):15-17. http://www.cnki.com.cn/Article/CJFDTOTAL-DNKF201009007.htm
    [7]
    Wirbel L. WAN optimizer also does app acceleration. Electronic Engineering Times, 2005(1381): 32-36.
    [8]
    [2010-8-6]. Jacobson V. RFC 1323, TCP Extensions for High Performance. http://datatracker.ietf.org/doc/rfc1323/.
    [9]
    [2010-8-6]. Floyd S. RFC 3742, Limited Slow-Start for TCP with Large Congestion Windows. http://datatracker.ietf.org/doc/rfc3742/.
    [10]
    [2010-8-6].Floyd S. RFC 3649, High Speed TCP for Large Congestion Windows. http://datatracker.ietf.org/doc/rfc3649/.
    [11]
    梅松.一种新的采用TCP封装的IPSec广域网加速通信研究.计算机工程与科学, 2010(7):4-7. http://www.cnki.com.cn/Article/CJFDTOTAL-JSJK201007001.htm
    [12]
    Fowler D G. Application of Acceleration Technology to Military Sealift Command Afloat WAN Infrastructure//MILCOM 2006. Washington D C, United States, 2007: 1-7.
    [13]
    彭伟文, 王建新, 彭娜.广域网中RPC应用加速网关的研究与实现.计算技术与自动化, 2009(4): 107-111. http://www.cnki.com.cn/Article/CJFDTOTAL-JSJH200904029.htm
    [14]
    Wirbel L. New wrinkle rolls in WAN acceleration. Electronic Engineering Times, 2005(1389): 36-42. https://www.researchgate.net/publication/296541636_New_wrinkle_rolls_in_WAN_acceleration
    [15]
    董燕, 孙恩昌, 孙艳华, 等.基于傅里叶模型的最佳网络流量预测.计算机应用研究, 2010(4): 1419-1421. http://www.cnki.com.cn/Article/CJFDTOTAL-JSYJ201004058.htm
    [16]
    朱爱军.风云三号气象卫星数据传输体制分析.应用气象学报, 2006, 17(4):494-501. doi:  10.11898/1001-7313.20060417
    [17]
    方翔, 王新.小波变换在气象卫星云图压缩中的应用.应用气象学报, 2010, 21(4):424-432. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=20100405&flag=1
    [18]
    吴乐南, 范天锡, 王大昌, 等.气象卫星云图数据的高效无失真压缩.应用气象学报, 1996, 7(1):103-107. http://qikan.camscma.cn/jams/ch/reader/view_abstract.aspx?file_no=19960114&flag=1
    [19]
    李煜晖, 朱山风, 段上为, 译. 多媒体数字压缩原理与标准. 北京: 电子工业出版社, 2000.
  • 加载中
  • -->

Catalog

    Figures(8)  / Tables(1)

    Article views (3517) PDF downloads(1983) Cited by()
    • Received : 2011-05-03
    • Accepted : 2011-10-13
    • Published : 2012-02-29

    /

    DownLoad:  Full-Size Img  PowerPoint