Application of PIGZ Tool Software in the Archiving and Long-term Preservation System of Provincial Electronic Meteorological Archives
To complete the construction of provincial electronic archives and long-term preservation systems and ensure the timely transmission and storage of meteorological data,this article is to solve the problem of too long time in compressing and packaging large files and provide a method of using the compression tool PIGZ.By comparing the characteristics of various compression and packaging tools,we use different tools in compressing and packaging the same file,and conduct experiments to compare the processing time of ZIP and PIGZ.Moreover,the common problems in the application of PIGZ are analyzed based on actual development.The experiment result proves that the compression and packaging time of PIGZ is much lower than that of ZIP.For the experimental file of 9.6G,the time of using the ZIP command is 4.4 times that of using PIGZ.However,the relationship between the compression speed and file size need further studying.From the application cases of electronic meteorological archive data packaging,we find that using the PIGZ tool can greatly shorten the time of data compression and packaging,especially for a large amount of minute-level meteorological data and it can reduce the network transmission waiting time and improve storage space usage.In addition,this article summarizes the problems and solutions encountered when using the PIGZ tool and accessing the CTS system,and also discusses the application of compression technology in meteorological data.These results could provide a reference for relevant technical personnel in electronic meteorological archive archiving and long-term preservation systems.
NETL
NSTL
万方数据
