Design and Implementation of High Speed Network Data Processing Framework Based on Domestic Sunway Processors
With the surge of network traffic in the era of big data,the traditional kernel-based network stack cannot fully utilize the high-speed NIC transceiver capability of 10 Gb or even 100 Gb due to the high kernel switch overhead of traditional kernel network stack.To reduce the software overhead,the open-source DPDK userspace network development kit is developed to support high-speed network ap-plication,which has been massively applied and deployed on x86 platforms.To meet the requirements of localization and national network security,we design and implement a DPDK-based IP packet parsing framework for the domestic Sunway processor platform,which make full use of DPDK's large-page memory,lock-free queue and other advance mechanisms and take advantage of the multi-core performance of the Sunway processor,which supports parsing of multiple user layer protocols based on TCP/IP stack,and has lightweight and scalable features.According to the experimental results on the real hardware platform,the performance of the proposed framework is about 10%higher than that of the existing mainstream software,which is a preliminary exploration for the application of the DPDK framework in domestic processors.