In the current job market,it is more and more challenging to find jobs related to big data.In order to deal with this problem,a Python-based job website crawling system is desgined.Python is used as the main programming language,and the Selenium framework is adopted for crawling.The crawling system designed can crawl the recruitment information of the 51 job career website in a manner of orientation according to the keywords and save the information locally in CSV format,so as to further analyze,process and visualize the crawled data.By analyzing the crawled post information,the current job market situation,working years and popular skill requirements can be understood,and it is also valuable for job seekers and recruiters alike,helping them make more informed decisions and succeed in a competitive job market.
维普
万方数据