Analysis of Job Requirements and Competence Tenure for Big Data Professionals within the New Engineering Context:Insights from Emerging Industries
The swift expansion of emerging industries has accelerated the evolution of new engineering disci-plines,leading to a significant surge in demand for big data professionals.This underscores the pressing need for an in-depth analysis of market demand and its developmental trajectory.Utilizing recruitment data for big data roles within emerging industries,this study employs text segmentation and statistical analysis to discern prevalent job positions across various professions.The LDA(Latent Dirichlet Allocation)topic model is then engaged to extract pivotal information from job postings,elucidating the specific demands of these talent roles.Subsequently,the TF-IDF(Term Frequency-Inverse Document Frequency)technique is applied to isolate key skill sets sought after for these positions,with a particular emphasis on competencies such as data analysis,SQL querying,and Python programming.Building upon these insights,social network analysis is conducted to examine the co-occurrence of job roles,industries,and skills.The findings indicate that certain skills,inclu-ding data analysis,BI(Business Intelligence)tool application,and Java programming,are frequently co-oc-current with various job positions.Moreover,there is an evident heightened demand in emerging industries for a diverse array of skill sets.The paper concludes with strategic recommendations for nurturing big data profes-sionals.These include enhancing the convergence of industry and academia,fortifying school-enterprise collaboration,and bolstering expertise in big data to furnish the intellectual underpinning for the sustainable growth and technological advancement of emerging industries.
new engineering disciplinesbig data professionalsjob requirementscompetence tenureemerging industries
NETL
NSTL
万方数据
