Knowledge and skill sets for big data professions : analysis of recruitment information based on the latent dirichlet allocation model

Universities, enterprises, and students are the key subjects in the talent training system of Big Data. This study used text mining, interviews, questionnaires, and other methods to analyze the characteristics and deficiencies of Chinese universities in the training of Big Data talents, the requirements of enterprises on the professional quality of big data talents, and the cognition of students on the ability of big data talents. Furthermore, this study used the theory of plan-action-inspection-action cycle to evaluate the talent cultivation and quality management system of Big Data in China. The results showed that employees with rich professional background and proficiency in multiple programming languages are more favored by enterprises in recruitment. From the perspective of students, 83% of students hope that universities will implement the multi-disciplinary training model. From the perspective of talent training, more Chinese universities should open up the mode of interdisciplinary talent training. The results, based on pair-to-body comparisons, showed that students and businesses differ in skills. Secondly, most of the graduates think that the training of talents in universities needs to be improved. Furthermore, the training system of most universities is not suitable for the versatile talents that today’s enterprises need.