Encyclopedia of Big Data Technologies

Living Edition
| Editors: Sherif Sakr, Albert Zomaya

Big Data Enables Labor Market Intelligence

  • Mario Mezzanzanica
  • Fabio MercorioEmail author
Living reference work entry
DOI: https://doi.org/10.1007/978-3-319-63962-8_276-1


Labor market intelligence (LMI)

is a term that is emerging in the whole labor market community, especially in the European Union. Although there is no unified definition of what LMI is, it can be referred to the design and use of AI algorithms and frameworks to analyze data related to labor market (aka labor market information) for supporting policy and decision-making (see, e.g., UK Commission for Employment and Skills 2015; UK Department for Education and Skills 2004).

Classification system or taxonomy

in the field of labor market refers to a taxonomy or a graph that organizes jobs into a clearly defined set of groups according to the tasks and duties undertaken in the job, as in the case of the International Standard Classification System ISCO (Organization IL 2017) and the US classification system O*NET (U.S. Department of Labor/Employment & Training Administration 2017). Recently, such systems have been improved to take into account also skills, competences, and...

This is a preview of subscription content, log in to check access.


  1. Anne Kennan M, Cole F, Willard P, Wilson C, Marion L (2006) Changing workplace demands: what job Ads tell us. In: Aslib proceedings, vol 58. Emerald group publishing limited, pp 179–196Google Scholar
  2. Bao F, Chen J (2014) Visual framework for big data in d3.js. In: 2014 IEEE workshop on electronics, computer and applications. IEEE, pp 47–50Google Scholar
  3. Batini C, Cappiello C, Francalanci C, Maurino A (2009) Methodologies for data quality assessment and improvement. ACM Comput Surv (CSUR) 41(3):16Google Scholar
  4. Bel N, Koster CH, Villegas M (2003) Cross-lingual text categorization. In: ECDL, vol 2769. Springer, pp 126–139Google Scholar
  5. Bergamaschi S, Carlini E, Ceci M, Furletti B, Giannotti F, Malerba D, Mezzanzanica M, Monreale A, Pasi G, Pedreschi D et al (2016) Big data research in Italy: a perspective. Engineering 2(2):163–170Google Scholar
  6. Biran O, Cotton C (2017) Explanation and justification in machine learning: a survey. In: IJCAI-17 workshop on explainable AI (XAI), p 8Google Scholar
  7. Boselli R, Cesarini M, Marrara S, Mercorio F, Mezzanzanica M, Pasi G, Viviani M (2017a) Wolmis: a labor market intelligence system for classifying web job vacancies. J Intell Inf Syst, 1–26. https://doi.org/10.1007/s10844-017-0488-x
  8. Boselli R, Cesarini M, Mercorio F, Mezzanzanica M (2017b) Using machine learning for labour market intelligence. In: The European conference on machine learning and principles and practice of knowledge discovery in databases – ECML-PKDDGoogle Scholar
  9. Bostock M, Ogievetsky V, Heer J (2011) D3 data-driven documents. IEEE Trans Vis Comput Graph 17(12):2301–2309Google Scholar
  10. CEDEFOP (2010) A new impetus for European cooperation in vocational education and training to support the Europe 2020 strategy (publicly available at https://goo.gl/Goluxo)
  11. CEDEFOP (2014) Real-time labour market information on skill requirements: feasibility study and working prototype. CEDEFOP reference number ao/rpa/vkvet-nsofro/real-time lmi/010/14. Contract notice 2014/s 141-252026 of 15 July 2014. https://goo.gl/qNjmrn
  12. CEDEFOP (2016) Real-time labour market information on skill requirements: setting up the EU system for online vacancy analysis ao/dsl/vkvet-grusso/real-time lmi 2/009/16. contract notice – 2016/s 134-240996 of 14 July 2016. https://goo.gl/5FZS3E
  13. DARPA (2017) Explainable artificial intelligence (XAI). Available at https://www.darpa.mil/program/explainable-artificial-intelligence
  14. European Commission (2016a) A new skills agenda for Europe. COM(2016) 381/2Google Scholar
  15. European Commission (2016b) Vacancies for ICT online repository 2 (victory 2): data collection. https://goo.gl/3D7qNQ
  16. European Commission (2017) ESCO: European skills, competences, qualifications and occupations. Available at https://ec.europa.eu/esco/portal/browse
  17. EuroStat (2016) The ESSnet big data project. Available at https://goo.gl/EF6GtU
  18. Fayyad U, Piatetsky-Shapiro G, Smyth P (1996) The KDD process for extracting useful knowledge from volumes of data. Commun ACM 39(11):27–34CrossRefGoogle Scholar
  19. Fox M, Long D, Magazzeni D (2017) Explainable planning. arXiv preprint arXiv:170910256Google Scholar
  20. Frey CB, Osborne MA (2017) The future of employment: how susceptible are jobs to computerisation? Technol Forecast Soc Chang 114(Supplement C):254–280. https://doi.org/10.1016/j.techfore.2016. 08.019, http://www.sciencedirect.com/science/article/ pii/S0040162516302244
  21. Gosling SD, Vazire S, Srivastava S, John OP (2004) Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires. Am Psychol 59(2):93CrossRefGoogle Scholar
  22. Hong W, Zheng S, Wang H (2013) Dynamic user profile-based job recommender system. In: Computer science & education (ICCSE). IEEEGoogle Scholar
  23. Kokkodis M, Papadimitriou P, Ipeirotis PG (2015) Hiring behavior models for online labor markets. In: Proceedings of the eighth ACM international conference on web search and data mining. ACM, pp 223–232Google Scholar
  24. Kureková L, Beblavỳ M, Haita C (2012) Qualifications or soft skills? Studying demand for low-skilled from job advertisements. Technical report, NEUJOBS working paperGoogle Scholar
  25. Li H, Ge Y, Zhu H, Xiong H, Zhao H (2017) Prospecting the career development of talents: a survival analysis perspective. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 917–925Google Scholar
  26. Little RJ, Rubin DB (2014) Statistical analysis with missing data. Wiley, New York, USAzbMATHGoogle Scholar
  27. Mang C (2012) Online job search and matching quality. Technical report, IFO working paperGoogle Scholar
  28. Mezzanzanica M, Boselli R, Cesarini M, Mercorio F (2015) A model-based evaluation of data quality activities in KDD. Inf Process Manag 51(2):144–166CrossRefGoogle Scholar
  29. Neculoiu P, Versteegh M, Rotaru M, Amsterdam TB (2016) Learning text similarity with siamese recurrent networks. ACL 2016, p 148Google Scholar
  30. Olsson JS, Oard DW, Hajič J (2005) Cross-language text classification. In: Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 645–646Google Scholar
  31. Organization IL (2017) ISCO: the international standard classification of occupations. Available at http://www.ilo.org/public/english/bureau/stat/isco/
  32. Prettenhofer P, Stein B (2011) Cross-lingual adaptation using structural correspondence learning. ACM Trans Intell Syst Tech (TIST) 3(1):13Google Scholar
  33. Redman TC (1998) The impact of poor data quality on the typical enterprise. Commun ACM 41(2):79–82CrossRefGoogle Scholar
  34. Ribeiro MT, Singh S, Guestrin C (2016) Why should I trust you?: explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1135–1144Google Scholar
  35. Sebastiani F (2002) Machine learning in automated text categorization. ACM compu surv (CSUR) 34(1):1–47CrossRefGoogle Scholar
  36. Shi L, Mihalcea R, Tian M (2010) Cross language text classification by model translation and semi-supervised learning. In: Proceedings of the 2010 conference on empirical methods in natural language processing. Association for Computational Linguistics, pp 1057–1067Google Scholar
  37. Singh A, Rose C, Visweswariah K, Chenthamarakshan V, Kambhatla N (2010) Prospect: a system for screening candidates for recruitment. In: Proceedings of the 19th ACM international conference on information and knowledge management. ACM, pp 659–668Google Scholar
  38. The European Network on Regional Labour Market Monitoring (2017) Web page (http://www.regionallabourmarketmonitoring.net)
  39. UK Commission for Employment and Skills (2015) The importance of LMI. Available at https://goo.gl/TtRwvS
  40. UK Department for Education and Skills (2004) LMI Matters!Google Scholar
  41. U.S. Department of Labor/Employment & Training Administration (2017) O*net: the occupational information network. Available at https://www.onetcenter.org
  42. Vassiliadis P, Simitsis A, Skiadopoulos S (2002) Conceptual modeling for ETL processes. In: Proceedings of the 5th ACM international workshop on data warehousing and OLAP. ACM, pp 14–21Google Scholar
  43. Verroios V, Papadimitriou P, Johari R, Garcia-Molina H (2015) Client clustering for hiring modeling in work marketplaces. In: Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 2187–2196Google Scholar
  44. Wade MR, Parent M (2002) Relationships between job skills and performance: a study of webmasters. J Manage Inf Syst 18(3):71–96CrossRefGoogle Scholar
  45. Wang RY, Strong DM (1996) Beyond accuracy: what data quality means to data consumers. J Manage Inf Syst 12(4):5–33CrossRefGoogle Scholar
  46. Yi X, Allan J, Croft WB (2007) Matching resumes and jobs based on relevance models. In: Proceedings of the 30th annual international ACM SIGIR conference on research and development in information retrieval. ACM, pp 809–810Google Scholar
  47. Zhu C, Zhu H, Xiong H, Ding P, Xie F (2016) Recruitment market trend analysis with sequential latent variable models. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 383–392Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  1. 1.Department of Statistics and Quantitative Methods – CRISP Research CentreUniversity of Milan BicoccaMilanItaly

Section editors and affiliations

  • Kamran Munir
    • 1
  • Antonio Pescapè
    • 2
  1. 1.Computer Science and Creative TechnologiesUniversity of the West of EnglandBristolUnited Kingdom
  2. 2.Department of Electrical Engineering and Information TechnologyUniversity of Napoli Federico IINapoliItaly