Abstract
In the online job recruitment domain, matching job seekers with relevant jobs is critical for closing the skills gap. When dealing with millions of resumes and job postings, such matching analytics involve several Big Data challenges. At CareerBuilder, we tackle these challenges by (i) classifying large datasets of job ads and job seeker resumes to occupation categories and (ii) providing a scalable framework that facilitates executing web services for Big Data applications.
In this chapter, we discuss two systems currently in production at CareerBuilder that facilitate our goal of closing the skills gap. These systems also power several downstream applications and labor market analytics products. We first discuss Carotene, a large-scale, machine learning-based semi-supervised job title classification system. Carotene has a coarse and fine-grained cascade architecture and a clustering based job title taxonomy discovery component that facilitates discovering more fine-grained job titles than the ones in the industry standard occupation taxonomy. We then describe CARBi, a system for developing and deploying Big Data applications for understanding and improving job-resume dynamics. CARBi consists of two components: (i) WebScalding, a library that provides quick access to commonly used datasets, database tables, data formats, web services, and helper functions to access and transform data, and (ii) ScriptDB, a standalone application that helps developers execute and manage Big Data projects. The system is built in such a way that every job developed using CARBi can be executed in local and cluster modes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
- 2.
- 3.
- 4.
Freebase, http://www.freebase.com
- 5.
- 6.
Recruitment Edge, http://edge.careerbuilder.com
- 7.
Stringtemplate, http://www.stringtemplate.org
References
Dumais S, Chen H (2000) Hierarchical classification of web content. In: Proceedings of ACM SIGIR’00. New York, USA, pp 256–263
Joachims T (1999) Transductive inference for text classification using support vector machines. In: Proceedings of ICML 1999. San Francisco, USA, pp 200–209
Liu M, Lu L, Ye X et al (2011) Coarse-to-fine classification via parametric and nonparametric models for computer-aided diagnosis. In: Proceedings of ACM CIKM’11. New York, USA, pp 2509–2512
Shen D, Ruvini J-D, Sarwar B (2012) Large-scale item categorization for e-commerce. In: Proceedings of ACM CIKM’12, pp 595–604
Bekkerman R, Gavish M (2011) High-precision phrase-based document classification on a modern scale. In: Proceedings of the 17th ACM SIGKDD-KDD’11, pp 231–239
Babbar R, Partalas I (2013) On flat versus hierarchical classification in large-scale taxonomies. In: Proceedings of the neural information processing systems (NIPS), pp 1–9
Osiński S, Weiss D (2005) A concept-driven algorithm for clustering search results. IEEE Intell Syst 3(20):48–54
Fan RE et al (2008) Liblinear: a library for large linear classification. J Mach Learn Res 9:1871–1874
Nathan P (2013) Enterprise data workflows with cascading, 1st edn. O’ReillyMedia, Sebastopol. Sebastopol, USA
Hall M, Frank E, Holmes G et al (2009) The WEKA data mining software: an update. ACM SIGKDD Explor Newsl 11(1):10–18
Yu H-F, Ho C-H, Juan Y-C et al (2013) LibShortText: a library for short-text classification and analysis. Department of Computer Science, National Taiwan University, Taipei, Technical report. http://www.csie.ntu.edu.tw/ncjlin/papers/libshorttext.pdf
Jacob F, Javed F, Zhao M et al (2014) sCooL: a system for academic institution name normalization. In: 2014 international conference on collaboration technologies and systems, CTS. Minneapolis, USA, pp 86–93
Zhao M, Javed F, Jacob F et al (2015) SKILL: a system for skill identification and normalization. AAAI 2015. Austin, USA, pp 4012–4018
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Javed, F., Jacob, F. (2015). Data Science and Big Data Analytics at Career Builder. In: Trovati, M., Hill, R., Anjum, A., Zhu, S., Liu, L. (eds) Big-Data Analytics and Cloud Computing. Springer, Cham. https://doi.org/10.1007/978-3-319-25313-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-25313-8_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25311-4
Online ISBN: 978-3-319-25313-8
eBook Packages: Computer ScienceComputer Science (R0)