Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Combining Learning Analytics with Job Market Intelligence to Support Learning at the Workplace

  • Chapter
  • First Online:
Digital Workplace Learning

Abstract

Numerous research articles are concerned with the issues surrounding the deployment of e-portfolios. Without proper mentorship, well-designed e-portfolios and stable systems, the learner’s experience is often negative. In this chapter, we review how to combine two large-scale big data infrastructures – the JISC UK national experimental learning analytics (LA) and the Cedefop’s European Job Market Intelligence (JMI) infrastructure – to provide optimised and just-in-time advice. LA is a new data-driven field and is rich in methods and analytical approaches. The focus of LA is the optimisation of the learning environment by capturing and analysing the learner’s online digital traces. JMI digests vacancy data providing a broad overview of the job market including new and emerging skill demands. We look towards a future where we populate e-portfolios with authentic job market-related tasks providing transferable long-term markers of attainment. We populate through entity extraction running ensembles of machine learning algorithms across millions of job descriptions. We enhance the process with LA allowing us to approximate the skill level of the learner and select the tasks within the e-portfolio most appropriate for that learner relative to their local and temporal workplace demands.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Aguiar, E., Ambrose, G. A., Chawla, N. V., Goodrich, V., & Brockman, J. (2014). Engagement vs performance: Using electronic portfolios to predict first semester engineering student persistence. Journal of Learning Analytics, 1(3), 7–33. https://doi.org/10.18608/jla.2014.13.3

  • Ahmed, E., & Ward, R. (2016). Analysis of factors influencing acceptance of personal, academic and professional development e-portfolios. Computers in Human Behavior, 63, 152–161. https://doi.org/10.1016/j.chb.2016.05.043

  • Apereo. (2017). The Apereo learning analytics initiative homepage. Retrieved from https://www.apereo.org/communities/learning-analytics-initiative

  • Arnold, K. E., & Pistilli, M. D. (2012). Course signals at Purdue. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge – LAK ’12 (p. 267). New York: ACM Press. https://doi.org/10.1145/2330601.2330666

  • Bakharia, A., Kitto, K., Pardo, A., Gašević, D., & Dawson, S. (2016). Recipe for success: Lessons learnt from using xAPI within the connected learning analytics toolkit. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge – LAK ’16 (pp. 378–382). New York: ACM Press. https://doi.org/10.1145/2883851.2883882

  • Barrett, H. C. (2005). White paper: Researching electronic portfolios and learner engagement. Retrieved from www.electronicportfolios.com/reflect/whitepaper.pdf.

  • Barrot, J. S. (2016). Using Facebook-based e-portfolio in ESL writing classrooms: Impact and challenges. Language, Culture and Curriculum, 29(3), 286–301. https://doi.org/10.1080/07908318.2016.1143481

  • Beckers, J., Dolmans, D., & Van Merriënboer, J. (2016). e-Portfolios enhancing students’ self-directed learning: A systematic review of influencing factors. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.2528

  • Berg, A., Scheffel, M., Drachsler, H., Ternier, S., & Specht, M. (2016). Dutch cooking with xAPI recipes: The good, the bad, and the consistent. In 2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT) (pp. 234–236). IEEE. https://doi.org/10.1109/ICALT.2016.48

  • Berg, A. M., Mol, S. T., Kismihók, G., & Sclater, N. (2016). The role of a reference synthetic data generator within the field of learning analytics. Journal of Learning Analytics, 3, 107–128. http://doi.org/10.18608/jla.2016.31.7

  • Burning Glass Technologies Research. (2015). Job market intelligence: Cybersecurity 2015. Job Market Intelligence: Cybersecurity Jobs, 2015, 1–19. Boston, MA. Retrieved from http://burning-glass.com/research/cybersecurity/

  • Cambridge, D., Fernandez, L., Kahn, S., Kirkpatrick, J., & Smith, J. (2008). The impact of the open source portfolio on learning and assessment. MERLOT Journal of Online Learning and Teaching, 4(4), 492–502.

    Google Scholar 

  • Carl, A., & Strydom, S. (2017). e-Portfolio as reflection tool during teaching practice: The interplay between contextual and dispositional variables. South African Journal of Education, 37(1), 1–10. https://doi.org/10.15700/saje.v37n1a1250

  • Chang, C.-P., Lee, T.-T., & Mills, M. E. (2017). Clinical nurse preceptors’ perception of e-portfolio use for undergraduate students. Journal of Professional Nursing, 33(4), 276–281. https://doi.org/10.1016/j.profnurs.2016.11.001

  • Chen, H., & Zhang, Y. (2017). Educating data management professionals: A content analysis of job descriptions. The Journal of Academic Librarianship, 43(1), 18–24. https://doi.org/10.1016/j.acalib.2016.11.002

  • Chou, C.-Y., Tseng, S.-F., Chih, W.-C., Chen, Z.-H., Chao, P.-Y., Lai, K. R., Lin, Y.-L. (2017). Open student models of core competencies at the curriculum level: Using learning analytics for student reflection. IEEE Transactions on Emerging Topics in Computing, 5(1), 32–44. https://doi.org/10.1109/TETC.2015.2501805

  • Contreras-Higuera, W. E., Martínez-Olmo, F., José Rubio-Hurtado, M., & Vilà-Baños, R. (2016). University students’ perceptions of E-portfolios and rubrics as combined assessment tools in education courses. Journal of Educational Computing Research, 54(1), 85–107. https://doi.org/10.1177/0735633115612784

  • Cooper, A., Berg, A., Sclater, N., Dorey-Elias, T., & Kitto, K. (2017). LAK17 hackathon. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference on – LAK ’17 (pp. 514–515). New York: ACM Press. https://doi.org/10.1145/3027385.3029435

  • Datacamp. (2016). Homepage. Retrieved from https://www.datacamp.com

  • Deng, X. N., Li, Y., & Galliers, R. D. (2016). Business analytics education: A latent semantic analysis of skills, knowledge and abilities required for business versus non- business graduates. In Proceedings of the International Conference on Information Systems (ICIS) (pp. 1–14). https://doi.org/10.1016/j.procs.2017.08.041

  • Driessen, E. (2017). Do portfolios have a future? Advances in Health Sciences Education, 22(1), 221–228. https://doi.org/10.1007/s10459-016-9679-4

  • Driessen, E., Van Tartwijk, J., Van Der Vleuten, C., & Wass, V. (2007). Portfolios in medical education: Why do they meet with mixed success? A systematic review. Medical Education, 41(12), 1224–1233. https://doi.org/10.1111/j.1365-2923.2007.02944.x

  • Dunbar, K., Laing, G., & Wynder, M. (2016). A content analysis of accounting job advertisements: Skill requirements for graduates. The E-Journal of Business Education & Scholarship of Teaching, 10(1), 58.

    Google Scholar 

  • Dunlap, J. C., & Grabinger, S. (2008). Preparing students for lifelong learning: A review of instructional features and teaching methodologies. Performance Improvement Quarterly, 16(2), 6–25. https://doi.org/10.1111/j.1937-8327.2003.tb00276.x

  • ESCO. (2017). European skills/competences, qualifications and occupations. Retrieved from https://ec.europa.eu/esco/portal/home

    Google Scholar 

  • Galanis, N., Mayol, E., Alier, M., & García-Peñalvo, F. J. (2016). Supporting, evaluating and validating informal learning. A social approach. Computers in Human Behavior, 55, 596–603. https://doi.org/10.1016/j.chb.2015.08.005

  • Garrett, B. M., MacPhee, M., & Jackson, C. (2013). Evaluation of an eportfolio for the assessment of clinical competence in a baccalaureate nursing program. Nurse Education Today, 33(10), 1207–1213. https://doi.org/10.1016/j.nedt.2012.06.015

  • Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2–3), 87–105. doi:10.1016/S1096-7516(00)00016-6

    Google Scholar 

  • Gerbic, P., & Maher, M. (2008). Collaborative self-study supporting new technology: The Mahara e-portfolio project. Proceedings of ASCILITE Melbourne, pp. 320–324.

    Google Scholar 

  • Goodman, B., & Flaxman, S. (2016). European Union regulations on algorithmic decision-making and a “right to explanation”. arXiv preprint arXiv:1606.08813.

    Google Scholar 

  • Haggerty, C., & Thompson, T. (2017). The challenges of incorporating ePortfolio into an undergraduate nursing programme. Open Praxis, 9(2), 245. https://doi.org/10.5944/openpraxis.9.2.554

  • Hinojosa, J., & Howe, T.-H. (2016). EPortfolio: The scholarly capstone for the practice doctoral degree in occupational therapy. The Open Journal of Occupational Therapy, 4(3). https://doi.org/10.15453/2168-6408.1203

  • Holt, D., McGuigan, N., Kavanagh, M., Leitch, S., Ngo, L., Salzman, S., & McKay, J. (2016). Academic leaders’ perspectives on adopting ePortfolios for developing and assessing professional capabilities in Australian business education. Australasian Journal of Educational Technology, 32(5). 1–18.

    Google Scholar 

  • Hong, J. E. (2016). Identifying skill requirements for GIS positions: A content analysis of job advertisements. Journal of Geography, 115(4), 147–158. https://doi.org/10.1080/00221341.2015.1085588

  • Jayaprakash, S. M., Moody, E. W., Lauria, E. J. M., Regan, J. R., & Baron, J. D. (2014). Early alert of academically at-risk students: An open source analytics initiative. Journal of Learning Analytics, 1(1), 6–47. Retrieved from http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/3249

  • Karakatsanis, I., AlKhader, W., MacCrory, F., Alibasic, A., Omar, M. A., Aung, Z., & Woon, W. L. (2017). Data mining approach to monitoring the requirements of the job market: A case study. Information Systems, 65, 1–6, 1. https://doi.org/10.1016/j.is.2016.10.009

  • Karuta Project homepage. (2017). Retrieved from http://karutaproject.org

  • King, A. (2013). A trainee’s guide to surviving ePortfolio. Clinical Medicine, 13(4), 367–369. https://doi.org/10.7861/clinmedicine.13-4-367

  • Kitto, K., Cross, S., Waters, Z., & Lupton, M. (2015). Learning analytics beyond the LMS. In Proceedings of the Fifth International Conference on Learning Analytics And Knowledge – LAK ’15 (pp. 11–15). New York: ACM Press. https://doi.org/10.1145/2723576.2723627

  • Kobayashi, V. B., Mol, S. T., Berkers, H. A., Kismihók, G., & Den Hartog, D. N. (2017a). Text classification for organizational researchers. Organizational Research Methods. https://doi.org/10.1177/1094428117719322

  • Kobayashi, V. B., Mol, S. T., Berkers, H. A., Kismihók, G., & Den Hartog, D. N. (2017b). Text mining in organizational research. Organizational Research Methods. https://doi.org/10.1177/1094428117722619

  • Kovanović, V., Gašević, D., Hatala, M., & Siemens, G. (2017). A novel model of cognitive presence assessment using automated learning analytics methods. Retrieved from http://a4li.sri.com/archive/papers/Kovanovic_2017_Presence.pdf

  • Kvetan, V. (2017). What are the skills that employers want? Using big data technology to open the black box. Retrieved from http://skillspanorama.cedefop.europa.eu/en/blog/what-are-skills-employers-want-using-big-data-technology-open-black-box

  • Labutov, I., Huang, Y., Brusilovsky, P., & He, D. (2017). Semi-supervised techniques for mining learning outcomes and prerequisites. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining – KDD ’17 (pp. 907–915). New York: ACM Press. https://doi.org/10.1145/3097983.3098187

  • Lim, C. P., Lee, J. C.-K., & Jia, N. (2016). E-portfolios in pre-service teacher education: Sustainability and lifelong learning. In J. Chi-Kin Lee & C. Day (Eds.), Quality and change in teacher education: Western and chinese perspectives (pp. 163–174). Cham, Switzerland: Springer International Publishing. https://doi.org/10.1007/978-3-319-24139-5_10

  • Liu, R., Ouyang, Y., Rong, W., Song, X., Tang, C., & Xiong, Z. (2016). Rating prediction based job recommendation service for college students. In O. Gervasi, B. Murgante, S. Misra, A. M. A. C. Rocha, C. M. Torre, D. Taniar, S. Wang (Eds.), Computational science and its applications – ICCSA 2016: 16th International Conference, Beijing, China, July 4–7, 2016, Proceedings, Part V (pp. 453–467). Cham, Switzerland: Springer International Publishing. https://doi.org/10.1007/978-3-319-42092-9_35

  • Martin, F., & Whitmer, J. C. (2016). Applying learning analytics to investigate timed release in online learning. Technology, Knowledge and Learning, 21(1), 59–74. https://doi.org/10.1007/s10758-015-9261-9

  • McArthur, E., Kubacki, K., Pang, B., & Alcaraz, C. (2017). The employers’ view of “work-ready” graduates: A study of advertisements for marketing jobs in Australia. Journal of Marketing Education, 82. https://doi.org/10.1177/0273475317712766

  • McClendon, K., & Ho, T. (2016). Building a quality assessment process for measuring and documenting student learning. Assessment Update, 28(2), 7–14. https://doi.org/10.1002/au.30053

  • McMullan, M. (2006). Students’ perceptions on the use of portfolios in pre-registration nursing education: A questionnaire survey. International Journal of Nursing Studies, 43(3), 333–343. https://doi.org/10.1016/j.ijnurstu.2005.05.005

  • Mihret, D. G., Abayadeera, N., Watty, K., & McKay, J. (2017). Teaching auditing using cases in an online learning environment: The role of ePortfolio assessment. Accounting Education, 26(4), 335–357. https://doi.org/10.1080/09639284.2017.1292466

  • Miranda, S., Orciuoli, F., Loia, V., & Sampson, D. (2017). An ontology-based model for competence management. Data & Knowledge Engineering, 107, 51–66. https://doi.org/10.1016/j.datak.2016.12.001

  • Müller, W., Rebholz, S., & Libbrecht, P. (2017). Automatic inspection of E-Portfolios for improving formative and summative assessment (pp. 480–489). https://doi.org/10.1007/978-3-319-52836-6_51

  • Mýtna Kureková, L., Beblavý, M., Haita, C., & Thum, A.-E. (2016). Employers’ skill preferences across Europe: Between cognitive and non-cognitive skills. Journal of Education and Work, 29(6), 662–687. https://doi.org/10.1080/13639080.2015.1024641

  • Nadeau, D., & Sekine, S. (2007). A survey of named entity recognition and classification. Lingvisticae Investigationes, 30(1), 3–26. https://doi.org/10.1075/li.30.1.03nad

  • Ochirbat, A., Shih, T. K., Chootong, C., Sommool, W., Gunarathne, W. K. T. M., Wang, H.-H., & Ma, Z.-H. (2017). Hybrid occupation recommendation for adolescents on interest, profile, and behavior. Telematics and Informatics. https://doi.org/10.1016/j.tele.2017.02.002

  • Oner, D., & Adadan, E. (2016). Are integrated portfolio systems the answer? An evaluation of a web-based portfolio system to improve preservice teachers’ reflective thinking skills. Journal of Computing in Higher Education, 28(2), 236–260. https://doi.org/10.1007/s12528-016-9108-y

  • PMML. (2017). Predictive model markup language specification. Retrieved from http://dmg.org/pmml/v4-3/GeneralStructure.html

  • Predictive Analytics Reporting Framework Par. (2017). Retrieved from https://community.datacookbook.com/public/institutions/par

  • Prinsloo, P., & Slade, S. (2017). Ethics and learning analytics: Charting the un charted. In C. Lang, G. Siemens, A. F. Wise, & D. Gaševic (Eds.), The handbook of learning analytics (1st ed., pp. 49–57). Alberta, Canada: Society for Learning Analytics Research (SoLAR). Retrieved from http://solaresearch.org/hla-17/hla17-chapter1

  • Rahayu, P., & Sensuse, D. I. (2015). CSF for implementation e-portfolio model: A systematic review. In 2015 International Conference on Information Technology Systems and Innovation (ICITSI) (pp. 1–6). IEEE. https://doi.org/10.1109/ICITSI.2015.7437714

  • Rahayu, P., Sensuse, D. I., Purwandari, B., Budi, I., Khalid, F., & Zulkarnaim, N. (2017). A systematic review of recommender system for e-Portfolio domain. In Proceedings of the 5th International Conference on Information and Education Technology – ICIET ’17 (pp. 21–26). New York: ACM Press. https://doi.org/10.1145/3029387.3029420

  • Ramya, R. S., Venugopal, K. R., Iyengar, S. S., & Patnaik, L. M. (2017). Feature extraction and duplicate detection for text mining: A survey. Global Journal of Computer Science and Technology, 16(5). Retrieved from https://www.computerresearch.org/index.php/computer/article/view/1459

  • Rienties, B., Boroowa, A., Cross, S., Kubiak, C., Mayles, K., & Murphy, S. (2016). Analytics4Action evaluation framework: A review of evidence-based learning analytics interventions at the open university UK. Journal of Interactive Media in Education, 1(2), 1–11. https://doi.org/10.5334/jime.az

  • Sclater, N., Berg, A., & Webb, M. (2015). Developing an open architecture for learning analytics. Proceedings of the EUNIS 2015 Congress. https://doi.org/ISSN. pp. 2409–1340.

  • Shankararaman, V., & Gottipati, S. (2016). Mapping information systems student skills to industry skills framework. In IEEE Global Engineering Education Conference (Vol. 10-13-NaN-2016, pp. 248–253). EDUCON. https://doi.org/10.1109/EDUCON.2016.7474561

  • Siemens, G. (2011, 5). Learning and academic analytics. Retrieved from http://www.learninganalytics.net/?p=131

  • Tailor, A., Dubrey, S., & Das, S. (2014). Opinions of the ePortfolio and workplace-based assessments: A survey of core medical trainees and their supervisors. Clinical Medicine, 14(5), 510–516. https://doi.org/10.7861/clinmedicine.14-5-510

  • Taylor, J., Dunbar-Hall, P. & Rowley, J. (2012). The e-portfolio continuum: Discovering variables for e-portfolio adoption within music education. Australasian Journal of Educational Technology, 28(8), 1362–1381. doi: http://dx.doi.org/10.14742/ajet.776

  • Terblanche, C., & Wongthongtham, P. (2016). Ontology-based employer demand management. Software: Practice and Experience, 46(4), 469–492. https://doi.org/10.1002/spe.2319

    Google Scholar 

  • Van der Schaaf, M., Donkers, J., Slof, B., Moonen-van Loon, J., van Tartwijk, J., Driessen, E.,Ten Cate, O. (2017). Improving workplace-based assessment and feedback by an E-portfolio enhanced with learning analytics. Educational Technology Research and Development, 65(2), 359–380. https://doi.org/10.1007/s11423-016-9496-8

  • Vance, G. H. S., Burford, B., Shapiro, E., & Price, R. (2017). Longitudinal evaluation of a pilot e-portfolio-based supervision programme for final year medical students: Views of students, supervisors and new graduates. BMC Medical Education, 17(1), 141. https://doi.org/10.1186/s12909-017-0981-5

  • Venville, A., Cleak, H., & Bould, E. (2017). Exploring the potential of a collaborative web-based E-portfolio in social work field education. Australian Social Work, 70(2), 185–196. https://doi.org/10.1080/0312407X.2017.1278735

  • Wetzel, K., & Strudler, N. (2005). The diffusion of electronic portfolios in teacher education. Journal of Research on Technology in Education, 38(2), 231–243. https://doi.org/10.1080/15391523.2005.10782458

  • Wilson, S. (2013). Community-Driven Specifications. In Innovations in Organizational IT Specification and Standards Development (pp. 250–263). IGI Global, Pennsylvania, USA. https://doi.org/10.4018/978-1-4666-2160-2.ch015

  • Winberg, C., & Pallitt, N. (2016). “I am trying to practice good teaching”: Reconceptualizing eportfolios for professional development in vocational higher education. British Journal of Educational Technology, 47(3), 543–553. https://doi.org/10.1111/bjet.12440

  • Woolridge, R. W., & Parks, R. (2016). What’s In and What’s Out: Defining an industry-aligned IS curriculum using job advertisements. Journal of Higher Education Theory and Practice, 16(2), 105. Retrieved from http://www.na-businesspress.com/JHETP/WoolridgeRW_Web16_2_.pdf

  • xAPI. (2017). The xAPI specification. retrieved from https://github.com/adlnet/xAPI-Spec

  • Yang, Q., Zhang, X., Du, X., Bielefield, A., & Liu, Y. (2016). Current market demand for core competencies of librarianship—A text mining study of American Library Association’s advertisements from 2009 through 2014. Applied Sciences, 6(2), 48. https://doi.org/10.3390/app6020048

  • Young, S., & Carson, A. (2016). What is a journalist? Journalism Studies, 1–21. https://doi.org/10.1080/1461670X.2016.1190665

Download references

Acknowledgments

The authors would like to acknowledge the critical feedback and support given by Naill Sclater and gratefully acknowledge the financial support from the Eduworks Marie Curie Initial Training Network Project (PITN-GA-2013-608311) of the European Commission’s 7th Framework Program.

The views expressed in the paper are solely the authors’ and do not necessarily represent those of the European Centre for the Development of Vocational Training (CEDEFOP).

Author information

Authors and Affiliations

  1. Central Services (ICTS), University of Amsterdam, Amsterdam, Netherlands

    Alan Mark Berg

  2. Cedefop (European Centre for Development of Vocational Training), Thessaloniki, Greece

    Jiri Branka

  3. Amsterdam Business School, University of Amsterdam, Amsterdam, Netherlands

    Gábor Kismihók

Authors
  1. Alan Mark Berg
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiri Branka
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gábor Kismihók
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alan Mark Berg .

Editor information

Editors and Affiliations

  1. Deakin University, Geelong, Australia

    Dirk Ifenthaler

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Berg, A.M., Branka, J., Kismihók, G. (2018). Combining Learning Analytics with Job Market Intelligence to Support Learning at the Workplace. In: Ifenthaler, D. (eds) Digital Workplace Learning. Springer, Cham. https://doi.org/10.1007/978-3-319-46215-8_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46215-8_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46214-1

  • Online ISBN: 978-3-319-46215-8

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation