Sparrows and Owls: Characterisation of Expert Behaviour in StackOverflow

  • Jie Yang
  • Ke Tao
  • Alessandro Bozzon
  • Geert-Jan Houben
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8538)

Abstract

Question Answering platforms are becoming an important repository of crowd-generated knowledge. In these systems a relatively small subset of users is responsible for the majority of the contributions, and ultimately, for the success of the Q/A system itself. However, due to built-in incentivization mechanisms, standard expert identification methods often misclassify very active users for knowledgable ones, and misjudge activeness for expertise. This paper contributes a novel metric for expert identification, which provides a better characterisation of users’ expertise by focusing on the quality of their contributions. We identify two classes of relevant users, namely sparrows and owls, and we describe several behavioural properties in the context of the StackOverflow Q/A system. Our results contribute new insights to the study of expert behaviour in Q/A platforms, that are relevant to a variety of contexts and applications.

Keywords

Question answering systems Expert modelling Expert behaviour 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Anderson, A., Huttenlocher, D., Kleinberg, J., Leskovec, J.: Kleinberg J., and Leskovec J.: Steering user behavior with badges. In: WWW 2013, pp. 95–106. ACM (2013)Google Scholar
  2. 2.
    Bian, J., Liu, Y., Zhou, D., Agichtein, E., Zha, H.: Learning to recognize reliable users and content in social media with coupled mutual reinforcement. In: WWW 2009, pp. 51–60. ACM (2009)Google Scholar
  3. 3.
    Bouguessa, M., Dumoulin, B., Wang, S.: Identifying authoritative actors in question-answering forums: The case of yahoo! answers. In: KDD 2008, pp. 866–874. ACM (2008)Google Scholar
  4. 4.
    Ericsson, K.A.: The Cambridge handbook of expertise and expert performance. Cambridge University Press (2006)Google Scholar
  5. 5.
    Fritz, T., Ou, J., Murphy, G.C., Murphy-Hill, E.: A degree-of-knowledge model to capture source code familiarity. In: ICSE 2010, pp. 385–394. ACM (2010)Google Scholar
  6. 6.
    Hanrahan, B.V., Convertino, G., Nelson, L.: Modeling problem difficulty and expertise in stackoverflow. In: CSCW 2012, pp. 91–94. ACM (2012)Google Scholar
  7. 7.
    Jurczyk, P., Agichtein, E.: Discovering authorities in question answer communities by using link analysis. In: CIKM 2007, pp. 919–922. ACM (2007)Google Scholar
  8. 8.
    Kagdi, H., Hammad, M., Maletic, J.I.: Who can help me with this source code change? In: ICSM 2008, pp. 157–166. IEEE (2008)Google Scholar
  9. 9.
    Ma, D., Schuler, D., Zimmermann, T., Sillito, J.: Expert recommendation with usage expertise. In: ICSM 2009, pp. 535–538. IEEE (2009)Google Scholar
  10. 10.
    Pal, A., Chang, S., Konstan, J.A.: Evolution of experts in question answering communities. In: ICWSM 2012. AAAI (2012)Google Scholar
  11. 11.
    Pal, A., Harper, F.M., Konstan, J.A.: Exploring question selection bias to identify experts and potential experts in community question answering. ACM Trans. Inf. Syst. 30(2), 10 (2012)CrossRefGoogle Scholar
  12. 12.
    Pal, A., Konstan, J.A.: Expert identification in community question answering: exploring question selection bias. In: CIKM 2010, pp. 1505–1508. ACM (2010)Google Scholar
  13. 13.
    Vasilescu, B., Serebrenik, A., Devanbu, P., Filkov, V.: How social q&a sites are changing knowledge sharing in open source software communities. In: CSCW 2014, ACM (2014)Google Scholar
  14. 14.
    Zhang, J., Ackerman, M.S., Adamic, L.: Expertise networks in online communities: structure and algorithms. In: WWW 2007, pp. 221–230. ACM (2007)Google Scholar
  15. 15.
    Zhou, Y., Cong, G., Cui, B., Jensen, C.S., Yao, J.: Routing questions to the right users in online communities. In: ICDE 2009, pp. 700–711. IEEE (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Jie Yang
    • 1
  • Ke Tao
    • 1
  • Alessandro Bozzon
    • 1
  • Geert-Jan Houben
    • 1
  1. 1.Delft University of TechnologyDelftThe Netherlands

Personalised recommendations