Skip to main content

Bayesian Vote Weighting in Crowdsourcing Systems

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNAI,volume 7653)

Abstract

In social collaborative crowdsourcing platforms, the votes which people give on the content generated by others is a very important component of the system which seeks to find the best content through collaborative action. In a crowdsourced innovation platform, people vote on innovations/ideas generated by others which enables the system to synthesize the view of the crowd about an idea. However, in many such systems gaming or vote spamming as it is commonly known is prevalent. In this paper we present a Bayesian mechanism for weighting the actual vote given by a user to compute an effective vote which incorporates the voters history of voting and also what the crowd is thinking about the value of the innovation. The model results into some interesting insights about social voting systems and new avenues for gamification.

Keywords

  • Vote System
  • Prediction Market
  • Herd Behavior
  • Cognitive Science Society
  • Minimum Span Tree Problem

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agichtein, E., Castillo, C., Donato, D., Gionis, A., Mishne, G.: Finding high-quality content in social media with an application to community-based question answering. In: Proceedings of WSDM (2008)

    Google Scholar 

  2. Bian, J., Liu, Y., Agichtein, E., Zha, H.: A few bad votes too many?: towards robust ranking in social media. In: Proc. 4th Intl. Workshop on Adversarial Information Retrieval on the Web (AIRWeb), pp. 53–60 (2008)

    Google Scholar 

  3. Dani, V., Madani, O., Pennock, D.M., Sanghai, S.K., Galebach, B.: An Empirical Comparison of Algorithms for Aggregating Expert Predictions. In: Proceedings of the Conference on Uncertainty in Artificial Intelligence, UAI (2006)

    Google Scholar 

  4. Immorlica, N., Jain, K., Mahdian, M., Talwar, K.: Click Fraud Resistant Methods for Learning Click-Through Rates. In: Deng, X., Ye, Y. (eds.) WINE 2005. LNCS, vol. 3828, pp. 34–45. Springer, Heidelberg (2005)

    CrossRef  Google Scholar 

  5. Jeon, J., Croft, W., Lee, J., Park, S.: A framework to predict the quality of answers with non-textual features. In: Proceedings of SIGIR (2006)

    Google Scholar 

  6. Kuncheva, L.I., Whitaker, C.J., Shipp, C.A.: Limits on the majority vote accuracy in classifier fusion. Pattern Analysis & Applications 6(1), 22–31 (2003)

    CrossRef  MathSciNet  MATH  Google Scholar 

  7. Lee, M.D., Grothe, E., Steyvers, M.: Conjunction and Disjunction Fallacies in Prediction Markets. In: Taatgen, N., van Rijn, H., Schomaker, L., Nerbonne, J. (eds.) Proceedings of the 31th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum, Mahwah (2009)

    Google Scholar 

  8. Mehta, B., Hoffmann, T., Fankhauser, P.: Lies and propaganda: detecting spam users in Collaborative Filtering. In: Proc. of the 12th International Conference on Intelligent User Interfaces, IUI (2007)

    Google Scholar 

  9. Miller, B., Hemmer, P., Steyvers, M., Lee, M.D.: The Wisdom of Crowds in Ordering Problems. In: Proceedings of the Ninth International Conference on Cognitive Modeling, Manchester, UK (2009)

    Google Scholar 

  10. Radlinski, F., Joachims, T.: Minimally invasive randomization for collecting unbiased preferences from clickthrough logs. In: Proc. of the National Conference on Artificial Intelligence, AAAI (2006)

    Google Scholar 

  11. Su, Q., Pavlov, D., Chow, J., Baker, W.: Internet-scale collection of human-reviewed data. In: Proc. of the 16th International Conference on World Wide Web, WWW 2007 (2007)

    Google Scholar 

  12. Surowiecki, J.: The Wisdom of Crowds. W. W. Norton & Company, Inc., New York (2004)

    Google Scholar 

  13. Turner, B., Steyvers, M.: A Wisdom of the Crowd Approach to Forecasting. In: 2nd NIPS Workshop on Computational Social Science and the Wisdom of Crowds (2011)

    Google Scholar 

  14. Yi, S.K.M., Steyvers, M., Lee, M.D., Dry, M.: Wisdom of Crowds in Minimum Spanning Tree Problems. In: Proceedings of the 32nd Annual Conference of the Cognitive Science Society. Lawrence Erlbaum, Mahwah (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hardas, M.S., Purvis, L. (2012). Bayesian Vote Weighting in Crowdsourcing Systems. In: Nguyen, NT., Hoang, K., Jȩdrzejowicz, P. (eds) Computational Collective Intelligence. Technologies and Applications. ICCCI 2012. Lecture Notes in Computer Science(), vol 7653. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34630-9_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34630-9_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34629-3

  • Online ISBN: 978-3-642-34630-9

  • eBook Packages: Computer ScienceComputer Science (R0)