Abstract
In data-centric crowdsourcing, it is well known that the incentive structure connected to workers’ behavior greatly affects output data. This paper proposes to use a declarative language to deal with both of data computation and the incentive structure explicitly. In the language, computation is modeled as a set of Datalog-like rules, and the incentive structures for the crowd are modeled as games in which the actions taken by players (workers) affect how much payoff they will obtain. The language is unique in that it introduces the game aspect that separates the code for the incentive structure from the other logic encoded in the program. This paper shows that the game aspect not only makes it easier to analyze and maintain the incentive structures, it gives a principled model of the fusion of human and machine computations. In addition, it reports the results of experiments with a real set of data.
Chapter PDF
Similar content being viewed by others
References
Ahn, L., Dabbish, L.: ESP: labeling images with a computer game. In: AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors, pp. 91–98 (2005)
Ahn, L., Dabbish, L.: Designing games with a purpose. Commun. ACM 51(8), 58–67 (2008)
Abiteboul, S., Hull, R., Vianu, V.: Foundations of Databases. Addison-Wesley (1995), ISBN 0-201-53771-0
Ahn, L., Kedia, M., Blum, M.: Verbosity: a game for collecting common-sense facts. In: CHI, pp. 75–78 (2006)
Artikis, A., Weidlich, M., Schnitzler, F., Boutsis, I., Liebig, T., Piatkowski, N., Bockermann, C., Morik, K., Kalogeraki, V., Marecek, J., Gal, A., Mannor, S., Gunopulos, D., Kinane, D.: Heterogeneous stream processing and crowdsourcing for urban traffic management. In: EDBT, pp. 712–723 (2014)
Franklin, M.J., Kossmann, D., Kraska, T., Ramesh, S., Xin, R.: CrowdDB: answering queries with crowdsourcing. In: SIGMOD Conference, pp. 61–72 (2011)
Gustas, R., Gustiene, P.: Conceptual Modeling Method for Separation of Concerns and Integration of Structure and Behavior. IJISMD 3(1), 48–77 (2012)
Geiger, D., Rosemann, M., Fielt, E., Schader, M.: Crowdsourcing information systems - definition, typology, and design. In: ICIS (2012)
Goldberg, S.L., Wang, D.Z., Kraska, T.: CASTLE: Crowd-assisted system for text labeling and extraction. In: HCOMP (2013)
Jain, S., Parkes, D.C.: The role of game theory in human computation systems. In: HCOMP 2009, pp. 58–61 (2009)
Kiczales, G., Lamping, J., Mendhekar, A., Maeda, C., Lopes, C., Loingtier, J.-M., Irwin, J.: Aspect-oriented programming. In: AkĹźit, M., Matsuoka, S. (eds.) ECOOP 1997. LNCS, vol. 1241. Springer, Heidelberg (1997)
Hodges, W.: Logic and Games. The Stanford Encyclopedia of Philosophy (Spring 2013 Edition), Zalta, E.N., (ed.). http://plato.stanford.edu/archives/spr2013/entries/logic-games
Kittur, A., Smus, B., Kraut, R.: CrowdForge: crowdsourcing complex work. In: CHI Extended Abstracts, pp. 1801–1806 (2011)
Kondreddi, S.K., Triantafillou, P., Weikum, G.: Combining information extraction and human computing for crowdsourced knowledge acquisition. In: ICDE, pp. 988–999 (2014)
Little, G., Chilton, L.B., Goldman, M., Miller, R.C.: TurKit: human computation algorithms on mechanical turk. In: UIST, pp. 57–66 (2010)
Langley, P., Simon, H.A.: Applications of Machine Learning and Rule Induction. Commun. ACM 38(11), 54–64 (1995)
Minder, P., Bernstein, A.: CrowdLang: a programming language for the systematic exploration of human computation systems. In: Aberer, K., Flache, A., Jager, W., Liu, L., Tang, J., Guéret, C. (eds.) Social Informatics. LNCS, vol. 7710, pp. 124–137. Springer, Heidelberg (2012)
Morishima, A., Shinagawa, N., Mitsuishi, T., Aoki, H., Fukusumi, S.: CyLog/Crowd4U: a declarative platform for complex data-centric crowdsourcing. VLDB 5(12), 1918–1921 (2012)
Marcus, A., Wu, E., Karger, D., Madden, S., Miller, R.: Human-powered Sorts and Joins. PVLDB 5(1), 13–24 (2011)
Nebeling, M., Speicher, M., Grossniklaus, M., Norrie, M.C.: Crowdsourced web site evaluation with crowdstudy. In: Brambilla, M., Tokuda, T., Tolksdorf, R. (eds.) ICWE 2012. LNCS, vol. 7387, pp. 494–497. Springer, Heidelberg (2012)
Parameswaran, A.G., Park, H., Garcia-Molina, H., Polyzotis, N., Widom, J.: Deco: declarative crowdsourcing. In: CIKM, pp. 1203–1212 (2012)
Park, H., Pang, R., Parameswaran, A.G., Garcia-Molina, H., Polyzotis, N., Widom, J.: An overview of the deco system: data model and query language; query processing and optimization. SIGMOD Record 41(4), 22–27 (2012)
Roughgarden, T.: Algorithmic game theory. Commun. ACM 53(7), 78–86 (2010)
Vega-Redondo, F.: Economics and Theory of Games. Cambridge University Press (2003)
Yu, Y., Cesar, J., Leite, S.P., Mylopoulos, J.: From goals to aspects: discovering aspects from requirements goal models. In: RE, pp. 38–47 (2004)
Fukusumi, S., Morishima, A., Kitagawa, H.: Game Aspect: An Approach to Separation of Concerns in Crowdsourced Data Management, Technical Report. http://mlab.info/t-reports/game_aspect-full.pdf
Crowd4U. http://crowd4u.org
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Fukusumi, S., Morishima, A., Kitagawa, H. (2015). Game Aspect: An Approach to Separation of Concerns in Crowdsourced Data Management. In: Zdravkovic, J., Kirikova, M., Johannesson, P. (eds) Advanced Information Systems Engineering. CAiSE 2015. Lecture Notes in Computer Science(), vol 9097. Springer, Cham. https://doi.org/10.1007/978-3-319-19069-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-19069-3_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-19068-6
Online ISBN: 978-3-319-19069-3
eBook Packages: Computer ScienceComputer Science (R0)