Mobile Networks and Applications

, Volume 17, Issue 3, pp 395–414 | Cite as

The Design and Evaluation of Task Assignment Algorithms for GWAP-based Geospatial Tagging Systems

  • Ling-Jyh Chen
  • Yu-Song Syu
  • Hung-Chia Chen
  • Wang-Chien Lee


Geospatial tagging (geotagging) is an emerging and very promising application that can help users find a wide variety of location-specific information, and thereby facilitate the development of advanced location-based services. Conventional geotagging systems share some limitations, such as the use of a two-phase operating model and the tendency to tag popular objects with simple contexts. To address these problems, a number of geotagging systems based on the concept of ‘Games with a Purpose’ (GWAP) have been developed recently. In this study, we use analysis to investigate these new systems. Based on our analysis results, we design three metrics to evaluate the system performance, and develop five task assignment algorithms for GWAP-based systems. Using a comprehensive set of simulations under both synthetic and realistic mobility scenarios, we find that the Least-Throughput-First Assignment algorithm (LTFA) is the most effective approach because it can achieve competitive system utility, while its computational complexity remains moderate. We also find that, to improve the system utility, it is better to assign as many tasks as possible in each round. However, because players may feel annoyed if too many tasks are assigned at the same time, it is recommended that multiple tasks be assigned one by one in each round in order to achieve higher system utility.


geospatial tagging Games with a Purpose human computation tagging 



We wish to thank the editors and anonymous reviewers for their insightful comments and suggestions. This study is based on research supported by the National Science Council of Taiwan under NSC Grants: NSC 98-2221-E-001-014-MY3 and NSC 99-2631-S-003-002.


  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
    Bell M, Reeves S, Brown B, Sherwood S, MacMillan D, Ferguson J, Chalmers M (2009) Eyespy: supporting navigation through play. In: ACM SIGCHIGoogle Scholar
  9. 9.
    Bokhari SH (1987) Assignment problems in parallel and distributed computing. Springer, New YorkCrossRefGoogle Scholar
  10. 10.
    Casavant, TL, Kuhl JG (1988) A taxonomy of scheduling in general-purpose distributed computing systems. IEEE Trans Softw Eng 14(2):141–154CrossRefGoogle Scholar
  11. 11.
    Casey S, Kirman B, Rowland D (2007) The gopher game: a social, mobile, locative game with user generated content and peer review. In: International conference on advances in computer entertainment technologyGoogle Scholar
  12. 12.
    Chen L-J, Syu Y-S, Wang B-C, Lee W-C (2009) An analytical study of GWAP-based geospatial tagging systems. In: IEEE CollaborateComGoogle Scholar
  13. 13.
    Chen L-J, Wang B-C, Chen K-T (2010) The design of puzzle selection strategies for GWAP systems. Concurrency Computat Pract Exper 22(7):890–908Google Scholar
  14. 14.
    Drozd A, Benford S, Tandavanitj N, Wright M, Chamberlain A (2006) Hitchers: designing for cellular positioning. In: UbiCompGoogle Scholar
  15. 15.
    Froehlich J, Neumann J, Oliver N (2008) Measuring the pulse of the city through shared bicycle programs. In: ACM UrbanSensingGoogle Scholar
  16. 16.
    Gershenfeld N (1998) The nature of mathematical modeling. Cambridge University Press, CambridgeGoogle Scholar
  17. 17.
    Goldman J, Shilton K, Burke J, Estrin D, Hansen M, Ramanathan N, Reddy S, Samanta V, Srivastava M, West R (2009) Participatory sensing: a citizen-powered approach to illuminating the patterns that shape our world. Foresight & Governance Project, White PaperGoogle Scholar
  18. 18.
    Grant L, Daanen H, Benford S, Hampshire A, Drozd A, Greenhalgh C (2007) MobiMissions: the game of missions for mobile phones. In: ACM SIGGRAPHGoogle Scholar
  19. 19.
    Horanont T, Shibasaki R (2008) An implementation of mobile sensing for large-scale urban monitoring. In: ACM UrbanSensingGoogle Scholar
  20. 20.
    Howe J (2006) The rise of crowdsourcing. Wired 14(6).
  21. 21.
    Lee EA (2008) Cyber physical systems: design challenges. Technical Report UCB/EECS-2008-8, EECS Department, University of California, BerkeleyGoogle Scholar
  22. 22.
    Lee K, Hong S, Kim SJ, Rhee I, Chong S (2009) SLAW: a mobility model for human walks. In: IEEE InfocomGoogle Scholar
  23. 23.
    Lieberman H, Smith D, Teeters a (2007) Common consensus: a web-based game for collecting commonsense goals. In: ACM workshop on common sense for intelligent interfacesGoogle Scholar
  24. 24.
    Lo VM (1988) Heuristic algorithms for task assignment in distributed systems. IEEE Trans Comput 37(11):1384–1397MathSciNetCrossRefGoogle Scholar
  25. 25.
    Lu H, Pan W, Lane ND, Choudhury T, Campbell AT (2009) SoundSense: scalable sound sensing for people-centric sensing applications on mobile phones. In: ACM/USENIX MobiSysGoogle Scholar
  26. 26.
    Matyas S (2007) Playful geospatial data acquisition by location-based gaming communities. Int J Virtual Real 6(3):1–10Google Scholar
  27. 27.
    Matyas S, Matyas C, Schlieder C, Kiefer P, Mitarai H, Kamata M (2008) Designing location-based mobile games with a purpose: collecting geospatial data with CityExplorer. In: ACM ACEGoogle Scholar
  28. 28.
    Patel K, Ismail M, Motahari S, Rosenbaum DJ, Ricken ST, Grandhi SA, Schuler RP, Jones Q (2010) MarkIt: community play and computation to generate rich location descriptions through a mobile phone game. In: Hawaii international conference on system sciencesGoogle Scholar
  29. 29.
    Ritzer G (ed) (2007) The Blackwell encyclopedia of sociology. Wiley-Blackwell, OxfordGoogle Scholar
  30. 30.
    Schlieder C (2005) Representing the meaning of spatial behavior by spatially grounded intentional systems. Lect Notes Comput Sci 3799:30–44CrossRefGoogle Scholar
  31. 31.
    Schlieder C, Kiefer P, Matyas S (2006) Geogames: designing location-based games from classic board games. IEEE Intell Syst 21(5):40–46CrossRefGoogle Scholar
  32. 32.
    Simmel G, Wolff KH (1950) The sociology of Georg Simmel. The Free Press, MankatoGoogle Scholar
  33. 33.
    Surowiecki J (2004) The wisdom of crowds: why the many are smarter than the few and how collective wisdom shapes business, economies, societies and nations. Doubleday, Garden CityGoogle Scholar
  34. 34.
    von Ahn L (2006) Games with a purpose. IEEE Computer 39(6):92–94CrossRefGoogle Scholar
  35. 35.
    von Ahn L, Dabbish L (2004) Labeling images with a computer game. In: ACM SIGCHIGoogle Scholar
  36. 36.
    von Ahn L, Dabbish L (2008) Designing games with a purpose. Commun ACM 51(8):58–67Google Scholar
  37. 37.
    von Ahn L, Kedia M, Blum M (2006) Verbosity: a game for collecting common-sense facts. In: ACM SIGCHIGoogle Scholar
  38. 38.
    Yuen M-C, Chen L-J, King I (2009) A survey of human computation systems. In: IEEE symposium on social computing applicationsGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Ling-Jyh Chen
    • 1
  • Yu-Song Syu
    • 1
  • Hung-Chia Chen
    • 1
  • Wang-Chien Lee
    • 2
  1. 1.Institute of Information ScienceTaipeiTaiwan
  2. 2.Department of Computer Science and EngineeringThe Pennsylvania State UniversityUniversity ParkUSA

Personalised recommendations