Collecting and Organizing Citizen Opinions: A Dynamic Microtask Approach and Its Evaluation

  • Masaki MatsubaraEmail author
  • Yuhei Matsuda
  • Ryohei Kuzumi
  • Masanori Koizumi
  • Atsuyuki Morishima
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12051)


Citizens’ opinions are important information resources for democratic local governments. Since a mere collection of opinions is not easy to analyze, the collected opinions should be organized, so that the governments can effectively analyze it. Recently, web-based public opinion collection systems have been widely used, but many of them merely implement traditional methods. For example, collecting opinions in web-based questionnaire still use free-text fields, and organizing the collected opinions remains a cumbersome task for the government staff. This paper explores a new design space and proposes a scheme where citizens take part in organizing and classifying opinions while answering the questionnaire. In the scheme, we collect citizen opinions in a structured form, with a microtask interface that changes the list of choices dynamically. Our system has been used by Tsukuba city for several real-world opinion-collection projects. Our experience so far shows that the scheme is effective in organizing the collected opinions for analysis.


Information integration System development Civic-tech Public opinion data 



This work was partially supported by JST CREST Grant Number JPMJCR16E3 including AIP challenge program and JST Mirai Program Grant Number JPMJMI19G8, Japan.


  1. 1.
    Antoun, C., Couper, M.P., Conrad, F.G.: Effects of mobile versus pc web on survey response quality: a crossover experiment in a probability web panel. Public Opin. Q. 81(S1), 280–306 (2017). Scholar
  2. 2.
    Baldauf, M., Suette, S., Fröhlich, P., Lehner, U.: Interactive opinion polls on public displays: studying privacy requirements in the wild. In: Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services, MobileHCI 2014, pp. 495–500. ACM, New York (2014).
  3. 3.
    Barnes, W., Mann, B.C.: Making local democracy work: municipal officials’ views about public engagement. Nat. Civic Rev. 100(3), 58–62 (2011)CrossRefGoogle Scholar
  4. 4.
    Butt, M.: Result-oriented e-government evaluation: citizen’s perspective. Webology 11(1), 1–33 (2014)MathSciNetGoogle Scholar
  5. 5.
    Chua, A.Y., Goh, D.H., Ang, R.P.: Web 2.0 applications in government web sites: prevalence, use and correlations with perceived web site quality. Online Inf. Rev. 36(2), 175–195 (2012)CrossRefGoogle Scholar
  6. 6.
    Couper, M.P.: The future of modes of data collection. Public Opin. Q. 75(5), 889–908 (2011). Scholar
  7. 7.
    Dow, A., Vines, J., Comber, R., Wilson, R.: Thoughtcloud: exploring the role of feedback technologies in care organisations. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 2016, pp. 3625–3636. ACM, New York (2016).
  8. 8.
    Evans, L., Franks, P., Chen, H.M.: Voices in the cloud: social media and trust in canadian and us local governments. Rec. Manage. J. 28(1), 18–46 (2018)Google Scholar
  9. 9.
    Fishkin, J.: When the People Speak: Deliberative Democracy and Public Consultation. Oxford Univerity Press, Oxford (2011). Scholar
  10. 10.
    Graeff, E.: Crowdsourcing as reflective political practice: Building a location-based tool for civic learning and engagement, September 2014Google Scholar
  11. 11.
    Granicus: textizen.
  12. 12.
    Groves, R.M., Presser, S., Dipko, S.: The role of topic interest in survey participation decisions. Public Opin. Q. 68(1), 2–31 (2004). Scholar
  13. 13.
    Isaksson, M., Jørgensen, P.E.F.: Connecting with citizens: the emotional rhetoric of norwegian and danish municipal websites. Nordicom Rev. 39(1), 111–128 (2018)CrossRefGoogle Scholar
  14. 14.
    Kawamoto, T., Aoki, T.: Democratic classification of free-format survey responses with a network-based framework. Nat. Mach. Intell. 1(7), 322 (2019)CrossRefGoogle Scholar
  15. 15.
    Kawase, S., et al.: Cyber-physical hybrid environment using a largescale discussion system enhances audiences’ participation and satisfaction in the panel discussion. IEICE Trans. Inf. Syst. 101(4), 847–855 (2018)CrossRefGoogle Scholar
  16. 16.
    King, S.F., Brown, P.: Fix my street or else: using the internet to voice local public service concerns. In: Proceedings of the 1st International Conference on Theory and Practice of Electronic Governance, ICEGOV 2007, pp. 72–80. ACM, New York (2007).
  17. 17.
    Klein, M.: Enabling large-scale deliberation using attention-mediation metrics. Comput. Support. Coop. Work (CSCW) 21(4), 449–473 (2012). Scholar
  18. 18.
    Koeman, L., Kalnikaité, V., Rogers, Y.: “Everyone is talking about it!”: a distributed approach to urban voting technology and visualisations. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 3127–3136. ACM, New York (2015).
  19. 19.
    Lee, C.S., Anand, V., Han, F., Kong, X., Goh, D.H.-L.: Investigating the use of a mobile crowdsourcing application for public engagement in a smart city. In: Morishima, A., Rauber, A., Liew, C.L. (eds.) ICADL 2016. LNCS, vol. 10075, pp. 98–103. Springer, Cham (2016). Scholar
  20. 20.
    Loures, T.C., Vaz de Melo, P.O., Veloso, A.A.: Generating entity representation from online discussions: challenges and an evaluation framework. In: Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web, WebMedia 2017, pp. 197–204. ACM, New York (2017).
  21. 21.
    Matsumoto, T., Sunayama, W., Hatanaka, Y., Ogohara, K.: Data analysis support by combining data mining and text mining. In: 2017 6th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI), pp. 313–318, July 2017.
  22. 22.
    Mergel, I.: Distributed democracy: for crowdsourced issue reporting, January 2012Google Scholar
  23. 23.
    Miller, P.V.: Is there a future for surveys? Public Opin. Q. 81(S1), 205–212 (2017). Scholar
  24. 24.
    Network, G.O.I.: Online Consultation in GOL Countries: Initiatives to Foster E-democracy: Project Report (2001).
  25. 25.
    Offenhuber, D.: Infrastructure legibility-a comparative analysis of open311-based citizen feedback systems. Camb. J. Reg. Econ. Soc. 8(1), 93–112 (2015). Scholar
  26. 26.
    Price, V.: Public opinion research in the new century reflections of a former POQ editor. Public Opin. Q. 75(5), 846–853 (2011). Scholar
  27. 27.
    Reddel, T., Woolcock, G.: From consultation to participatory governance? a critical review of citizen engagement strategies in Queensland. Aust. J. Public Adm. 63(3), 75–87 (2004). Scholar
  28. 28.
    Sakamura, M., Ito, T., Tokuda, H., Yonezawa, T., Nakazawa, J.: Minaqn: web-based participatory sensing platform for citizen-centric urban development. In: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2015 Adjunct, pp. 1607–1614. ACM, New York (2015).
  29. 29.
    Sandoval-Almazan, R., Gil-Garcia, J.R.: Assessing local e-government: an initial exploration of the case of Mexico. In: Proceedings of the 4th International Conference on Theory and Practice of Electronic Governance, ICEGOV 2010, pp. 61–65, ACM, New York (2010).
  30. 30.
    Schober, M.F., Pasek, J., Guggenheim, L., Lampe, C., Conrad, F.G.: Social media analyses for social measurement. Public Opin. Q. 80(1), 180–211 (2016). Scholar
  31. 31.
    Schuurman, D., Baccarne, B., De Marez, L., Mechant, P.: Smart ideas for smartcities: investigating crowdsourcing for generating and selecting ideas forict innovation in a city context. J. Theor. Appl. Electron. Commer. Res. 7(3), 49–62 (2012). Scholar
  32. 32.
    Seki, Y.: Use of twitter for analysis of public sentiment for improvement of local government service. In: 2016 IEEE International Conference on Smart Computing (SMARTCOMP), pp. 1–3, May 2016.
  33. 33.
    Siangliulue, P., Chan, J., Dow, S.P., Gajos, K.Z.: Ideahound: improving large-scale collaborative ideation with crowd-powered real-time semantic modeling. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST 2016, pp. 609–624. ACM, New York (2016).
  34. 34.
    Vargas, A.M.P.: A proposal of digital government for Colombia. In: Proceedings of the 11th International Conference on Theory and Practice of Electronic Governance, pp. 693–695. ACM (2018)Google Scholar
  35. 35.
    Vlachokyriakos, V., et al.: Postervote: expanding the action repertoire for local political activism. In: Proceedings of the 2014 Conference on Designing Interactive Systems, DIS 2014, pp. 795–804. ACM, New York (2014).
  36. 36.
    Wright, S.: Government-run online discussion fora: moderation, censorship and the shadow of control1. The Br. J. Polit. Int. Relat. 8(4), 550–568 (2006). Scholar
  37. 37.
    Yamanishi, K., Li, H.: Mining open answers in questionnaire data. IEEE Intell. Syst. 17(5), 58–63 (2002). Scholar
  38. 38.
    Yaniv, I.: Receiving other people’s advice: influence and benefit. Organ. Behav. Hum. Decis. Process. 93(1), 1–13 (2004). Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Masaki Matsubara
    • 1
    Email author
  • Yuhei Matsuda
    • 2
  • Ryohei Kuzumi
    • 3
  • Masanori Koizumi
    • 1
  • Atsuyuki Morishima
    • 1
  1. 1.Faculty of Library, Information and Media ScienceUniversity of TsukubaTsukuba-shiJapan
  2. 2.Graduate school of Library and Media StudiesUniversity of TsukubaTsukubaJapan
  3. 3.Public Relations Policy DivisionTsukubaJapan

Personalised recommendations