Skip to main content

A Rewarding Framework for Crowdsourcing to Increase Privacy Awareness

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12840))

Abstract

Digital applications typically describe their privacy policy in lengthy and vague documents (called PrPs), but these are rarely read by users, who remain unaware of privacy risks associated with the use of these digital applications. Thus, users need to become more aware of digital applications’ policies and, thus, more confident about their choices. To raise privacy awareness, we implemented the CAP-A portal, a crowdsourcing platform which aggregates knowledge as extracted from PrP documents and motivates users in performing privacy-related tasks. The Rewarding Framework is one of the most critical components of the platform. It enhances user motivation and engagement by combining features from existing successful rewarding theories. In this work, we describe this Rewarding Framework, and show how it supports users to increase their privacy knowledge level by engaging them to perform privacy-related tasks, such as annotating PrP documents in a crowdsourcing environment. The proposed Rewarding Framework was validated by pilots ran in the frame of the European project CAP-A and by a user evaluation focused on its impact in terms of engagement and raising privacy awareness. The results show that the Rewarding Framework improves engagement and motivation, and increases users’ privacy awareness.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://www.varonis.com/blog/gdpr-privacy-policy/.

  2. 2.

    https://eur-lex.europa.eu/eli/reg/2016/679/oj.

  3. 3.

    https://www.cap-a.eu/portal.

  4. 4.

    https://www.cap-a.eu.

  5. 5.

    https://www.caprice-community.net.

  6. 6.

    https://www.mturk.com/.

  7. 7.

    http://www.w3id.org/reward-ontology.

  8. 8.

    https://cap-a.eu/portal#info.

  9. 9.

    https://conjointly.com/kb/likert-scaling/.

  10. 10.

    https://www.nngroup.com/articles/usability-metrics/.

References

  1. Amini, S., Lin, J., Hong, J.I., Lindqvist, J., Zhang, J.: Mobile application evaluation using automation and crowdsourcing (2018). https://doi.org/10.1184/R1/6470255.v1

  2. Amini, S.: Analyzing mobile app privacy using computation and crowdsourcing. Ph.D. thesis, Carnegie Mellon University (2014)

    Google Scholar 

  3. Antikainen, M.J., Vaataja, H.K.: Rewarding in open innovation communities-how to motivate members. Int. J. Entrepre. Innov. Manag. 11(4), 440–456 (2010)

    Google Scholar 

  4. Antón, A.I., Earp, J.B., He, Q., Stufflebeam, W., Bolchini, D., Jensen, C.: Financial privacy policies and the need for standardization. IEEE Secur. Privacy 2(2), 36–45 (2004)

    Article  Google Scholar 

  5. Bergmann, M.: Testing privacy awareness. In: IFIP Summer School on the Future of Identity in the Information Society, pp. 237–253 (2008)

    Google Scholar 

  6. Bergram, K., Bezençon, V., Maingot, P., Gjerlufsen, T., Holzer, A.: Digital nudges for privacy awareness: from consent to informed consent? In: ECIS (2020)

    Google Scholar 

  7. Bhatia, J., Breaux, T.D., Schaub, F.: Mining privacy goals from privacy policies using hybridized task recomposition. ACM TOSEM 25(3), 1–24 (2016)

    Google Scholar 

  8. Chrysakis, I.: CAP-A rewarding framework evaluation - list of questions (2020). https://doi.org/10.6084/m9.figshare.13042772.v8

  9. Chrysakis, I.: Introduction to CAP-A portal & rewarding evaluation scenario (2020). https://doi.org/10.6084/m9.figshare.13042787.v5

  10. Chrysakis, I., Flouris, G., Patkos, T., Dimou, A., Verborgh, R.: REWARD: ontology for reward schemes. In: Harth, A., et al. (eds.) ESWC 2020. LNCS, vol. 12124, pp. 56–60. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-62327-2_10

    Chapter  Google Scholar 

  11. Chrysakis, I., et al.: CAP-A: a suite of tools for data privacy evaluation of mobile applications. In: JURIX (2020)

    Google Scholar 

  12. Chrysakis, I., et al.: Evaluating the data privacy of mobile applications through crowdsourcing. In: JURIX (2020)

    Google Scholar 

  13. Craig, T., Ludloff, M.E.: Privacy and Big Data: The Players, Regulators, and Stakeholders. O’Reilly Media, Inc., Sebastopol (2011)

    Google Scholar 

  14. Diamantopoulou, V., Androutsopoulou, A., Gritzalis, S., Charalabidis, Y.: An assessment of privacy preservation in crowdsourcing approaches: towards GDPR compliance. In: RCIS, pp. 1–9. IEEE (2018)

    Google Scholar 

  15. Fatima, R., Yasin, A., Liu, L., Wang, J., Afzal, W., Yasin, A.: Sharing information online rationally: An observation of user privacy concerns and awareness using serious game. J. Inf. Secur. Appl. 48, 102351 (2019)

    Google Scholar 

  16. Finnerty, A., Kucherbaev, P., Tranquillini, S., Convertino, G.: Keep it simple: reward and task design in crowdsourcing. In: CHItaly (2013)

    Google Scholar 

  17. Flouris, G., et al.: Towards a collective awareness platform for privacy concerns and expectations. In: ODBASE (2018)

    Google Scholar 

  18. Grobbink, E., Peach, K.: Combining crowds and machines (2020), https://www.nesta.org.uk/report/combining-crowds-and-machines/

  19. Hatamian, M., Kitkowska, A., Korunovska, J., Kirrane, S.: ‘It’s shocking!’: analysing the impact and reactions to the A3: android apps behaviour analyser. In: DBSec, pp. 198–215 (2018)

    Google Scholar 

  20. Kani-Zabihi, E., Helmhout, M.: Increasing service users’ privacy awareness by introducing on-line interactive privacy features. In: Laud, P. (ed.) NordSec 2011. LNCS, vol. 7161, pp. 131–148. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-29615-4_10

    Chapter  Google Scholar 

  21. Kavaliova, M., Virjee, F., Maehle, N., Kleppe, I.A.: Crowdsourcing innovation and product development: gamification as a motivational driver. Cogent Bus. Manag. 3(1), 1128132 (2016)

    Google Scholar 

  22. Kokolakis, S.: Privacy attitudes and privacy behaviour: a review of current research on the privacy paradox phenomenon. Comput. Secur. 64, 122–134 (2017)

    Google Scholar 

  23. Krishnamurthy, S., Ou, S., Tripathi, A.K.: Acceptance of monetary rewards in open source software development. Res. Policy 43(4), 632–644 (2014)

    Google Scholar 

  24. Lee, T.Y., et al.: Experiments on motivational feedback for crowdsourced workers. In: \(7^{th}\) AAAI Conference on Weblogs and Social Media (2013)

    Google Scholar 

  25. Liang, F., Yu, W., An, D., Yang, Q., Fu, X., Zhao, W.: A survey on big data market: pricing, trading and protection. IEEE Access 6, 15132–15154 (2018)

    Google Scholar 

  26. McCall, M., Voorhees, C.: The drivers of loyalty program success: an organizing framework and research agenda. Cornell Hosp. Q. 51(1), 35–52 (2010)

    Article  Google Scholar 

  27. McGonigal, J.: Reality Is Broken: Why Games Make Us Better and Bow They Can Change the World, Penguin, New York (2011)

    Google Scholar 

  28. Morschheuser, B., Hamari, J., Koivisto, J.: Gamification in crowdsourcing: a review. In: \(49^{th}\) Hawaii International Conference on System Sciences (2016)

    Google Scholar 

  29. Morschheuser, B., Hamari, J., Koivisto, J., Maedche, A.: Gamified crowdsourcing: conceptualization, literature review, and future agenda. Int. J. Hum. Comput. Stud. 106, 26–43 (2017)

    Article  Google Scholar 

  30. Nejad, N.M., Scerri, S., Lehmann, J.: KnIGHT: mapping privacy policies to GDPR. In: European Knowledge Acquisition Workshop, pp. 258–272 (2018)

    Google Scholar 

  31. Newman, G., Wiggins, A., Crall, A., Graham, E., Newman, S., Crowston, K.: The future of citizen science: emerging technologies and shifting paradigms. Front. Ecol. Environ. 10(6), 298–304 (2012)

    Google Scholar 

  32. Oltramari, A., Piraviperumal, D., Schaub, F., Wilson, S., Cherivirala, S., Norton, T.B., Russell, N.C., Story, P., Reidenberg, J., Sadeh, N.: Privonto: a semantic framework for the analysis of privacy policies. Seman. Web 9(2), 185–203 (2018)

    Article  Google Scholar 

  33. Pötzsch, S.: Privacy awareness: a means to solve the privacy paradox? In: Matyáš, V., Fischer-Hübner, S., Cvrček, D., Švenda, P. (eds.) Privacy and Identity 2008. IAICT, vol. 298, pp. 226–236. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03315-5_17

    Chapter  Google Scholar 

  34. Samaha, S.A., Palmatier, R.W., Dant, R.P.: Poisoning relationships: perceived unfairness in channels of distribution. J. Market. 75(3), 99–117 (2011)

    Article  Google Scholar 

  35. Scekic, O., Truong, H.L., Dustdar, S.: Incentives and rewarding in social computing. Commun. ACM 56(6), 72–82 (2013)

    Article  Google Scholar 

  36. Solove, D.J.: The myth of the privacy paradox. Available at SSRN (2020)

    Google Scholar 

  37. Vroom, V.H.: Work and Motivation. Wiley, New York (1964)

    Google Scholar 

  38. Wilson, S., et al.: Crowdsourcing annotations for websites’ privacy policies: can it really work? In: Proceedings of WWW-16, pp. 133–143 (2016)

    Google Scholar 

  39. Xu, H., Dinev, T., Smith, H.J., Hart, P.J.: Examining the formation of individual’s privacy concerns: toward an integrative view. In: ICIS (2008)

    Google Scholar 

  40. Yang, D., Xue, G., Fang, X., Tang, J.: Crowdsourcing to smartphones: incentive mechanism design for mobile phone sensing. In: MobiCom (2012)

    Google Scholar 

  41. Zichermann, G., Cunningham, C.: Gamification by Design: Implementing Game Mechanics in Web and Mobile Apps. O’Reilly Media, Inc., Sebastopol (2011)

    Google Scholar 

Download references

Acknowledgement

This work has been supported by the CAP-A project which has received funding from the European Union’s Horizon 2020 research and innovation programme under the NGI_TRUST grant agreement no 825618. The described research activities were also funded by Ghent University, imec, Flanders Innovation & Entrepreneurship (VLAIO). Ruben Verborgh is a postdoctoral fellow of the Research Foundation – Flanders (FWO).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ioannis Chrysakis .

Editor information

Editors and Affiliations

Appendix: RF Implementation Details

Appendix: RF Implementation Details

We present below details regarding the rules that we applied for task levels, tiers and for the introduced badges in the RF implementation.

Table 4. Task levels
Table 5. Available tiers

Badges

  • Social/Buddy: users who invited more than five friends to join the system or to accomplish a specific task within a month;

  • Super Star: users who completed at least ten tasks in a month;

  • On Fire: users who completed more than three tasks in the last week;

  • Ambassador: users with high expertise on various tasks or on privacy issues; ambassadors are invited/suggested by the crowd or by other ambassadors.

  • Inactive: users who joined the system but did not start/complete any task;

  • Sleepy: users who completed at least one task but did not start a new one for the last three months.

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chrysakis, I. et al. (2021). A Rewarding Framework for Crowdsourcing to Increase Privacy Awareness. In: Barker, K., Ghazinour, K. (eds) Data and Applications Security and Privacy XXXV. DBSec 2021. Lecture Notes in Computer Science(), vol 12840. Springer, Cham. https://doi.org/10.1007/978-3-030-81242-3_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-81242-3_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-81241-6

  • Online ISBN: 978-3-030-81242-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics