Effects of Cognitive Consistency in Microtask Design with only Auditory Information
- 737 Downloads
Abstract
Microtasks expand ways for people to work, which we could not imagine in the past. When people have pockets of time, they can perform microtasks. This paper pursues this approach further by exploring the design of microtasks that interact with workers with audio and physical means only, without any visual representation. Such a task can be performed in situations where workers cannot use display devices. This paper shows that consistency in navigation is an important factor and proposes a principled framework that develops consistent non-visual microtasks. The experimental results with real-world workers show that the resultant task design allows them to produce better results than tasks without consistency.
Keywords
Crowdsourcing No visual representation ConsistencyNotes
Acknowledgments
This work was partially supported by JST CREST Grant Number JPMJCR16E3 and JSPS KAKENHI Grant Number 17K20022, Japan.
References
- 1.Abelson, R.P., Rosenberg, M.: Symbolic psycho-logic: a model of attitudinal cognition. Behav. Sci. 3, 1–8 (1958)CrossRefGoogle Scholar
- 2.Aggarwal, P., et al.: A case study on the use of IVR systems by visually impaired people. In: The 3rd ACM Symposium on Computing for Development (2013)Google Scholar
- 3.Brehm, J.W., Cohen, A.R.: Explorations in Cognitive Dissonance. Wiley, New York (1962)CrossRefGoogle Scholar
- 4.Cartwright, D., Harary, F.: Structural balance: a generalization of Heider’s theory. Psychol. Rev. 63, 277–293 (1956)CrossRefGoogle Scholar
- 5.Christen, P.: Data Matching. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-31164-2CrossRefGoogle Scholar
- 6.Corkrey, R., Parkinson, L.: Interactive voice response: review of studies 1989–2000. Behav. Res. Methods Instrum. Comput. 34, 342–353 (2002). https://doi.org/10.3758/BF03195462CrossRefGoogle Scholar
- 7.D’Atri, E., Medaglia, C., Serbanati, A., Ceipidor, U.B., Panizzi, E., D’Atri, A.: A system to aid blind people in the mobility: a usability test and its results. In: 2nd International Conference on Systems (2007)Google Scholar
- 8.Donker, H., Klante, P., Gorny, P.: The design of auditory user interfaces for blind users. In: Proceedings of the Second Nordic Conference on Human-Computer Interaction (2002)Google Scholar
- 9.Elmagarmid, A.K., Ipeirotis, P.G., Verykios, V.S.: Duplicate record detection: a survey. TKDE 19, 1–16 (2007)Google Scholar
- 10.Festinger, L.: A Theory of Cognitive Dissonance. Row, Peterson, Evanston (1957)Google Scholar
- 11.Getoor, L., Machanavajjhala, A.: Entity resolution: theory, practice & open challenges. In: Proceedings of the VLDB Endowment (2012) Google Scholar
- 12.Gokhale, C., et al.: Corleone: hands-off crowdsourcing for entity matching. In: SIGMOD, pp. 601–612 (2014)Google Scholar
- 13.Heberlein, T.A., Black, J.S.: Cognitive consistency and environmental action. Environ. Behav. 13, 717–734 (1981)CrossRefGoogle Scholar
- 14.Heider, F.: Attitudes and cognitive organization. J. Psychol. 21, 107–111 (1946)CrossRefGoogle Scholar
- 15.Heider, F.: The Psychology of Interpersonal Relations. Wiley, New York (1958)CrossRefGoogle Scholar
- 16.Hirth, M., HoBfeld, T., Tran-Gia, P.: Anatomy of a crowdsourcing platform - using the example of microworkers.com. In: Workshop on Future Internet and Next Generation Networks (2011)Google Scholar
- 17.Iwamoto, E., et al.: Passerby crowdsoucing: workers’ behavior and data quality management. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, no. 4 (2018)Google Scholar
- 18.Jiang, L., Wang, Y., Hoffart, J., Weikum, G.: Crowdsourced entity markup. In: CrowdSem (2013)Google Scholar
- 19.Lahav, O., Schloerb, D., Kumar, S., Srinivasan, M.: A virtual environment for people who are blind - a usability study. J. Assist. Technol. 6(1), 38–52 (2012). https://doi.org/10.1108/17549451211214346 CrossRefGoogle Scholar
- 20.Marcus, A., Wu, E., Karger, D., Madden, S., Miller, R.: Human-powered sorts and joins. PVLDB 5, 13–24 (2011)Google Scholar
- 21.Mudgal, S., et al.: Deep learning for entity matching: a design space exploration. In: SIGMOD 2018 (2018)Google Scholar
- 22.Nengroo, A.S., Kuppusamy, K.S.: Accessible images (AIMS): a model to build self-describing images for assisting screen reader users. Univers. Access Inf. Soc. 17, 607–619 (2017). https://doi.org/10.1007/s10209-017-0607-zCrossRefGoogle Scholar
- 23.Newcomb, T.M.: An approach to the study of communicative acts. Psychol. Rev. 60, 393–404 (1953)CrossRefGoogle Scholar
- 24.Osgood, C.E., Tannenbaum, P.H.: The principle of congruity in the prediction of attitude change. Psychol. Rev. 62, 42–55 (1955)CrossRefGoogle Scholar
- 25.Rahmanian, B., D.J.G.: User interface design for crowdsourcing systems. In: AVI (2014)Google Scholar
- 26.Rosenberg, M.J.: An Analysis of Affective-Cognitive Consistency. Yale University Press, New Haven (1960)Google Scholar
- 27.Sampath, H. A., R.R.I.B.: Conititively inspired task design to improve user performance on crowdsourcing platforms. In: CHI (2014)Google Scholar
- 28.Sanderson, P.M., Anderson, J., Watson, M.: Extending ecological interface design to auditory displays. In: Proceedings of the 2000 Annual Conference of the Computer-Human Interaction Special Interest Group (CHISIG) of the Ergonomics Society of Australia (OzCHI2000) (2000)Google Scholar
- 29.Shen, W., Li, X., Doan, A.: Constraint-based entity matching. In: AAAI 2005 (2005)Google Scholar
- 30.Simon, D., Snow, C.J., Read, S.J.: The redux of cognitive consistency theories: evidence judgments by constraint satisfaction. J. Pers. Soc. Psychol. 86, 814–837 (2004)CrossRefGoogle Scholar
- 31.Wang, J., Kraska, T., Franklin, M.J., Feng, J.: Crowder: crowdsourcing entity resolution. In: VLDB, pp. 1483–1494 (2012)Google Scholar
- 32.Yin, M., Zhai, S.: The benefits of augmenting telephone voice menu navigation with visual browsing and search. In: CHI 2006, pp. 319–328 (2006)Google Scholar
- 33.Zyskowski, K., Morris, M., Bigham, J., Gray, M., Kane, S.: Accessible crowdwork? Understanding the value in and challenge of microtask employment for people with disabilities. In: Proceedings of the 18th ACM Conference on Computer-Supported Cooperative Work & Social Computing, CSCW 2015, pp. 1682–1693 (2015)Google Scholar