Abstract
Crowd accessibility services for people with disabilities, driven by crowd-sourcing methods, are gaining traction as a viable means of realizing innovative services by leveraging both human and machine intelligence. As the approach matures, researchers and practitioners are seeking to build various types of services. However, many of them encounter similar challenges, such as variations in quality and sustaining contributor participation for durable services. There are growing needs to share tangible knowledge about the best practices to help build and maintain successful services. Towards this end, we are sharing our experiences with crowd accessibility services that we have deployed and studied. Initially, we developed a method to analyze the dynamics of contributor participation. We then analyzed the actual data from three service deployments spanning several years. The service types included Web accessibility improvement, text digitization, and video captioning. We then summarize the lessons learned and future research directions for sustainable services.
Chapter PDF
Similar content being viewed by others
References
von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2004, pp. 319–326 (2004)
Benetech. Accessible books and periodicals for readers with print disabilities - Bookshare - accessible books for individuals with print disabilities, http://www.bookshare.org/
Bigham, J.P., Jayant, C., Ji, H., Little, G., Miller, A., Miller, R.C., Miller, R., Tatarowicz, A., White, B., White, S., Yeh, T.: VizWiz: nearly real-time answers to visual questions. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 333–342 (2010)
Bigham, J.P., Kaminsky, R.S., Ladner, R.E., Danielsson, O.M., Hempton, G.L.: WebInSight: making Web images accessible. In: Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2006, pp. 181–188 (2006)
Bigham, J.P., Ladner, R.E., Borodin, Y.: The design of human-powered access technology. In: Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2011, pp. 3–10 (2011)
Bryant, S.L., Forte, A., Bruckman, A.: Becoming Wikipedian: transformation of participation in a collaborative online encyclopedia. In: Proceedings of the 2005 International ACM SIGGROUP Conference on Supporting Group Work, GROUP 2005, pp. 1–10 (2005)
Dardailler, D.: The ALT-server (“An eye for an alt”) (1997), http://www.w3.org/WAI/altserv.htm
Ishihara, T., Itoko, T., Sato, D., Tzadok, A., Takagi, H.: Transforming Japanese archives into accessible digital books. In: Proceedings of the 12th ACM/IEEE-CS Joint Conference on Digital Libraries, JCDL 2012, pp. 91–100 (2012)
IQ Engines. IQ Engines: image recognition and visual search, http://www.iqengines.com/
Nielsen, J.: Zipf distribution (power law) of Website popularity (Alertbox Sidebar) (1997), http://www.useit.com/alertbox/zipf.html
Nielsen, J.: 90-9-1” rule for participation inequality: lurkers vs. contributors in internet communities (Jakob Nielsen’s Alertbox) (2006), http://www.useit.com/alertbox/participation_inequality.html
Sobhi, A., Nagatsuma, R., Saitoh, T.: Collaborative Caption Editing System – Enhancing the Quality of a Captioning and Editing System. In: Proceedings of the 28th Annual International Technology and Persons with Disabilities Conference, CSUN 2012 (2012)
Nonnecke, B., Preece, J.: Lurker demographics: counting the silent. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2000, pp. 73–80 (2000)
Nonnecke, B., Preece, J.: Why lurkers lurk. In: Proceedings of the Americas Conference on Information Systems (2001)
Stewart, O., Lubensky, D., Huerta, J.M.: Crowdsourcing participation inequality: a SCOUT model for the enterprise domain. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, HCOMP 2010, pp. 30–33 (2010)
Swartz, A.: Who writes Wikipedia? (2006), http://www.aaronsw.com/weblog/whowriteswikipedia
Takagi, H., Kawanaka, S., Kobayashi, M., Itoh, T., Asakawa, C.: Social Accessibility: achieving accessibility through collaborative metadata authoring. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2008, pp. 193–200 (2008)
Takagi, H., Kawanaka, S., Kobayashi, M., Sato, D., Asakawa, C.: Collaborative Web accessibility improvement: challenges and possibilities. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2009, pp. 195–202 (2009)
Valerie, C., Harrison, A.: Bookshare crosses 100,000-member milestone - Bookshare - accessible books for individuals with print disabilities (2010), http://www.bookshare.org/_/aboutUs/2010/07/100KmemberMilestone
Wikipedia. Wikipedia:Wikipedians - Wikipedia, the free encyclopedia (2011), http://en.wikipedia.org/wiki/Wikipedia:Wikipedians
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 IFIP International Federation for Information Processing
About this paper
Cite this paper
Takagi, H., Harada, S., Sato, D., Asakawa, C. (2013). Lessons Learned from Crowd Accessibility Services. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2013. INTERACT 2013. Lecture Notes in Computer Science, vol 8117. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40483-2_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-40483-2_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40482-5
Online ISBN: 978-3-642-40483-2
eBook Packages: Computer ScienceComputer Science (R0)