Natural Language & Linguistic Theory

, Volume 34, Issue 2, pp 481–495

A streamlined approach to online linguistic surveys

Article

DOI: 10.1007/s11049-015-9305-9

Cite this article as:
Erlewine, M.Y. & Kotek, H. Nat Lang Linguist Theory (2016) 34: 481. doi:10.1007/s11049-015-9305-9

Abstract

More and more researchers in linguistics use large-scale experiments to test hypotheses about the data they research, in addition to more traditional informant work. In this paper we describe a new set of free, open-source tools that allow linguists to post studies online, turktools. These tools allow for the creation of a wide range of linguistic tasks, including grammaticality surveys, sentence completion tasks, and picture-matching tasks, allowing for easily implemented large-scale linguistic studies. Our tools further help streamline the design of such experiments and assist in the extraction and analysis of the resulting data. Surveys created using the tools described in this paper can be posted on Amazon’s Mechanical Turk service, a popular crowdsourcing platform that mediates between ‘Requesters’ who can post surveys online and ‘Workers’ who complete them. This allows many linguistic surveys to be completed within hours or days and at relatively low costs. Alternatively, researchers can host these randomized experiments on their own servers using a supplied server-side component.

Keywords

Experimental methods Online surveys Web-based experiments Crowdsourcing Amazon Mechanical Turk Software 

Supplementary material

11049_2015_9305_MOESM1_ESM.pdf (326 kb)
(PDF 320 kB)

Copyright information

© Springer Science+Business Media Dordrecht 2015

Authors and Affiliations

  1. 1.National University of SingaporeSingaporeSingapore
  2. 2.McGill UniversityMontrealCanada