We recruited participants from CrowdFlowerFootnote 2: 600 workers for the single worker experiments modes and 600 workers for the collaborative experiments.
6.1 Social Pressure: Please Stay vs Let’s Play
When Wordsmith senses that a worker’s partner is about to exit the task, the worker is alerted. The worker can then request their partner to remain in the task. If the worker has tagged less than the requisite number of images in order to get paid, the worker can send a please stay request, else, the worker can send a let’s play request. The receiving worker can then decide to stay (i will stay) or to leave the task (i will go) Table 1.
Social Pressure Requests. From the results in Fig. 2 with its accompanying table, we observe that workers are more likely to initiate a request of any kind when they have not been paid. When a worker has not yet been paid, they are more likely to request that their partner stay (please stay request) than permitting their partner to leave. After the workers had been paid, they were also more likely to request their partner to stay (let’s play request) than permitting them to leave. The please stay requests (Requests = 1, 023) were used more frequently as a social incentive than the let’s play request (Requests = 151), suggesting that workers are more inclined to put pressure on their partners when there is financial reward at stake than just fun. Figure 2 also reveals that some workers would actually release their partner to leave and wait to be connected to another partner. It shows that on the average, as expected, fewer workers (20 % vs 35 %) who haven’t been paid would opt for this option.
Social Pressure Responses Figure 3 summarises the results (in a logarithmic scale) of a worker’s responses to both please stay and let’s play requests. When a worker receives a please stay request (signifying that the requesting partner has not yet been paid), they can respond by choosing either to stay (I will stay) or to leave (I will go). The choice to stay or to leave also varies depending on whether the receiving worker has been paid or not. The results indicate that, a worker who has not been paid, receiving a please stay message from a fellow unpaid is more likely to stay, with 95 % probability, than to exit the task (760 vs 41). This is in line with workers being incentivised by having shared circumstances (i.e., the need to both get paid), as stated by . Similarly, a worker receiving a please stay request from an unpaid worker, after they have been paid, is also likely to respond by staying, albeit, with a slightly less probability of 75 % (92 vs 30). Furthermore, a worker receiving a let’s play request (from a worker that has been paid) can also choose to stay or to leave, depending on whether the receiving worker has been paid or not. The results illustrate that, a worker who has not been paid, previously intending to exit the task, would almost certainly remain in the task after being sent a let’s play message with 97 % probability (32 vs 1). The result also reveals the response to social flow incentives: a worker who has been paid would return to continue playing with another worker with 80 % certainty, even more likely than they would help a partner get paid (although, the results suggest that these requests occur less frequently). This is also another form of incentivisation by having shared circumstances (i.e., the desire to re-experience social flow).
Figure 3 also gives insights into when workers decide to leave their partners, despite receiving either a please stay or let’s play request. The results reveal that, after receiving a please stay request from a worker who has not been paid, a receiving worker is more likely to leave if they have not been paid also. Hence they do not feel any guilt from leaving their partner hanging since they haven’t been paid also. Similarly, after receiving a let’s play request from a partner who has been paid, the receiving worker is more likely to decline the offer and choose to exit the task if they have also been paid.