Skip to main content

Measuring Perceived Causal Relationships Between Narrative Events with a Crowdsourcing Application on Mturk

  • Conference paper
  • First Online:
  • 2022 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10354))

Abstract

The computational study of narrative is important to multiple academic disciplines. However, prior research has been limited by the inability to quantify each subject’s comprehension of the causal structure. With the aid of big data technology and crowdsourcing tools, we aim to design a new approach to analyze the content of narratives in a data-driven manner, while also making these analyses scientifically replicable. The goal of this research is therefore to develop a method that can be used to measure people’s understanding of the causal relationships within a piece of text.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Bird, S., et al.: Natural Language Processing with Python. O’Reilly Media, Inc. (2009)

    Google Scholar 

  2. Boyd, S., et al.: Randomized gossip algorithms. IEEE/ACM Trans. Networking (TON) 14(SI), 2508–2530 (2006)

    MathSciNet  MATH  Google Scholar 

  3. Broniatowski, D.A., et al.: Effective vaccine communication during the Disneyland measles outbreak. Vaccine 34(28), 3225–3228 (2016)

    Article  Google Scholar 

  4. Buhrmester, M., et al.: Amazon’s Mechanical Turk a new source of inexpensive, yet high-quality, data? Perspect. Psychol. Sci. 6(1), 3–5 (2011)

    Article  Google Scholar 

  5. Callison-Burch, C., Dredze, M.: Creating speech and language data with Amazon’s Mechanical Turk. In: Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon’s Mechanical Turk, pp. 1–12. Association for Computational Linguistics (2010)

    Google Scholar 

  6. Cowan, R., Jonard, N.: Network structure and the diffusion of knowledge. J. Econ. Dyn. Control 28(8), 1557–1575 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  7. Del Vicario, M., et al.: The spreading of misinformation online. Proc. Natl. Acad. Sci. 113(3), 554–559 (2016)

    Article  Google Scholar 

  8. Dredze, M., et al.: Zika vaccine misconceptions: a social media analysis. Vaccine 34(30), 3441 (2016)

    Article  Google Scholar 

  9. Gernsbacher, M.A., et al.: Investigating differences in general comprehension skill. J. Exp. Psychol. Learn. Memory Cogn. 16(3), 430 (1990)

    Article  Google Scholar 

  10. Heitkötter, H., Hanschke, S., Majchrzak, Tim A.: Evaluating cross-platform development approaches for mobile applications. In: Cordeiro, J., Krempels, K.-H. (eds.) WEBIST 2012. LNBIP, vol. 140, pp. 120–138. Springer, Heidelberg (2013). doi:10.1007/978-3-642-36608-6_8

    Chapter  Google Scholar 

  11. Hu, D., Broniatowski, D.A.: Designing a Crowdsourcing Tool to Measure Perceived Causal Relationships Between Narrative Events. http://sbp-brims.org/2016/proceedings/LB_129.pdf

  12. Kintsch, W., Van Dijk, T.A.: Toward a model of text comprehension and production. Psychol. Rev. 85(5), 363 (1978)

    Article  Google Scholar 

  13. Kozinets, R.V., et al.: Networked narratives: Understanding word-of-mouth marketing in online communities. J. Mark. 74(2), 71–89 (2010)

    Article  Google Scholar 

  14. Leskovec, J., Sosič, R.: SNAP: a general purpose network analysis and graph mining library in C++, June 2014. http://snap.stanford.edu/snap

  15. McKoon, G., Ratcliff, R.: Inference during reading. Psychol. Rev. 99(3), 440 (1992)

    Article  Google Scholar 

  16. Shutters, S.T., Cutts, B.B.: A simulation model of cultural consensus and persistent conflict. In: Proceedings of the Second International Conference on Computational Cultural Dynamics, pp. 71–78 (2008)

    Google Scholar 

  17. Singer, M., et al.: Minimal or global inference during reading. J. Mem. Lang. 33(4), 421 (1994)

    Article  Google Scholar 

  18. Trabasso, T., et al.: Logical necessity and transitivity of causal relations in stories. Discourse Processes 12(1), 1–25 (1989)

    Article  Google Scholar 

  19. Trabasso, T.: Causal cohesion and story coherence (1982)

    Google Scholar 

  20. Trabasso, T., Van Den Broek, P.: Causal thinking and the representation of narrative events. J. Mem. Lang. 24(5), 612–630 (1985)

    Article  Google Scholar 

  21. Van den Broek, P., et al.: The landscape model of reading: Inferences and the online construction of a memory representation. The construction of mental representations during reading, pp. 71–98 (1999)

    Google Scholar 

  22. Winterbottom, A., et al.: Does narrative information bias individual’s decision making? A systematic review. Soc. Sci. Med. 67(12), 2079–2088 (2008)

    Article  Google Scholar 

Download references

Acknowledgment and Disclaimer

This work was supported in part by the National Institute of General Medical Sciences under grant number 5R01GM114771. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dian Hu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Hu, D., Broniatowski, D.A. (2017). Measuring Perceived Causal Relationships Between Narrative Events with a Crowdsourcing Application on Mturk. In: Lee, D., Lin, YR., Osgood, N., Thomson, R. (eds) Social, Cultural, and Behavioral Modeling. SBP-BRiMS 2017. Lecture Notes in Computer Science(), vol 10354. Springer, Cham. https://doi.org/10.1007/978-3-319-60240-0_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60240-0_43

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60239-4

  • Online ISBN: 978-3-319-60240-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics