Abstract
Black young adults use social media frequently and they are especially active on Twitter. Black young adults are exposed to both racially-affirming positive content and also racially-discriminatory negative content on Twitter. Correlational investigations have suggested that exposure to such content has psychological consequences, yet our understanding of acute responses to race-related Twitter messages remains hampered by the lack of a social media stimuli set that can be employed in an experimental setting. Therefore, we developed and tested an initial stimuli set of Tweets with different valences (i.e., positive, negative) and content (i.e., race-related, non-race-related) that can be used for testing experimental hypotheses about physiological, emotional, and behavioral changes associated with exposure to Twitter content in subsequent research. In two studies with Black college-attending young adult Twitter users (N = 43; Mage = 19.26) and a national sample of Black young adult Twitter users (N = 290, Mage = 25.85), we developed and tested the internal consistency, construct, convergent, ecological, and criterion-related validity of the stimuli set. The final Tweet Stimuli Set for Content about Black People (TSS-CBP) includes 16 stimuli grouped into four conditions (positive non-race-related, positive race-related, negative non-race-related, and negative race-related).
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Anderson, E., Walker, J., Kafai, Y. B., & Lui, D. (2017). The gender and race of pixels: An exploration of intersectional identity representation and construction within minecraft and its community. FDG 2017: Proceedings of the 12th International Conference on the Foundations of Digital Games, 17, 1–10. https://doi.org/10.1145/3102071.3102094
Bliuc, A.-M., Faulkner, N., Jakubowicz, A., & McGarty, C. (2018). Online networks of racial hate: A systematic review of 10 years of research on cyber-racism. Computers in Human Behavior, 87, 75–86. https://doi.org/10.1016/j.chb.2018.05.026
Brock, A. (2009). “Who do you think you are?”: Race, representation, and cultural rhetorics in online spaces. Poroi, 6(1), 15–35. https://doi.org/10.13008/2151-2957.1013
Brock, A. (2012). From the Blackhand side: Twitter as a cultural conversation. Journal of Broadcasting & Electronic Media, 56(4), 529–549. https://doi.org/10.1080/08838151.2012.732147
Canella, G. (2020). #BlackIsBeautiful: The radical politics of Black hair. Visual Studies, 35(2–3), 273–284. https://doi.org/10.1080/1472586X.2020.1789501
Chaudhry, I. (2015). #Hashtagging hate: Using Twitter to track racism online. First Monday, 20(2). https://doi.org/10.5210/fm.v20i2.5450
Chong, E. S. K., Zhang, Y., Mak, W. W. S., & Pang, I. H. Y. (2015). Social media as social capital of LGB individuals in Hong Kong: Its relation with group membership, stigma, and mental well-being. American Journal of Community Psychology, 55, 228–238. https://doi.org/10.1007/s10464-014-9699-2
Clark, L. E., & Watson, D. (2003). Constructing validity: Basic issues in objective scale development. In A. Kazdin (Ed.), Methodological issues and strategies in clinical research (pp. 207–232). The American Psychological Association.
Cox, J. M. (2017). The source of a movement: Making the case for social media as an informational source using Black Lives Matter. Ethnic and Racial Studies, 40(11), 1847–1854. https://doi.org/10.1080/01419870.2017.1334935
Criss, S., Michaels, E. K., Solomon, K., Allen, A. M., & Nguyen, T. T. (2020). Twitter fingers and echo chambers: Exploring expressions and experiences of online racism using Twitter. Journal of Racial and Ethnic Health Disparities, 8, 1322–1331. https://doi.org/10.1007/s40615-020-00894-5
Desalu, J. M., Goodhines, P. A., & Park, A. (2021). Vicarious racial discrimination racial identity and alcohol-related outcomes among Black young adults: An experimental approach. Psychology of Addictive Behaviors, 35(3), 283–294. https://doi.org/10.1037/adb0000707
Gaddis, S. M. (2017). How Black are Lakisha and Jamal? Racial perceptions from names used in correspondence audit studies. Sociological Science, 4, 469–489. https://doi.org/10.15195/v4.a19
Gill, T. M. (2015). #TeamNatural: Black hair and the politics of community in digital media. Nka Contemporary African Art, 37, 70–79. https://doi.org/10.1215/10757163-3339739
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition. The Implicit Association Tests. Journal of Personality and Social Psychology, 74(6), 1464–1480.
Hargittai, E., & Litt, E. (2011). The Tweet smell of celebrity success: Explaining variation in Twitter adoption among a diverse group of young adults. New Media & Society, 13(5), 824–842. https://doi.org/10.1177/1461444811405805
Hughey, M. W., & Daniels, J. (2013). Racist comments at online news sites: A methodological dilemma for discourse analysis. Media, Culture, & Society, 35(3), 332–347. https://doi.org/10.1177/0163443712472089
Ince, J., Rojas, F., & Davis, C. A. (2017). The social media response to Black Lives Matter: How Twitter users interact with Black Lives Matter through hashtag use. Ethnic & Racial Studies, 40(11), 1814–1830. https://doi.org/10.1080/01419870.2017.1334931
Jackson, S. J., Bailey, M., & Welles, B. F. (2020). #HashtagActivism: Networks of race and gender justice. MIT Press.
Kende, A., van Zomeren, M., Ujhelyi, A., & Lantos, N. A. (2016). The social affirmation use of social media as a motivator of collective action. Journal of Applied Social Psychology, 46, 453–469. https://doi.org/10.1111/jasp.12375
Keum, B. T. (2021). Does witnessing racism online promote individual and institutional anti-racism advocacy among White individuals? The role of White empathy, white guilt, and White fear of other races. Cyberpsychology, Behavior, and Social Networking, 24(11), 756–761.
Keum, B. T. (2022). Impact of Online Racism on Suicide Ideation Through Interpersonal Factors Among Racial Minority Emerging Adults: The Role of Perceived Burdensomeness and Thwarted Belongingness. Journal of Interpersonal Violence. https://doi.org/10.1177/08862605221117247
Keum, B. T. H., & Ahn, L. H. (2021). Impact of online racism on psychological distress and alcohol use severity: Testing ethnic-racial socialization and silence about race as moderators. Computers in Human Behavior, 120, 106773. https://doi.org/10.1016/j.chb.2021.106773
Keum, B. T. H., & Cano, M. A. (2021). Online racism, psychological distress, and alcohol use among racial minority women and men: A multi-group mediation analysis. American Journal of Orthopsychiatry, 91(4), 524–530. https://doi.org/10.1037/ort0000553
Keum, B. T., & Cano, M. Á. (2023). Online racism, depressive and anxiety symptoms, coping-related drinking motives, and alcohol use severity among Black, Latina/o/x, and Asian emerging adults. Addictive behaviors, 136, 107468. https://doi.org/10.1016/j.addbeh.2022.107468
Keum, B. T. H., & Miller, M. J. (2017). Racism in digital era: Development and initial validation of the Perceived Online Racism Scale (PORS v1.0). Journal of Counseling Psychology, 64(3), 310–324. https://doi.org/10.1037/cou0000205
Kite, M. E., & Whitley, B. E. (2018). Developing a measurement strategy. In Principles of research in behavioral science (pp. 226–276). Routledge.
Kowalski, R. M., Dillon, E., Macbeth, J., Franchi, M., & Bush, M. (2020). Racial differences in cyberbullying from the perspective of victims and perpetrators. American Journal of Orthopsychiatry, 90(5), 644–652. https://doi.org/10.1037/ort0000492
Krueger, R. A., & Casey, M. A. (2009). Focus groups: A practical guide for applied research. Sage.
Larsen, J. T., Norris, C. J., McGraw, A. P., Hawkley, L. C., & Cacioppo, J. T. (2009). The evaluative space grid: A single-item measure of positivity and negativity. Cognition and Emotion, 23(3), 453–480. https://doi.org/10.1080/02699930801994054
Lozada, F. T., Seaton, E. K., Williams, C. D., & Tynes, B. M. (2020). Exploration of bidirectionality in African American and Latinx adolescents’ offline and online ethnic-racial discrimination. Cultural Diversity and Ethnic Minority Psychology. Advance online publication. https://doi.org/10.1037/cdp0000355
Maxie-Moreman, A. D., & Tynes, B. M. (2022). Exposure to online racial discrimination and traumatic events online in Black adolescents and emerging adults. Journal of Research on Adolescence, 32(1), 254–269. https://doi.org/10.1111/jora.12732
Maynard, D.-M.B., & Jules, M. A. (2020). Exploring her roots: Black Caribbean hair identity and going natural using social media networks. Journal of Black Psychology, 47(1), 3–30. https://doi.org/10.1177/0095798420971892
Murthy, D., Gross, A., & Pensavalle, A. (2016). Urban social media demographics: An exploration of Twitter use in major American cities. Journal of Computer-Mediated Communication, 21, 33–49. https://doi.org/10.1111/jcc4.12144
Nielsen Company. (2016). Young, connected, and Black: African-American millennials are driving social change and leading digital advancement. Retrieved June 11, 2019, from https://www.nielsen.com/us/en/insights/report/2016/young-connected-and-black/#
Nisbett, R. E., & Wilson, T. D. (1977). The halo effect: Evidence of unconscious alteration of judgements. Journal of Personality and Social Psychology, 35, 250–256. https://doi.org/10.1037/0022-3514.35.4.250
Nish, N. W., Matias, C. E., & Montoya, R. (2015). Exposing the White avatar: Projections, justifications, and the ever-evolving American racism. Social Identities, 21(5), 459–473. https://doi.org/10.1080/13504630.2015.1093470
Ortiz, S. M. (2020). Racists without racism? From colourblind to entitlement racism online. Ethnic and Racial Studies, 44(14), 2637–2657. https://doi.org/10.1080/01419870.2020.1825758
Palan, S., & Schitter, C. (2018). Prolific.ac - A subject pool for online experiments. Journal of Behavioral and Experimental Finance, 17, 22–27. https://doi.org/10.1016/j.jbef.2017.12.004
Peer, E., Samat, S., Brandimarte, L., & Acquisti, A. (2017). Beyond the Turk: Alternative platforms for crowdsourcing behavioral research. Journal of Experimental Social Psychology, 70, 153–163. https://doi.org/10.1016/j.jesp.2017.01.006
Pew Research Center. (2018). A majority of teens have experienced some form of cyberbullying. Retrieved June 11, 2019, from https://www.pewresearch.org/internet/2018/09/27/a-majority-of-teens-have-experienced-some-form-of-cyberbullying/
Pew Research Center. (2019). Mobile technology and home broadband 2019. Retrieved June 11, 2020, from https://www.pewresearch.org/internet/2019/06/13/mobile-technology-and-home-broadband-2019/
Pew Research Center. (2021a). 7% of Americans don’t use the internet. Who are they? Retrieved June 1, 2022, from https://www.pewresearch.org/fact-tank/2021/04/02/7-of-americans-dont-use-the-internet-who-are-they/
Pew Research Center. (2021b). About three-in-ten U.S. adults say they are ‘almost constantly’ online. Retrieved June 1, 2022, from https://www.pewresearch.org/fact-tank/2021/03/26/about-three-in-ten-u-s-adults-say-they-are-almost-constantly-online/
Pew Research Center. (2021c). Social Media Use in 2021c. Retrieved June 1, 2022, from https://www.pewresearch.org/internet/2021/04/07/social-media-use-in-2021/
Pew Research Center. (2021d). Social Media Fact Sheet. Retrieved June 1, 2022, from https://www.pewresearch.org/internet/fact-sheet/social-media/
Phelps-Ward, R. J., & Laura, C. T. (2016). Talking back in cyberspace: Self-love, hair care, and counter narratives in Black adolescent girls’ Youtube vlogs. Gender and Education, 28(6), 807–820. https://doi.org/10.1080/09540253.2016.1221888
Plummer-D’Amato, P. (2008). Focus group methodology part 1: Considerations for design. International Journal of Therapy and Rehabilitation, 15(2). https://doi.org/10.12968/ijtr.2008.15.2.28189
Ray, R., Brown, M., Raistat, N., & Summers, E. (2017). Ferguson and the death of Michael Brown on Twitter: #BlackLivesMatter, #TCOT, and the evolution of collective identities. Ethnic & Racial Studies, 40(11), 1797–1813. https://doi.org/10.1080/01419870.2017.1335422
Reicher, S. D., Spears, R., & Postmes, T. (1995). A social identity model of deindividuation phenomena. European Review of Social Psychology, 6(1), 161–198. https://doi.org/10.1080/14792779443000049
Reid, L. D., & Foels, R. (2010). Cognitive complexity and the perception of subtle racism. Basic and Applied Social Psychology, 32(4), 291–301. https://doi.org/10.1080/01973533.2010.519217
Sagar, H. A., & Schofield, J. W. (1980). Racial and behavioral cues in Black and White children’s perception of ambiguously aggressive acts. Journal of Personality and Social Psychology, 39(4), 590–598. https://doi.org/10.1037/0022-3514.39.4.590
Smith, K. (2016). 44 Twitter statistics for 2016. Brandwatch Blog. Retrieved September 1, 2019, from https://www.brandwatch.com/blog/44-twitter-stats-2016
Sosoo, E. E., MacCormack, J. K., & Neblett, E. W. (2022). Psychophysiological and affective reactivity to vicarious police violence. Psychophysiology, 59(10), e14065. https://doi.org/10.1111/psyp.14065
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
Thompson, S. (2020). The subaltern is signifyin(g): Black Twitter as a site of resistance. In S. C. Drake & D. K. Henderson (Eds.), Are you entertained? (pp. 161–174). Duke University Press.
Tynes, B. M., Lozada, F. T., Smith, N. A., & Stewart, A. M. (2018). From racial microaggressions to hate crimes: A model of online racism based on the lived experiences of adolescents of color. In G. C. Torino, D. P. Rivera, C. M. Capodilupo, K. L. Nadal, & D. W. Sue (Eds.), Microaggresison theory: Influence and implications (pp. 194–212). Wiley.
Tynes, B. M., & Mitchell, K. J. (2014). Black youth beyond the digital divide: Age and gender differences in Internet use, communication patterns, and victimization experiences. Journal of Black Psychology, 40(3), 291–307. https://doi.org/10.1177/0095798413487555
Tynes, B. M., Rose, C. A., & Markoe, S. L. (2013). Extending campus life to the Internet: Social media, discrimination, and perceptions of racial climate. Journal of Diversity in Higher Education, 6(2), 102–114. https://doi.org/10.1037/a0033267
Tynes, B. M., Rose, C. A., & Williams, D. R. (2010). The development and validation of the Online Victimization Scale for adolescents. Cyberpsychology: Journal of Psychosocial Research on Cyberspace, 4(2), 2. Retrieved September 1, 2017, from https://cyberpsychology.eu/article/view/4237
Tynes, B. M., Willis, H. A., Stewart, A. M., & Hamilton, M. W. (2019). Race-related traumatic events online and mental health among adolescents of color. Journal of Adolescent Health, 65, 371–377. https://doi.org/10.1016/j.Adohealth.2019.03.006
Volpe, V. V., Hoggard, L. S., Willis, H. A., & Tynes, B. M. (2021a). Anti-Black structural racism goes online: A conceptual model for racial health disparities research. Ethnicity & Disease, 31(Suppl 1), 311–318. https://doi.org/10.18865/ed.31.S1.311
Volpe, V. V., Willis, H. A., Joseph, P., & Tynes, B. M. (2021b). Liberatory media literacy as protective against posttraumatic stress for emerging adults of color. Journal of Traumatic Stress, 34(5), 1045–1055. https://doi.org/10.1002/jts.22640
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070. https://doi.org/10.1037/0022-3514.54.6.1063
Weinstein, M., Jensen, M. R., & Tynes, B. M. (2021). Victimized in many ways: Online and offline bullying/harassment and perceived racial discrimination in diverse racial-ethnic minority adolescents. Cultural Diversity and Ethnic Minority Psychology, 27(3), 397–407. https://doi.org/10.1037/cdp0000436
Williams, A., & Gonlin, V. (2017). I got all my sisters with me (on Black Twitter): Second screening of How to Get Away with Murder as a discourse on Black womanhood. Information, Communication & Society, 20(7), 984–1004. https://doi.org/10.1080/1369118X.2017.1303077
Williams, K. D., & Jarvis, B. (2006). Cyberball: A program for use in research on interpersonal ostracism and acceptance. Behavior Research Methods, 38, 174–180.
Wolf, W., Levordashka, A., Ruff, J. R., Kraaijeveld, S., Lueckmann, J.-M., & Williams, K. D. (2015). Ostracism online: A social media ostracism paradigm. Behavior Research Methods, 47(2), 361–373.
Acknowledgements
This study was funded by the Society for Community Research and Action and start-up research funds awarded to the PI (Vanessa V. Volpe) by North Carolina State University.
Funding
Funding for the current studies was provided by the Society for Community Research and Action and North Carolina State University to Vanessa V. Volpe (PI).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethics approval
The first study was approved by the North Carolina State University Institutional Review Board. The second study was ruled exempt by the North Carolina State University Institutional Review Board. Both studies were performed in accordance with ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments.
Informed consent
All participants provided electronic informed consent before participating in these studies.
Disclosure of potential conflicts of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Volpe, V.V., Benson, G.P. & Keum, B.T. Tweet Stimuli Set for Content about Black People (TSS-CBP): Development and testing of stimuli to assess the impacts of online race-related content. Curr Psychol 43, 2196–2213 (2024). https://doi.org/10.1007/s12144-023-04471-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-023-04471-x