Abstract
Psychological research on the relationship between spirituality/religion and mental health has grown considerably over the past several decades and now constitutes a sizable body of scholarship. Among dimensions of S/R, positive beliefs about God have been significantly related to better mental health outcomes, and conversely negative beliefs about God are generally associated with more distress. However, prior research on this topic has relied heavily upon self-report Likert-type scales, which are vulnerable to self-report biases and measure only explicit cognitive processes. In this study, we developed and validated an implicit social cognition task, the Positive/Negative God Go/No-go Association Task (PNG-GNAT), for use in psychological research on spirituality and religion (S/R). Preliminary evidence in a large sample (N = 381) suggests that the PNG-GNAT demonstrates internal consistency, test–retest and split-half reliability, and concurrent evidence of validity. Further, our results suggest that PNG-GNAT scores represent different underlying dimensions of S/R than explicit self-report measures, and incrementally predict mental health above and beyond self-report assessment. The PNG-GNAT appears to be an effective tool for measuring implicit positive/negative beliefs about God.

Similar content being viewed by others
Notes
Avoidant attachment to God negatively loaded on this factor.
References
Agishtein, P., Pirutinsky, S., Kor, A., Baruch, D., Kanter, J., & Rosmarin, D. H. (2013). Integrating spirituality into a behavioral model of depression. Journal of Cognitive and Behavioral Psychotherapies, 13, 275–289.
Barrett, L. F., Tugade, M. M., & Engle, R. W. (2004). Individual differences in working memory capacity and dual-process theories of the mind. Psychological Bulletin, 130(4), 553–567.
Barzilai-Nahon, K., & Barzilai, G. (2005). Cultured technology: The internet and religious fundamentalism. The Information Society, 21(1), 25–40.
Beck, R., & McDonald, A. (2004). Attachment to God: The attachment to God inventory, tests of working model. Journal of Psychology and Theology, 32(2), 92–103.
Bosson, J. K., Swann, W. B., Jr., & Pennebaker, J. W. (2000). Stalking the perfect measure of implicit self-esteem: The blind men and the elephant revisited? Journal of Personality and Social Psychology, 79(4), 631–643.
Campbell, H. A., & Golan, O. (2011). Creating digital enclaves: Negotiation of the internet among bounded religious communities. Media, Culture and Society, 33(5), 709–724.
Cohen, A. B., Shariff, A. F., & Hill, P. C. (2008). The accessibility of religious beliefs. Journal of Research in Personality, 42(6), 1408–1417.
D’Onofrio, B. M., Eaves, L. J., Murrelle, L., Maes, H. H., & Spilka, B. (1999). Under-standing biological and social influences on religious attitudes and behaviors: A behavior-genetic perspective. Journal of Personality, 67(6), 953–984.
De Houwer, J. (2006). What are implicit measures and why are we using them? In R. W. Wiers & A. W. Stacy (Eds.), The handbook of implicit cognition and addiction (pp. 11–28). Thousand Oaks, CA: Sage Publishers.
De Houwer, J., Teige-Mocigemba, S., Spruyt, A., & Moors, A. (2009). Implicit measures: A normative analysis and review. Psychological Bulletin, 135(3), 347–368.
Emmons, R. A., & Paloutzian, R. F. (2003). The psychology of religion. Annual Review of Psychology, 54, 377–402.
Gawronski, B., & Bodenhausen, G. V. (2006). Associative and propositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132(5), 692–731.
Gorsuch, R. L. (1984). Measurement: The boon and bane of investigating religion. American Psychologist, 39(3), 228–236.
Granqvist, P., Mikulincer, M., & Shaver, P. R. (2010). Religion as attachment: Normative processes and individual differences. Personality and Social Psychology Review, 14(1), 49–59.
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74(6), 1464–1480.
Hafizi, S., Rosmarin, D. H., & Koenig, H. G. (2014). Brief trust/mistrust in God scale: Psychometric properties of the Farsi version in Muslims. Mental Health Religion and Culture, 17(4), 415–420.
Hill, P. C. (2005). Measurement in the psychology of religion and spirituality: Current status and evaluation. In R. F. Paloutzian & C. L. Park (Eds.), Handbook of the psychology of religion and spirituality (pp. 43–61). New York: Guilford Press.
Idler, E. L., Musick, M. A., Ellison, C. G., George, L. K., Krause, N., Ory, M. G., et al. (2003). Measuring multiple dimensions of religion and spirituality for health research: Conceptual background and findings from the 1998 General Social Survey. Research on Aging, 25(4), 327–365.
Inquisit 2.0.60616 [Computer software]. (2006). Seattle, WA: Millisecond Software.
Keren, G., & Schul, Y. (2009). Two is not always better than one: A critical evaluation of two-system theories. Perspectives on Psychological Science, 4, 533–550.
Kincaid, J. P., Aagard, J. A., O’Hara, J. W., & Cottrell, L. K. (1981). Computer readability editing system. Professional Communication IEEE Transactions on Professional Communication, 1, 38–42.
Koenig, H. G., McCullough, M. E., & Larson, D. B. (2001). Handbook of religion and health. New York: Oxford.
Koenig, H., Parkerson, G. R., & Meador, K. G. (1997). Religion index for psychiatric research. American Journal of Psychiatry, 154(6), 885–886.
Krumrei, E. J., Pirutinsky, S., & Rosmarin, D. H. (2013). Jewish spirituality, depression, and health: an empirical test of a conceptual framework. International Journal of Behavioral Medicine, 20(3), 327–336.
Lev-On, A., & Shahar, R. N. B. (2011). A forum of their own: Views about the internet among ultra-Orthodox Jewish women who browse designated closed forums. First Monday, 16(4).
McCullough, M. E., Enders, C. K., Brion, S. L., & Jain, A. R. (2005). The varieties of religious development in adulthood: A longitudinal investigation of religion and rational choice. Journal of Personality and Social Psychology, 89(1), 78–89.
Nosek, B. A., & Banaji, M. R. (2001). The go/no-go association task. Social Cognition, 19(6), 625–666.
Nosek, B. A., & Greenwald, A. G. (2009). Part of the case for a pragmatic approach to validity: Comment on De Houwer, Teige-Mocigemba, Spruyt, and Moors. Psychological Bulletin, 135, 373–376.
Nosek, B. A., Greenwald, A. G., & Banaji, M. R. (2007). The implicit association test at age 7: A methodological and conceptual review. In J. A. Bargh (Ed.), Automatic processes in social thinking and behavior (pp. 265–292). New York: Psychology Press.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods Instruments and Computers, 32(3), 396–402.
Orne, M. T., & Whitehouse, W. G. (2000). Demand characteristics. In A. E. Kazdin (Ed.), Encyclopedia of psychology (pp. 469–470). Oxford: Oxford University Press.
Pargament, K. I., Koenig, H. G., & Perez, L. M. (2000). The many methods of religious coping: Development and initial validation of the RCOPE. Journal of Clinical Psychology, 56(4), 519.
Petty, R. E., & Cacioppo, J. T. (1986). The elaboration likelihood model of persuasion (pp. 1–24). New York: Springer.
Pirutinsky, S. (2013). Career assessment of ultraorthodox jewish men: Reliability, validity, and results of the strong interest inventory. Journal of Career Assessment, 21(2), 326–336.
Pirutinsky, S., & Rosmarin, D. H. (2014). Book review: A new approach to religious orientation: The commitment-reflectivity circumplex. Journal of Religion and Health, 53, 631–633.
Pirutinsky, S., Rosmarin, D. H., Holt, C. L., Feldman, R. H., Caplan, L. S., Midlarsky, E., et al. (2011a). Does social support mediate the moderating effect of intrinsic religiosity on the relationship between physical health and depressive symptoms among Jews? Journal of Behavioral Medicine, 34(6), 489–496.
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
Rosmarin, D. H., Krumrei, E. J., & Andersson, G. (2009). Religion as a predictor of psychological distress in two religious communities. Cognitive Behaviour Therapy, 38(1), 54–64.
Rosmarin, D. H., Pargament, K. I., Pirutinsky, S., & Mahoney, A. (2010). A randomized controlled evaluation of a spiritually-integrated treatment for subclinical anxiety in the Jewish community. Journal of Anxiety Disorders, 24(7), 799–808.
Rosmarin, D. H., Pirutinsky, S., & Pargament, K. I. (2011). A brief measure of core religious beliefs for use in psychiatric settings. International Journal of Psychiatry in Medicine, 41, 253–261.
Rudman, L. A., Ashmore, R. D., & Gary, M. L. (2001). “Unlearning” automatic biases: The malleability of implicit prejudice and stereotypes. Journal of Personality and Social Psychology, 81(5), 856–869.
Sedikides, C. (2010). Why does religiosity persist? Personality and Social Psychology Review, 14(1), 3–6.
Sedikides, C., & Gebauer, J. E. (2010). Religiosity as self-enhancement: A meta-analysis of the relation between socially desirable responding and religiosity. Personality and Social Psychology Review, 14(1), 17–36.
Smith, E. R., & DeCoster, J. (2000). Dual-process models in social and cognitive psychology: Conceptual integration and links to underlying memory systems. Personality and Social Psychology Review, 4(2), 108–131.
Smith, T. B., McCullough, M. E., & Poll, J. (2003). Religiousness and depression: evidence for a main effect and the moderating influence of stressful life events. Psychological Bulletin, 129(4), 614–636.
Storch, E. A., Strawser, M. S., & Storch, J. B. (2004). Two-week test–retest reliability of the Duke Religion Index. Psychological Reports, 94(3), 993–994.
Teachman, B. A. (2007). Evaluating implicit spider fear associations using the Go/No-go association task. Journal of Behavior Therapy and Experimental Psychiatry, 38(2), 156–167.
Tremlin, T. (2005). Divergent religion: a dual-process model of religious thought, behavior, and morphology. In Mind and religion: psychological and cognitive foundations of religiosity (pp. 69–83). Walnut Creek, CA: AltaMira.
Weber, C. R., Lavine, H., Huddy, L., & Federico, C. M. (2014). Placing racial stereotypes in context: Social desirability and the politics of racial hostility. American Journal of Political Science, 58(1), 63–78.
Weber, S. R., & Pargament, K. I. (2014). The role of religion in spirituality in mental health. Current Opinion in Psychiatry, 27(5), 358–363.
Wenger, J. L., & Yarbrough, T. D. (2005). Religious individuals: Evaluating their intrinsic and extrinsic motivations at the implicit level of awareness. The Journal of Social Psychology, 145(1), 5–16.
Williams, B. J., & Kaufmann, L. M. (2012). Reliability of the Go/No Go association task. Journal of Experimental Social Psychology, 48(4), 879–891.
Wilson, T. D., Lindsey, S., & Schooler, T. Y. (2000). A model of dual attitudes. Psychological Review, 107(1), 101–126.
Wittenbrink, B., & Schwarz, N. (2007). Implicit measures of attitudes. New York: Guilford Press.
Zigmond, A. S., & Snaith, R. P. (1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67(6), 361–370.
Funding
This study was funded by private donations to the McLean Hospital/Harvard Medical School Development Fund.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Dr. Steven Pirutinsky declares that he has no conflict of interest. Sean Carp declares that he has no conflict of interest. Dr. David H. Rosmarin declares that he has no conflict of interest.
Ethical Approval
No animals were involved in this study, and this article does not contain any studies with animals performed by any of the authors. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. This study was approved by the IRB of McLean Hospital/Harvard Medical School, 115 Mill Street, Belmont, MA 02478.
Informed Consent
Informed consent was obtained from all individual participants included in this study.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Pirutinsky, S., Carp, S. & Rosmarin, D.H. A Paradigm to Assess Implicit Attitudes towards God: The Positive/Negative God Associations Task. J Relig Health 56, 305–319 (2017). https://doi.org/10.1007/s10943-016-0303-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10943-016-0303-y
