International Journal of Cognitive Therapy

, Volume 12, Issue 4, pp 217–241 | Cite as

Construct validity of “Not Just Right Experiences”: results from a picture-based assessment procedure

  • Claudio SicaEmail author
  • Gioia Bottesi
  • Corrado Caudek
  • Igor Marchetti
  • Antonella Orsucci
  • Giulia Palmieri
  • Stefania Righi
  • Marta Ghisi
Original emprical study


It has been contended that research about “Not Just Right Experiences” (NJREs) would be biased by the type of measures prevalently utilized to assess such phenomenon. That is, items intended to assess a construct conceptualized as a possible vulnerability factor of obsessive–compulsive (OC) symptoms may have tapped the symptoms themselves. In the current study, a picture-based measure of NJREs (NJR-PM) not derived from OC themes was administered to two samples of undergraduate students along with questionnaires of OC symptoms, general distress, and NJREs (the NJRE-Q-R). Exploratory and confirmatory factor analyses in these undergraduate samples showed that the NJR-PM had a unidimensional structure. The total score derived by the sum of ratings to each picture proved insensitive to gender. The NJR-PM was more strongly associated with the NJRE-Q-R than to general distress. Commonality analysis showed that the NJR-PM and the two NJRE-Q-R indices predicted OC symptoms both conjointly and in a distinct way. In addition, the NJR-PM predicted all common types of obsessive–compulsive disorder (OCD) symptoms over and beyond general distress and discriminated individuals with high scores in OC symptoms from low-score counterparts. NJREs can be measured also without reference to patients’ symptoms and may therefore be useful in advancing our understanding of obsessive–compulsive disorder.


Not Just Right Experiences Assessment Obsessive–compulsive symptoms Construct validity Commonality analysis 


Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

Supplementary material

41811_2019_54_MOESM1_ESM.jpg (92 kb)
ESM 1 (JPG 92 kb)
41811_2019_54_MOESM2_ESM.jpg (57 kb)
ESM 2 (JPG 56 kb)
41811_2019_54_MOESM3_ESM.jpg (39 kb)
ESM 3 (JPG 39 kb)
41811_2019_54_MOESM4_ESM.jpg (108 kb)
ESM 4 (JPG 107 kb)
41811_2019_54_MOESM5_ESM.jpg (26 kb)
ESM 5 (JPG 26 kb)
41811_2019_54_MOESM6_ESM.jpg (125 kb)
ESM 6 (JPG 125 kb)
41811_2019_54_MOESM7_ESM.jpg (81 kb)
ESM 7 (JPG 81 kb)
41811_2019_54_MOESM8_ESM.jpg (52 kb)
ESM 8 (JPG 52 kb)
41811_2019_54_MOESM9_ESM.jpg (78 kb)
ESM 9 (JPG 78 kb)
41811_2019_54_MOESM10_ESM.jpg (59 kb)
ESM 10 (JPG 59 kb)
41811_2019_54_MOESM11_ESM.jpg (56 kb)
ESM 11 (JPG 56 kb)
41811_2019_54_MOESM12_ESM.jpg (43 kb)
ESM 12 (JPG 43 kb)
41811_2019_54_MOESM13_ESM.jpg (39 kb)
ESM 13 (JPG 38 kb)
41811_2019_54_MOESM14_ESM.jpg (57 kb)
ESM 14 (JPG 57 kb)
41811_2019_54_MOESM15_ESM.jpg (100 kb)
ESM 15 (JPG 99 kb)
41811_2019_54_MOESM16_ESM.docx (28 kb)
ESM 16 (DOCX 28.1 kb)


  1. Abramowitz, J. S., & Jacoby, R. J. (2014). Obsessive-compulsive disorder in the DSM-5. Clinical Psychology: Science and Practice, 21(3), 221–235. Scholar
  2. Abramowitz, J. S., & Jacoby, R. J. (2015). Obsessive-compulsive and related disorders: a critical review of the new diagnostic class. Annual Review of Clinical Psychology, 11, 165–186. Scholar
  3. Albert, U., Maina, G., Bogetto, F., Chiarle, A., & Mataix-Cols, D. (2010). Clinical predictors of health-related quality of life in obsessive-compulsive disorder. Comprehensive Psychiatry, 51(2), 193–200. Scholar
  4. Arrindell, W. A., van Well, S., Kolk, A. M., Barelds, D. P. H., Oei, T. P. S., Yi Lau, P., & Cultural Clinical Psychology Study Group. (2013). Higher levels of masculine gender role stress in masculine than in feminine nations: a thirteen-nations study. Cross-Cultural Research, 47, 51–67. Scholar
  5. Belloch, A., Fornés, G., Carrasco, A., López-Solá, C., Alonso, P., & Menchón, J. M. (2016). Incompleteness and not just right experiences in the explanation of obsessive–compulsive disorder. Psychiatry Research, 236, 1–8. Scholar
  6. Bloch, M. H., Landeros-Weisenberger, A., Sen, S., Dombrowski, P., Kelmendi, B., Coric, V., et al. (2008). Association of the serotonin transporter polymorphism and obsessive-compulsive disorder: systematic review. American Journal of Medical Genetics Part B: Neuropsychiatric Genetics, 147(6), 850–858. Scholar
  7. Bottesi, G., Ghisi, M., Altoè, G., Conforti, E., Melli, G., & Sica, C. (2015). The Italian version of the Depression Anxiety Stress Scales-21: factor structure and psychometric properties on community and clinical samples. Comprehensive Psychiatry, 60, 170–181. Scholar
  8. Bottesi, G., Ghisi, M., Sica, C., & Freeston, M. H. (2017). Intolerance of uncertainty, Not Just Right Experiences, and compulsive checking: test of a moderated mediation model on a non-clinical sample. Comprehensive Psychiatry, 73, 111119. Scholar
  9. Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.Google Scholar
  10. Cameron, D. H., Summerfeldt, L. J., Rowa, K., McKinnon, M. C., Rector, N. A., et al. (2019). Differences in neuropsychological performance between incompleteness- and harm avoidance-related core dimensions in obsessive-compulsive disorder. Journal of Obsessive-Compulsive and Related Disorders, 22. Scholar
  11. Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276. Scholar
  12. Cohen, J. (1988). Statistical power analysis for the behavioral sciences 2nd edn.Google Scholar
  13. Coles, M. E., Frost, R. O., Heimberg, R. G., & Rhéaume, J. (2003). “Not just right experiences”: perfectionism, obsessive–compulsive features and general psychopathology. Behaviour Research and Therapy, 41(6), 681–700. Scholar
  14. Coles, M. E., Heimberg, R. G., Frost, R. O., & Steketee, G. (2005). Not just right experiences and obsessive–compulsive features: experimental and self-monitoring perspectives. Behaviour Research and Therapy, 43(2), 153–167. Scholar
  15. Coles, M. E., Hart, A. S., & Schofield, C. A. (2012). Initial data characterizing the progression from obsessions and compulsions to full-blown obsessive compulsive disorder. Cognitive Therapy and Research, 36(6), 685–693. Scholar
  16. Cougle, J. R., Fitch, K. E., Jacobson, S., & Lee, H. J. (2013). A multi-method examination of the role of incompleteness in compulsive checking. Journal of Anxiety Disorders, 27(2), 231–239. Scholar
  17. Cudeck, R., & Browne, M. W. (1992). Constructing a covariance matrix that yields a specified minimizer and a specified minimum discrepancy function value. Psychometrika, 57(3), 357–369.CrossRefGoogle Scholar
  18. Ecker, W., & Gönner, S. (2008). Incompleteness and harm avoidance in OCD symptom dimensions. Behaviour Research and Therapy, 46(8), 895–904. Scholar
  19. Ecker, W., Kupfer, J., & Gönner, S. (2013). Self-Related incompleteness in obsessive-compulsive disorder. Verhaltenstherapie, 23, 12–21. Scholar
  20. Eddy, C. M., & Cavanna, A. E. (2014). Tourette syndrome and obsessive-compulsive disorder: compulsivity along the continuum. Journal of Obsessive-Compulsive and Related Disorders. Scholar
  21. Eisen, J. L., Mancebo, M. A., Pinto, A., Coles, M. E., Pagano, M. E., Stout, R., & Rasmussen, S. A. (2006). Impact of obsessive-compulsive disorder on quality of life. Comprehensive Psychiatry, 47(4), 270–275. Scholar
  22. Fergus, T. A. (2014). Are “Not Just Right Experiences” (NJREs) specific to obsessive-compulsive symptoms? Evidence that NJREs span across symptoms of emotional disorders. Journal of Clinical Psychology, 70, 353–363. Scholar
  23. Ferrão, Y. A., Shavitt, R. G., Prado, H., Fontenelle, L. F., Malavazzi, D. M., de Mathis, M. A., et al. (2012). Sensory phenomena associated with repetitive behaviors in obsessive-compulsive disorder: an exploratory study of 1001 patients. Psychiatry Research, 197(3), 253–258. Scholar
  24. Foa, E. B., Huppert, J. D., Leiberg, S., Langner, R., Kichic, R., Hajcak, G., & Salkovskis, P. M. (2002). The obsessive-compulsive inventory: development and validation of a short version. Psychological Assessment, 14(4), 485. Scholar
  25. Fornés-Romero, G., & Belloch, A. (2017). Induced not just right and incompleteness experiences in OCD patients and non-clinical individuals: An in vivo study. Journal of Behavior Therapy and Experimental Psychiatry, 5, 103–112. CrossRefGoogle Scholar
  26. Ghisi, M., Chiri, L. R., Marchetti, I., Sanavio, E., & Sica, C. (2010). In search of specificity: “Not Just Right Experiences” and obsessive–compulsive symptoms in non-clinical and clinical Italian individuals. Journal of Anxiety Disorders, 24(8), 879–886. Scholar
  27. Grabe, H. J., Meyer, C., Hapke, U., Rumpf, H. J., Freyberger, H. J., Dilling, H., & John, U. (2000). Prevalence, quality of life and psychosocial function in obsessive-compulsive disorder and subclinical obsessive-compulsive disorder in northern Germany. European Archives of Psychiatry and Clinical Neuroscience, 250(5), 262–268. Scholar
  28. Graham, J. W. (2009). Missing data analysis: making it work in the real world. Annual Review of Psychology, 60, 549–576. Scholar
  29. Hellriegel, J., Barber, C., Wikramanayake, M., Fineberg, N. A., & Mandy, W. (2017). Is “not just right experience” (NJRE) in obsessive-compulsive disorder part of an autistic phenotype? CNS Spectrums, 22(1), 41–50. Scholar
  30. Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185.CrossRefGoogle Scholar
  31. Hox, J. J., Moerbeek, M., & van de Schoot, R. (2010). Multilevel analysis: techniques and applications. Routledge.Google Scholar
  32. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. Scholar
  33. James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013). An introduction to statistical learning: with applications in R. New York: Springer.CrossRefGoogle Scholar
  34. Janet, P. (1908). Les obsessions et la psychasthénie (2nd ed., M. W. Adamiwicz, trans.). Paris: Alcan.Google Scholar
  35. Kugler, B. B., Lewin, A. B., Phares, V., Geffken, G. R., Murphy, T. K., & Storch, E. A. (2013). Quality of life in obsessive-compulsive disorder: the role of mediating variables. Psychiatry Research, 206(1), 43–49. Scholar
  36. Lee, S. R., & Wu, K. D. (2019). Feelings of incompleteness explain symptoms of OCD and OCPD beyond harm avoidance. Journal of Obsessive-Compulsive and Related Disorders, 21, 151–157. Scholar
  37. Lewin, A. B., Wu, M. S., Murphy, T. K., & Storch, E. A. (2015). Sensory over-responsivity in pediatric obsessive-compulsive disorder. Journal of Psychopathology and Behavioral Assessment, 37(1), 134–143. Scholar
  38. Little, R. J., & Rubin, D. B. (2002). Bayes and multiple imputation. Statistical Analysis with Missing Data, Second Edition, 200-220. DOI: CrossRefGoogle Scholar
  39. Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety inventories. Behaviour Research and Therapy, 33(3), 335–343. Scholar
  40. Mancebo, M. C., Garcia, A. M., Pinto, A., Freeman, J. B., Przeworski, A., Stout, R., et al. (2008). Juvenile-onset OCD: clinical features in children, adolescents and adults. Acta Psychiatrica Scandinavica, 118(2), 149–159. Scholar
  41. Marchetti, I., Chiri, L. R., Ghisi, M., & Sica, C. (2010). Obsessive-Compulsive Inventory-Revised (OCI-R): presentazione e indicazioni di utilizzo nel contesto italiano. Psicoterapia Cognitiva e Comportamentale, 16, 69–84.Google Scholar
  42. Marchetti, I., Loeys, T., Alloy, L. B., & Koster, E. H. W. (2016). Unveiling the structure of cognitive vulnerability for depression: specificity and overlap. PLoS One. Scholar
  43. Marchetti, I., Everaert, J., Dainer-Best, J., Loeys, T., Beevers, C. G., & Koster, E. H. W. (2018). Specificity and overlap of emotional biases in depression. Journal of Affective Disorders, 225, 404–412. Scholar
  44. McGovern, R. A., & Sheth, S. A. (2017). Role of the dorsal anterior cingulate cortex in obsessive-compulsive disorder: converging evidence from cognitive neuroscience and psychiatric neurosurgery. Journal of Neurosurgery, 126(1), 132–147. Scholar
  45. McKay, D., Abramowitz, J. S., Calamari, J. E., Kyrios, M., Radomsky, A., Sookman, D., et al. (2004). A critical evaluation of obsessive–compulsive disorder subtypes: symptoms versus mechanisms. Clinical Psychology Review, 24(3), 283–313. Scholar
  46. Monzani, B., Rijsdijk, F., Harris, J., & Mataix-Coles, D. (2014). The structure of genetic and environmental risk factors for dimensional representations of DSM-5 obsessive-compulsive spectrum disorders. JAMA Psychiatry, 71, 182–189. Scholar
  47. Neal, M., & Cavanna, A. E. (2013). “Not just right experiences” in patients with Tourette syndrome: complex motor tics or compulsions? Psychiatry Research, 210, 559–563. Scholar
  48. Parkin, R. (1997). Obsessive-compulsive disorder in adults. International Review of Psychiatry, 9(1), 73–82. Scholar
  49. Pertusa, A., Frost, R. O., Fullana, M. A., Samules, J., Steketee, G., Tolin, D., Saxena, S., Leckman, J. F., & Mataix-Cols, D. (2010). Refining the diagnostic boundaries of compulsive hoarding: a critical review. Clinical Psychology Review, 30, 371–386. Scholar
  50. Pietrefesa, A. S., & Coles, M. E. (2008). Moving beyond an exclusive focus on harm avoidance in obsessive compulsive disorder: considering the role of incompleteness. Behavior Therapy, 39(3), 224–231. Scholar
  51. Pitman, R. K. (1987). Pierre Janet on obsessive-compulsive disorder (1903). Archives of General Psychiatry, 44, 226–232.CrossRefGoogle Scholar
  52. Rasmussen, S. A., & Eisen, J. L. (1992). The epidemiology and clinical features of obsessive compulsive disorder. The Psychiatric Clinics of North America, 15, 743–758. Scholar
  53. Riesel, A., Endrass, T., Auerbach, L. A., & Kathmann, N. (2015). Overactive performance monitoring as an endophenotype for obsessive-compulsive disorder: evidence from a treatment study. American Journal of Psychiatry, 172(7), 665–673. Scholar
  54. Russo, M., Naro, A., Mastroeni, C., Morgante, F., Terranova, C., Muscatello, M. R., et al. (2014). Obsessive-compulsive disorder: a “sensory-motor” problem? International Journal of Psychophysiology, 92(2), 74–78. Scholar
  55. Salkovskis, P., Millar, J., Gregory, J., & Wahl, K. (2016). The termination of checking and the role of just right feelings: a study of obsessional checkers compared with anxious and non-clinical controls. Behavioural and Cognitive Psychotherapy, 23, 349–371. Scholar
  56. Schafer, J. L. (1997). Analysis of incomplete multivariate data. CRC press.Google Scholar
  57. Sica, C., Ghisi, M., Altoè, G., Chiri, L. R., Franceschini, S., Coradeschi, D., & Melli, G. (2009). The Italian version of the Obsessive Compulsive Inventory: its psychometric properties on community and clinical samples. Journal of Anxiety Disorders, 23(2), 204–211. Scholar
  58. Sica, C., Chiri, L., McKay, D., & Ghisi, M. (2010). Cognitive-behavioral and neuropsychological models of obsessive-compulsive disorder. NY: Nova Science Publishers.Google Scholar
  59. Sica, C., Caudek, C., Chiri, L., Ghisi, M., & Marchetti, I. (2012). “Not just right experiences” predict obsessive–compulsive symptoms in non-clinical italian individuals: a one-year longitudinal study. Journal of Obsessive-Compulsive and Related Disorder., 1, 159–167. Scholar
  60. Sica, C., Caudek, C., Bottesi, G., De Fazio, E., Ghisi, M., Marchetti, I., & Orsucci, A. (2013). Fathers’ “not just right experiences” predict obsessive–compulsive symptoms in their sons: family study of a non-clinical italian sample. Journal of Obsessive-Compulsive and Related Disorder, 2, 263–272. Scholar
  61. Sica, C., Bottesi, G., Orsucci, A., Pieraccioli, C., Sighinolfi, C., & Ghisi, M. (2015). Not Just Right Experiences are specific to obsessive–compulsive disorder: further evidence from Italian clinical samples. Journal of Anxiety Disorders, 31, 73–83. Scholar
  62. Sica, C., Bottesi, G., Caudek, C., Orsucci, A., & Ghisi, M. (2016). Not Just Right Experiences as a psychological endophenotype for obsessive-compulsive disorder: evidence from an Italian family study. Psychiatry Research, 245, 27–35. Scholar
  63. Sica, C., Caudek, C., Belloch, A., Bottesi, G., Ghisi, M., Melli, G., Garcìa-Soriano, G., & Olatunji, B. O. (2019). Not Just Right Experiences, disgust proneness and their associations to obsessive-compulsive symptoms: a stringent test with structural equation modeling analysis. Cognitive Therapy and Research. Scholar
  64. Steketee, G., Frost, R., & Wilson, K. (2002). Studying cognition in obsessive compulsive disorder: where to from here? In Cognitive Approaches to Obsessions and Compulsions (pp. 465-473). DOI: CrossRefGoogle Scholar
  65. Stevens, J. P. (2002). Applied multivariate statistics for the social sciences (4th ed.). Hillsdale, NS: Erlbaum.Google Scholar
  66. Subirà, M., Sato, J. R., Alonso, P., do Rosário, M. C., Segalàs, C., Batistuzzo, M. C., et al. (2015). Brain structural correlates of sensory phenomena in patients with obsessive–compulsive disorder. Journal of Psychiatry & Neuroscience: JPN, 40(4), 232. Scholar
  67. Summerfeldt, L. J. (2004). Understanding and treating incompleteness in obsessive-compulsive disorder. Journal of Clinical Psychology, 60, 1155–1168. Scholar
  68. Summerfeldt, L. J., Kloosterman, P. H., Antony, M. M., & Swinson, R. P. (2014). Examining an obsessive-compulsive core dimensions model: structural validity of harm avoidance and incompleteness. Journal of Obsessive-Compulsive and Related Disorders, 3(2), 83–94. Scholar
  69. Summers, B. J., Fitch, K. E., & Cougle, J. R. (2014). Visual, tactile, and auditory “not just right” experiences: associations with obsessive-compulsive symptoms and perfectionism. Behavior Therapy, 45(5), 678–689. Scholar
  70. Szechtman, H., & Woody, E. (2004). Obsessive–compulsive disorder as a disturbance of security motivation. Psychological Review, 111, 111–127. Scholar
  71. Taylor, S. (2011). Early versus late onset obsessive-compulsive disorder: evidence for distinct subtypes. Clinical Psychological Review, 31, 1083–1100. Scholar
  72. Taylor, S. (2012). Endophenotypes of obsessive–compulsive disorder: current status and future directions. Journal of Obsessive-Compulsive and Related Disorders, 1(4), 258–262. Scholar
  73. Taylor, S., Mckay, D., Crowe, K. B., Abramowitz, J. S., Conelea, C. A., Calamari, J. E., et al. (2014). The sense of incompleteness as a motivator of obsessive-compulsive symptoms: an empirical analysis of concepts and correlates. Behavior Therapy, 45, 254–262. Scholar
  74. Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327.CrossRefGoogle Scholar
  75. Visser, H. A., van Oppen, P., van Megen, H. J., Eikelenboom, M., & van Balkom, A. J. (2014). Obsessive-compulsive disorder; chronic versus non-chronic symptoms. Journal of Affective Disorders, 152, 169–174. Scholar
  76. Woods, D. W., Piacentini, J. C., Himle, M. B., & Chang, S. (2005). Initial development and psychometric properties of the Premonitory Urge for Tics Scale (PUTS) in children with Tourette syndrome. Journal of Developmental and Behavioral Pediatrics, 26, 1–7. Scholar
  77. Zwick, W. R., & Velicer, W. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Health Sciences, Psychology SectionUniversity of FirenzeFirenzeItaly
  2. 2.Department of General PsychologyUniversity of PadovaPadovaItaly
  3. 3.Department of Neurosciences, Psychology, Drug Research, and Child HealthUniversity of FirenzeFirenzeItaly
  4. 4.Department of Experimental-Clinical and Health PsychologyGhent UniversityGhentBelgium
  5. 5.Department of Life Sciences, Psychology SectionUniversity of TriesteTriesteItaly

Personalised recommendations