Abstract
Background
Bullying increases risk of social anxiety and can produce symptoms of posttraumatic stress disorder (PTSD). According to cognitive models, these are maintained by unhelpful beliefs, which are therefore assessed and targeted in cognitive therapy. This paper describes psychometric validation of a new measure of beliefs related to bullying experiences.
Methods
In an online survey of 1879 young people before starting university or college in the UK, 1279 reported a history of bullying (N = 1279), and 854 rated their agreement with beliefs about self and others related to bullying experiences and completed symptom measures of social anxiety and PTSD related to bullying. An empirical structure for a Bullied Cognitions Inventory was established using exploratory and confirmatory factor analyses and assessed using model fit statistics and tests of reliability and validity.
Results
Fifteen items clustered into four themes: “degraded in the eyes of others”, “negative interpretations of reactions to bullying”, “recognisable as a bullying victim” and “social defeat”. The measure has acceptable reliability and validity and, accounting for existing cognitive measures, explained additional variance in symptoms of PTSD but not social anxiety.
Conclusions
The Bullied Cognitions Inventory (BCI) is a valid and reliable tool for measuring cognitions related to bullying. It may be useful in therapy for identifying and monitoring unhelpful cognitions in those who were bullied.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Bullying is associated with higher likelihood of social anxiety disorder (SAD; Siegel et al., 2009; Storch et al., 2005) and can produce symptoms of posttraumatic stress disorder (PTSD; Idsoe et al., 2021; Nielsen et al., 2015). SAD is characterised by excessive fear or anxiety about social situations in which the individual may feel judged by other people (American Psychiatric Association, 2013; World Health Organisation, 2019) and which are subsequently avoided or endured with intense fear or anxiety which is disproportionate to the actual threat posed. Following a traumatic experience, PTSD symptoms may develop that include distressing unwanted memories of the trauma, avoidance of reminders, negative alterations in cognitions and mood, and alterations in arousal and reactivity (American Psychiatric Association, 2013; World Health Organisation, 2019). Cognitive models suggest that negative beliefs maintain social anxiety (Clark & Wells, 1995) and PTSD (Ehlers & Clark, 2000) and are commonly connected in meaning to past negative social experiences (SAD) or trauma (PTSD). This paper presents the development and psychometric validation of a Bullied Cognitions Inventory (BCI) that measures beliefs about self and others related to bullying experiences and reports associations with SAD and PTSD among young people who have been bullied.
Bullying is a pervasive form of interpersonal aggression (Craig et al., 2009; Skrzypiec et al., 2018) including behaviours that are overt (e.g., name calling, making sexual comments or gestures at someone, or hitting, shoving, physically aggressing) or relational (e.g., excluding somebody from a social group, ignoring them, gossiping behind their backs) that can happen in person and online, with considerable overlap (Cosma et al., 2020). Bullying behaviour is distinguished from conflict or other aggressive acts by characteristics of intentionality, frequency, and power differential (i.e., the behaviour is deliberately hurtful, is not a one-off attack, and is perpetrated by those with higher status or power over those with less). Power imbalance is thought to set bullying apart from disagreements, teasing between friends, playful fighting, or general hostility between individuals or groups and may be of particular interest when evaluating appraisals of bullying experiences and their impact on mental health. There is evidence indicating that power imbalance exacerbates adjustment problems associated with victimisation (Malecki et al., 2014). Furthermore, the presence of a power imbalance between the perpetrator and the target echoes interpersonal trauma and abuse (such as physical or sexual assault) that can precede stressor related disorders including PTSD. Evaluating the relationship between perceived power differential during bullying experiences and later psychopathology is potentially clinically important and may explain some of the variance in PTSD symptoms among people who have been bullied. Therefore, in this study power imbalance was conceptualised as an additional cognitive variable rather than an inclusion criterion for bullying, so that its contribution as a potential cognitive predictor of psychological adjustment could be investigated.
There is increasing evidence that negative psychosocial effects of bullying in childhood and adolescence can persist into adulthood (Arseneault, 2018; McDougall & Vaillancourt, 2015) and recognition that these experiences need to be meaningfully incorporated into mental health assessment and treatment. Peer victimisation in childhood and adolescence is associated with later social anxiety (Siegel et al., 2009; Storch et al., 2005). Adults with social anxiety are particularly likely to report having been bullied or teased when they were younger (McCabe et al., 2003, 2010) and socially anxious students recall higher levels of social exclusion and relational victimisation (Boulton, 2013). Bullying is also associated with PTSD symptoms among adolescents (Crosby et al., 2010; Guzzo et al., 2014; Mynard et al., 2000; Storch & Esposito, 2003) and students in higher education (Andreou et al., 2021; Manrique et al., 2020), and the association persists into adulthood (Idsoe et al., 2021; Nielsen et al., 2015). Of note, over a quarter of sexual minority adults who self-identified as victims of homophobic bullying at school continued to be distressed regularly by recollections of their experiences (Rivers, 2006). Given the developmental context and repetitive nature of experiences, bullying is a particularly potent context for social trauma, which is described in more detail below.
There is longstanding debate regarding the definition and measurement of psychological trauma (Weathers & Keane, 2007) in relation to PTSD diagnosis (Brewin et al., 2009). Experiencing threatened death, serious injury, or sexual violence (DSM-5) or exposure to an extremely threatening or horrific event or series of events (ICD-11) is a prerequisite for developing stress related disorders including PTSD (American Psychiatric Association, 2013; World Health Organisation, 2019). This means that PTSD cannot be diagnosed in the absence of this type of event, although symptoms consistent with PTSD may be present. Socially traumatic events have been defined as extremely unpleasant social events during which the individual experiences intense anxiety and perceives ridicule or rejection by others (Wild & Clark, 2011) and can be perceived as extremely threatening to the social self (Idsoe et al., 2021). Socially traumatic experiences occur in many environments (e.g., work meetings, performance events) but occur particularly frequently and repetitively in the context of bullying or victimisation by peers (Wild & Clark, 2011). Socially traumatic experiences are associated with social anxiety in adolescents (Pontillo et al., 2019) and adults (McCabe et al., 2010) and can produce symptoms of posttraumatic stress disorder (Bjornsson et al., 2020; Carleton et al., 2011) but they are not qualifying events for PTSD diagnosis.
There is evidence for psychological common ground between reactions to threats to physical and social self among clinical populations. In a sample of 75 individuals with and without SAD (Erwin et al., 2006), socially stressful events were common (100% of those with SAD, and 70% of those without) but more than a third of those with SAD, compared with none in the control group, experienced PTSD-like symptoms in connection to the stressful event, including distressing and persistent intrusive thoughts and feelings. Similarly, among 60 individuals seeking treatment for SAD, a third of those who had experienced social trauma reported PTSD-like symptoms (Bjornsson et al., 2020). The authors suggested that individuals with SAD may be more likely to interpret stressful social events as traumatic. Individuals with SAD have also reported higher skin conductance response to social trauma memories (Sansen et al., 2015). Indeed, commonalities exist in the phenomenology of PTSD and SAD, in terms of avoidance of related stimuli (social interactions, relationships) and negative cognitions related to past experiences, the self and other people. In response to socially traumatic experiences, individuals may experience fear of negative evaluation (consistent with SAD), as well as distressing intrusive memories of the experience, physiological symptoms when reminded of it, feelings of detachment, restricted range of affect, and hyperarousal expressed as irritability, outbursts or difficulty concentrating (consistent with PTSD), and avoidance of social situations (consistent with both SAD and PTSD). It is possible that individuals experiencing social anxiety as well as PTSD-like symptoms in response to social trauma may be best understood not as suffering with two distinct disorders but rather as experiencing a stress response to the social experience that involves an ongoing sense of social threat associated with intrusive memories, hypervigilance and avoidance related to their experience.
Cognitive models propose that maladaptive beliefs maintain social anxiety disorder (Clark & Wells, 1995) and PTSD (Ehlers & Clark, 2000). Results from cross-sectional and prospective studies support this hypothesis (e.g., SAD: Clark, 2005; PTSD: Beierl et al., 2019). Cognitive therapy for SAD (Clark et al., 2003, 2006) and PTSD (Ehlers et al., 2005, 2014) target idiosyncratic beliefs relevant to the disorder and have been shown to be highly effective. Clark and Wells (1995) propose that social anxiety symptoms persist due to overestimating social threat based on beliefs about unfavourable personal characteristics and negative expectations of others’ reactions. Unhelpful attempts to manage the threat maintain the problem. Common negative appraisals are often connected in meaning to past experiences of humiliation or rejection (Wild et al., 2007) and relate to performance in current social situations (e.g., “I always say the wrong thing”, “I am boring”). Similarly, Ehlers and Clark (2000) suggest that an ongoing sense of external or internal current threat is central to PTSD. One source of the perceived threat is excessively negative appraisals about trauma that lead to negative emotions (such as fear, anger, guilt, shame, disgust) and motivate unhelpful coping strategies. These inadvertently maintain the problem. Appraisals commonly relate to the traumatic experience (e.g., “bad things always happen to me”, “others will look down on me as they can see that I am a victim”) and its sequelae (e.g., “I’ll never be able to trust people again”, “I’m going mad”). Changes in these beliefs have been shown to mediate symptom change in both conditions (SAD: Thew et al., 2020; PTSD: Kleim et al., 2013) and frequent assessment of cognitions to guide treatment and monitor progress in cognitive therapy is recommended (Warnock-Parkes et al., 2020; Wild et al., 2020). Ehlers et al. (1998) observed that during prolonged and repeated interpersonal trauma, some people experience a state of mental defeat where they perceive a complete loss of autonomy, degradration and dehumanisation. Mental defeat has been shown to predict PTSD after interpersonal trauma (Ehlers & Clark, 2000; Kleim et al., 2007). It is conceivable that perceived defeat also plays a role in bullying.
Cognitions related to memories of socially traumatic events can contribute to onset and maintenance of social anxiety (Hackmann et al., 2000; Norton & Abbott, 2017; Pontillo et al., 2019; Wild & Clark, 2011) and are important therapeutic targets. Bullies may confirm negative beliefs repeatedly and explicitly (e.g., telling the person directly that they are boring/weird/unacceptable) making these experiences particularly potent. Appraisals of self and others and personal reactions related to experiences of bullying are associated with psychological adjustment (Troop-Gordon & Ladd, 2005) and may contribute to distress, avoidance and shame (Wu et al., 2021). Victimisation may be associated with beliefs of being less than peers (Carlisle & Rofes, 2007) and increased self-criticism (Kopala-Sibley et al., 2013). Social anxiety and poorer psychosocial adjustment into adulthood may also be fuelled by shame (Strøm et al., 2018) and beliefs of deserving or being responsible for childhood victimisation (Boulton, 2013). Indeed, after bullying, new social experiences may be misinterpreted as excessively threatening (Fox et al., 2022) including via heightened attention to negative social cues and interpreting social situations and others’ intentions as more negative, hostile, or dangerous (Kellij et al., 2022).
For PTSD, the Posttraumatic Cognitions Inventory (PTCI; Foa et al., 1999) includes items that measure negative thoughts about the self, the world, and self-blame. For social anxiety, the Social Attitudes Questionnaire (SAQ; D.M. Clark, 2005) measures problematic beliefs about social behaviour, social situations and patient’s evaluations of their social self. These measures are important tools in cognitive therapy but were not developed within bullied samples. Specific bullying-related cognitions may be particularly important for maintaining the sense of ongoing threat that perpetuates SAD and PTSD symptoms related to bullying experiences. A bespoke measure tailored for people who were bullied could provide specific relevant prompts for therapists, aid disclosure, and provide a replicable basis for research into specific cognitions maintaining emotional difficulties. Therefore, potential items for this measure were developed and piloted following literature review, consultations with expert clinicians, and qualitative analyses of interviews with young people who were bullied (see Graham, 2022).
This study describes psychometric evaluation of a new measure of cognitions relevant to SAD and PTSD among a large sample of young people who were bullied. An empirical structure among potential items was established using exploratory and confirmatory factor analyses (Brown, 2015) and assessed using model fit statistics (Sellbom & Simms, 2019) and multiple tests of reliability and validity.
Methods
Procedure
Young people aged 18 to 29 expecting to start university or college in September 2018 were contacted by email using a student networking app mailing list distributed by the Universities and Colleges Application System (UCAS) and available free of charge to all UK higher education applicants. Those who chose to participate completed an online survey about bullying and mental health via Qualtrics (qualtrics.com). They were encouraged to take breaks if needed but to complete the questionnaires on one day. Since the survey included emotionally difficult themes, information about support services was offered to all participants and an automatically generated email was sent 24 h after completing the survey to check-in regarding wellbeing and offer additional options for support. Participants were compensated with entry into a prize draw for online shopping vouchers. Participants were invited to complete a shorter survey 1 week later, including repeated measures for test–retest reliability. The survey was closed when ten percent of responses had been completed. The study received all relevant ethical approvals.
Measures
Background Characteristics
Participants provided their age, gender, ethnicity, and sexual orientation.
Item Pool for Bullied Cognitions Inventory
Participants rated their agreement with 23 statements about self and others related to bullying experiences over the last month on a 7-point Likert scale from 1 (totally disagree) to 7 (totally agree) where higher scores indicate more maladaptive appraisals. Items were based on qualitative analysis of interviews with young people who were bullied, literature review, and consultation with expert clinicians.
Posttraumatic Cognitions Inventory
The PTCI (Foa et al., 1999) measures excessively negative appraisals of a traumatic experience and its consequences. In this study an adapted 20-item version (Kleim et al., 2013) referred to the worst bullying experience as the index event. Negative cognitions about the self, the world and self-blame are rated on a 7-point Likert scale from 1 (totally disagree) to 7 (totally agree). A mean score is calculated (range 1–7) and higher scores indicate more maladaptive appraisals. Internal consistency in this sample was excellent, \(\alpha\) = .94. It can be downloaded from https://oxcadatresources.com.
Social Attitudes Questionnaire (SAQ)
The SAQ (Clark, 2005) is a measure of beliefs about the self and social interactions that are thought to make an individual vulnerable to social anxiety disorder. It is a 50-item scale that includes beliefs about excessively high standards for social performance, conditional beliefs, and unconditional beliefs that are rated on a 7-point Likert scale from 1 (totally agree) to 7 (totally disagree). A mean score is calculated (range 1–7) and higher scores indicate lower endorsement of unhelpful beliefs. Internal consistency in this sample was excellent, \(\alpha\) = .98. It can be downloaded from https://oxcadatresources.com. This was completed by the retest subsample only (n = 133).
Victimisation
The California Bullying Victimization Scale-Revised (Reid et al., 2016) asks if the participant has experienced any of nine types of direct and indirect bullying experiences, including over the internet in a mean or hurtful way during their life. Participants selected the “worst” type of bullying they experienced and rated the frequency each type occurred, “a few times a year or less”, “about once a month”, “2 or 3 times a month”, “about once a week”, “several times a week”. Power imbalance was inferred when the aggressor was reported to be older, bigger, more athletic, attractive, popular, wealthy, or intelligent. The threshold for bullying was defined as reporting five or more types of bullying (reflecting range of experiences) and/or frequency 2 to 3 times per month or more (reflecting repeated exposure).
Psychopathology
PTSD symptom severity was measured using the PTSD Checklist for DSM-5 (PCL-5; Weathers et al., 2013). Participants answered in relation to their worst bullying experience and rated on a 5-point Likert scale of 0 (not at all) to 4 (extremely) how much they have been bothered by each symptom over the last month (range 0–80). Social anxiety symptom severity was measured using the Social Phobia Inventory (SPIN; Connor et al., 2000). Participants rated on a 5-point Likert scale of 0 (not at all) to 4 (extremely) how much each statement applied over the past week (range 0–68). Depression symptom severity was measured using the Patient Health Questionnaire-9 (PHQ-9; Kroenke et al., 2001). Participants rated on a 4-point Likert scale of 0 (not at all) to 4 (nearly every day) how often they had been bothered by each problem over the last 2 weeks, with higher scores indicating more severe depression (range 0–27). General anxiety symptom severity was measured using the GAD-7 (Spitzer et al., 2006). Participants rated on a 4-point Likert scale of 0 (not at all) to 4 (nearly every day) how often they were bothered by each problem over the last 2 weeks (range 0–21). On each scale, higher scores indicate more severe symptoms.
Data Analysis
Due to online collection method, data were checked for challenges to reliability indicated by “straight-lining” (repeatedly selecting the same response across the survey) and low total response time compared with number of questionnaires completed (time automatically recorded by Qualtrics). No participants were excluded because of these checks. Cases were included if they responded to at least one item in the pool. Data was analysed using SPSS 27 and R (R Core Team, 2022), using RStudio (RStudio Team, 2022) with haven (Wickham et al., 2022b), tidyr (Wickham & Girlich, 2022), dplyr (Wickham et al., 2022a), psych (Revelle, 2021) and lavaan (Rosseel, 2012; Rosseel et al., 2022).
Item Reduction and Factor Analyses
Sampling adequacy for the item pool was confirmed by Kaiser–Meyer–Olkin (KMO) score greater than 0.7 (Kaiser & Rice, 1974) and a significant result on Bartlett’s test of sphericity. The sample was split into two random half datasets using R’s random sampling function for model development (EFA, n = 650) and validation (CFA, n = 629). Exploratory factor analysis (EFA) determines the smallest number of interpretable factors needed to explain the correlations among a set of items. Items were considered for removal if they had weak factor loadings (< 0.4) or high cross-loading across factors indicated by high complexity rating, low difference in factor loading (< 0.2) or two significant loadings (> 0.3). EFA was repeated after each item was removed. Confirmatory factor analysis (CFA) tests the suggested factor structure in a different sample.
Factor extraction was guided by multiple metrics (Finch, 2019) namely number of factors with Eigenvalues > 1 (Guttman–Kaiser rule), number of factors indicated before the elbow on a scree plot, number of factors suggested by parallel analysis, and comparisons of model fit. There was little missing data (completion rate 0.995–0.998) but skewness was high (common when assessing potentially clinical features in a non-clinical sample) and inter-factor correlation was expected. Therefore, an oblique (oblimin) rotation was used and MLR (maximum likelihood robust) estimation was applied, which is robust to non-normality. Model fit was assessed according to four recommended fit statistics (Brown, 2015; Hu & Bentler, 1999). Chi-square fit was determined such that \(\chi^{2}\):df ratio below 3:1 is acceptable (i.e., \(\chi^{2}\)/df below 3). On the Comparative Fit Index (CFI), Tucker Lewis Index (TLI), and root mean square error of approximation (RMSEA), acceptable fit was indicated by CFI ≥ .90, TLI ≥ .90, RMSEA ≤ .08, and good fit was indicated by CFI ≥ .95, TLI ≥ .95, and RMSEA ≤ .06.
Once a suitable structure was defined in the EFA sample, the same structure was applied within the CFA sample and model fit was evaluated using the same indices and using the highest loading item as the reference item for each factor. To assess the appropriateness of using single scale scores, fit statistics were evaluated for each full scale using a single second-order factor. Modification indices represent the improvement in model \(\chi^{2}\) that is achieved by freeing the residual variance correlation between two items and were considered only if very large (> 30) and conceptually appropriate (Brown, 2015).
Reliability and Validity
Several tests of reliability (internal consistency, test–retest) and validity (convergent, discriminant, criterion) were applied to evaluate the robustness of the scales. Internal consistency was indicated by Cronbach’s alpha for extracted factors and the full scale, 0.7 to 0.8 (acceptable), 0.8 to 0.9 (very good), > 0.9 (potential multicollinearity). Test–retest reliability was indicated by a correlation 0.40–0.59 (fair), 0.60–0.74 (good) and > 0.75 (excellent). Convergent validity was indicated by the percentage of item variance explained by the extracted factors with a minimum threshold of 0.5, meaning that 50% of item variance is explained by all extracted factors (Hair et al., 2010). Discriminant validity between factors (representing subscales) indicated the extent to which they reflect distinct constructs such that factor correlations < 0.85 (acceptable) with higher correlations indicating potential multicollinearity.
Criterion validity was indicated by Pearson correlations with symptoms of PTSD to bullying experience (PCL-5) and Social Anxiety (SPIN) and cognitive measures (PTCI, SAQ). To assess the unique contributions of the new measures to explaining variance in the outcomes, simultaneous multiple logistic regressions included the new measures alongside pre-existing measures of cognitions, and perceived power imbalance during the event.
Finally, for diagnostic group comparisons, likely diagnosis of SAD was inferred from SPIN sum score 19 or above (Connor et al., 2000) and likely diagnosis of PTSD was inferred from PCL sum score 31 or above (Weathers et al., 2013). Participants were categorised into four groups: no likely diagnosis of either PTSD or SAD (PCL < 31, SPIN < 19), likely diagnosis of SAD only (PCL < 31, SPIN ≥ 19), likely diagnosis of PTSD only (PCL ≥ 31, SPIN < 19), and likely diagnosis of both SAD and PTSD (SPIN ≥ 19, PCL ≥ 31). Group comparisons were conducted using multinomial logistic regressions with likely diagnostic status as the dependent variable. Overall model statistics were reviewed for goodness of fit with the data and then comparisons were calculated between each of the four outcome categories (None, SAD, PTSD, SAD + PTSD) by setting each in turn as the reference group.
Results
Participants
Of 1879 young people who took part in the survey, 1279 reported having been bullied. Survey participants were randomly allocated into two groups of 650 and 629 for the purposes of data analyses. Of these 449 and 405 respectively provided data for at least one potential BCI item and were included in these analyses. Participant characteristics are presented in Table 1. The two groups did not differ in terms of bullying exposure, age, gender, ethnicity, sexual orientation, or PTSD. There was a small difference (d = 0.15) in social anxiety severity in that the EFA sample reported slightly greater severity. There was large variability in SPIN scores in both samples with standard deviations > 16.
Item Reduction
Of the original 23 items considered for inclusion in the measure, five were removed due to extreme skewness (1,“I deserve to be treated the way they treated me”), very low correlation with main outcomes (7, “If someone is more important than me then they have the right to pick on me”), repetitive wording with another item (10,“If people knew I was picked on they would find me less attractive”; retained 13), unclear concept (18,“I wish I had physical scars so people could see how bad it was”) and unclear wording (3, “I am the classic example of someone who is easy to pick on”). The remaining 18 items were appropriate for factor analysis evidenced by high Kaiser–Meyer–Olkin sampling adequacy (0.96) and significant Bartlett’s test of sphericity (\(\chi^{2}\) = 6,334.33, df = 171, p < .001). Inter-item and item-total correlations for all original items are included as Supplementary materials.
Exploratory Factor Analysis
Items were entered into an EFA among the first random half of the sample (n = 449) and the suggested number of factors varied according to method used. Eigenvalues suggested a 2-factor solution (10.68, 1.24, 0.84), scree plot suggested up to three factors, parallel analysis suggested 4 factors. Therefore, model fit and factor loadings in the EFA were evaluated for two, three and four factor solutions to establish a well-fitting and conceptually coherent model. Fit statistics indicated poor fit for the two factor solution (TLI = 0.90, RMSEA = 0.09, \(\chi^{2}\) = 628.24 on df = 134, \(\chi^{2}\):df = 4.69), marginally acceptable fit for the three factor solution (TLI = 0.93, RMSEA = 0.07, \(\chi^{2}\) = 390.84 on df = 117, \(\chi^{2}\):df = 3.34), and excellent fit for the four factor solution (TLI = 0.96, RMSEA = 0.06, \(\chi^{2}\) = 245.48 on df = 101, \(\chi^{2}\):df = 2.43).
Items with relatively low factor loadings (< 0.4) and/or high complexity indicated by high cross-loadings (within 0.2) were considered for deletion. This applied across all factor solutions for item 2, “If I fail at anything it means the person or people who picked on me were right”. After removing this item, model fit for the three-factor solution remained poor, but the four-factor model fit improved, with good conceptual fit supported by a two-item factor of the items “I have been totally degraded” and “I have been totally humiliated”. Although factors can be indicated by two items in EFA, particularly if highly correlated as the items are here, this would produce an unidentified model in subsequent CFA, where factors must include three or more items to produce a stable scale. Therefore, despite relatively low loading onto this factor and high cross loading, item 5, “If I hadn’t been picked on maybe I would be a better person than I am now” was retained to support the overall stability of the measure. Two further items were removed to simplify the scale without reducing model fit (6, “I still believe the things that other people told me about myself” and 9,“If people knew I was picked on they would reject me”).
Among the remaining 15 items, fit statistics indicated poor fit for the two-factor solution (TLI = 0.89, RMSEA = 0.10, \(\chi^{2}\) = 403.55 on df = 76, \(\chi^{2}\):df = 5.31) acceptable fit for the three-factor solution on all but one of the indicators (TLI = 0.92, RMSEA = 0.08, \(\chi^{2}\) = 258.11 on df = 63, \(\chi^{2}\):df = 4.10) and a much closer fit to the data for the four-factor solution (TLI = 0.97, RMSEA = 0.05, \(\chi^{2}\) = 111.36 on df = 51, \(\chi^{2}\):df = 2.18) which also produced coherent and interpretable factors. Of note, removing item 5 which was retained to stabilise the four-factor solution did not improve model fit for the three-factor solution (TLI = 0.911, RMSEA = 0.092, \(\chi^{2}\) = 250.47 on df = 52, \(\chi^{2}\):df = 4.82). Therefore, the four-factor model with 15 items was chosen. This model explained 52.5% of the variance and had adequate factor loadings for all factors. The factors had good conceptual fit, described as “degraded in the eyes of others” (3 items, 12.0%), “negative interpretations of reactions to bullying” (6 items, 18.6%), “recognisable as a bullying victim” (3 items, 12.3%), and “social defeat” (3 items, 9.4%). The total score range is 15 to 105.
Confirmatory Factor Analysis
The four-factor structure was evaluated using CFA in the second random half of the sample (n = 405). The four-factor model had acceptable fit for the data (CFI = 0.94, TLI = 0.92, RMSEA = 0.08 (CI 0.07–0.09), \(\chi^{2}\) = 299.11 on df = 84, \(\chi^{2}\):df = 3.56) although chi-square ratio was outside the acceptable range. Modification indices suggested that adding a correlated residual between the two core items in the social defeat factor (56.832) would improve model fit (CFI = 0.95, TLI = 0.94, RMSEA = 0.07 (CI 0.06–0.08), \(\chi^{2}\) = 244.59 on df = 83, \(\chi^{2}\):df = 2.95) but this was not applied as it added complexity to the model which was marginally acceptable without the modification. Superior fit for the four-factor model was confirmed by chi-square comparison with the three-factor model (\(\Delta\)χ2 = 76.06, \(\Delta\)df = 3, p ≤ .001).
There were positive correlations among all four factors which loaded together onto a second-order factor with acceptable fit on three indices (CFI = 0.94, TLI = 0.92, RMSEA = 0.08 (CI 0.07–0.09) and chi-square ratio slightly above the acceptable range (\(\chi^{2}\) = 303.94 on df = 86, \(\chi^{2}\):df = 3.53). Model fit was not significantly different from the four-factor model (\(\Delta\)χ2 = 3.146, \(\Delta\)df = 3, p = .207) suggesting that a combined total score is meaningful alongside the individual factor scores. Factor loadings are shown in Table 2.
Reliability and Validity
Reliability assessments within the CFA sample showed that internal consistency was very good for the factors (Cronbach’s \(\alpha\) = 0.82–0.85) and full scale (\(\alpha\) = 0.93). Test–retest reliability was excellent for the total scale (r = 0.88) and excellent or good for individual factors (1: r = 0.76, 2: r = 0.84, 3: r = 0.80, 4: r = 0.68). Item deletion statistics based on alpha did not support dropping any items. Convergent validity was partially confirmed such that percent variance explained by extracted factors was above 0.5 for items other than item 12 (r2 = 0.472), item 15 (r2 = 0.451), item 19 (r2 = 0.397), item 22 (r2 = 0.419), item 23 (r2 = 0.453). Discriminant validity was marginally acceptable with factor correlations between 0.766 and 0.898. Criterion validity for the full scale was established by significant medium-large Pearson correlations with symptoms of social anxiety (r = 0.57) and PTSD (r = 0.65). Factor and outcome correlations are in Table 2.
The BCI total score had large correlations with existing cognitive measures, PTCI (r = 0.78) and SAQ (r = − 0.72; higher scores on the SAQ indicate lower endorsement of unhelpful beliefs). To test the additional contribution of the BCI in explaining variance in PTSD and social anxiety symptoms, multiple linear regression analysis was conducted including BCI total score, presence of power imbalance, and PTCI or SAQ respectively. The models explained 59.8% of the variance in PTSD symptoms (R2 = .598, R2Adjusted = .596, F(3, 768) = 380.220, p < .001 and 41.7% of the variance in social anxiety symptoms (R2 = .417, R2Adjusted = .403, F(3, 125) = 29.835, p < .001). The BCI explained small but significant additional variance in PTSD symptoms over the PTCI (11.6%) but the contribution to explaining social anxiety symptoms over the SAQ (13.7%) was not significant as the sample size was smaller. To check for potential multicollinearity in the model, variance inflation factors were evaluated and were not excessive. See Table 3.
Group Comparisons
Participants were classified by probable SAD or PTSD diagnoses. In total, 173 of the 854 participants (20.3%) were below the symptom thresholds for probable diagnosis of both SAD and PTSD, 315 (36.9%) met the threshold for SAD only, 43 (5.0%) for PTSD only, and 323 (37.8%) for both SAD and PTSD combined.
The BCI predicted diagnostic group membership (χ2 (3, N = 835) = 377.58, Nagelkerke R2 = .40, p < .001) and distinguished between the non-clinical and other groups, such that higher scores were associated with membership of one of the clinical groups. Compared with the non-clinical group, higher BCI significantly increased the likelihood being in the SAD alone group (OR 1.06, 95% CI [1.04, 1.07]), PTSD alone group (OR 1.07, 95% CI [1.05, 1.09]), and the combined SAD + PTSD group (OR 1.12, 95% CI [1.10, 1.14]). Within the clinical groups, there was no distinction between the SAD alone and PTSD alone groups (OR 1.01, 95% CI [0.99, 1.03]) but an increase in BCI score significantly increased the likelihood of being in the SAD + PTSD group compared with SAD alone (OR 1.06, 95% CI [1.05, 1.07]) or PTSD alone (OR 1.05, 95% CI [1.03, 1.07]).
Discussion
The Bullied Cognitions Inventory (BCI) is a reliable and valid measure of beliefs about self and others related to bullying experiences that cluster into four factors, “degraded in the eyes of others” (3 items), “negative interpretations of reactions to bullying” (6 items), “recognisable as a bullying victim” (3 items), and “social defeat” (3 items). Scores on this measure explained significant variance in social anxiety and PTSD symptoms experienced by young people with a history of bullying. Among those suffering with social anxiety, the measure distinguishes those also experiencing high symptoms of PTSD related to their bullying experiences and vice versa. The BCI could be a useful tool for assessment and monitoring in cognitive therapy for people who experience ongoing distress related to experiences of bullying. It added additional variance in explaining PTSD symptoms over and above the PTCI, with a similar effect size for explaining additional variance in social anxiety over and above the SAQ not quite reaching significance because of the smaller sample size.
Correlations among the clusters of beliefs about self and others related to bullying experiences in the BCI reflect strong potential links between the concepts that may reinforce each other. For example, beliefs about having been degraded by bullying experiences are entwined with beliefs that if others found out about what happened then social wellbeing could be damaged. In addition, beliefs that past events have the power to mark you out and make you permanently recognisable as a target for bullying are held alongside self-critical thoughts that those experiences were not serious enough to warrant a reaction. Taken together, these beliefs may increase perceived social threat. Clinically, the BCI total score provides an indication of severity of unhelpful cognitions that are associated with social anxiety and PTSD symptoms. In addition, subscale and individual item scores can be used to identify particular targets for intervention. Of note, in addition to social anxiety and PTSD, scores on the BCI were also significantly correlated with depression and general anxiety so it is possible that the measures may represent cognitions and behaviours related to bullying that drive symptoms of a range of disorders.
Features of the study may limit specificity of conclusions. First, the sample was not selected according to symptom levels and included participants with low and high scores across all symptom domains, potentially inflating correlations and obscuring clinically interesting symptom patterns among those with higher scores. Of note, relatively fewer participants were categorised as experiencing PTSD-only, with far more experiencing social anxiety alone or in combination with PTSD. This reflects the likely clinical picture among young people who were bullied but means that PTSD-only group comparisons were underpowered. Future research could use network analyses to explore whether certain subgroups of symptoms (rather than total scores for social anxiety, PTSD, anxiety, and depression) show stronger associations to specific cognitive themes. Second, items within the measure could be further refined, particularly within the “social defeat” factor where the item, “If I hadn’t been picked on maybe I would be a better person” was retained due its relative position in the model structure and contribution to model stability. Future research could adapt the wording to be more direct, for example “being picked on made me an inferior person”, and reassess variance explained within the factor and contribution to overall measure stability. Finally, data collection method and sample characteristics could be important. Data were self-reported online potentially compromising validity despite data checks. Although the sample was diverse, notably in terms of sexual orientation and ethnicity, people who identified as female were overrepresented and all were prospective students. Furthermore, the sample was self selected and it is possible that those with experiences of bullying and negative effects were more interested in taking part. Therefore, findings may not generalise to younger or older people, or people with very different circumstances, and replication is needed in a gender-balanced non-selected sample.
There are clinical implications for the assessment of bullying experiences and related cognitions. Social anxiety symptoms were high in this sample of young adults with a history of bullying and, of those with clinically relevant social anxiety symptoms, just over half (51.2%) also had clinically relevant PTSD symptoms to their worst bullying experience. The extent of clinically relevant PTSD symptoms was therefore even higher in this sample than in another sample of adults with experiences of social trauma (Bjornsson et al., 2020) in which just under a third (32.7%) of individuals with SAD also reported clinically significant symptoms of posttraumatic stress. The high level of symptoms is perhaps unsurprising given the nature of the sample as all having experienced bullying and theoretical likelihood that both types of symptoms were precipitated or exacerbated by shared experiences of socially traumatic events. Only one in five participants did not reach the threshold for likely clinical diagnosis of SAD or PTSD. The PTSD alone group was by far the smallest group, with nearly seven times fewer participants than in each of the other clinical groups, SAD alone and SAD + PTSD. The temporal associations between SAD and PTSD are unclear (Collimore et al., 2010) but high comorbidity suggests that mechanisms and pathways to symptoms may overlap among people who have experienced the social trauma of bullying. It is possible that people who have been bullied and are experiencing SAD and PTSD-like symptoms related to their experiences may be best understood as experiencing a stress response to traumatic social experiences that involves an ongoing sense of social threat.
The high rate of symptoms of both social anxiety and PTSD in this sample supports ongoing focus on bullying experiences as psychologically impactful events. Clinicians who work with bullied people should be aware of the potential for PTSD-like symptoms related to their experiences. If used within social anxiety treatment, a high score could suggest using techniques associated with processing negative past experiences, such as imagery rescripting and updating memories related to the bullying experiences to challenge unhelpful beliefs connected to (the worst parts of) the experience (Wild & Clark, 2011). The utility of routine assessment of bullying is supported by themes identified in this measure that may lead young people to avoid disclosure, such as shame (e.g., “If I told someone I was picked on they would think I am weak”) and self-criticism particularly in terms of downplaying the seriousness of the events (e.g., “It is unreasonable to feel bad as much worse things can happen”). The BCI is a bespoke measure of beliefs related to bullying that may be of particular relevance for young people who are experiencing symptoms of social anxiety and PTSD related to their experiences.
Data Availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5) (5th ed.). American Psychiatric Association.
Andreou, E., Tsermentseli, S., Anastasiou, O., & Kouklari, E.-C. (2021). Retrospective accounts of bullying victimization at school: Associations with post-traumatic stress disorder symptoms and post-traumatic growth among University Students. Journal of Child & Adolescent Trauma, 14(1), 9–18. https://doi.org/10.1007/s40653-020-00302-4
Arseneault, L. (2018). Annual Research Review: The persistent and pervasive impact of being bullied in childhood and adolescence: Implications for policy and practice. Journal of Child Psychology and Psychiatry, 59, 405–421. https://doi.org/10.1111/jcpp.12841
Beierl, E., Böllinghaus, I., Clark, D., Glucksman, E., & Ehlers, A. (2020). Cognitive paths from trauma to posttraumatic stress disorder: A prospective study of Ehlers and Clark's model in survivors of assaults or road traffic collisions. Psychological Medicine, 50(13), 2172–2181. https://doi.org/10.1017/S0033291719002253
Bjornsson, A. S., Hardarson, J. P., Valdimarsdottir, A. G., Gudmundsdottir, K., Tryggvadottir, A., Thorarinsdottir, K., Wessman, I., Sigurjonsdottir, Ó., Davidsdottir, S., & Thorisdottir, A. S. (2020). Social trauma and its association with posttraumatic stress disorder and social anxiety disorder. Journal of Anxiety Disorders, 72, 102228. https://doi.org/10.1016/j.janxdis.2020.102228
Boulton, M. J. (2013). Associations between adults’ recalled childhood bullying victimization, current social anxiety, coping, and self-blame: Evidence for moderation and indirect effects. Anxiety, Stress, & Coping, 26(3), 270–292. https://doi.org/10.1080/10615806.2012.662499
Brewin, C. R., Lanius, R. A., Novac, A., Schnyder, U., & Galea, S. (2009). Reformulating PTSD for DSM-V: Life after Criterion A. Journal of Traumatic Stress, 22(5), 366–373. https://doi.org/10.1002/jts.20443
Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). The Guildford Press.
Carleton, R. N., Peluso, D. L., Collimore, K. C., & Asmundson, G. J. G. (2011). Social anxiety and posttraumatic stress symptoms: The impact of distressing social events. Journal of Anxiety Disorders, 25(1), 49–57. https://doi.org/10.1016/j.janxdis.2010.08.002
Carlisle, N., & Rofes, E. (2007). School bullying: Do adult survivors perceive long-term effects? Traumatology, 13, 16–26. https://doi.org/10.1177/1534765607299911
Clark, D., Ehlers, A., Hackmann, A., McManus, F., Fennell, M., Grey, N., Waddington, L., & Wild, J. (2006). Cognitive therapy versus exposure and applied relaxation in social phobia: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 74(3), 568.
Clark, D. M. (2005). Three questionnaires for measuring central constructs in the cognitive model of social phobia: Preliminary analysis [Unpublished]. Retrieved from https://oxcadatresources.com
Clark, D. M., Ehlers, A., McManus, F., Hackmann, A., Fennell, M., Campbell, H., Flower, T., Davenport, C., & Louis, B. (2003). Cognitive therapy versus fluoxetine in generalized social phobia: A randomized placebo-controlled trial. Journal of Consulting and Clinical Psychology, 71(6), 1058.
Clark, D. M., & Wells, A. (1995). A cognitive model of social phobia. In M. R. Heimberg, D. A. Hope, & F. R. Schneier (Eds.), Social phobia: Diagnosis, assessment and treatment (pp. 69–93). Guilford Press.
Collimore, K. C., Carleton, R. N., Hofmann, S. G., & Asmundson, G. J. G. (2010). Posttraumatic stress and social anxiety: The interaction of traumatic events and interpersonal fears. Depression and Anxiety, 27(11), 1017–1026. https://doi.org/10.1002/da.20728
Connor, K. M., Davidson, J. R., Churchill, L. E., Sherwood, A., Foa, E., & Weisler, R. H. (2000). Psychometric properties of the Social Phobia Inventory (SPIN). New self-rating scale. British Journal of Psychiatry, 176, 379–386. https://doi.org/10.1192/bjp.176.4.379
Cosma, A., Walsh, S. D., Chester, K. L., Callaghan, M., Molcho, M., Craig, W., & Pickett, W. (2020). Bullying victimization: Time trends and the overlap between traditional and cyberbullying across countries in Europe and North America. International Journal of Public Health, 65(1), 75–85. https://doi.org/10.1007/s00038-019-01320-2
Craig, W., Harel-Fisch, Y., Fogel-Grinvald, H., Dostaler, S., Hetland, J., Simons-Morton, B., Molcho, M., de Mato, M. G., Overpeck, M., Due, P., & Pickett, W. (2009). A cross-national profile of bullying and victimization among adolescents in 40 countries. International Journal of Public Health, 54(Suppl 2), 216–224. https://doi.org/10.1007/s00038-009-5413-9
Crosby, J. W., Oehler, J., & Capaccioli, K. (2010). The relationship between peer victimization and post-traumatic stress symptomatology in a rural sample. Psychology in the Schools, 47(3), 297–310. https://doi.org/10.1002/pits.20471
Ehlers, A., & Clark, D. M. (2000). A cognitive model of posttraumatic stress disorder. Behaviour Research and Therapy, 38, 319–345. https://doi.org/10.1016/s0005-7967(99)00123-0
Ehlers, A., Clark, D. M., Dunmore, E., Jaycox, L., Meadows, E., & Foa, E. B. (1998). Predicting response to exposure treatment in PTSD: The role of mental defeat and alienation. Journal of Traumatic Stress, 11(3), 457–471. https://doi.org/10.1023/A:1024448511504
Ehlers, A., Clark, D. M., Hackmann, A., McManus, F., & Fennell, M. (2005). Cognitive therapy for post-traumatic stress disorder: Development and evaluation. Behaviour Research and Therapy, 43, 413–431. https://doi.org/10.1016/j.brat.2004.03.006
Ehlers, A., Hackmann, A., Grey, N., Wild, J., Liness, S., Albert, I., Deale, A., Stott, R., & Clark, D. (2014). A randomized controlled trial of 7-day intensive and standard weekly cognitive therapy for PTSD and emotion-focused supportive therapy. American Journal of Psychiatry, 171(3), 294–304.
Erwin, B. A., Heimberg, R. G., Marx, B. P., & Franklin, M. E. (2006). Traumatic and socially stressful life events among persons with social anxiety disorder. Journal of Anxiety Disorders, 20, 896–914. https://doi.org/10.1016/j.janxdis.2005.05.006
Finch, W. H. (2019). Using fit statistic differences to determine the optimal number of factors to retain in an exploratory factor analysis. Educational and Psychological Measurement. https://doi.org/10.1177/0013164419865769
Foa, E. B., Ehlers, A., Clark, D. M., Tolin, D. F., & Orsillo, S. M. (1999). The Posttraumatic Cognitions Inventory (PTCI): Development and validation. Psychological Assessment, 11(3), 303–314. https://doi.org/10.1037/1040-3590.11.3.303
Fox, J. K., Ryan, J. L., Martin Burch, J., & Halpern, L. F. (2022). The Role of parental overcontrol in the relationship between peer victimization, social threat cognitions, and social anxiety in school-age children. School Mental Health, 14(1), 201–212. https://doi.org/10.1007/s12310-021-09466-2
Graham, B. (2022). Cognitive factors in adjustment after social trauma [PhD thesis]. University of Oxford
Guzzo, G., Pace, U., Lo Cascio, V., Craparo, G., & Schimmenti, A. (2014). Bullying victimization, post-traumatic symptoms, and the mediating role of alexithymia. Child Indicators Research, 7(1), 141–153. https://doi.org/10.1007/s12187-013-9206-6
Hackmann, A., Clark, D. M., & McManus, F. (2000). Recurrent images and early memories in social phobia. Behaviour Research and Therapy, 38(6), 601–610. https://doi.org/10.1016/S0005-7967(99)00161-8
Hair, J. F., Black, W. C., & Babin, B. J. (2010). Multivariate data analysis: A global perspective. Pearson Education.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Idsoe, T., Vaillancourt, T., Dyregrov, A., Hagen, K. A., Ogden, T., & Nærde, A. (2021). Bullying victimization and trauma. Frontiers in Psychiatry, 11, 480353. https://doi.org/10.3389/fpsyt.2020.480353
Kaiser, H. F., & Rice, J. (1974). Little Jiffy, Mark Iv. Educational and Psychological Measurement, 34(1), 111–117. https://doi.org/10.1177/001316447403400115
Kellij, S., Lodder, G. M. A., van den Bedem, N., Güroğlu, B., & Veenstra, R. (2022). The social cognitions of victims of bullying: A systematic review. Adolescent Research Review. https://doi.org/10.1007/s40894-022-00183-8
Kleim, B., Ehlers, A., & Glucksman, E. (2007). Early predictors of chronic post-traumatic stress disorder in assault survivors. Psychological Medicine, 37(10), 1457–1467. https://doi.org/10.1017/S0033291707001006
Kleim, B., Grey, N., Wild, J., Nussbeck, F. W., Stott, R., Hackmann, A., Clark, D. M., & Ehlers, A. (2013). Cognitive change predicts symptom reduction with cognitive therapy for posttraumatic stress disorder. Journal of Consulting and Clinical Psychology, 81(3), 383–393. https://doi.org/10.1037/a0031290
Kopala-Sibley, D. C., Zuroff, D. C., Leybman, M. J., & Hope, N. (2013). Recalled peer relationship experiences and current levels of self-criticism and self-reassurance. Psychology and Psychotherapy: Theory, Research and Practice, 86, 33–51. https://doi.org/10.1111/j.2044-8341.2011.02044.x
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9. Journal of General Internal Medicine, 16, 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
Malecki, C. K., Demaray, M. K., Coyle, S., Geosling, R., Rueger, S. Y., & Becker, L. D. (2014). Frequency, power differential, and intentionality and the relationship to anxiety, depression, and self-esteem for victims of bullying. Child & Youth Care Forum, 44, 115–131. https://doi.org/10.1007/s10566-014-9273-y
Manrique, M., Allwood, M. A., Pugach, C. P., Amoh, N., & Cerbone, A. (2020). Time and support do not heal all wounds: Mental health correlates of past bullying among college students. Journal of American College Health, 68(3), 227–235. https://doi.org/10.1080/07448481.2018.1538999
McCabe, R. E., Antony, M. M., Summerfeldt, L. J., Liss, A., & Swinson, R. P. (2003). Preliminary examination of the relationship between anxiety disorders in adults and self-reported history of teasing or bullying experiences. Cognitive Behaviour Therapy, 32, 187–193. https://doi.org/10.1080/16506070310005051
McCabe, R. E., Miller, J. L., Laugesen, N., Antony, M. M., & Young, L. (2010). The relationship between anxiety disorders in adults and recalled childhood teasing. Journal of Anxiety Disorders, 24, 238–243. https://doi.org/10.1016/j.janxdis.2009.11.002
McDougall, P., & Vaillancourt, T. (2015). Long-term adult outcomes of peer victimization in childhood and adolescence: Pathways to adjustment and maladjustment. American Psychologist, 70, 300–310. https://doi.org/10.1037/a0039174
Mynard, H., Joseph, S., & Alexander, J. (2000). Peer-victimisation and posttraumatic stress in adolescents. Personality and Individual Differences, 29(5), 815–821. https://doi.org/10.1016/S0191-8869(99)00234-2
Nielsen, M. B., Tangen, T., Idsoe, T., Matthiesen, S. B., & Magerøy, N. (2015). Post-traumatic stress disorder as a consequence of bullying at work and at school. A literature review and meta-analysis. Aggression and Violent Behavior, 21, 17–24. https://doi.org/10.1016/j.avb.2015.01.001
Norton, A. R., & Abbott, M. J. (2017). Bridging the gap between aetiological and maintaining factors in social anxiety disorder: The impact of socially traumatic experiences on beliefs, imagery and symptomatology. Clinical Psychology & Psychotherapy, 24(3), 747–765. https://doi.org/10.1002/cpp.2044
Pontillo, M., Tata, M. C., Averna, R., Demaria, F., Gargiullo, P., Guerrera, S., Pucciarini, M. L., Santonastaso, O., & Vicari, S. (2019). Peer victimization and onset of social anxiety disorder in children and adolescents. Brain Sciences, 9(6), 6. https://doi.org/10.3390/brainsci9060132
R Core Team. (2022). R: A language and environment for statistical computing. R Core Team.
Reid, G. M., Holt, M. K., Bowman, C. E., Espelage, D. L., & Green, J. G. (2016). Perceived social support and mental health among first-year college students with histories of bullying victimization. Journal of Child and Family Studies, 25, 3331–3341. https://doi.org/10.1007/s10826-016-0477-7
Revelle, W. (2021). psychTools: Tools to Accompany the ’psych; Package for Psychological Research (2.1.6) [R package]. Retrieved from https://cran.r-project.org/web/packages/psychTools
Rivers, I. (2006). Recollections of bullying at school and their long-term implications for lesbians, gay men, and bisexuals. Crisis, 25, 169–175. https://doi.org/10.1027/0227-5910.25.4.169
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. https://doi.org/10.18637/jss.v048.i02
Rosseel, Y., Jorgensen, T. D., Rockwood, N., Oberski, D., Byrnes, J., Vanbrabant, L., Savalei, V., Merkle, E., Hallquist, M., Rhemtulla, M., Katsikatsou, M., Barendse, M., Scharf, F., & Du, H. (2022). lavaan: Latent Variable Analysis (0.6-11) [R package]. Retrieved from https://CRAN.R-project.org/package=lavaan
RStudio Team. (2022). RStudio: Integrated Development for R. (2022.2.1.461) [R package]. Retrieved from http://www.rstudio.com/
Sansen, L. M., Iffland, B., & Neuner, F. (2015). The trauma of peer victimization: Psychophysiological and emotional characteristics of memory imagery in subjects with social anxiety disorder. Psychophysiology, 52, 107–116. https://doi.org/10.1111/psyp.12291
Sellbom, M., & Simms, L. J. (2019). Introduction to the special issue on methodological and statistical advancements in clinical assessment. Psychological Assessment, 31(12), 1383–1385. https://doi.org/10.1037/pas0000786
Siegel, R. S., Greca, A. M. L., & Harrison, H. M. (2009). Peer victimization and social anxiety in adolescents: Prospective and reciprocal relationships. Journal of Youth and Adolescence, 38(8), 1096–1109. https://doi.org/10.1007/s10964-009-9392-1
Skrzypiec, G., Alinsug, E., Nasiruddin, U., Andreou, E., Brighi, A., Didaskalou, E., Guarini, A., Kang, S.-W., Kaur, K., Kwon, S., Ortega-Ruiz, R., Romera, E. M., Roussi-Vergou, C., Sandhu, D., Sikorska, I., Wyra, M., & Yang, C.-C. (2018). Self-reported harm of adolescent peer aggression in three world regions. Child Abuse & Neglect, 85, 101–117. https://doi.org/10.1016/j.chiabu.2018.07.030
Spitzer, R. L., Kroenke, K., Williams, J. B., & Lowe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166, 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
Storch, E. A., & Esposito, L. E. (2003). Peer victimization and posttraumatic stress among children. Child Study Journal, 33(2), 91–99.
Storch, E. A., Masia-Warner, C., Crisp, H., & Klein, R. G. (2005). Peer victimization and social anxiety in adolescence: A prospective study. Aggressive Behavior, 31(5), 437–452. https://doi.org/10.1002/ab.20093
Strøm, I. F., Aakvaag, H. F., Birkeland, M. S., Felix, E., & Thoresen, S. (2018). The mediating role of shame in the relationship between childhood bullying victimization and adult psychosocial adjustment. European Journal of Psychotraumatology, 9(1), 1418570. https://doi.org/10.1080/20008198.2017.1418570
Thew, G. R., Ehlers, A., Grey, N., Wild, J., Warnock-Parkes, E., Dawson, R. L., & Clark, D. M. (2020). Change processes in cognitive therapy for social anxiety disorder delivered in routine clinical practice. Clinical psychology in Europe, 2(2)
Troop-Gordon, W., & Ladd, G. W. (2005). Trajectories of peer victimization and perceptions of the self and schoolmates: Precursors to internalizing and externalizing problems. Child Development, 76, 1072–1091. https://doi.org/10.1111/j.1467-8624.2005.00898.x
Warnock-Parkes, E., Wild, J., Thew, G. R., Kerr, A., Grey, N., Stott, R., Ehlers, A., & Clark, D. M. (2020). Treating social anxiety disorder remotely with cognitive therapy. The Cognitive Behaviour Therapist, 13, e30. https://doi.org/10.1017/S1754470X2000032X
Weathers, F. W., & Keane, T. M. (2007). The criterion a problem revisited: Controversies and challenges in defining and measuring psychological trauma. Journal of Traumatic Stress, 20(2), 107–121. https://doi.org/10.1002/jts.20210
Weathers, F. W., Litz, B. T., Keane, T. M., Palmieri, P. A., Marx, B. P., & Schnurr, P. P. (2013). The PTSD checklist for DSM-5 (PCL-5). Scale available from the National Center for PTSD. Retrieved from www.ptsd.va.gov
Wickham, H., François, R., Henry, L., & Müller, K. (2022a). dplyr: A Grammar of Data Manipulation. (1.0.9). Retrieved from https://dplyr.tidyverse.org, https://github.com/tidyverse/dplyr
Wickham, H., Miller, E., & Smith, D. (2022b). haven: Import and Export ‘SPSS’, ‘Stata’ and ‘SAS’ Files. (2.5.0). Retrieved from https://haven.tidyverse.org, https://github.com/tidyverse/haven, https://github.com/WizardMac/ReadStat.
Wickham, H., & Girlich, M. (2022). tidyr: Tidy Messy Data. (1.2.0). Retrieved from https://tidyr.tidyverse.org, https://github.com/tidyverse/tidyr.
Wild, J., Hackmann, A., & Clark, D. M. (2007). When the present visits the past: Updating traumatic memories in social phobia. Journal of behavior therapy and experimental psychiatry, 38(4), 386–401
Wild, J., & Clark, D. M. (2011). Imagery rescripting of early traumatic memories in social phobia. Cognitive and Behavioral Practice, 18, 433–443. https://doi.org/10.1016/j.cbpra.2011.03.002
Wild, J., Warnock-Parkes, E., Murray, H., Kerr, A., Thew, G., Grey, N., Clark, D. M., & Ehlers, A. (2020). Treating posttraumatic stress disorder remotely with cognitive therapy for PTSD. European Journal of Psychotraumatology, 11(1), 1785818. https://doi.org/10.1080/20008198.2020.1785818
World Health Organisation. (2019). International classification of diseases, 11th revision. Retrieved from https://icd.who.int/
Wu, X., Qi, J., & Zhen, R. (2021). Bullying victimization and adolescents’ social anxiety: Roles of shame and self-esteem. Child Indicators Research, 14(2), 769–781. https://doi.org/10.1007/s12187-020-09777-x
Acknowledgements
We would like to express our gratitude to the young people who took part in this study and the OxCADAT team for support throughout the research process.
Funding
This work was funded by the Wellcome Trust [205156, 200796] the NIHR Biomedical Research Centre at Oxford University Hospitals NHS Trust and the University of Oxford Returning Carers Fund.
Author information
Authors and Affiliations
Contributions
AE, BG: Conceptualization; AE, BG: Methodology; BG: Formal analysis; BG: Investigation; BG: Writing—original draft preparation; AE: Writing—review & editing.
Corresponding author
Ethics declarations
Conflict of interest
Belinda Graham and Anke Ehlers declare that they have no conflict of interest.
Informed consent
Informed consent was obtained from participants electronically, and the study was approved by the University of Oxford Medical Sciences Inter-Divisional Research Ethics Committee [R58149/RE001].
Animal Rights
No animals were involved in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Graham, B., Ehlers, A. Development and Validation of the Bullied Cognitions Inventory (BCI). Cogn Ther Res 47, 1033–1045 (2023). https://doi.org/10.1007/s10608-023-10412-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10608-023-10412-6