Introduction

Antisocial behavior is among the most common reasons for referral to mental health services in adolescence and externalizing disorders often leads to detrimental long-term consequences (Erskine et al. 2016; Hacker et al. 2014). Antisocial behavior is a multidimensional construct that includes a broad range of behaviors, mainly aggression and delinquency (Morizot and Kazemian 2015). In an effort to shed light on the etiology of antisocial behavior, researchers have revealed the role of genetic (explaining 40–60% of the variance) and non-shared environmental factors (explaining 30% of the variance) (Ferguson 2010; Tuvblad et al. 2011; Vitaro et al. 2015). Non-shared environmental factors refer to the environment that is not shared by siblings in a family, such as peer relations, differential parental treatment, accidents, or health issues. Shared and non-shared environmental factors have been thoroughly examined in relation to antisocial behavior and the important role of family and peer relations has been established (Assink et al. 2015). Research has also focused on identifying specific genes that contribute to the development of antisocial behavior, indicating that a region in chromosome 2 (2p12) and variation within AVPR1A might be associated with antisocial behavior (Pappa et al. 2016). There is also growing evidence on the effects of gene-environment interactions between specific genes and environmental factors on antisocial behavior, focusing, among others, on deviant peer affiliation, as it is one of the stronger predictors of adolescent antisocial behavior (Vitaro et al. 2015). However, there is a lack of research on potential gene-environment interaction effects between the oxytocin receptor gene (OXTR) and deviant peer affiliation in antisocial behavior, despite OXTR’s association with antisocial behavior as well as social affiliation and bonding.

The OXTR gene is the encoded receptor for the neuropeptide oxytocin, which is involved in social-affective behaviors, such as prosocial behavior, social affiliation, attachment, and pair bonding (Lee et al. 2009). Experimental studies have indicated that intranasal administration of oxytocin enhances empathy, emotion recognition, trust, and generosity, and reduces stress reactivity (Guastella and MacLeod 2012; Veening and Olivier 2013). Importantly, this effect was more pronounced in individuals with social-affective deficits (Bartz et al. 2011). Abnormal oxytocin levels have also been found in patients with ADHD, conduct disorder, and psychopathy, but the results have been contradictory, demonstrating both higher and lower oxytocin levels in patients compared to controls (see for a review Fragkaki et al. 2017).

Furthermore, the OXTR gene is expressed in the brain and several other tissues, but its anatomical distribution varies considerably across species and affects the social organization of each species (see for a review Vaidyanathan and Hammock 2016). Developmental experiences and epigenetics can alter OXTR expression in adulthood leading to impairments in social behavior. OXTR expression and distribution differ across development and it has been proposed that “OXTR may be a developmental plasticity gene that serves as a transducer of the social environment to fine-tune the experience-dependent plasticity of the social brain” (Vaidyanathan and Hammock 2016). More specifically, a transient profile of OXTR mRNA has been observed in the human neocortex and it has been argued that oxytocin plays a crucial role in the processing of socially contingent sensory information in the neocortex (Vaidyanathan and Hammock 2016). Indeed, genetic studies have shown associations between OXTR and social behavior, pair bonding, social cognition, social interaction, and social support, especially for the single nucleotide polymorphisms (SNPs) rs53576 and rs2254298, although the results were inconsistent (Bakermans-Kranenburg and Van IJzendoorn 2013; Ebstein et al. 2012). Based on these findings and taking into account that individuals with antisocial behavior are characterized by social-affective deficits, research has explored whether antisocial behavior might be related to variations within the OXTR.

Several studies have addressed this question by examining OXTR variations in healthy and antisocial individuals. Findings from healthy samples revealed significant effects of OXTR polymorphisms on antisocial behavior in young males (Hovey et al. 2015; LoParo et al. 2016). Particularly, the C allele of the rs4564970 and the AA genotype of the rs7632287 were related to aggression and rs7632287 AA was associated with delinquency in boys only in a large sample of 2372 individuals and a replication sample of 1232 individuals, including adolescents and young adults (16–20 years) (Hovey et al. 2015). A 6-factor model for OXTR was also associated with aggression and interacted with alcohol in 235 males aged 18–32 years in response to aggression provocation (LoParo et al. 2016). Another study showed that male carriers of the A allele of rs1042778 had higher right amygdala reactivity in response to angry faces which was related to higher levels of antisocial behavior in a sample of 406 healthy young adults aged 18–22 years (Waller et al. 2016). Overall, the evidence so far suggested an association between genetic variations in OXTR and antisocial behavior in healthy samples.

Previous studies on clinical samples with antisocial behavior have also yielded significant associations with OXTR polymorphisms. In specific, the C allele of rs1042778 as well as the haplotypes CG of rs1042778 and rs6770632, and CT of rs1042778 and rs53576 were more prevalent in aggressive boys, whereas the A allele for rs6770632 was more prevalent in aggressive girls in 160 children and adolescents with disruptive disorders compared to 160 healthy adults (Malik et al. 2012). However, the findings did not survive multiple correction testing when compared to 182 healthy children (Malik et al. 2014). A recent study found increased conduct problems at age 15 in rs53576 G carriers in a sample of 404 adolescents with high levels of maternal depression (Smearman et al. 2015). In contrast, another study examined the effects of 10 single nucleotide polymorphisms in 1750 adolescents with substance and behavioral problems and found no significant effects of the 10 single nucleotide polymorphisms in relation to conduct disorder (Sakai et al. 2012). It is noteworthy that the aforementioned studies showed various OXTR polymorphisms in relation to antisocial behavior, but the results did not consistently support the central role of specific single nucleotide polymorphisms. These mixed findings suggest the contribution of small effects of several single nucleotide polymorphisms rather than the role of one specific single nucleotide polymorphism in antisocial behavior.

Additionally, the complexity of antisocial behavior should be taken into account in the interpretation of the findings. Although aggression and delinquency are central components of antisocial behavior, there are more specific subtypes, such as types of aggression and psychopathic traits. Particularly, two types of aggression are often distinguished, reactive and proactive aggression. Reactive aggression is an impulsive response to threat, provocation, or frustration and it is accompanied with anger, whereas proactive aggression is planned and driven by the achievement of a goal or a reward (Vitaro et al. 2006). These two types of aggression have distinct characteristics and are related to different social, cognitive, emotional, and physiological processes and outcomes (Hubbard et al. 2010).

More specifically, reactive aggression is associated with anger, peer rejection, internalizing problems, paranoid personality traits, bad quality of parent-child relationship, lower number of friends, and higher physiological arousal after provocation (Hubbard et al. 2010). In contrast, proactive aggression is not related to anger, internalizing problems, or bad quality of parent-child relationship but rather the lack of parental monitoring. It is characterized by a lack of physiological arousal in response to provocation (Hubbard et al. 2010) and it is linked to antisocial but not paranoid personality traits (Lobbelstael et al. 2015). In addition, distinct deficiencies in social information processing have been found in reactive and proactive aggression, indicating that reactive aggression is linked to impairments in encoding and interpretation of cues, whereas proactive aggression is linked to impairments in clarification of goals, response access, and response decision (Kempes et al. 2005). Most importantly, although both types are influenced by genetic and environmental factors, the stability of proactive aggression over time is more strongly explained by genetic factors than the stability of reactive aggression (Tuvblad and Baker 2011). In addition, proactive aggression is behaviorally and genetically linked to callous-unemotional traits and psychopathy (Bezdjian et al. 2011; Cima and Raine 2009), which are characterized by shallow emotion, lack of empathy, shame, or guilt and are related to more severe antisocial behavior and stronger biological underpinnings (Frick et al. 2014). Overall, distinct characteristics between reactive and proactive aggression have been revealed, underscoring the different processes associated with each type and suggesting a stronger biological background for proactive aggression compared to a more environmental background for reactive aggression.

Taken together, the findings, although promising, do not provide a clear picture of the genetic contribution of OXTR in antisocial behavior. First, the aforementioned studies showed various risk alleles in different types of antisocial behavior. Second, previous studies did not systematically include several types of antisocial behavior, raising the question of whether OXTR variations are linked to antisocial behavior as a construct or to specific types of antisocial behavior.

In a similar vein, the gene-environment interaction between OXTR and deviant peer affiliation has not been explored yet. Considering that OXTR is related to social affiliation and bonding, and that peer affiliation is a fundamental expression of social relationships in adolescence, it is crucial to explore whether OXTR interacts with deviant peer affiliation in the development of antisocial behavior. Deviant peer affiliation has been widely established as one of the strongest non-shared environmental predictors of antisocial behavior in adolescence (Dishion et al. 1995; Vitaro et al. 2015). However, it is also influenced by genetic factors, especially in adolescence (Connolly et al. 2015; Vitaro et al. 2015). In addition, there is increased support for gene-environment interactions in antisocial behavior. Gene-environment interaction studies explain their findings in terms of the diathesis stress model (Zuckerman 1999) or the differential susceptibility model (Belsky and Pluess 2009). According to the diathesis-stress model, adolescents with a genetic predisposition toward antisocial behavior are more likely to develop such a behavior when they affiliate with deviant peers (Zuckerman 1999). According to the differential susceptibility model, adolescents with a genetic vulnerability might exhibit more positive behaviors when interacting with a positive environment but more negative behaviors when interacting with a negative environment (Belsky and Pluess 2009). Several previous studies revealed gene-environment interactions in antisocial behavior for several genes, but the results were inconsistent (Vitaro et al. 2015).

It is argued that the investigation of a gene-environment interaction between OXTR and deviant peer affiliation is crucial due to OXTR’s involvement not only in antisocial behavior but also in social affiliation, which is under ongoing development during adolescence in form of peer relationships. In an effort to understand the role of oxytocin in social behavior, it has been suggested that oxytocin might modulate the salience of social stimuli in the environment and direct our attention toward them, leading to a better understanding of social cues and thus a more successful formation of social relations (Shamay-Tsoory and Abu-Akel 2016). Another approach posits that oxytocin might be related to self-referential processing and interoception that may contribute to the development of empathy and promote in-group survival (Hurlemann and Scheele 2016). Additionally, as mentioned above, oxytocin is involved in the development of the social brain (Vaidyanathan and Hammock 2016). Recent animal studies showed that oxytocin release is increased in the ventral tegmental area during social interactions, which in turn increases the activity of dopamine neurons that are involved in social reward, emphasizing the role of oxytocin in social behaviors (Hung et al. 2017). Therefore, oxytocin seems to have a contributing part in the development of social-affective behaviors and especially social relationships.

It is widely known that during adolescence peers exert a great influence on each other and adolescents tend to create in-groups with close friends and conform to the behavioral norms of the group (Steinberg and Morris 2001). Consequently, adolescents who affiliate with deviant peers tend to exhibit also deviant behaviors in order to conform to their friends’ behavior and maintain their peer group. Speculatively, a potential gene-environment interaction of OXTR and deviant peer affiliation might be driven by OXTR’s role in the development of the social brain, prosocial behavior, and social affiliation that can interact with the social bonds with peers leading to distinct patterns in antisocial behavior.

Current Study

The purpose of this longitudinal study was to investigate the association between OXTR polymorphisms and the developmental trajectories of antisocial behavior as well as the gene-environment interaction with perceived deviant peer affiliation in these trajectories in a sample of adolescents from 13 to 18 years. Specifically, the main effect of OXTR and the proposed gene-environment interaction were assessed in three main aspects of antisocial behavior: reactive aggression, proactive aggression, and delinquency. Importantly, this study has a longitudinal design following youth from early adolescence (age 13) to late adolescence (age 18). This design allows the examination of the development and stability of antisocial behavior across adolescence and can shed light on whether the proposed gene-environment interaction leads to distinct trajectories of antisocial behavior over the course of adolescence. Taken together, based on OXTR’s role on social and antisocial behaviors as well as previous findings supporting a main effect of OXTR and perceived deviant affiliation on antisocial behavior, it was hypothesized that OXTR would influence the developmental trajectories of antisocial behavior and that there would be an interaction between OXTR and perceived deviant peer affiliation. Importantly, it was explored whether OXTR interacted with perceived deviant peer affiliation on all aspects of antisocial behavior or it was specific to proactive aggression, reactive aggression, or delinquency.

Last but not least, due to previous inconsistent findings on the specific OXTR polymorphisms as well as recent directions underscoring the limitations of SNP-based tests, gene-based tests were performed to examine the direct and interaction effects. Gene-based tests increase the detectability of associations by aggregating small effects, reducing the number of tests and thus the need for multiple testing correction, and avoiding canceling signals with opposite etiological effects (Tzeng et al. 2011). That way, the amount of genetic variation and the power to detect associations are increased, especially in moderate sample sizes (Tzeng et al. 2011). They also allow the inclusion of covariates to control for the effect of known predictors of adolescent antisocial behavior, such as gender and socioeconomic status (Loeber and Farrington 2000; Murray and Farrington 2010). Therefore, this approach has several benefits compared to SNP-based tests that investigate small individual effects of many single nucleotide polymorphisms and required correction for multiple testing. The use of gene-based testing is common in genome-wide association studies and is recently expanding on the effects of specific genes in various phenotypes in smaller studies (LoParo et al. 2016; Tzeng et al. 2011; Zhao et al. 2015). It’s important to note though that gene-based tests are not direction tests and do not provide specific directionality of the proposed interactions as they aggregate the effects of several different single nucleotide polymorphisms, each of which has its own positive or negative loading (LoParo et al. 2016; Tzeng et al. 2011). Overall, this study explored the interaction between OXTR and perceived deviant peer affiliation on antisocial behavior over the course of adolescence using a longitudinal design and gene-based testing.

Method

Participants

The sample included in this study is a subsample of an ongoing longitudinal project, the Research on Adolescent Development And Relationships–young cohort study (RADAR-y). The project prospectively follows 497 Dutch families in order to investigate normal and abnormal adolescent development and the role of parents and peers with a specific focus on delinquency development. To achieve this goal, an increased number of adolescents at risk of externalizing problems were included (as identified by a T score ≥ 60 on the Teacher’s Report Form at age 11; Achenbach 1991). The project has been conducted in accordance with the Declaration of Helsinki and has been granted Medical Ethical approval from the University Medical Center Utrecht. All participants and their parents provided written informed consent and received a financial compensation for their participation. A more detailed description of the recruitment of participants in the Research on Adolescent Development And Relationships–young cohort study (RADAR-y) can been found elsewhere (e.g., Maciejewski et al. 2015).

In this study, adolescents who participated in the first six annual waves with measurements of aggression, delinquency, delinquent behavior of their friends (index of perceived deviant peer affiliation), DNA samples (at Wave 5), and of European ancestry (n = 332) were included. Eight participants were excluded due to DNA contamination or DNA criteria for exclusion (see details in Genotyping). The final sample comprised 323 adolescents (182 males) with a mean age of 13.00 (SD = .42) at the first wave and 18.00 (SD = .42) at the sixth wave. The majority of the participants came from a medium or high socio-economic background (93.7%; at least one of the parents’ jobs was classified as medium or high level) and approximately one third of the sample (35.6%) was at risk of externalizing problems. The attrition rate was 4.6% in this sample over the six waves.

Procedure

Prior to the beginning of the study, the participants and their parents received detailed written information about the project and provided written informed consent. Home visits took place annually and trained research assistants administered a battery of questionnaires to the adolescents. The research assistants provided verbal instructions in addition to the written instructions for each questionnaire. Other research assistants performed the data entry to ensure anonymity of the participants. DNA samples were collected at Wave 5 and participants had to visit the university lab to provide blood samples (see details in Genotyping).

Measures

Aggression

Reactive and proactive aggression were measured in each wave with a short version (23-item) of the Self-report of Aggression and Social Behavior Measure (Linder et al. 2002; Morales and Crick 1998). The items are rated on a 7-point Likert scale ranging from 1 (not at all true) to 7 (completely true). In this study only the total scores for proactive (8 items) and reactive (8 items) aggression were included to provide a more robust measurement of aggression and examine the specific hypotheses. Example items are “When someone makes me very angry, I push or punch that person” for reactive aggression and “I threaten to hurt others (hitting, kicking) to make them do what I want” for proactive aggression. A sum score of the items corresponding to each subscale for each wave was computed and higher scores indicated higher levels of proactive and reactive aggression. The distinct subscales of the measurement have shown good reliability and construct validity in previous studies (Ostrov and Houston 2008; Skripkauskaite et al. 2015). The Cronbach’s alpha of proactive aggression ranged from .84 to .90 and the Cronbach’s alpha of reactive aggression ranged from .84 to .88 across the six waves.

Delinquency

Delinquent behavior of the participants was assessed in each wave with the International Self-Report Delinquency scale (Junger-Tas et al. 1994). The scale includes 30 statements of delinquent behaviors, such as vandalism, theft, and selling stolen goods rated on a 5-point Likert scale (0 = never, 4 = more than 10 times). A variety score was used, indicating how many different delinquent acts were committed by the participants instead of a frequency score, because the former is a more accurate indicator of severity of delinquency due to the disproportion of minor and serious offenses and their weight in frequency scores (Bendixen et al. 2003). The variety score was computed by recoding all 30 items into dichotomous (0/1) variables (i.e., never/at least once) and summing them for each wave. This type of measure has been frequently used with established psychometric properties (Junger-Tas and Marshall 1999). The Cronbach’s alpha ranged from .76 to .89 across the six waves.

Deviant peer affiliation

Perceived peer delinquency (as an index of perceived deviant peer affiliation) was assessed annually with a 6-item scale in which the participants indicated how many of their friends committed various delinquent acts in the past three months, such as vandalism, theft under 5 euro, theft over 5 euro, assault, burglary, or robbery (Weerman and Smeenk 2005). The items are rated on a 3-point Likert scale from 1 (no one) to 3 (most/all of them). A sum score of all the items for each subscale was calculated and higher scores indicated higher levels of perceived peer delinquency. This scale has satisfactory one-dimensional factor structure and good reliability and construct validity in previous studies (Keijsers et al. 2012; Weerman and Smeenk 2005) and the Cronbach’s alpha in this study ranged from .64 to .86 across the six waves. A mean score across the six waves was calculated to provide a robust measure of perceived peer delinquency and achieve convergence of the models.

Genotyping

The genotyping was performed with the Affymetrix 6.0 array (McCarroll et al. 2008) using DNA from the whole blood. The genotype calling was performed with the Birdseed 2 algorithm (Korn et al. 2008; McCarroll et al. 2008), with the Affymetrix 3.3 APT software on all samples simultaneously. Samples were removed in case the Affymetrix CQC was lower than 0.40, the genotyping calling rate was lower than 0.90, the heterozygosity F value was different from zero, or in case the DNA gender of the sample did not match the phenotype gender. Additionally, samples were removed if the 10 genetic principal components indicated a CEU ethnic outlier after projection of the study samples on the 1000 genomes reference sample. Fifty-three participants were identified as ethnic outliers and excluded from the analyses. Single nucleotide polymorphisms were filtered using Plink 1.07 (Purcell et al. 2007) based on the following criteria: No or incorrect mapping on Build 37 HG19 of the human genome, inconsistent calls in plate control samples with an error rate >1%, <0.95 genotyping rate, MAF < 0.01, HWE p < 0.000001. After this QC, all single nucleotide polymorphisms were strand aligned to the 1000 genomes Phase 1 June 2014 reference. The genotype data were subsequently phased with SHAPEIT V2.970 (Delaneau et al. 2013) and imputed to the 1000 genomes reference with IMPUTE 2.3.1 following standard protocols (van Leeuwen et al. 2015). Single nucleotide polymorphisms with imputation quality R2 higher than 0.8 were used.

The oxytocin receptor gene (OXTR) is a 389-amino acid polypeptide with seven transmembrane domains and belongs to the class I G protein-coupled receptor family. The gene coding for OXTR is located on chromosome 3 (3p25), and has 3 introns and 4 exons (Gimpl and Fahrenholz 2001). It is 17kbp long and has 111 common single nucleotide polymorphisms. In this study, the following single nucleotide polymorphisms were included: rs1042778, rs2254298, rs53576, rs4686302, rs237915. These single nucleotide polymorphisms were selected due to their association with social behaviors and their relation to antisocial behavior in the previous studies described above. They are also all involved in the transcriptional regulation of OXTR and thus play a role in the expression of the gene (Lee and Shatkay 2008). The rs2254298, rs53576, and rs237915 are located on introns, the rs1042778 is located on the 3’ prime untranslated region, and the rs4686302 is nonsynonymous. The linkage disequilibrium (LD) and the Hardy-Weinberg (HW) equilibrium were assessed with Haploview (Barrett et al. 2005). There was high linkage disequilibrium between some single nucleotide polymorphisms (rs1042778 and rs2254298: D’ = .84; rs53576 and rs4686302: D’ = .82; rs4686302 and rs237915: D’ = 1). The gene-based tests performed in this study take into account the high linkage disequilibrium of the single nucleotide polymorphisms. All single nucleotide polymorphisms were in Hardy-Weinberg equilibrium (all ps > .05) (see Table 1).

Table 1 Markers of the five single-nucleotide polymorphism (SNPs) included in the study

Analytic Strategy

Two steps were followed to examine the main effects and the gene-environment interaction. First, latent growth curve models were fitted to estimate the developmental trajectories of reactive aggression, proactive aggression, and delinquency across the six annual waves using Mplus version 7.0 (Muthén and Muthén 1998-2015). The growth curves are estimated by the intercept (i.e., the initial level of antisocial behavior at wave 1) and the linear, quadratic, or cubic slopes (i.e., the change in antisocial behavior over time across the six waves). Maximum likelihood estimation with robust standard errors was selected to handle non-normality and missing data. To estimate the fit of the models, the following fit indices were used: the root mean square error of approximation (RMSEA), the standardized root mean square residual (SRMR), the comparative fit index (CFI), and the Tucker-Lewis fit index (TLI). Values below .10 for the root mean square error of approximation and the standardized root mean square residual, and above .90 for the comparative fit index and Tucker-Lewis fit index are indicative of an acceptable fit (Browne et al. 1993; MacCallum et al. 1996). However, more strict cut-off values of <.06 for the root mean square error of approximation, <.08 for the standardized root mean square residual, and >.95 for the comparative fit index and Tucker-Lewis fit index have also been proposed for a good fit (Hu and Bentler 1999).

The trajectory of delinquency was evaluated with a two-part model due to a preponderance of zeros and the highly skewed distribution of delinquency scores. This model breaks down a variable into two parts, a dichotomous part that expresses the probability of an observed behavior (delinquency) occurring at each time point and a continuous part that expresses the amount of the observed behavior among participants who reported the occurrence of the observed behavior (variety of delinquent acts) using log-transformed values. In the continuous part, the participants who did not report committing a delinquent act were treated as missing, under the assumption that data are missing at random (MAR) (Muthén and Muthén 1998-2015). The first part of the model is estimated with a logistic growth function and the second part with a linear growth function. In order to identify the best fitting models, the growth curves of the probability and amount of delinquent acts were evaluated in two separate unconditional models. The model fit of the probability of committing a delinquent act (part 1) was assessed comparing a model including a linear and a quadratic growth factor. The addition of the quadratic slope improved the model fit (Δχ2 = 23.131, p < .005). Considering that χ2 tests are affected by large sample sizes and that the mean and variance of the quadratic slope were not significant, the quadratic slope was fixed in the combined two-part model. The model fit of the variety of delinquent acts (part 2) was assessed with a linear and a quadratic growth factor. The addition of the quadratic slope significantly improved the model fit. Thus, the combined unconditional two-part latent growth model included linear and quadratic growth factors for part 1 and part 2. Due to the insignificant variance of the quadratic slope of part 2, this slope was also constrained to zero to achieve convergence of the model. The continuous part of this model was used in the genetic analyses, because a dichotomous variable is not an indicator of variety of delinquent behavior. In contrast, the continuous variable of delinquency represents the number of different delinquent acts.

Second, the main genetic effect of OXTR and the gene-environment interaction of OXTR with perceived deviant peer affiliation were examined on the intercepts and slopes of reactive aggression, proactive aggression, and delinquency. Gender was added as a control variable due to its potential influence on the genetic effects based on the mixed findings of previous research in OXTR, as well as socioeconomic status (SES) and risk status (T score ≥60 on the Teacher’s Report Form at age 11), which are known predictors of aggression and delinquency (Loeber and Farrington 2000; Murray and Farrington 2010). Gene-based tests that evaluate the joint association of multiple loci in the gene were performed; in this case the combined effect of the five included single nucleotide polymorphisms. The main genetic effect as well as the gene-environment interaction were tested with similarity regressions that evaluated the association between similarities in reactive aggression, proactive aggression, delinquency for pairs of unrelated individuals with their genetic similarities in OXTR (Tzeng et al. 2011). The genetic similarity is calculated by the average of the weighted allele matching score between two subjects across the markers (in this case, the 5 included single nucleotide polymorphisms). This method combines marker information through a sum of genotype similarity across markers rather than a sum of genotypes, which avoids canceling opposite effects. The tests were conducted in R using the SIMreg package 1.31 (Tzeng et al. 2011). Given the number of tests performed to include both the initial level and the change over time of the three dependent variables, correction for multiple testing with the False Discovery Rate (FDR) correction at .05 level was applied (Benjamini and Hochberg 1995).

Results

Descriptive Statistics

Table 2 presents the means, standard deviations, and range for reactive aggression, proactive aggression, delinquency, and perceived deviant peer affiliation for each annual wave in the total sample. The percentages of participants’ engagement in at least one delinquent act across the six waves are as follows: Wave 1: 60.4%, Wave 2: 44.6%, Wave 3: 47.1%, Wave 4: 45.2%, Wave 5: 40.6%, and Wave 6: 30.3%. A mean score of perceived deviant peer affiliation across the six waves was computed and used for the gene-environment interactions (M = 6.895, SD = 1.092). Table 3 depicts the correlations among the study variables. All the variables were significantly correlated with each other across the six waves.

Table 2 Means and standard deviations of reactive aggression, proactive aggression, delinquency, and peer delinquency
Table 3 Correlations among reactive aggression, proactive aggression, delinquency across the six annual waves and mean peer delinquency

Developmental Trajectories of Antisocial Behavior

Tables 4 and 5 present the model fit indices, the means, and the variances for all the latent growth models. The model fit indices showed that quadratic curves were fitted best to the trajectories of reactive and proactive aggression. The model for reactive aggression yielded a significant negative mean of the linear slope, suggesting an overall decrease of reactive aggression from early to late adolescence. The model for proactive aggression showed that the linear and quadratic slopes were not significant, suggesting a fairly stable trajectory of proactive aggression across adolescence. The variances of the intercept, the linear slope, and the quadratic slope were all significant, revealing the presence of individual differences in the initial level and the growth patterns of reactive and proactive aggression in adolescence. From the two-part model of delinquency, the continuous part for the analyses was used. The slopes of the amount of delinquency were not significant, indicative of a stable pattern of delinquency among adolescents who engaged in delinquent behavior. The variances of the intercept and the slope were significant, suggesting that the initial amount of delinquency and the change over time varied among the participants.

Table 4 Model fit indices for latent growth curve models for proactive aggression, reactive aggression, and delinquency
Table 5 Results of the unconditional latent growth curve models for proactive aggression, reactive aggression, and delinquency

Finally, perceived deviant peer affiliation was added to the models to examine its main effect on antisocial behavior controlling for gender, risk status, and SES. Perceived deviant peer affiliation was a significant and positive predictor of the initial level of reactive aggression, proactive aggression, and delinquency (reactive aggression: 2.323, p < .001; proactive aggression: 0.953, p = .004; delinquency: 0.222, p < .001). The effect of perceived deviant peer affiliation on the slopes was not significant for reactive aggression and proactive aggression, but it was significant for the linear slope of delinquency (linear slope = 0.114, p = .018; quadratic slope = −0.017, p = .061). This indicated that perceived deviant peer affiliation was associated with the change of delinquency over the course of adolescence.

Main Genetic Effects and Gene x Environment Interaction

Six gene-based tests were performed to examine the main genetic effect and the interaction effects of OXTR and perceived deviant peer affiliation in the intercepts and quadratic slopes of reactive aggression, proactive aggression, and delinquency. There was no main genetic effect of OXTR on any of the intercepts or slopes of antisocial behavior (see Table 6). However, there were significant gene-environment interactions in the intercepts, but not the slopes, of reactive aggression, proactive aggression, and delinquency. The gene-environment interaction remained significant for proactive aggression (corrected p = 0.047) and delinquency (corrected p = 0.005), but marginal for reactive aggression (corrected p = 0.065) after correction for multiple testing. The findings indicated that OXTR interacted with perceived deviant peer affiliation on the level of proactive aggression and delinquency, but not on the pattern of change over time. To clarify that this effect was indeed a gene-environment interaction effect and not a masked gene-environment correlation, a test for gene-environment correlation between OXTR and perceived deviant peer affiliation was conducted controlling for gender, risk status, and SES. The results showed that OXTR was not significantly correlated with perceived deviant peer affiliation (T.G. = 81.679, p = .194).

Table 6 Results of the gene-based tests for proactive aggression, reactive aggression, and delinquency

The sample size, attrition rates, reasons for exclusion, and computation of measured variables were reported in the Method section and used as such in the reported analyses and results without any other manipulations.

Discussion

Gene-environment interactions in antisocial behavior have gained interest and revealed that several genes interact with environmental factors, such as perceived deviant peer affiliation, in the development of antisocial behavior. However, there is one gene that although it has been associated with both prosocial and antisocial behaviors (Bakermans-Kranenburg and Van IJzendoorn 2013; Ebstein et al. 2012; Lee et al. 2009), it has not been investigated in gene-environment interaction studies yet; the OXTR gene. OXTR is involved in the development of the social brain (Vaidyanathan and Hammock 2016) and it might affect the formation of social relationships in adolescence, especially peer relations. Given its complex involvement not only in prosocial and antisocial behavior, but also in social affiliation, it seems essential to investigate its interaction with deviant peer affiliation and not only its direct effect on antisocial behavior. The present study aimed to examine whether OXTR interacts with perceived deviant peer affiliation in antisocial behavior in adolescents aged from 13 to 18, using a longitudinal design and gene-based testing. Importantly, three components of antisocial behavior were examined, reactive aggression, proactive aggression, and delinquency to capture the complexity of antisocial behavior. The findings revealed no main direct effect of OXTR in antisocial behavior, but a significant gene-environment interaction between OXTR polymorphisms and perceived deviant peer affiliation in proactive aggression and delinquency.

More specifically, there was no main genetic effect of OXTR polymorphisms on antisocial behavior, but there was a main effect of perceived deviant peer affiliation on all dependent variables. The role of perceived deviant peer affiliation in antisocial behavior has been well established in previous research (Dishion et al. 1995; Vitaro et al. 2015), but the findings on main effects of OXTR are inconsistent. Previous research examined various single nucleotide polymorphisms of the OXTR in relation to antisocial behavior using SNP-based tests and although some studies found significant effects of a limited number of single nucleotide polymorphisms (Hovey et al. 2015; LoParo et al. 2016; Malik et al. 2012; Smearman et al. 2015), others did not find effects that survived correction for multiple testing (Malik et al. 2014; Sakai et al. 2012). In this study, gene-based tests were used to overcome the limitations of SNP-based tests, as they include a number of single nucleotide polymorphisms in one test, increasing the detectability of associations by aggregating small effects and reducing the number of tests (Tzeng et al. 2011). The findings suggest that OXTR does not have a direct effect on any aspect of antisocial behavior but it rather interacts with perceived deviant peer affiliation. However, it is important to highlight that only five single nucleotide polymorphisms were included that did not provide coverage of the entire OXTR gene. Speculatively, the addition of more single nucleotide polymorphisms in future gene-based tests might reveal a potential small direct effect of OXTR. In addition, the sample size was small and did not have the power to detect small direct effects. Considering the role of OXTR in social behavior and affiliation, the gene-environment interaction of OXTR with perceived deviant peer affiliation can provide more useful information on how the undeniable role of peers in adolescent antisocial behavior might also be related to the genetic makeup.

This interaction suggests that the effect of perceived deviant peer affiliation on antisocial behavior might be influenced by OXTR variations. Given that gene-based tests are not direction tests, it is not possible to reveal specific risk alleles, as each single nucleotide polymorphism has its own positive or negative loading (see also LoParo et al. 2016 for a similar methodology). Considering the role of oxytocin in a broad spectrum of social behaviors, such as social affiliation, pair bonding, and trust (MacDonald and MacDonald 2010) as well as OXTR’s role in the development of the social brain (Vaidyanathan and Hammock 2016), it is possible that variations in OXTR have a differential effect on the regulation of oxytocin that consequently leads to different interaction effects with peers.

For instance, adolescents with specific OXTR variations might be more prone to behave similarly to their peers in an effort to seek acceptance and bonding and thus exhibit the same behavior as their peers (positive or negative), supporting the differential susceptibility model. There is evidence indicating that oxytocin administration can enhance trust toward individuals who are seen as trustworthy or belong to the “in-group”, but can have the opposite effect for the “out-group” or toward individuals who are seen as untrustworthy (Bartz et al. 2010, 2011; Van IJzendoorn and Bakermans-Kranenburg 2012). In addition, it has been suggested that oxytocin might be related to self-referential processing and interoception that may promote in-group survival (Hurlemann and Scheele 2016). This raises the question whether OXTR function might play a role in how adolescents perceive and affiliate with their peers compared to the “rest of the world”. They might trust their in-group of peers and exhibit matching behaviors. They potentially perceive as untrustworthy those who are considered to be outside of their in-group circle and simultaneously exhibit aggressive behavior toward them. This potential explanation, however, is based on previous studies on oxytocin administration and not on genetic variations of OXTR. A further and closer investigation of this gene-environment interaction could shed additional light on how OXTR affects the formation of peer relationships, in-group and out-group trust, as well as the paths toward antisocial behavior.

In addition, this gene-environment interaction might be driven by the link between oxytocin and prosocial behavior. Transient OXTR expression during neocortical development might increase neural activity in response to multisensory inputs and shape the processing of social inputs (Vaidyanathan and Hammock 2016). A specific brain activation network has been identified in empathy, consisting of the anterior midcingulate cortex (aMCC), the dorsal anterior cingulate cortex (dACC), the dorsal-caudal edge extending to supplementary motor area (SMA), and bilateral anterior insula (Fan et al. 2011). Moreover, it has been suggested that the development of empathy emerges very early in life and can be detected in neurophysiological patterns in infancy (Tousignant et al. 2017), a period with increased OXTR expression in the neocortex. Previous genetic studies have also shown that OXTR variations are associated with empathy (Rodrigues et al. 2009; Uzefovsky et al. 2015) and oxytocin administration enhances empathy and emotion recognition especially in individuals with social-affective deficits (Bartz et al. 2011).

It is hence possible that OXTR variations might be related to impairments in empathy and prosocial behavior that could relate to the development of antisocial behavior. Speculatively, this effect might interact with the social environment and lead to the development of antisocial behavior only when adolescents affiliate with deviant peers, supporting the diathesis-stress model. Alternatively, the differential susceptibility model might also be in place. Positive peer affiliation might be beneficial for the development of empathy and prosocial behavior, especially in youth with social deficits, whereas deviant peer affiliation might reinforce these deficits and lead to antisocial behavior. Overall, there are several interesting approaches to interpret this gene-environment interaction, but they merit further exploration to draw solid conclusions. It would be especially beneficial to examine this gene-environment interaction not only in relation to perceived deviant peer affiliation but also in relation to positive and supportive peer groups to decipher whether this interaction supports the diathesis-stress model or the differential susceptibility model.

It is important to mention that the results remained significant for proactive aggression but not for reactive aggression after correction for multiple testing. These two types of aggression have distinct characteristics and are related to different processes and outcomes (Hubbard et al. 2010). A recent study found a gene-environment interaction between Monoamine Oxidase A (MAOA) and Catechol-O-Methyltransferase (COMT) genes and parenting on reactive aggression but not on proactive aggression, highlighting the differential genetic contribution of these two types of aggression (Zhang et al. 2016). In the present study, OXTR interacted with deviant peers on proactive aggression but not on reactive aggression, suggesting that this interaction might be specific to proactive aggression. However, the corrected alpha level was .06 for reactive aggression, which advise us to interpret this finding with caution. It is possible that this result would remain significant in a larger study and hence it seems imperative to replicate it in larger studies before drawing solid conclusions.

Moreover, the gene-environment interaction did not predict how antisocial behavior changed over time. Previous research yielded different trajectories of antisocial behavior over the course of adolescence that usually included multiple classes (Reef et al. 2011; Van Lier et al. 2007). The present sample size was not large enough for a latent class analysis and it is possible that the gene-environment interaction might be significant for specific classes but not for the total sample. Using the overall change over time, it is not possible to detect a specific effect of the interaction in a particular class. Larger studies are highly needed to unravel whether this gene-environment interaction affects a specific class of antisocial behavior. Importantly, the gene-environment interaction on the intercept indicates that OXTR variations interact with perceived deviant peer affiliation in early adolescence (age 13). It has been posited that childhood-onset antisocial behavior is more severe, has more adverse outcomes, and is more biologically driven compared to adolescent-onset antisocial behavior (Moffitt et al. 1996). In line with this theory, it is possible that genetic contributions and interactions with perceived deviant peer affiliation are more relevant in antisocial behavior at an early age and might be indicative of more severe antisocial behavior.

In addition, a study suggested that the effect of deviant peer affiliation, although substantial, it might have been overestimated in previous studies and the effects of social control processes might have been underestimated (Haynie and Osgood 2005). The authors found that the effects of peer delinquency and unstructured socializing on delinquency were comparable. Taking into account the development of self-regulation and inhibitory control from childhood to adolescence (Steinberg 2008), the role of psychosocial immaturity in persistent antisocial behavior (Monahan et al. 2013) as well as the genetic contribution to inhibitory control (Weafer et al. 2017), it is reasonable to assume that younger adolescents might be more prone to gene-environment interactions with peers compared to older adolescents especially in unstructured settings. It would be interesting for future research to explore this gene-environment interaction in younger children and also incorporate other social control contexts to better understand the developmental process of this interaction.

Finally, the developmental trajectories of antisocial behavior showed that reactive aggression decreased over time, whereas proactive aggression and delinquency remained stable. Previous research has identified multiple classes in aggression and delinquency, suggesting the presence of stable low or moderate levels, increasing levels, or stable high levels of antisocial behavior in adolescence (Landsheer and van Dijkum 2005; Reef et al. 2011). Specifically, for reactive and proactive aggression, a study found that in proactive aggression, the majority of adolescents exhibited a low stable trajectory, followed by adolescents with moderate stable and high peaking proactive aggression (Barker et al. 2010). In reactive aggression, the majority of adolescents exhibited a moderate desisting pattern, followed by low stable and high peaking patterns. In addition, proactive aggression is related to and predictive of delinquency in adolescence and they seem to follow similar trajectories (Hubbard et al. 2010).

It has been suggested that reactive aggression, but not proactive aggression is highly associated with peer rejection and victimization (Hubbard et al. 2010). As adolescents grow older, they develop more efficient coping strategies and peer victimization and physical fighting decrease as they learn to use these coping strategies in conflict resolution (Compas et al. 2017; Rudatsikira et al. 2008; Zimmer-Gembeck and Skinner 2016). It is thus possible that the decrease of reactive aggression might be explained by the development of coping strategies in late adolescence that have been related to lower levels of psychopathology (Compas et al. 2017). In contrast, proactive aggression, especially at a young age, is related to callous-unemotional traits and psychopathy in adulthood, more adverse outcomes in the long run, and higher levels of antisocial behavior and delinquency (Frick et al. 2014). Importantly, the stability of proactive aggression over time is more strongly explained by genetic factors than the stability of reactive aggression (Tuvblad and Baker 2011). Overall, the findings are in line with previous studies on developmental trajectories of antisocial behavior, although specific classes were not examined as they were out of the scope of this study.

Several limitations of this study should also be mentioned to better understand the generalizability of the findings and suggest useful directions for future research. First, a community sample of adolescents who were at risk of externalizing problems were recruited but they were not clinical patients and the sample size was small. Genetic studies using larger samples and clinical populations are necessary to confirm the present findings and examine whether this interaction is different in clinical populations. Second, this study did not have the power to examine gender differences that have been found in previous research with SNP-based tests. Speculatively, this gene-environment interaction may be more pronounced in males given the stronger evidence of a direct effect of OXTR in antisocial behavior as well as the higher rates of antisocial behavior and deviant peer affiliation in boys and male adults. Relatedly, the sample lacked the power to examine classes of trajectories that might be specifically related to the gene-environment interaction under investigation. Third, although gene-based tests that are advantageous compared to SNP-based tests were used, a small number of single nucleotide polymorphisms was included in this study. The inclusion of five single nucleotide polymorphisms was based on their associations with social and antisocial behavior in previous research as well as their role in the expression of the gene as a meaningful and economical first step toward exploring this gene-environment interaction. The inclusion of a large number of single nucleotide polymorphisms in future gene-based tests is highly recommended, as it would provide a more robust measurement of the OXTR gene. Fourth, this study recruited a sample of adolescents aged 13 to 18, but it would be very elucidating for future studies to explore different developmental trajectories from an earlier age. Fifth, an indirect measurement of deviant peer affiliation was used in this study, which is not the optimal methodology. It has been proposed that indirect measurements of peer delinquency suffer from several shortcomings (Young et al. 2015), which should be taken into account when interpreting the findings of this study. The measurement used in this study has been examined in comparison to direct measures of peer delinquency and the authors concluded that indirect measures were reliable but might underreport peer delinquency, potentially because responders might not be aware of all the delinquent acts committed by their friends (Weerman and Smeenk 2005). Sixth, this study was focused on perceived deviant peer affiliation, but this is only one aspect of peer affiliation. Future studies should also investigate potential gene-environment interactions with perceived peer support and more positive peer groups. Last but not least, given the role of OXTR in social and prosocial behavior, it is essential for future research to examine more potential gene-environment interactions of OXTR with other socially relevant environmental factors that could be involved in antisocial behavior, such as family relations or parental style.

Conclusion

The aim of this study was to contribute to the genetic research of antisocial behavior by examining the gene-environment interaction of OXTR and perceived deviant peer affiliation in antisocial behavior. OXTR has been associated with both social affiliation and antisocial behavior but its interaction with deviant peer affiliation, which is a strong predictor of antisocial behavior in youth and a fundamental expression of social relationships, has been overlooked so far. This longitudinal study provided evidence of a gene-environment interaction of OXTR and perceived deviant peer affiliation on antisocial behavior using gene-based tests, but found no main genetic effect of OXTR polymorphisms. The findings underscore that genetic variation in the OXTR might affect the influence of deviant peer affiliation on antisocial behavior, contributing to a better understanding of individual differences in antisocial behavior during adolescence. Taken together, this study suggests that addressing potential gene-environment interactions of OXTR and perceived deviant peer affiliation as well as other socially relevant environmental factors in antisocial behavior in larger clinical studies might be a promising direction to disentangle its neurobiology.