Anxiety disorders are the earliest form of psychopathology to emerge in childhood, the most prevalent and frequently diagnosed disorders in youth (Beesdo et al. 2009), and associated with adverse health outcomes (Brent et al. 1986; Essau 2003; Kessler et al. 1996; Pine et al. 1998; Weissman et al. 1999; Woodward and Fergusson 2001). Beyond the numbers for clinical diagnoses, sub-clinical levels of anxiety symptoms are estimated at 40% in children (Muris et al. 2000a), which increase the risk for full-blown anxiety disorders at older ages. Currently, programs based on Cognitive Behavioural Therapy (CBT) have been shown to be most effective (Butler et al. 2006; Fisak Jr et al. 2011; In-Albon and Schneider 2007; Kendall 2011; Mychailszyn et al. 2012). However, CBT outcomes are mixed and effect sizes are small to moderate (Fisak Jr et al. 2011; Mychailszyn et al. 2012).

These disappointing outcomes of CBT-based indicated prevention programs might be related to limitations regarding the way in which interventions are delivered, rather than the therapeutic principles on which they are based (Granic et al. 2014; Kazdin 2011). These limitations include a didactic-based approach that might not be engaging and motivating for some children (Gosch et al. 2006), few opportunities to practice newly-acquired knowledge, non-adherence of practitioners to the protocol (Eichstedt et al. 2014), and low accessibility and high costs of interventions (Collins et al. 2004; Farmer et al. 1999; Kataoka et al. 2002).

The aforementioned limitations can be addressed by using game-based interventions (see Granic et al. 2014 for full discussion; Rideout et al. 2010; Olson 2010). On this basis, the video game MindLight (GainPlay Studio 2014) was developed in order to prevent the escalation of anxiety in at-risk children. The game incorporates evidence-based techniques by translating these techniques into game mechanics. Game mechanics are the actions in the game that are designed for the player to repeat over and over; they are the vehicles by which certain skills are trained (see Table 1). Results from an indicated randomized controlled trial (RCT; Schoneveld et al. 2016) showed that after playing 5 sessions of MindLight, at-risk children showed significant reductions in anxiety symptoms by 3-months follow-up. In addition, a second indicated RCT showed that playing MindLight for 6 sessions is as effective as a CBT-based indicated prevention program (i.e., Coping Cat; van Starrenburg et al. 2017) in reducing anxiety symptoms from pre- to post-measurement, including the 3- and 6-months follow-up (Schoneveld et al. 2018).Footnote 1 Finally, results from a third study showed that compared to online CBT-based psychoeducation, playing MindLight resulted in similar improvements in anxiety symptoms and state anxiety in response to a (social and cognitive) stressor (Tsui et al. 2018, manuscript submitted for publication).

Table 1 Overview of the evidence-based principles that are translated into game mechanics in MindLight and the specific in-game play behaviours that are indicative of these mechanics

These results are promising, but it remains unclear whether the means by which children improve in anxiety symptoms are through the game mechanics that were explicitly designed into MindLight. Investigating such in-game processes is extremely valuable, not only because it gives insight into who will benefit most from the game, but also into which game mechanics are most important for anxiety symptom-reduction more generally (and those that are in need of further development). By testing the effect of the game mechanics in MindLight, the current study provides a first step towards building a toolbox of validated game mechanics. In turn, those validated game mechanics that are able to change causal processes associated with the development and maintenance of anxiety could be used in new applied games targeting anxiety symptoms or other psychopathologies with the same underlying deficits.

MindLight

MindLight is a video game for children 8 to 12 years of age, designed and developed in a cross-disciplinary collaboration among developmental psychologists, clinicians, game designers, and children themselves. In the game, the player is in grandma’s dark and decrepit mansion and needs to save her from evil forces by chasing away or uncovering “fear events” and solving puzzles. The player plays through the game by using his/her “mindlight”, a beam of light at the end of an antenna attached to the magical hat the avatar is wearing. The player needs this light in order to move through the dark game environment.

MindLight incorporates three evidence-based techniques based on cognitive-behavioural principles: relaxation through neurofeedback training (Price and Budzynski 2009), exposure training (Feske and Chambless 1995), and attention bias modification (Bar-Haim 2010; Bar-Haim et al. 2011). These techniques have been repeatedly shown to address causal processes associated with the development and maintenance of anxiety such as avoidance and negative attention bias (Mathews and MacLeod 2005; Weersing et al. 2012). In MindLight, the three techniques are translated into specific game mechanics: neurofeedback, approaching fear events, and attention bias modification puzzles (see Table 1), together aiming at teaching children how to cope with anxiety in a playful manner. Below we explain these techniques and game mechanics in more detail. More information can also be found in Appendix 1.

The first technique incorporated in MindLight is relaxation training through the use of neurofeedback. In conventional neurofeedback training individuals are presented with real-time electroencephalogram (EEG) recordings from their brain and guided through relaxation exercises in order to keep their EEG waves consistent with identified proxies of relaxation (i.e., reduction in relative beta power and increase in relative alpha power; Price and Budzynski 2009). In MindLight, the player wears an EEG headset with one (dry) sensor touching the forehead and one reference point located in the clip attached to the left earlobe. The headset detects EEG signals and converts them into a continuous data stream representing relaxation (Johnstone et al. 2012). This data stream is fed into the game and controls the amount of light that shines in the game. The brightness of players’ mindlight is proportional to the strength of the real-time relaxation of the player. When the player becomes more relaxed the mindlight becomes brighter, providing more light in the game environment. This way, players get feedback on their level of relaxation. Thus, relaxation is trained through the neurofeedback game mechanic in MindLight (see Table 1).

The second technique incorporated in MindLight is exposure training. There are fear events (i.e., fearful obstacles) in the game and by shining one’s mindlight on them they can be chased away or uncovered. Some fear events will then turn into a friendly kitten that follows the player and that reminds the player of past fears conquered. Other fear events turn into a benign object or animal and reward the player with a coin that is needed to unlock puzzles (see below). To play through the game, the fear events need to be approached. However, a player can also escape them (temporally) by hiding inside one of the chests or by turning on a ceiling light (both instances of safety behaviours). Thus, exposure training is done through the fear events in the game (see Table 1).

The third technique incorporated in MindLight is attention bias modification (ABM). Attentional biases characterized by a hyper attention towards potential threats play an important role in the development and maintenance of anxiety disorders (Muris 2016; Muris and Field 2008). With ABM-training, the attentional bias towards threats is retrained such that individuals pay more attention to positive stimuli rather than to negative stimuli (Bar-Haim 2010; Bar-Haim et al. 2011). Conventional ABM-procedures have used a modified version of the dot-probe task or a visual search task and have been shown to reduce anxiety (at least in the short term; Bar-Haim 2010; Bar-Haim et al. 2011; Hakamata et al. 2010). In MindLight, gaming elements have been added to the main principles of the dot-probe training. In the ABM puzzles, the player learns to focus on and attend to portraits of happy faces rather than threatening faces. Upon completion of the puzzle, the lights will turn back on in that particular room. Thus, ABM-training is done through the ABM-puzzles in MindLight (see Table 1).

In-Game Play Behaviours

Although the game was designed to provide children with repeated training opportunities to learn emotion-regulation strategies, there is also variability in how much children actually practice these skills. This variability is largely a function of the design of the game, which allows children to play at their own pace and explore and progress through the game in a variety of ways that foster a sense of autonomy and fun. For example, some children may be too afraid to move through the game at first, and will hide in chests to avoid the fearful stimuli, while others might prefer to explore a great deal more from the outset. These play-pattern differences may lead to differences in the amount of opportunities to practice the relaxation skills or to encounter fear events further in the game.

There are several specific in-game play behaviours that are most relevant to the intervention goals of MindLight (see Table 1). These behaviours can be classified into two types: “engaged” and “avoidant/safety” in-game play behaviours. Clinical research has shown that avoidant and/or safety behaviours are important maintenance processes for anxiety symptoms (Clark 1999; McManus et al. 2008; Salkovskis et al. 1999; Salkovskis et al. 1996), and that reducing avoidant and/or safety behaviours and increasing engagement with the treatment are predictive of better treatment outcomes (e.g., Glenn et al. 2013; Morgan and Raffle 1999; Salkovskis et al. 1999).

While playing MindLight, children can show in-game play behaviours that indicate engagement versus avoidant/safety behaviour. To be successful at MindLight, children need to show engaged in-game play behaviours, which will lead to a higher “dosage”, or more practice, with the game mechanics. Avoidant/safety in-game play behaviours limit that “dosage”. Differences in the dosage may result in anxiety symptom-reduction for some children and no anxiety symptom-reduction for other children based on how they played the game.

Table 1 presents an overview of the in-game play behaviours categorized as “engaged” versus “avoidant/safety” and how these behaviours relate to the game mechanics and cognitive-behavioural principles that are incorporated in MindLight. In the “engaged” category, all behaviours represent experiences that support players’ practice of relaxation, exposure, and modifying attention biases. For example, by exploring children are more exposed to fear events, which they can chase away or decloak and from which they can learn how to regulate their anxiety in the face of perceived threat. By solving puzzles they learn to focus more on the positive faces than on the negative ones. The “avoidant/safety” category represents behaviours that interfere with the intervention goals in MindLight. For example, hiding inside a chest or being inactive reduces exposure to fear events in the game. Turning on ceiling lights minimizes relaxation training, because under the ceiling light monsters are less likely to show up and the child needs to rely less on his or her own mindlight to brighten the environment.

Design and Hypotheses

In the current study, participants were children with elevated levels of anxiety that participated in a RCT to test the effect of 6 play-sessions of MindLight compared to CBT (Schoneveld et al. 2018). Only children from the MindLight group were included in the current study. Engaged and avoidant/safety in-game play behaviours were coded for the first and last play-sessions to examine 1) how pretest anxiety scores were related to in-game play behaviours during the first play-session, and 2) whether changes in in-game play behaviours from the first to the last play-session predicted changes in anxiety symptoms at the 3-months follow-up assessment. We hypothesized that a) higher pretest anxiety scores would be related to less engaged, and more avoidant/safety, in-game play behaviours during the first play-session, and b) increases in engaged behaviours and decreases in avoidant/safety behaviours from the first to the last play-session would predict reductions in anxiety symptoms at the 3-months follow-up assessment.

Method

Participants

Forty-three children (20 boys, 23 girls) with elevated levels of anxiety participated in the current study. Participants’ age ranged from 8.17 to 12.65 years (M = 9.94, SD = 1.14) at pretest. All children attended primary school in the east of the Netherlands and 97.7% were born in the Netherlands

Procedure

The current study was part of a 2-armed indicated prevention RCT (Schoneveld et al. 2018) which has been approved by the ethics committee of the Faculty of Social Sciences. Within this RCT, the effect of MindLight on anxiety symptoms is compared to the effect of the CBT-program Coping Cat (Kendall and Hedtke 2006; van Starrenburg et al. 2017). Participants for this RCT were selected based on their score on the child-version of the Spence Children’s Anxiety Scale (SCAS-C; Spence 1998). Children were included with a total SCAS-score one standard deviation above the mean or when they scored one standard deviation above the mean on two subscales of the SCAS (not including the obsessive compulsive disorder subscale). Children that already received mental health care were excluded. Seven hundred and ninety-one children from eight primary schools filled out the screening. Two hundred and eight children met the inclusion criteria, of which 174 children agreed to participate in the study. Eighty-six children were randomly allocated to play MindLight. Seventy-two children completed the MindLight-intervention.

Participants played MindLight (Version 1.0.1; 2014) for a total of approximately 6 hours. Gameplay was broken down into six 1-hour sessions spread out over a 6-week period. MindLight sessions took place under supervision of two research assistants at the children’s own school after school hours. MindLight was played on 15.6-in. ASUS X552CL-SX033H laptops, using a MindWave headset (Version 1.1.23, Neurosky Inc. 2011; Johnstone et al. 2012) and a Xbox 360 controller. Children and their parents filled out several questionnaires including the Spence Children’s Anxiety Scale (Spence 1998) 2 weeks before and after playing MindLight, at 3-months and 6-months follow-up (when children had not played the game for 3 respectively 6 months).

Before coding the in-game data for the current study, only children that had completed both pre- and post-measurements of anxiety symptoms were included. In addition, only children with (almost) complete video data were selected: children with less than 4 recorded and/or attended play-sessions, with no recorded first and/or last play-session, with only a short video of the first session (i.e., 6 and 9 min), or with significant disturbancesFootnote 2 during gameplay were excluded. In total, video data of 43 children were coded and analysed. Children that were excluded did not significantly differ from the children that were included with respect to their sex, age and pretest anxiety scores (χ2(1, N = 77) = 0.53, p = .466; t(75) = −0.60, p = .551; and t(75) = 0.94, p = .351, respectively).

Measures

Anxiety Symptoms

The Spence Children’s Anxiety Scale (SCAS-C; Spence 1997, 1998) was used to assess anxiety symptoms before and after playing MindLight. This scale consisted of 44 items where children are asked how often (i.e., never, sometimes, often, always; scored as 0–3) they experience symptoms of six DSM-IV defined anxiety disorders, namely separation anxiety disorder (6 items), social phobia (6 items), panic disorder and agoraphobia (9 items), physical injury fears (5 items), generalized anxiety disorder (6 items), and obsessive-compulsive disorder (6 items). Six items were positive filler items to reduce negative response bias. Mean anxiety scores were calculated over the 38 anxiety items and used in the analyses. The SCAS-C is a reliable and valid measure (Birmaher et al. 1997; Muris et al. 1998; Muris et al. 2000b; Reynolds and Richmond 1978) and in the current study internal consistency was good; Cronbach’s alpha = .89 for pretest and .90 for posttest.

Coding of in-Game Play Behaviours

During the MindLight sessions, the on-screen output was videotaped using Fraps (Version 3.5.99; 2015). This program records the exact output of the screen (i.e., what the children see on their screens while playing the game). On-screen video data was coded using observational codes with the Noldus Observer XT (Version 11.5; Noldus Information Technology 2013). Real-time in-game play behaviours during the first and last play-sessionFootnote 3 were coded following the adapted version of the MindLight Coding System (i.e., MCS-II; based on Sherman 2015; see Appendix Table 6 for written guidelines of all codes) which has been developed to measure the frequency and duration of different in-game play behaviours. The MCS-II includes mutually exclusive codes for the: [1] type of engagement, [2] location in the game-environment, [3] presence of different kinds of fear events, and [4] brightness of the mindlightFootnote 4 (which could be “none”, “some”, or “total”). In the current study, codes of interest included four engaged in-game play behaviours and two avoidant/safety in-game play behaviours (see Table 1). Engaged behaviours were the frequency of defeat and the duration of exploration, attempts to decloak or attack fear events (“fear attempts”), and the brightness of the mindlight. Avoidant/safety behaviours were the frequency of ceiling light attempts, and the duration of hiding inside a chest. A detailed description of all codes can be found in Appendix Table 6.

The first author trained research assistants in the use of Noldus Observer XT and the MindLight Coding System-II. Training took approximately 8 hours and training materials included video data from excluded cases. Coders were blind to the hypotheses. Weekly to bi-weekly recalibration training and reliability checks were conducted to monitor coding and minimize coder drift. Fifteen percent of the total amount of coded video data was independently coded by 2 or more randomly-selected coders. The average reliability was .89 kappa (range .49–1.00).

Strategy of Analyses

The frequency and duration of in-game play behaviours were transformed to frequencies per minute and proportions, respectively, to control for differences in duration of play-sessions. For the brightness of the mindlight, only the durations of the two extremes (“none” and “total”) were used in the analyses. Then, descriptive statistics of the study variables and Pearson correlations between 1) pretest anxiety scores and in-game play behaviours during the first play-session, and 2) in-game play behaviours during the first play-session and the last play-session were examined. Second, two hierarchical regression analyses (one for engaged and one for avoidant/safety in-game play behaviours) were performed to examine whether changes in in-game play behaviours from the first to the last play-session (i.e., differences in frequencies/proportions calculated as last minus first play-session) were related to changes in anxiety symptoms 3 months later. The pretest anxiety score was entered in the first step. The difference in frequency or proportion of the specific in-game play behaviours were entered as a set in the second step. The anxiety score at the 3-months follow-up assessment was entered as dependent variable. Before running the regression models, statistical assumptions necessary for multiple regression (i.e., normal distribution of measurement error, homoscedasticity of the variances, linearity of the model, and multicollinearity) were tested and met. Nevertheless, bootstrapping (n = 5000) was used to ensure accurate and valid results (and taking into account the small sample size). One participant that was an outlier (z-score > |3|) on both pretest and posttest anxiety was excluded from the analyses.

Results

Descriptive Statistics

Means and standard deviations of the study variables are presented in Table 2. Contrary to what was expected, anxiety at pretest was not significantly associated with the in-game play behaviours during the first play-session (see Table 3). In addition, age and sex were not significantly associated with anxiety at pretest nor with the different in-game play behaviours during the first play-session.

Table 2 Means and standard deviations (SDs) of the study variables
Table 3 Pearson correlations of anxiety at pretest, age, sex, and in-game play behaviours during the first play-session

Moderate to large correlations were found between several in-game play behaviours during the first play-session (see Table 3). Exploration was positively associated with total mindlight, and negatively associated with ceiling light attempts, hiding inside a chest, and fear attempts. Further, total mindlight was negatively associated with ceiling light attempts. Thus, a child that spent large amounts of time exploring the game environment showed longer periods of bright mindlight, fewer ceiling light attempts, and shorter periods of time hiding inside a chest and decloaking or attacking fear events. Longer periods of bright mindlight were associated with fewer ceiling light attempts.

Regarding the correlations between in-game play behaviours during the first and the last play-session, Table 4 shows that none of the in-game play behaviours were associated with one another over time except for the negative association between exploration during the first play-session and fear attempts during the last play-session. It might be that children that explored more during the first session defeated more fear events during the game, resulting in less fear attempts needed during the last session.

Table 4 Pearson correlations of in-game play behaviours during the first and last play-session

In-Game Play Behaviours and Improvements in Anxiety 3 Months Later

Table 5 presents hierarchical regression analyses predicting anxiety at the 3-months follow-up from the difference in in-game play behaviours from the first to the last play-session controlled for anxiety at pretest. Model statistics represent the difference in the unique proportion of variance explained by the engaged and avoidant/safety in-game play behaviours respectively, beyond the proportion of variance explained by anxiety at pretest. Anxiety at pretest explained 44.4% of the variance in anxiety at the 3-months follow-up.

Table 5 Hierarchical regression analyses predicting anxiety at the 3-months follow-up from the differences in in-game play behaviours from the first to the last play-session controlled for anxiety at pretest
Table 6 MindLight Coding System-II

We hypothesized that increases in engaged in-game play behaviours and decreases in safety/avoidant in-game play behaviours from the first to the last play-session would predict reduction in anxiety symptoms at the 3-months follow-up. In line with these expectations, Table 5 shows that increases in exploration were significantly associated with lower anxiety scores 3 months later. For the avoidant/safety in-game play behaviours increases in ceiling light attempts and time spent hiding inside chests were significantly associated with higher anxiety scores 3 months later.

Discussion

The video game MindLight translates evidence-based techniques into game mechanics that teach children how to cope with anxiety in a playful manner. The aim of the present study was to investigate whether children with elevated levels of anxiety improved in their anxiety levels through these game mechanics that were explicitly designed into MindLight. Based on the anxiety literature, two types of in-game play behaviours (i.e., “engaged” and “avoidant/safety”) that are most relevant to the intervention goals of MindLight were distinguished and coded during gameplay. First, contrary to what was expected, pretest anxiety scores were not associated with the different in-game play behaviours during the first play-session. Second, in line with our predictions, increases in one of the in-game engaged behaviours and decreases in the two avoidant/safety behaviours predicted lower anxiety scores at 3-months follow-up. Together, these findings suggest that mechanics related to exposure techniques predicted improvements in children’s anxiety symptoms.

Associations between Pretest Anxiety Scores and In-Game Play Behaviours

Our finding that none of the in-game play behaviours, and the avoidant/safety behaviours in particular, were associated with pretest anxiety scores was unexpected. Because safety behaviours are an important maintenance process in anxiety disorders (Clark 1999), it was expected that children higher in anxiety would try to create more light by turning on ceiling lights and to hide more inside chests, because these objects provide a way to reduce and/or avoid exposure to fear events. The current study is part of an indicated prevention trial in which selection was based on scoring one standard deviation above the mean and clinical cases that already received mental health care were excluded. Therefore, the current finding might be due to a restricted range in anxiety scores. It might also be that the first play-session was standardized in such a way (with a lot of cut-scenes explaining the game) that little room was left for children to show very different in-game play behaviours. Nevertheless, it is promising that irrespective of their pretest anxiety scores, children started playing MindLight in a similar way because this strengthens the findings for the second hypothesis; changes in in-game play behaviours and the predicted improvements in anxiety symptoms are not due to associations between initial levels of anxiety and in-game play behaviours during the first session. Furthermore, the finding that none of the in-game play behaviours during the first session was associated with behaviours during the last session (except one association) is promising, because this suggests that MindLight is able to change the way in which children continued playing the game after the first session, enhancing opportunities to change anxiety symptoms.

Additional findings showed negative associations between several engaged and avoidant/safety in-game play behaviours during the first play-session, which provide support for the theory-based distinction between these two types of behaviours and at the same time supports the contention that the MindLight Coding System-II is able to distinguish these conceptually different in-game play behaviours.

In-Game Play Behaviours Representing Exposure Predicted Improvements in Anxiety

Results showed that changes in in-game play behaviours representing therapeutic exposure techniques predicted improvements in anxiety symptoms 3 months later. Regarding the engaged in-game behaviours, exploring the fearful game-environment for longer periods of time predicted decreases in anxiety symptoms. The time spent on actual attempts to chase away these fearful stimuli did not predict changes in anxiety symptoms nor did the frequency of getting defeated by these fear events. Regarding the avoidant/safety in-game behaviours, more attempts to seek safety under a ceiling light and increases in time spent hiding inside chests (and therefore avoiding fearful stimuli) predicted higher anxiety symptoms 3 months later. These findings are in line with previous research on avoidant/safety behaviours during traditional therapy (Glenn et al. 2013; Hammond 2005; Morgan and Raffle 1999; Salkovskis et al. 1999; Price and Budzynski 2009). However, the present study also extends this research by investigating these predictors in a game-based intervention. The current findings suggest that avoidant/safety behaviors play a similar role in an applied video game as in traditional face-to-face therapy.

Moreover, relaxation during gameplay (indicated by no or total mindlight) did not predict changes in anxiety symptoms. It might be that relaxation during gameplay is not as important for improvements in anxiety as the exposure game mechanic. Recent evidence (published after MindLight was developed) suggests that the contribution of relaxation training to anxiety improvements in youth appears to be limited, although it might be that a higher dose of relaxation is needed to improve anxiety symptoms (Peris et al. 2015).

Most importantly, the present study provides a unique contribution to the field by demonstrating that changes in the interaction with the game mechanics in MindLight predicted real-world improvements in anxiety symptoms at the 3-months follow-up assessment (when children had not played the game for 3 months). These findings show that what children learned and practiced in the game led to actual changes in their real-life (self-reported) behaviours. Most CBT approaches are not able to close this gap (Granic et al. 2014; Kendall 2011) and only a few game-based interventions have examined these effects (e.g., Girard et al. 2013). Moreover, by including a long-term follow-up, the present study is one of the few longitudinal studies in the field of applied video games (Girard et al. 2013; Granic et al. 2014; Primack et al. 2012).

Limitations and Suggestions for Future Research

There are a few limitations that should be mentioned when interpreting the findings and future research should attempt to overcome. The first limitation is that no in-game play behaviours representing the third technique (i.e., attention bias modification), that was initially incorporated in MindLight, were included in the current study. Because of how the game was designed, these behaviours were too dependent on the specific puzzle and the current location of the player and these locations varied widely across players, leaving comparisons across children unreliable. For example, a puzzle success on an easier puzzle would be different from a puzzle success on a more difficult puzzle, which requires more puzzle attempts and also the ability to distinguish different varieties of positive faces and negative faces. However, evidence for the effectiveness of attention bias modification in the literature is mixed. Some research has shown that attention bias modification is capable of reducing anxiety (Bar-Haim 2010; Bar-Haim et al. 2011; Hakamata et al. 2010), whereas other recent studies – that were published after MindLight was developed - failed to show this (for an overview see Clarke et al. 2014; Cristea et al. 2015). Clarke et al. (2014) argue that the studies finding no effects of attention bias modification failed to manipulate attention and therefore found no effects on the outcome measures. Future research should first test whether the puzzles in MindLight actually are able to modify attentional bias before in-game puzzle-solving behaviours are examined in relation to changes in anxiety.

A second limitation is that despite the fact that inactivity has good face validity for representing avoidant/safety behaviour because it reduces exposure to fear events and literally limits engagement with the game mechanics in MindLight, the inactivity code in the MindLight Coding System-II is not able to distinguish between actively avoiding the game or being inactive because the child is waiting for a research assistant to answer a question. Relatedly, the technical problem code might have been confounded too, because this code was used – but not exclusively – when the game was paused. It is possible that some children paused the game to actively avoid fear events in the game. Future research should try to separate these different behaviours, such that codes become as clear as possible and might show relations to changes in anxiety symptoms.

Finally, the current study did not test mediators or moderators. It is possible that associations between (multiple) in-game play behaviours and changes in anxiety symptoms are mediated or moderated by other factors, such as game expectancies, game experience, motivation, and enjoyment, which are known to be important predictors of treatment outcome (Castonguay et al. 1996; Ferguson and Olson 2013; Przybylski et al. 2010). Future research might want to examine these effects in a larger sample to get insight into why and for whom MindLight works best.

Practical Implications

Notwithstanding the aforementioned limitations, the current study has three important implications. The first implication applies to clinical research on anxiety. Results showed that in-game behaviours representing the exposure principle predicted improvements in anxiety. These findings underscore the importance of this technique in anxiety disorders and show that applied games can be used to reduce anxiety symptoms. Using game-based interventions contribute to the movement of tailoring and personalizing treatments (Chorpita and Weisz 2009) by engaging and motivating children that might not like the rather didactic-based approach of traditional CBT-treatments (Gosch et al. 2006) and by providing rich practice opportunities for children that find it difficult to use newly-acquired knowledge in real-life situations (Granic et al. 2014).

The second implication relates to designs aimed at improving both gameplay experiences and intervention outcomes. Because results demonstrated that the MindLight Coding System-II is useful for distinguishing between engaged and avoidant/safety in-game play behaviours, the coding system could be integrated into the game itself. In-game play behaviours can then be tracked automatically and be used as a measure for determining children’s progress. Measurements of in-game behaviours can be used to dynamically adjust the game to the player’s actions, diverse needs and learning paces (Bakkes et al. 2012; Bakkes et al. 2014). For example, the game may provide more hiding spaces in the beginning of the game for more anxious children (cf. Milosevic and Radomsky 2008; cf. Rachman et al. 2008), or provide more exposures to fear events when children are able to stay relaxed and calm in the face of less/easier fear events. Additionally, such measurements could tell clinicians and researchers when and where children are encountering difficulties in the game, and provide opportunities to help at an early stage. Finally, measuring in-game behaviours provides feedback for the players, clinicians, researchers and future game-based interventions, without the biases and stigma that are associated with self-reports.

The third implication applies to future research and the development of game-based interventions. Using observational codes, the current study provided a first step in testing the effect of the game mechanics in MindLight; the exposure to fear events is an important game mechanic that predicted anxiety symptoms 3 months later. Because of the modularity of game design, games hold the immense potential to test mechanisms of change with tightly controlled experiments. The next step for future research could be to experimentally manipulate the game mechanics in MindLight to test their causal impact on improvements in anxiety. Different versions of the game could be played with and without the game mechanics. Such experimentally controlled studies contribute to the development of a toolbox of validated game mechanics that could be used in new games targeting anxiety symptoms or other psychopathologies with the same underlying deficits.