Frequency effects in monolingual and bilingual natural reading
This paper presents the first systematic examination of the monolingual and bilingual frequency effect (FE) during natural reading. We analyzed single fixation durations on content words for participants reading an entire novel. Unbalanced bilinguals and monolinguals show a similarly sized FE in their mother tongue (L1), but for bilinguals the FE is considerably larger in their second language (L2) than in their L1. The FE in both L1 and L2 reading decreased with increasing L1 proficiency, but it was not affected by L2 proficiency. Our results are consistent with an account of bilingual language processing that assumes an integrated mental lexicon with exposure as the main determiner for lexical entrenchment. This means that no qualitative difference in language processing between monolingual, bilingual L1, or bilingual L2 is necessary to explain reading behavior. We present this account and argue that not all groups of bilinguals necessarily have lower L1 exposure than monolinguals do and, in line with Kuperman and Van Dyke (Journal of Experimental Psychology, 39 (3), 802-823, 2013), that individual vocabulary size and language exposure change the accuracy of the relative corpus word frequencies and thereby determine the size of the FEs in the same way for all participants.
KeywordsEye movements and reading Psycholinguistics Visual word recognition
Although word recognition and production are both very complex processes influenced by a wide range of variables, the frequency of occurrence of a word in a language is by far the most robust predictor of language performance (Brysbaert et al., 2011; Murray & Forster, 2004). In both word identification (e.g., Rubenstein, Garfield, & Millikan, 1970; Scarborough, Cortese, & Scarborough, 1977) and word production tasks (e.g., Forster & Chambers, 1973; Monsell, Doyle, & Haggard, 1989) high frequency words are processed faster than low frequency words. This observation is called the word frequency effect (FE), and it is one of the most investigated phenomena in (monolingual) psycholinguistics.
Multiple language models of comprehension (e.g., Dijkstra & Van Heuven, 2002; McClelland & Rumelhart, 1981; Morton, 1970) explain FEs using implicit learning accounts. These state that repeated exposure to a certain lexical item raises this item’s baseline activation in proportion to its distance to the activation threshold, so that lexical selection of that particular word is faster during recognition (e.g., Monsell, 1991). The maximal speed of lexical access is limited, so once a word has received a certain amount of exposure, no more facilitation will be expected when there is additional exposure to that particular item (Morton 1970).
In the visual domain, word recognition speed increases with the logarithm of word corpus frequency (Howes & Solomon, 1951). A certain number of additional exposures to a low frequency word will result in a large decrease of its lexical access time, while the same number of additional exposures to a high frequency word will result in a much smaller decrease of its lexical access time. This particular characteristic of the relationship between word frequency and processing time causes the size of the FE to be modulated by language exposure.
Bilinguals offer an interesting opportunity to study the relationship between exposure and lexical access, because of the within-subject difference in language exposure for L1 and L2. We will examine the effect of word frequency in bilingualism on the basis of new natural reading data collected for English monolinguals and Dutch-English bilinguals. We will start by examining the literature on individual differences in the word FE and discuss the relation of these findings to the FE in bilinguals. Following Kuperman and Van Dyke (2013), we will formulate an account of exposure-related differences in the effect of corpus word frequency that originates in the statistical characteristics of word frequency distributions.
Individual differences in the frequency effect (FE)
The collection and evaluation of frequency norms based on text corpora is central to psycholinguistic research (e.g., Brysbaert & New, 2009; Keuleers, Brysbaert, & New, 2010; Van Heuven, Mandera, Keuleers, & Brysbaert, 2014). The number of exposures to a certain word is often operationalized as the count of word occurrences in language corpora like the Subtlex database (Keuleers et al., 2010). Mostly, corpus frequencies are expressed as relative values because these can be used independent of corpus size. These objective corpus word frequencies are supposed to reflect the average number of exposures to certain words of an experienced reader. While corpus word frequencies are a tremendously useful proxy measure for relative exposure, it should not be forgotten that the relative frequency of a word in a text corpus is not necessarily equal to the relative frequency of exposure to that word for a particular individual.
Solomon and Howes (1951) have previously emphasized that word counts from text corpora are based on an arbitrary sample of the language and that there may be individual variation in the relative frequency of exposure to specific words. In other words, corpus word frequencies may under- or overestimate subjective word frequencies, which can lead to a difference in the size of the FE when corpus word frequencies are used in analyses. The differences in the FE size would disappear when a measure of actual exposure or subjective frequency (e.g., Connine, Mullennix, Shernoff, & Yelen, 1990; Gernsbacher, 1984) is used. Still, in experiments where words from different semantic domains (for example tools or clothing) are used as stimuli, such differences in relative frequency would in principle not lead to systematic differences in the FE between individuals. This is because differences in subjective frequency, in particular semantic categories, would be cancelled out by the use of stimuli from multiple domains.
Next to the possibility of individual differences in the relative frequency for specific words due to differences in experience with a specific vocabulary, it is possible that individuals who are at different stages in the language acquisition process, or, more broadly, have a differing amount of total language exposure, may have different relative frequencies for words. For this reason, some studies have used familiarity ratings of words as a more accurate reflection of the actual exposure to certain words for a specific group of readers (e.g., Balota, Pilotti, & Cortese, 2001; Kuperman & Van Dyke, 2013). Balota et al. (2001) observed that these subjective norms explained unique variance above and beyond objective corpus frequencies for lexical decision and naming tasks. Kuperman and Van Dyke (2013) confirm that objective corpus frequencies are particularly poor estimates and systematically overestimate the subjective frequencies for low frequent words for individuals with smaller vocabularies.
Most research on the FE in language processing has focused on monolingual participants, while more than half of the world’s population, the “default” person, is bilingual or multilingual. Taking into account that bi- or multilingualism is at least as widespread as monolingualism, it is important to assess how exposure to L1 or L2 affects a bilingual person’s language processing. This is not straightforward because there is now a consensus that L1 and L2 constantly interact during visual word recognition (e.g., Duyck, Van Assche, Drieghe, & Hartsuiker, 2007;Van Assche, Duyck & Hartsuiker, 2012). These crosslingual interactions strongly suggest the existence of a unified bilingual lexicon with parallel activation for all items in that lexicon, with items competing for selection within and across languages (for a more comprehensive overview of the evidence for an integrated bilingual lexicon, see Brysbaert & Duyck, 2010 and Dijkstra & Vanheuven, 2002). Not only does L1 knowledge influence L2 lexical access, but the knowledge of an L2 also changes L1 visual word recognition (e.g., Van Assche, Duyck, Hartsuiker & Diependaele, 2009). Because these interactions occur in both directions, it is not only important to assess the differential influence of word exposure on lexical access for L1 and L2 reading, but also the possible differences between the frequency effect for monolinguals and bilinguals in L1.
Although the individual differences in frequency distribution described above are relevant for monolingual research, this is even more the case for bilingual research. The integrated bilingual lexicon will contain on average more lexical items than that of a monolingual lexicon. For advanced learners of an L2, who have a lexical entry for almost all concepts, we can assume that they would have almost double the number of words in their lexicon. Inspired by observations of bilingual disadvantages in production tasks (e.g., Ivanova & Costa, 2008; Gollan, Montoya, Fennema-Notestine & Morris, 2005; Gollan et al., 2011), the weaker links theory (Gollan & Silverberg, 2001; Gollan & Acenas, 2004; Gollan et al., 2008, 2011) was proposed. This theory posits the idea that bilinguals necessarily divide their language use across two languages, resulting in lower exposure to all of the words in their lexicon, including L1 words. The lexical representations of bilinguals in both languages will have accumulated less exposure than the ones in the monolingual lexicon. Over time, this pattern of use would lead to weaker links between semantics and phonology for bilinguals, relative to monolinguals (Gollan et al., 2008).
Diependaele et al. (2013) generalize the weaker links account and assume a decrease in lexical exposure for bilinguals, and suggest that this can result in a reduced lexical entrenchment either by reduced lexical precision of those representations (e.g., Perfetti, 1992, 2007), or by reduced word-word inhibition or weaker integration between phonological and semantic codes (e.g., Gollan et al., 2008, 2011).
In short, the mere knowledge of a second language (and being exposed to its words) will reduce the lexical entrenchment of the first language, because this language will receive less exposure. Gollan et al. (2008) suggest a direct relationship between the weaker links and the frequency effect. They make the explicit hypothesis that bilinguals should have a larger frequency effect than monolinguals because (a) bilinguals have used words in each language less often than monolinguals have, and (b) increased use leads to increased lexical accessibility only until a certain ceiling level of exposure, meaning that low frequency words should be more affected by differences in degree-of-use than high frequency words. From this hypothesis, we can also predict that in the case of unbalanced bilinguals, for whom L2 exposure is lower than the L1 exposure, the L2 FEs will also be larger than the L1 FEs. We support the idea posited by the weaker links account that differential FEs in the bilingual domain can be explained without assuming qualitatively different language processing for bilinguals compared to monolinguals and aim to specify the hypotheses put forward by the weaker links account (Gollan et al., 2008).
Word frequency distribution
Because of the logarithmic relationship between corpus word frequency and lexical access time, it is customary to use logarithmically transformed corpus word frequencies in any analysis where word frequency is a variable in the model. This transformation changes the functional relationship between corpus word frequency and lexical access time from a logarithmic one to a linear one (see the upper and middle panel of Fig. 6 in Appendix A for an illustration).
When detecting changes in the size of the FE related to language exposure, it is important to note that when these transformed corpus word frequencies are used, the size of the word frequency effect is not affected by absolute exposure. In other words, while a participant who has more exposure to a certain language will be faster to process words in that language than a participant who has little exposure to that language, an analysis based solely on transformed corpus word frequency would predict that the difference in processing times for high frequency and low frequency words, in other words the FE, is the same for both participants. Still another way of putting it is that when x and y are untransformed relative corpus word frequencies (for instance x=100 per million and y=1 per million), then for a participant who has been exposed to 100 million words the difference in absolute exposure between x and y is 9,900 (10,000−100) while for a participant who has been exposed to 10 million words, the difference is 990 (1,000−10), which would lead to a larger frequency effect for the participant with more exposure. When logarithmically transformed frequencies are used, for the participant with exposure to 100 million words the difference between x and y is 2 (log10 (10,000) – log10 (100) = 4 − 2 = 2), while for the participant with exposure to 10 million words, the difference between x and y is also 2 (log10 (1,000) − log10 (10) = 3 – 1 = 2).
The ratio of a word’s relative frequency in the 50-million token SUBTLEX corpus to its relative frequency in a sample of 5 million tokens (relative frequencies averaged over 1,000 samples). Taken from Kuperman and Van Dyke (2013)
It is precisely this characteristic of word frequency distributions that is overlooked in the analysis of the effect of word frequency. If the evolution of relative word frequency with more exposure follows a trajectory that is analogous to the evolution of relative frequency with increase in corpus size, this alone can account for differences in the size of the FE. On these grounds, an interaction of proficiency and corpus frequency is expected, but it should not be attributed to qualitative differences between poor and good readers, or between a categorical difference between monolinguals and bilinguals. As we already mentioned, when assuming lower exposure to all items in the lexicon and using raw corpus word frequencies in the analyses, a larger FE slope is expected. When we log transform these word frequencies we do not necessarily expect a larger FE slope as long as the ratios between the relative frequencies stay the same. The importance of changes for low frequency words but not for high frequency words is exactly what a logarithmic transformation accounts for; differences in the frequency effect due to a lower exposure to all words in the lexicon should not be found if a logarithmic transformation is used and if there are no changes in relative word frequency. However, if relative subjective frequencies do not stay constant, this difference should lead to a difference in the size or slope of the frequency effect when a logarithmic transformation is applied to the frequencies. It should be noted that the reasoning that differences in the size of the frequency effect are only due to the logarithmic relationship between word frequencies and word processing times is therefore incomplete (e.g., Duyck, Vanderelst, Desmet & Hartsuiker, 2008; Schmidtke, 2014).
The weaker links theory is consistent with the individual differences account of Kuperman and Van Dyke (2013) in the sense that differences in the FE are attributed to the degree of exposure rather than to qualitative differences originating from the acquisition of multiple languages. However, the weaker links theory makes the general claim that (a) there is an overall lower (absolute) exposure to language for bilinguals than for monolinguals and (b) that this results in a larger FE for bilinguals.
A pure exposure-based account leaves open the possibility that bilinguals may have the same degree of exposure to one (or, in principle, more) of their two languages as monolinguals have, and this account can specify the exact locus of the modulation of the size of the FE, namely that it arises from differences in ratios of high and low relative frequencies for individuals with different levels of exposure.
When vocabulary size is small, the probability that the next encountered word will be a hitherto unseen type is large, but as exposure grows the probability that the next word will be a new type decreases. As a result, to double vocabulary size requires much more than twice the amount of exposure. Concurrently, the more exposure one has, the smaller the increase in vocabulary size that is associated with additional exposure. Assuming no large differences in the complexity of material that one is exposed too, a similar vocabulary score indicates similar exposure and an increase in vocabulary scores indicates a higher degree of exposure. For subjects with an equal but very high vocabulary score, it becomes more uncertain that they have the exact same amount of language exposure. Nevertheless, on the whole, when participants have equal proficiency scores, we do not expect differential FEs, because language exposure should be quite similar.
Kuperman and Van Dyke (2013) note that robust interactions between language proficiency and word frequency have been found in a wide range of studies concerning individual reading differences: More proficient readers showed a smaller frequency effect on reaction times (for examples see Chateau & Jared, 2000 and Diependaele et al. 2013).
Although this is indeed a robust finding, it must be noted that some authors have claimed that this finding might be an artifact of the base-rate effect (Butler & Hains, 1979; Faust et al. 1999; Yap et al., 2012). The base-rate effect is the observation that the magnitude of lexical effects correlates positively with reaction latencies. This would mean that the larger frequency effects for participants with a lower language proficiency score would be mainly due to the fact that their reaction times are longer than higher skilled participants. However, Kuperman and Van Dyke (2013) showed that the interaction between word frequency and language skill is still present after z-transforming reaction times per subject, thus eliminating any kind of base rate effect.
As shown by analyses that find larger frequency effects for L2 word recognition when word frequencies are log-transformed (Diependaele et al., 2013; Duyck et al., 2008; Lemhöfer et al., 2008; Whitford & Titone, 2011), exposure does have a systematic relation with the size of the word frequency effect that cannot be accounted for by the logarithmic relation between word processing times and word frequencies alone.
In the tradition of the weaker links account and as evidence for reduced lexical entrenchment for bilinguals compared to monolinguals, the bilingual FE has been compared with the monolingual FE. Indeed, when we look at the experimental findings, we find that when proficiency is equal across groups, no differences in the size of the FE are found: Gollan et al. (2011) found a similar FE in an English lexical decision and a sentence-reading task for balanced Spanish-English bilinguals to that for English monolinguals; Duyck et al.’s (2008) study did not find a difference between the L1 FE of unbalanced Dutch-English bilinguals and the FE of English monolinguals in lexical decision times either. The studies that did find a larger bilingual FE used bilingual participants with lower proficiency, and thus lower exposure, for the tested language than the monolinguals; also the tested language was acquired later than their other language. This means that the corpus frequencies were probably overestimated for the lower frequent words for the bilingual group, inflating reaction times for the low range. For example, Lehtonen et al. (2012) found a larger FE in a Finnish lexical decision task for balanced Finnish-Swedish bilinguals than for Finnish monolinguals. When we look at the Finnish proficiency scores we see that the bilinguals scored significantly lower than the monolinguals. Also, Lemhöfer et al. (2008) found a larger FE for different groups of bilinguals in English, their L2, than for English monolinguals in a word identification task. Gollan et al. (2011) showed that the L2 FE for Dutch-English bilinguals in a lexical decision task was larger than for English monolinguals. Naturally the bilinguals had less exposure to their L2 than the monolinguals had for their L1. These latter two studies used raw frequencies.
In short, the results of all of these studies concur with our expectations, namely that language exposure could account for all the differences found between bilingual and monolingual FEs.
Indeed, Diependaele et al. (2013) reinvestigated Lemhöfer et al.’s (2008) English word identification times, using log-transformed word frequencies. They hypothesized that target language proficiency is the determining factor for identification times both in the L1 of the monolinguals and in L2 of the bilinguals, without a qualitative difference between L1 and L2 processing. They found a larger FE for bilinguals’ word identification times in L2 than for the monolinguals’ word identification times in L1. When they added target language proficiency in their model, the FE modulation by group was no longer significant. Higher target language proficiency reduced the size of the FE and this effect was the same for both groups.
As already discussed, within the unbalanced bilingual’s lexicon, we assume lower exposure to L2 words than to L1 items. For this reason, a larger FE for bilinguals reading in L2 is expected compared to reading in L1, even when word frequencies are log-transformed. Duyck et al.’s (2008) data confirm this hypothesis. They used an English and Dutch lexical decision task to test Dutch-English unbalanced bilinguals. Using a dichotomous (low vs. high) corpus frequency manipulation, they found that the L2 FE is about twice as large as the L1 FE. Whitford and Titone (2011) used eye-movement measures of L1 and L2 paragraph reading of unbalanced English-French and French-English bilinguals. Bilinguals reading in L2 showed larger FEs in gaze durations and total reading time than they did in L1. On top of that, they found a modulation of the L1 and L2 FE by L2 exposure. Bilinguals with a higher L2 exposure showed a smaller FE when reading in L2 than the bilinguals with a lower L2 exposure.
In sum, the findings of FE modulation in the bilingual field are compatible with the account that Kuperman and Van Dyke (2013) propose for individual differences in FEs for monolingual participants. Quantitative differences between language exposure, resulting in a different ratio of relative frequencies for low compared to high exposure items, can account for the differences between bilingual and monolingual language processing, but also for the differences found within groups for L1 and L2 processing.
Our study is the first to investigate the difference between the first acquired and dominant L1 FE of unbalanced bilinguals, and the monolingual FE in natural reading. Duyck et al.’s (2008) study compared the same groups (Dutch-English bilinguals and English monolinguals) but merely used an isolated word recognition task. This lexical decision task contained a limited number of 50 target words (25 low frequency and 25 high frequency words) per participant and provided only a small amount of data per participant. On top of that, the isolated-word method used in their experiment represented an oversimplification of the natural way in which words are encountered, limiting ecological validity. When reading in a natural context, word processing takes place while other language processing is going on, e.g., integrating words in context, parsing of syntax, etc. Also a lexical decision task involves a behavioral response, which might require mental processes or strategic factors that are normally not associated with reading.
To date, only two studies compared the frequency effects for L1 and L2 visual word recognition (Duyck et al., 2008; Whitford & Titone, 2011). In Whitford and Titone’s (2011) study, comparing L1 with L2 FEs, participants read two paragraphs, each containing only about 50 content words. In our dataset, the largest bilingual eye-tracking data corpus (Cop, Drieghe & Duyck, 2014), bilingual and monolingual participants read a whole novel containing around 29,000 content words. Not only is this a much larger and thus more generalizable assessment of bilingual reading, it is also an even more naturalistic setting than paragraph reading, since people often read text in the context of a coherent story.
This study also attempts to resolve a concern we have with most cited studies, namely a poor measurement of L2 proficiency and a lack of assessment of L1 proficiency. We follow Luk and Bialystok (2014) in their assertions that there are multiple dimensions of bilingualism and follow their recommendation to use both methods of subjective and objective proficiency assessments. By triangulating these different measurements, we calculated a composite proficiency score for both L1 and L2 language proficiency. Both the individual measurements of this composite score can then be used to assess differences in proficiency between the tested groups. The way this composite score was calculated is described in the Method section.
Most studies on the bilingual FE use self-reported L2 language exposure as a measure of proficiency (cf., Whitford & Titone, 2011) or do not measure the language proficiency of their participants at all (cf. Duyck et al. 2008). For our analyses we use the LexTALE scores because this test has been validated as an indication of vocabulary size, a central concept in this study. Kuperman and Van Dyke (2013) explain the different individual FEs precisely by vocabulary size. On top of that, the LexTALE score has been used in multiple bilingual studies, ensuring an easy comparison between the results and replication of the effects of this score.
Interestingly, no study has ever investigated the differential effects of L1 versus L2 proficiency for bilinguals on frequency effects. This is even the first study to add L1 proficiency to the analysis of the FE of bilingual reading data. Neither Whitford and Titone (2011), Duyck et al. (2008) nor Diependaele et al. (2013) used this variable in analyzing the bilingual data, while it is expected that the proficiency of L1, which is an indication of lexicon size and exposure, is of importance to the actual frequencies of the word forms in the bilingual lexicon.
Concerning proficiency, the weaker links account (Gollan & Acenas, 2004) always assumed a trade-off between the two scores: A high L2 exposure will imply a lower L1 exposure. The proliferation of lexical items in bilinguals should necessarily lead to a lower exposure to other items and eventually to weaker links between lexical representations and their word forms. For unbalanced bilinguals we assume that the mentioned trade-off between L1 and L2 exposure will be much more unclear. We might even expect that the L1 and L2 proficiency scores should correlate positively with each other, when we assume that innate language aptitude plays a role in language acquisition. Many studies in the monolingual domain have found that participants with increased vocabulary size show a reduced response time and a higher accuracy rate in lexical decision tasks (Yap, Balota, Sibley, & Ratcliff, 2012) for both familiar and unfamiliar words (e.g., Chateau & Jared, 2000). On top of that Perfetti, Wlotko and Hart (2005) observe that individuals who are better at comprehending text or have a higher reading skill, require fewer exposures to learn new words. This means that a person with a large L1 proficiency score will be faster at establishing a connection between a new word form and its meaning (Perfetti et al., 2005) and might thus be more likely to also have a larger L2 proficiency score.
For monolingual L1 and bilingual L1 reading, we expect that L1 proficiency should have a large influence on the size of the frequency effect, with smaller L1 FEs for higher L1 proficiency. The relationship between L1 proficiency and the FE should be the same for both groups. For the comparison between the bilingual L2 reading, L1 proficiency might have a similar effect on the size of the FE, within the vocabulary size rationale discussed above. Given the robust effects of L2 proficiency on the size of the FE in previous studies, we might expect this effect to persist even in the presence of L1 proficiency. If it does, a higher L2 proficiency is expected to reduce the FE in L2 reading but not in L1 reading.
Nineteen unbalanced bilingual Ghent University and 14 monolingual Southampton University undergraduates participated either for course credit or monetary compensation. The bilingual participants’ dominant language was Dutch, their second language English. They had a relatively late L2 age of acquisition (mean=11 [2.46]). The monolingual participants had knowledge of only one language: English. Bilingual participants completed a battery of language proficiency tests including a Dutch and English spelling test (GLETSHER and WRAT4), the LexTALE (Lemhöfer & Broersma, 2011) in Dutch and English, a Dutch and English lexical decision task (for results see Table 6 in Appendix B), and a self-report language questionnaire (based on the LEAP-Q; Marian, Blumenfeld, & Kaushanskaya, 2007). Monolinguals completed an English spelling test, the English LexTALE, and an English lexical decision task. We calculated a composite L1 and L2 proficiency score by averaging the score on the spelling test, the score on the LexTALE, and the adjusted score of the lexical decision task. This composite score and the LexTALE scores show that bilinguals score significantly higher on L1 proficiency than they do on L2 proficiency, and that the bilinguals and monolinguals are matched on L1 proficiency. The LexTALE score is used in the analysis. Participants had normal or corrected-to-normal vision. None of the participants reported having any language and/or reading impairments. For detailed scores see Table 6. in Appendix B.
The participants were asked to read the novel “The mysterious affair at Styles” by Agatha Christie (Title in Dutch: “De zaak Styles”, Christie, 1920). This novel was selected out of a pool of books that was available via the Gutenberg collection. The books were judged on length and difficulty, indicated by the frequency distribution of the words that the book contained. We selected the novel that had a word frequency distribution that was most similar to the one in natural language use (Subtlex database). The Kullback–Leibler divergence was used to measure the difference between the two probability distributions (Cover & Thomas, 1991).
Summary of the characteristics of the content non-cognate words of the novel: Number of words, average content word frequency, and average word length. Standard deviations are in brackets
Number of words
Average content word frequency
Average word length
The bilingual and monolingual eye-movement data were recorded with the EyeLink 1000 system (SR-Research, Canada) with a sampling rate of 1 kHz. Reading was binocular, but eye movements were recorded only from the right eye. Text was presented in black 14 point Courier New font on a light grey background. The lines were triple-spaced and three characters subtended 1° of visual angle or 30 pixels. Text appeared in paragraphs on the screen. A maximum of 145 words was presented on one screen. During the presentation of the novel, the room was dimly illuminated.
Each participant read the entire novel in four sessions of an hour and a half each, except for one bilingual participant who only read the first half of the novel, in English. The other bilinguals read half of the novel in Dutch, the other half in English. The order was counterbalanced.
The participants were instructed to read the novel silently while the eye tracker recorded their eye movements. It was stressed that they should move their head and body as little as possible while they were reading. The participants were informed that they would be presented with multiple-choice questions about the contents of the book after each chapter. This was done to ensure that participants understood what they were reading and paid attention throughout the session.
The text of the novel appeared on the screen in paragraphs. When the participant finished reading the sentences on one screen, they were able to press the appropriate button on a control pad to move to the next part of the novel.
Before starting the practice trials, a nine-point calibration was executed. After this, the calibration was done every 10 min, or more frequently when the experiment leader deemed necessary.
Words that had an orthographically overlapping translation equivalent in the other language were categorized as identical cognates and were excluded for the frequency analysis (Dutch: 8.1 %, English: 13.7 %). The first and last word on a line were excluded from the analysis (Dutch: 18.8 %, English: 16.9 %) because their processing times also reflect sentence wrap-up effects (e.g., Rayner et al., 1989).
Average single fixation durations, gaze durations, and skipping rates for low [0.01–3.98] and high [3.99–5.90] frequent words and the mother tongue (L1) and second language (L2) bilingual and monolingual frequency effects
Low frequency words
High frequency words
Low frequency words
High frequecy words
Low frequency words
High frequecy words
Single fixation duration (ms)
Skipping rate (%)
First fixation duration (ms)
Gaze duration (ms)
In this article we report the analysis of the single fixation durations. We prefer this measure because eye movements are complex and can reflect different processes. For example, first fixation durations are used most commonly as an early measure of lexical access. However, these can consist of either the single fixation duration but also of the first fixation of multiple fixations on a word. This measure sometimes shows reversed word length effects because the first of a fixation on a longer word will be shorter because of the need to fixate a longer word multiple times (e.g., Rayner, Sereno & Raney, 1996). If there is only a single fixation on a target word, we assume that the target word is processed sufficiently with this one fixation because there is no refixation prior to moving to the next word or after doing so. Thus we prefer the measurement of single fixation duration because this would most accurately reflect lexical access time for the target word. The size of the corpus allows us to exclude words that are refixated whilst maintaining an ample amount of statistical power. For the analyses of the other three dependent variables, we refer the reader to Tables S1-S6 in the online supplementary materials.
Bilingual L1 reading versus monolingual reading
For the comparison between monolinguals and bilinguals reading in L1, all words that were either not fixated or were fixated more than once were excluded (46,.3 %). Single fixations that differed more than 2.5 standard deviations from the subject means were excluded from the dataset (2.23 %). This left us with 265,756 data points. The dependent variable was log transformed to normalize the distribution as suggested by the Box-Cox method. This transformation did not change the functional relationship between the single fixation durations and the log-transformed word frequencies (see Fig. 6 in Appendix A). This data was fitted in a linear mixed model using the lme4 package (version 1.1-7) of R (version 3.0.2). The model contained the fixed factors of Bilingualism (L1 or mono), log 10 word frequency (continuous), L1 proficiency (continuous) and the control variable of word length (continuous). As proficiency variable we used the score on the L1 LexTALE (Lemhöfer & Broersma, 2011). For the word frequency, the subtitle word frequency measures (English: Brysbaert & New 2009; Dutch: Keuleers et al., 2010) were log transformed with base 10 to normalize their distribution. All continuous predictors were centered. The maximum correlation between fixed effects in the final model was −0.063.
Estimates, standard errors, and t-values for the fixed and random effects of the final linear mixed effect model for Single Fixation Durations of the comparison between mother tongue (L1) bilingual and monolingual reading
Bilingual L1 versus monolingual
Word frequency*L1 proficiency
Word frequency * bilingualism
Word frequency * Word length
L1 proficiency * Word length
Word frequency * Word length
Our two groups did not differ in single fixation durations: L1 reading was equally fast for mono- and bilinguals (β=−0.019, SE=0.015, t-value=−1.25). We did find an overall frequency effect (β=−0.0082, SE=0.00095, t-value=−8.59), which was not larger for bilinguals than for monolinguals (β=0.00051, SE=0.0013, t-value=0.39).
What is striking is that the relationship between frequency and single fixation duration is the same for monolinguals and bilinguals reading in L1. Because word length is not matched across languages (0.48 letter difference), we added word length to this higher order interaction. The three-way interaction was not significant and did not render the significant two-way interaction between L1 proficiency and frequency insignificant.
Bilingual L1 reading versus bilingual L2 reading
Estimates, standard errors and t-values for the fixed and random effects of the final linear mixed effect model for Single Fixation Durations of the comparison between bilingual mother tongue (L1) and second language (L2) reading
Bilingual L1 vs. bilingual L2
Word frequency * Language
Word frequency * L1 proficiency
Language * L2 proficiency
Age of acquisition L2
Word frequency*Word length
L1 Proficiency* Word length
L2 Proficiency * Word length
Language * Word length
Language * Word frequency
Language * Word length
Because word length is not matched across languages, we again added word length to the higher order interactions. These three-way interactions were not significant and did not render the other two-way interactions insignificant. This means that the effects described generalize for both short and long words.
This paper compared the monolingual and bilingual (L1 and L2) FE in text reading. Participants read an entire novel containing ±29,000 content words, of which ±8,000 were nouns. Bilinguals read the novel half in Dutch (L1) and half in English (L2). In the analyses of single fixation durations on non-cognate content words, we found similarly sized FEs for bilinguals and monolinguals reading in their mother tongue. A rise in L1 proficiency reduced the slope of the L1 FE. The bilinguals showed a larger FE when reading in their L2 compared to reading in their L1. We also found a modulation of the bilingual L2 FE by L1 proficiency. A rise in L1 proficiency reduced the slope of the L1 and L2 FE. L2 proficiency did not modulate the FE, but it did have a differential effect across languages. In L2 reading, a rise in L2 proficiency speeds up single fixations, for L1 reading a rise in L2 proficiency does the opposite. This trade-off of reading speed is in line with the idea of “weaker links.” To account for both these and previous results, we propose an account that fits within the framework of the weaker links hypothesis, suggesting not only a lower exposure to all lexical items but a disproportionate overestimation of corpus word frequencies for low frequency words for smaller vocabularies. Our proposal is consistent with a purely exposure-based explanation of language processing speed.
Bilingual vs. monolingual L1 FE
We find a similarly sized FE for bilinguals reading in L1 and monolinguals reading in their mother tongue. Our findings seem at odds with the weaker links account, which predicts that due to a lower exposure to all items in the bilingual lexicon, bilinguals would show an overall larger FE in both their languages compared to a monolingual. Gollan and Acenas (2008), who mostly tested balanced Spanish-English populations, make the implicit assumption with their weaker links account that the total language exposure is equal for all people. While this may be the case for their participants, it is definitely not true for all groups of bilinguals. Our population of unbalanced bilinguals usually acquires a second language in a classroom context, thus increasing their total language exposure, not per se substantially decreasing their L1 exposure. The acquisition of a second language for adults might be more defined by actively seeking more language exposure in a second language, resulting in indeed a larger lexicon, but also a higher total exposure. The hypothesis that bilingual exposure to L1 is not substantially lowered by bilingualism is supported by the fact that the L1 proficiency of our monolinguals was equal to the L1 proficiency of the bilinguals.1 The similar proficiency scores indicate a similar-sized vocabulary and thus a similar exposure to L1 for both groups. This contrasts with most studies reporting differential FEs for bilinguals compared to monolinguals which use balanced bilingual populations and/or report lower target language proficiency for bilinguals than for monolinguals (Gollan et al., 2011; Lemhöfer et al., 2008; Lehtonen et al., 2012). To conclude, the weaker links account connects lower language exposure, leading to lower proficiency, to a larger FE. We nuance this rationale by pointing out that not all bilingual groups necessarily have lower L1 exposure than monolinguals do. This means that as long as there are no differences in language exposure as measured by language proficiency, we do not expect differently sized FEs. We would only predict a perceivable disadvantage for bilinguals in L1 compared to monolinguals when vocabulary size, and thus exposure, is considerably smaller for the bilinguals.
The second important observation in our data is the reduction of the monolingual and bilingual L1 FE as L1 proficiency rises. This is consistent with multiple findings in the literature. For example Ashby, Rayner and Clifton’s (2005) eye tracking experiment found that underperforming adults show a larger frequency effect especially for low frequency words. Also, Kuperman and Van Dyke (2011) showed that individual language skill scores in rapid automatized naming and word identification modulated frequency effects for fixation times. Participants scoring high on language skill showed a smaller frequency effect. Diependaele et al. (2013) showed that for both monolinguals and bilinguals, the rise of target language proficiency makes the size of the FE of word identification smaller. Kuperman and Van Dyke (2013) observed that the relative amount of exposure to high corpus based frequency words will be virtually identical for individuals with different language experiences, whereas the low corpus frequency words will yield a larger difference in exposure, i.e., lexical entrenchment, for different groups.
In short, a higher L1 proficiency score reflects the size of the lexicon and the exposure to the items in that lexicon. Our results show, consistent with ideas formulated by Diependaele et al. (2013), that target language proficiency explains the size of the FE in both monolingual and bilingual groups, and that the relationship between proficiency and FE is exactly the same for these two groups. This implies that we do not need qualitatively different lexical processing mechanisms to explain the size of L1 FEs for monolinguals and unbalanced bilinguals.
When we look at the mechanisms behind this modulation of the FE, we can draw conclusions about the location on the word frequency range this effect takes place. As we see a modulation of the FE by L1 proficiency even when word frequency is log transformed, this means that L1 proficiency does not measure absolute L1 exposure but is more sensitive to the L1 exposure for low frequency L1 items.
Bilingual L1 versus bilingual L2 FE
Bilinguals show a larger effect of frequency in the processing of L2 text than in the processing of L1 text. This finding is compatible with findings of Duyck et al. (2008) and Whitford and Titone (2011), who also found larger L2 FEs for unbalanced bilinguals for sentence reading and paragraph reading, respectively.
This finding is compatible with accounts of word recognition that implement implicit learning. In unbalanced bilingual populations, L2 words are learned later than L1 words and they have received on average less exposure than L1 words, thus making the threshold for activation for L2 items lower or the representations of these L2 words less accurate. Because we used corpus word frequencies in our analyses, the actual word exposure is overestimated for L2 reading compared to L1 reading. Kuperman and Van Dyke showed that this is especially the case for words with a low corpus frequency. This results in a larger FE in L2 mainly driven by a disproportional slower processing of low frequency words (see Fig. 3).
In both L1 and L2 a larger L1 proficiency reduces the slope of the FE. The effect of L1 proficiency on L1 reading is explained extensively in the above section: The processing time becomes disproportionally faster for low frequency than for high frequency words as exposure rises, causing a smaller FE.
The effect of L1 proficiency on L2 reading is much more surprising. Apparently, increased vocabulary size in the mother tongue facilitates access to low frequency words in a second language. To accommodate this finding, we have to assume that the L1 vocabulary size is measuring something more than exposure to the mother tongue. It is reasonable to assume that the amount of L1 exposure should be approximately the same for subjects with similar socioeconomic status, education, and age. Given that we do find different L1 proficiency scores, we are probably picking up on a more abstract reading skill or general language aptitude by measuring L1 vocabulary size. This assumption makes it more understandable that L1 proficiency modulates the FE in L2 reading in much the same way as it does in L1 reading. This line of reasoning is compatible with the idea proposed by Perfetti et al. (2005) that there is some individual variable that determines the speed of learning connections between word forms and meaning. We seem to capture this variable with our measure of L1 proficiency.
Diependaele et al. (2013) showed that proficiency explained the difference in FE across groups. In our data proficiency modulated the FE, but it did not eliminate the interaction between frequency and group. This means that the size of the FE was not totally explained by proficiency score. This is not that surprising, given that eye-movement measures are more complex than identification times. Also, Whitford and Titone’s (2011) results are in line with ours, seeing that they still found differences across groups after proficiency was added to their model.
In our data L2 proficiency did not have an effect on the size of the FE, neither in L1 reading nor in L2 reading. Higher L2 proficiency scores did however reduce L2 reading speed, which validates the measure. For reading in L1, a rise in L2 proficiency made the single fixation durations longer. High L2 proficiency does seem to reduce reading speed in L1, congruent with the idea of weaker links. These are the only effects of L2 proficiency we find in our reading data. It seems that while L1 proficiency has a disproportional impact on low frequency words in both languages, L2 proficiency has an equally large impact on low and high frequency words, but an opposite effect in both languages. Our results thus show that, despite the high correlation between the two, L1 and L2 proficiency are distinct concepts. L1 vocabulary size seems to be a measure for a general language aptitude, while L2 vocabulary size might be more linked to actual L2 exposure.
Although we tested similar populations (unbalanced bilinguals2) in a similar task (natural reading), Whitford and Titone (2011) found that more L2 exposure was linked to a larger L1 FE, but to a smaller L2 FE. So in their data L1 and L2 FEs are a function of L2 exposure, while our data shows that L1 and L2 FEs are a function of L1 proficiency. An important factor to take into account when trying to reconcile our data with those of Whitford and Titone is that their analysis did not actually include L1 proficiency of the bilinguals. Given that L1 and L2 proficiency are highly correlated, it is plausible that removing one of the factors from the analysis will have an impact on the significance of the other. Another factor is that they use a subjective estimate of L2 exposure in their analysis, while we use an objective vocabulary score to approximate language exposure. When we enter the subjective L2 exposure ratings in our analysis without L1 proficiency, we see that subjective L2 exposure does have an effect on the slope of the L1 and L2 FE, just as in Whitford and Titone’s study. A higher subjective exposure to L2 reduces the slope of the FE in L1 and L2. Again, a lower exposure inflates the FE. So, the fact that L2 exposure influences the size of the FE is compatible with Whitford and Titone’s results. What is not compatible is that we do not find a differential effect of this subjective L2 exposure on L1 and L2 reading. In our data, the effect of L2 exposure is the same in L1 and L2 reading, with smaller FEs for both languages.
Another possible reason for these different findings is that Whitford and Titone (2011) use gaze durations and total reading time as dependent variables. As already explained, we prefer single fixation durations due to the complexity of eye-movement variables. In their appendix they do report analyses of first fixation duration and skipping rates, but not single fixation durations. Their results for first fixation durations patterned with their results for gaze durations.
Our results are compatible with the assumption that the interaction between language proficiency and word frequency reported across a number of studies is caused by the use of corpus-based word frequencies. Kuperman and Van Dyke (2013) show that in eye-movement data the interaction between proficiency and frequency disappears when the objective corpus frequencies are replaced in the analysis by subjective frequencies, acquired by familiarity ratings. These subjective frequencies are supposed to be a closer approximation of the exact number of times a person has been exposed to a word form. In future studies, we recommend the use of more accurate estimates of actual word frequencies of bilingual populations to study the bilingual and monolingual FE.
A possible criticism tof our comparison of English and Dutch text is that the larger FEs for L2 compared to L1 reading could be explained by inherent language differences between English and Dutch, not controlled for in the experimental design. Given that the monolingual (English) – L1 Bilingual (Dutch) comparison did not yield any significant differences across groups, the differences we did find across languages in L1 (Dutch) and L2 (English) are very unlikely to be due to inherent language characteristics. Also the two most important lexical variables, word length and word frequency, were included in all of the higher order interactions in each model. This ensures that the reported effects are not due to any differences between the English and Dutch texts regarding word frequency or word length.
Even so, it could be pointed out that although the Dutch language is very closely related to English, English has a deeper orthography than Dutch (Aro & Wimmer, 2003). This means that the mapping from orthography to phonology is less transparent for English than for Dutch. This deeper orthography could, according to the orthographic depth hypothesis (Katz & Feldman, 1983), lead to more reliance on the orthographic route of visual word recognition, leading to more coarse-grained language processing. In this view, one could assume that this larger reliance on lexical representations for deep orthographies could cause larger word frequency effects on lexical access in those languages. This orthographic depth hypothesis is not without challenge (e.g., Besner & Hildebrandt, 1987; Lukatela & Turvey, 1999; Seidenberg, 1985, 1992; Tabossi & Laghi, 1992). For example Besner and Hildebrandt (Besner and Hilderbrandt 1987) compared naming in two Japanese syllabic orthographies and show that Japanese readers always use the orthographic route, regardless of the orthographic depth of the script they are reading. Second, looking at data supporting the orthographic depth hypotheses, no crosslingual comparison has found a modulation of the size of the frequency-effect by the orthographic depth of a language (Frost, Katz & Benin, 1987; Seidenberg & Vidanovic, 1985) and, to our knowledge, no study has found effects of orthographic depth on eye movements. As far as we know, the only evidence for a modulation of the frequency effect by depth of orthography comes from a study by Frost (1994). He compared naming of words in two scripts of Hebrew; an unpointed (deep) and a pointed (shallow) variant. He found a frequency effect for unpointed Hebrew words and no frequency effect for pointed Hebrew words. The absence of any frequency effect in the pointed script is probably caused by (a) the very transparent nature of the script and the task used, which makes it sufficient to use strict grapheme to phoneme conversion rules without activating the correct lexical representation and/or (b) the low frequent use of this particular script. Neither of these factors are applicable to reading Dutch. According to the same orthographic depth hypothesis, language learners rely more on phonology than adult-skilled readers, regardless of language (e.g., Katz & Feldman, 1983). This means that L2 reading of English should rely less on the orthographic route than L1 reading. So this hypothesis would actually predict a smaller frequency effect for L2 readers of English compared to L1 readers of English or Dutch, the opposite of what we observed.
A systematic exploration of the bilingual and monolingual FE in text reading showed that the FE is modulated by L1 proficiency, both for monolinguals and for bilinguals in L1 and L2.
The size of the FE was comparable for bilinguals and monolinguals when both groups read in their mother tongue. Bilinguals displayed no disadvantages in any of the L1 proficiency (see Appendix B) or any of the L1 reading measures under investigation (see Results and supplementary materials) compared to monolinguals. A higher score on L1 proficiency reduced the size of the FE equally for both groups. The size of the FE was larger for bilinguals reading in L2 compared to bilinguals reading in L1. Bilinguals showed clear proficiency (see Appendix B) and reading disadvantages (see Results and supplementary materials) in L2 compared to L1. The size of the FE was reduced for participants with higher scores on L1 proficiency, both for L1 and L2 reading. Whereas objective L2 proficiency had no effect on the slope of the FE, neither in L1 reading nor in L2 reading, a subjective rating of L2 exposure did modulate the size of the FE. A higher subjective exposure to L2 reduces the slope of the FE in L1 and L2. Because of the log transformation of the word frequency measure, we can attribute the modulation of the frequency effect to a disproportionately lower exposure to words with a low corpus frequency in L2 compared to L1.
These results are easily reconcilable with the weaker links account and (a) provide evidence for the assumption that the same qualitative relationship between exposure frequency and word recognition exists for all language users and (b) clarify that it is not a lowering of exposure to all items in the lexicon, but a disproportional lowering of the exposure to words with a low corpus word frequency that inflates the FE.
All four methods measuring L1 proficiency (LexTALE, lexical decision task, spelling test, and the proficiency questionnaire) do not yield different scores for the two groups (see Table B.1 in Appendix B for a summary of the objective measures). This makes it highly unlikely that we fail to pick up on existing language proficiency differences between our two groups.
Note that the languages of the tested populations were different. In our study Dutch-English bilinguals were tested, in Whitford and Titone’s (2011) study English-French bilinguals were tested.
This research was supported by a grant from the FWO (Fonds voor Wetenschappelijk Onderzoek).
- Aro, M., & Wimmer, H. (2003). Learning to read: English in comparison to six more regular orthographies. Applied Psycholinguistics, 24, 621–635.Google Scholar
- Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278.Google Scholar
- Besner, D., & Hilderbrandt, N. (1987). Orthographic and phonological codes in the oral reading of Japanese kana. Journal of Experimental Psychology: Learning, Memory, and Cognition, 13, 335–343.Google Scholar
- Christie, A. The Mysterious Affair at Styles. N.p.: John Lane, 1920. Project Gutenberg. 1 Mar. 1997. Web. 07 Nov. 2012. <http://www.gutenberg.org/>.
- Cop, U., Drieghe, D., & Duyck, W. (2014). Eye Movement Patterns in Natural Reading: a Comparison of Monolingual and Bilingual Reading of a Novel. Manuscript submitted for publication.Google Scholar
- Cover, T., & Thomas, J. (1991). Elements of information theory. New York: Wiley.Google Scholar
- De Pessemier, P., & Andries, C. (2009). GL&SCHR. Leuven/Apeldoorn: Garant.Google Scholar
- Dijkstra, T., & Van Heuven, W. J. B. (2002). The architecture of the bilingual word recognition system: From identification to decision. Bilingualism: Language and Cognition, 5(3), 175–197.Google Scholar
- Lemhöfer, K., & Broersma, M. (2011, advance online publication). Introducing LexTALE: A quick and valid Lexical Test for Advanced Learners of English. Behavior Research Methods. doi:10.3758/s13428-011-0146-0
- Lemhöfer, K., Dijkstra, T., Schriefers, H., Baayen, R. H., Grainger, J., & Zwitserlood, P. (2008). Native language influences on word recognition in a second language: A mega-study. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(1), 12–31.Google Scholar
- Monsell, S. (1991). The nature and locus of word frequency effects in reading. In D. Besner & G. W. Humphreys (Eds.), Basic Process in reading: Visual word recognition (pp. 148–197). Hillsdale, NJ: Erlbaum.Google Scholar
- Perfetti, C. A. (1992). The representation problem in reading acquisition. In P. B. Gough, L. C. Ehri, & R. Treiman (Eds.), Reading acquisition (pp. 145–174). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
- Rayner, K., Sereno, S. C., Morris, R. K., Schmauder, A. R., & Clifton, C. (1989). Eye movements and on-line language comprehension processes. Language and Cognitive Processes, 4(special issue), 21–49.Google Scholar
- Seidenberg, M.S., & Vidanovic, S. (1985). Word Recognition in Serbo-Croatian and English: Do they differ? Paper presented at the XXVI Annual Meeting of the Psychonomic Society, Boston.Google Scholar
- Wilkinson, G. S., & Robertson, G. (2006). Wide Range Achievement Test 4 professional manual. Lutz, FL: Psychological Assessment Resources.Google Scholar