Introduction

The twenty-first century has seen an increasing reliance on obtaining information via the audio-visual channel (Rideout, Foehr, & Roberts, 2010). This means that relatively speaking, book reading is declining among children and adolescents (Mangen, 2016; OECD, 2010), whereas consumption of audio(visual) information through, for example, TV and computer, is increasing (Rideout et al., 2010). At the same time, reading comprehension is an essential subject in primary education. It is known as an important predictor of children’s school career and lifelong learning (Spörer & Brunstein, 2009). Children’s reading comprehension skill levels are monitored through all years of primary education, and, if deemed necessary, additional coursework or interventions are provided. In contrast, listening comprehension has received much less attention in the educational system (Mommers, 2007), despite studies showing that there are specific listening comprehension problems, for example in children diagnosed with ADHD (McInnes, Humphries, Hogg-Johnson, & Tannock, 2003) or second-language learners (Bingol, Celik, Yildiz, & Mart, 2014; Goh, 2000). Given the increasing importance of listening comprehension in daily life, the status of listening comprehension in education might need to be reconsidered and insight into the development of the skill is needed. The question arises whether listening and reading comprehension are, conform to how they are treated in the educational practice, the same general comprehension skill albeit with information provided in different modalities, or whether they are different processes with different underlying modality-specific skills. In other words, the relationship between reading and listening comprehension should be examined.

Theories of comprehension generally do not elaborately address the relationship between comprehension types in which the input is provided in different modalities (for a review see McNamara & Magliano, 2009). Kintsch and Van Dijk (1978) proposed the situation model of comprehension. According to this framework, comprehension entails the construction of a situation model, i.e., a mental representation of the situation conveyed by the words of a text. This highly influential comprehension model mentions that comprehension types will differ in some aspects, without specifying these differences. Nevertheless, Kintsch and Van Dijk (1978) did recognize that the input modality might affect the comprehension process in which a situation model is built. Gernsbacher, Varner, and Faust (1990)’s structure-building model is built upon Kintsch and Van Dijk (1978)’s situation model. Gernsbacher et al. (1990)’s model describes the influence of the input modality on comprehension: the modality of the initial information does not influence the creation of the situation model. Instead, Gernsbacher et al. (1990) propose “a general comprehension skill that transcends modality”. In other words, comprehension is seen as a domain-general skill that is not tied to the modality of the input. As such, reading and listening comprehension are two versions of the same comprehension skill.

A complication of general comprehension theories is that they are confounded due to practical and methodological issues. A measure of comprehension must always be administered in a specific modality. If an effect of general comprehension is then found, with general comprehension having been measured in the auditory modality, to what extent does this effect then describe general comprehension if not listening comprehension? A striking example of the confounding effect of not taking into account the input modality in a comprehension theory can be found in the simple view of reading (Hoover & Gough, 1990). It is theorized that reading comprehension is the product of word decoding skills (measured as word reading fluency or word reading accuracy) and linguistic comprehension, which is general comprehension of language-related information. In practice, however, linguistic comprehension is most often measured as listening comprehension (LARRC, 2017). As a consequence, conclusions based on this framework concerning relationship between linguistic comprehension and reading comprehension and decoding only apply to listening comprehension, and not to a general linguistic comprehension process. The influence of modality-specific aspects of listening comprehension are thus not considered within the simple view of reading framework. These confounds in comprehension theories might have resulted in the neglect of modality-specific effects in research on comprehension, as well as the neglect of listening comprehension within education.

Some studies have examined the relationship between reading and listening comprehension directly, and not unintentionally by using listening comprehension as a measure of general linguistic comprehension. Listening comprehension and reading comprehension are highly related (Cain, Oakhill & Bryant 2000; Diakidoy, Stylianou, Karefillidou, & Papageorgiou, 2005; Protopapas, Simos, Sideridis, & Mouzaki, 2012; Tilstra, McMaster, Van Den Broek, Kendeou, & Rapp, 2009). Specifically, in opaque languages such as English the influence of listening comprehension as a measure of linguistic comprehension on reading comprehension increases over time, whereas the predictive strength of word reading fluency on reading comprehension decreases (Catts, Adlof, Hogan, & Weismer, 2005; Diakidoy et al., 2005; Vellutino, Tunmer, Jaccard, & Chen, 2007; Verhoeven & van Leeuwe, 2008). For transparent languages, such as Dutch, even for beginning readers listening comprehension is a stronger predictor of reading comprehension than decoding, because decoding is already acquired at a younger age (Florit & Cain, 2011).

The relation between reading and listening comprehension can vary due to the demands of different task formats and types of texts that have to be comprehended (Diakidoy et al., 2005). Diakidoy et al. (2005) reported a correlation between the two comprehension types of r = .63 when using a comprehension test with exactly the same format for both reading and listening. This correlation was twice as high compared to a study that used very different test formats, for example, a cloze test and a question-and-answer task (r = .29) (Ouellette & Beers, 2010). Although these differences are substantial, Muijselaar et al. (2017) suggest that the relationship between reading and listening comprehension may be confounded due to task-specific demands only when the format of comprehensions tests differ to a large extent. These large format differences include for example whether a test is timed or not, whether longer paragraphs are used or short paragraphs of one or two sentences or whether only one text and question type is used or multiple different text and question types. Therefore, it is important to use reading and listening comprehension tests with the same format when exploring the relationship between the two comprehension types. The few studies that used the same task format to investigate the relationship between reading and listening comprehension found that the two comprehension types correlate highly, but not perfectly (Diakidoy et al., 2005; Vellutino et al., 2007), indicating that reading and listening comprehension might overlap to some extent, but are not entirely the same. Some aspects of the reading comprehension and listening comprehension processes might entail an overlapping general comprehension process, but other aspects might be distinctive modality-specific processes.

To understand which parts of the comprehension process are general and which parts are modality-specific, it might be fruitful to investigate the foundational skills of reading and listening comprehension. Some foundational skills could be necessary to create a situation model, regardless of the modality in which the information is presented. However, each comprehension type might also rely on several modality-specific skills that help processing information presented in a specific modality. To illustrate, the foundational skill word reading fluency might be vital for reading comprehension, but not for listening comprehension. Similarly, because listeners cannot ‘relisten’ a passage whereas readers are able to reread a paragraph, attentional and memory skills might be of more importance for listening comprehension than to reading comprehension. As of yet, no studies have investigated shared, domain-general and unique, modality-specific underlying skills of reading and listening comprehension in tandem. Moreover, studies on the underlying skills of reading or listening comprehension have often assessed a combination of foundational skills (skills that form building blocks for more complex abilities, such as memory, attention, vocabulary) and higher-level skills (inference making, comprehension monitoring) as predictors. Because higher-level skills could obscure effects of the foundational skills, a study into the foundational skills contributing to spoken and written comprehension is necessary.

For reading comprehension, it has been shown that word reading fluency and listening comprehension are important predictors (Hoover & Gough, 1990). In addition, vocabulary has been found to be a contributor to reading comprehension (Cromley & Azevedo, 2007; Swart et al., 2017). The relation between vocabulary and reading comprehension is especially strong in poor comprehenders. Their comprehension might depend more on basic vocabulary knowledge compared to those with good comprehension abilities, who already have a more extensive vocabulary (Van den Bosch, Segers, & Verhoeven, 2018). Studies that are framed according to the simple view of reading sometimes take vocabulary as a proxy for linguistic comprehension (Muijselaar & De Jong, 2015) instead of the more standard proxy listening comprehension (LARRC, 2017). This suggests that vocabulary and listening comprehension are equally good measures of the general linguistic comprehension construct in the simple view of reading. Two different patterns of findings have been reported: an additional contribution of vocabulary to reading comprehension after controlling for listening comprehension (Foorman, Herrera, Petscher, Mitchell, & Truckenmiller, 2015; Protopapas et al., 2012; Tunmer & Chapman, 2012) or not (De Jong & Van der Leij, 2002). The results of these studies thus question whether measures for vocabulary and listening comprehension can be used interchangeably to operationalize general linguistic comprehension. Therefore, in this study, the role of vocabulary and listening comprehension as contributors to reading comprehension is also examined.

Other foundational skills that have been related to reading comprehension are memory processes, such as short-term memory, working memory and updating. It seems that especially working memory of verbal information contributes to reading comprehension (Carretti, Borella, Cornoldi, & De Beni, 2009; Daneman & Merikle, 1996; Van den Bosch et al., 2018). Especially in good comprehenders working memory seems to be a strong contributor (Van den Bosch et al., 2018). Mixed findings have been reported for attention: whereas Cutting and Scarborough (2006) did not find a contribution of attention as rated by parents, Cain and Bignell (2014) found that children with attention difficulties as rated by teachers performed more poorly on reading comprehension. Based on previous studies, it can be concluded that the effects of memory and attention measures on reading comprehension are not consistent. Moreover, there are no studies that simultaneously assess the contribution of word reading fluency and vocabulary, as well as the contribution of memory and attentional processes to reading comprehension.

With respect to listening comprehension, vocabulary is known to be one of the most important predictors (Cain & Oakhill, 2014; Florit, Roch, & Levorato, 2011; Hagtvet, 2003; Tompkins, Guo, & Justice, 2013). Findings on the role of verbal short-term memory and verbal working memory have either shown that verbal working memory contributes to listening comprehension outcome (Florit, Roch, Altoè, & Levorato, 2009; Potocki, Ecalle, & Magnan, 2013; Tighe, Spencer, & Schatschneider, 2015), or show no clear-cut contribution (Alonzo, Yeomans-Maldonado, Murphy, & Bevens, 2016; Kim, 2016). Effects of verbal memory seem to decline when children get older (Chrysochoou & Bablekou, 2011; Tighe et al., 2015). Furthermore, Currie and Cain (2015) found that effects of verbal short-term and verbal working memory on listening comprehension were fully mediated by vocabulary. Concerning short-term memory, some studies have reported an effect on listening comprehension after controlling for vocabulary (Florit et al., 2009), whereas others found no effects of short-term memory on reading comprehension at all (Potocki et al., 2013). Additionally, visual memory may be important for listening comprehension if the task not only requires listening, but also provides information through the visual modality (such as television comprehension as in Kendeou, Bohn-Gettler, White, and Van Den Broek (2008)).

Only a few studies have examined the effects of attentional processes or inhibition on listening comprehension. Kim (2016) reported no effect of attention on listening comprehension after several foundational and higher order skills were taken into account. Inhibition, however, was found to be a direct predictor of listening comprehension (Kim & Phillips, 2014). Attention-related measures might have a stronger effect on listening comprehension than on reading comprehension, due to the fleeting nature of the presentation of the information and the fact that comprehenders cannot control the pace of information themselves.

To sum up, the relationship between reading and listening comprehension is not yet fully understood. In this study, the relationship between reading and listening comprehension is explored to investigate whether it is justifiable to view reading and listening comprehension as one general comprehension skill without any modality-specific aspects, as has been done in theory and educational practice. Firstly, the overlap between the two comprehension types is examined to understand how general or modality-specific the reading and listening comprehension processes are. For this aim the explained variance of one comprehension type in the other will be analyzed. Furthermore, shared and unique cognitive contributors of reading and listening comprehension are sought to understand which parts of the comprehension process are domain-general and modality-specific. As such, the contributions of several foundational skills (word reading fluency, vocabulary, verbal short term memory, verbal working memory, visual memory, sustained aural attention, and inhibition) are analyzed. Lastly, the practice within the framework of the simple view of reading of using either listening comprehension or vocabulary as a proxy for general linguistic comprehension is studied. For this reason, it will be analyzed whether listening comprehension and vocabulary contribute uniquely to reading comprehension.

To ensure that the relationship between reading and listening comprehension is not affected by task-specific effects of the different task formats, reading comprehension and listening comprehension tasks with the same testing format are used. Moreover, an ecologically valid audio-visual rather than pure audio listening comprehension task is used. Listening comprehension in audio-only listening comprehension tasks, as used in previous studies, is not entirely similar to listening comprehension in daily life, in which not only audio but also visual information as well is involved. There is evidence that memory and the construction of a situation model are superior for audio-visual compared to audio-only material (Gibbons, Anderson, Smith, Field, & Fischer, 1986; Wannagat, Waizenegger, Hauf, & Nieding, 2018). Therefore, the present study uses reading and listening comprehension tasks with the same task formats and that are presented in ecologically valid modalities (in this case, the written versus audio-visual rather than audio-only modality).

It is hypothesized that a strong relationship between reading comprehension and listening comprehension is found in our sample, since the relationship seems to be strong in even beginning readers of a transparent language. We expect the overlap to be substantial: that reading comprehension explains a considerable amount of variance in listening comprehension and vice versa, since the comprehension process in which the situation model is created, is theoretically viewed as a general process, with little modality-specific effects. Full overlap is not expected, because it is thought that some aspects of the modality of the input will affect the comprehension process. Regarding reading comprehension, it is expected that especially word reading fluency, vocabulary and memory skills (verbal short-term memory, verbal working memory, and visual memory) will contribute. For listening comprehension, it is hypothesized that vocabulary, memory skills (verbal short-term memory, verbal working memory, and visual memory) and attentional skills are important contributors, but not word reading fluency. Concerning the relationship between vocabulary and listening comprehension, and reading comprehension, it is expected that these skills both contribute uniquely to reading comprehension, which would mean that they should not solely be used as a proxy of general linguistic comprehension.

Methods

Participants

In total 85 children with a mean age of 8;7 years (SD = 8 months) participated (52 girls), including 35 second graders (age: M = 8 years, SD = 6 months; 25 girls) and 50 third graders (age: M = 8;11 years, SD = 6 months; 27 girls). Dutch was the preferred language of 86% of the children. Three children were diagnosed with dyslexia and sixteen children had followed speech therapy.

Material

Reading comprehension

Reading comprehension was measured with a standardized reading comprehension task (Cito, 2009, 2014) from the LOVS test battery (Leerling-en OnderwijsVolgSysteem [System for the Longitudinal Assessment of School Achievement]) which consists of several standardized tests for first to sixth graders and is regularly used in Dutch education. The test has two parts, each lasting for 40–50 minutes and containing five to nine texts and 20–30 multiple-choice questions. Children were asked to read age-appropriate narrative and expository texts and answer corresponding multiple-choice questions. Two types of questions were present: literal questions, which questioned information literally stated in the texts, and inferential questions requiring children to combine information explicitly stated in the text with information not stated explicitly in the text. The questions had a four-option or true/false multiple-choice format. For the analyses, raw scores were converted to skill scores. In the year the present study was carried out, Cito introduced new skill score scales and formulas in second grade. The second grade skill scores were transformed to the same scale as the third grade skill scores using a formula provided by Cito. The reliability of the task is good (α = .86 in second grade; α = .89 in third grade) (Feenstra, Kamphuis, Kleintjes, & Krom, 2010).

Listening comprehension

Listening comprehension was tested through a standardized listening comprehension task (Cito, 2011) also from the LOVS test battery, which is divided in three separate test sessions. Children were required to listen to and watch selected audio-visual fragments and to answer corresponding multiple-choice questions on an answer sheet. In total, five to six age-appropriate narrative and expository fragments were presented. Children were first shown the whole fragment, after which it was segmented in shorter fragments that lasted about 6 minutes each with the four-choice multiple-choice questions in-between. In total the test consisted of 30–32 multiple-choice questions. These questions were presented aurally and visually (on the screen), but were not shown on the child’s answer sheet. The answer options were presented aurally and visually on the answer sheet, but not on the screen. Similar to the reading comprehension test questions were either literal, enquiring information explicitly said in the audio-visual fragments, or inferential, which required children to combine explicit information provided in the fragments with not explicitly presented information. For the analyses, raw scores were converted to skill scores. The reliability of the test was sufficient (Cronbach’s α is .74 in second grade and .77 in third grade) according to the manual (Cito, 2011).

Word reading fluency

Word reading fluency was measured with the One-Minute-Task (Brus & Voeten, 1973). Children were asked to read aloud as many words as they could in one minute. The task consists of 116 words increasing in difficulty. The final score was calculated by subtracting the number of errors from the number words read. According to the manual, mean parallel-test reliability was high (r = .90 between form A and B) (Van Den Bos, Spelberg, Scheepsma, & De Vries, 1994).

Vocabulary

The Peabody Picture Vocabulary Test (PPVT) III-NL (Dunn, Dunn, & Schlichting, 2005) was used to measure receptive vocabulary. Children were shown four different pictures and were asked to point at the one matching the target word. The PPVT is adaptive to the level vocabulary of the child. Testing and scoring proceeded according to the manual. The final score represents the number of words correctly identified. According to the manual (“PPVT-4 Publication Summary Form,” 2007), test–retest reliability was high (r = .93).

Verbal short-term and verbal working memory

Verbal short-term memory and verbal working memory were measured with the digit span forwards and backwards task from the WISC-III-NL (Wechsler et al., 2002). Digit span forwards taps children’s ability to repeat an increasing string of digits read aloud by the test leader. Testing proceeded according to the manual. The final score was the number of correctly repeated digit strings with a maximum score of 16. In the digit span backwards task, children had to repeat increasing strings of digits in reverse order. Testing proceeded according to the manual. The maximum score is 14. Cronbach’s α for the tasks together is .56 according to the manual (Wechsler et al., 2002).

Visual memory

The Benton Visual Retention Test (Sivan, 1992) was used to measure visual memory. Children were presented with a sheet with a 2D geometrical drawing for 10 seconds. They were asked to reproduce the drawing from memory with pencil and paper. Drawings were presented in ascending order of difficulty. The final score was the number of correct responses minus the number of errors. Inter-rater reliability is high (r = .95 to .97 according to the manual (Sivan, 1992)).

Sustained aural attention

A subtest of the NEPSY-II-NL (Zijlstra, Kingma, Swaab, & Brouwer, 2010) was used to measure sustained aural attention. In this task, children received a sheet with a red, blue, yellow and black circle and listened to a recording of a string of 180 Dutch words. The words consisted of 30 target words “rood” (red), 34 distraction words (the other colour names: “blauw” (blue), “geel” (yellow) and “zwart” (black)) and filler words (common Dutch mono- and bisyllabic words). The words were presented with a speed of one word per 2 seconds. There was a pause of 2 seconds between each word. Upon hearing the target word “rood” (red), children were required to point at the red circle on the sheet with coloured circles. Scoring proceeded according to the manual. An error was marked when a child did not respond to a target word within 2 seconds, or responded to a distraction or filler word. The final score was the number of errors subtracted from number of correct responses, with a maximum score of 30. Test–retest reliability is r = .42 for children aged 7–8 and r = .62 for children aged 9–10 (Brooks, Sherman, & Strauss, 2009). According to the manual, test–retest reliability is .65 (Korkman, Kirk, & Kemp, 2007), and construct validity seems to be low (Egberink & Vermeulen, 2009-2018).

Inhibition

Inhibition was measured using the Stroop task (Golden & Freshwater, 1978). For the first sheet, children had to read 100 written colour names as quickly as possible. For the second sheet, with 100 coloured rectangles, children were asked to name the colours as quickly as possible. For the third sheet, containing 100 colour names printed in a non-corresponding colour, children had to name the colours as quickly as possible, thus avoid reading the words. The final score was the time in seconds needed to read the second sheet subtracted from the time needed for the third sheet. Test–retest reliability is r = .67 (Franzen, Tishelman, Sharp, & Friedman, 1987).

Procedure

The tests, except for the reading comprehension task, were part of a larger test battery administered in April and May by five trained test assistants. The reading comprehension test was already administered by the school in February as part of the normal curriculum. The reading comprehension tests consist of two parts, each lasting for 40–50 minutes. The other tests were administered in four 45-minutes lasting testing sessions. Three in-class testing sessions included a part of the listening comprehension test. Each of the three listening comprehension parts had a duration of 30 minutes. The foundational skill tasks were administered in an individual test session. In a fixed order, the tasks for memory, sustained aural attention, inhibition, vocabulary and visual memory were administered. This session took approximately 40 minutes.

Results

Data screening and descriptive statistics

There were no missing data. Five outlier scores were recoded to deviate exactly three standard deviations from the mean. Descriptive statistics of the outcome measures are presented in Table 1. The data was normally distributed, as skewness and kurtosis were below ± 3 and ± 10 respectively (Kline, 2011). Correlations among all variables are displayed in Table 2. Reading comprehension and listening comprehension were highly correlated. Word reading fluency was highly correlated with reading comprehension and moderately with listening comprehension. The relations of vocabulary with reading and listening comprehension were respectively moderate to high. For all other variables, correlations with comprehension were low to moderate.

Table 1 Descriptive statistics of the outcome variables and predictors
Table 2 Correlations among outcome variables and predictors

Regression analyses

To examine the relationship between reading and listening comprehension, the overlap between the two was analyzed to find out whether comprehension is a general skill, or has modality-specific aspects (Table 3). In the regression analyses, grade was first entered as a control variable. Next, the opposite comprehension type was added as a contributor. Both comprehension types contributed significantly to the model. For reading comprehension, listening comprehension explained 40% of the variance. Listening comprehension was a significant contributor to reading comprehension (β = .70). For reading comprehension, the final model explained 41% of the variance. Regarding listening comprehension, reading comprehension explained 34% of the variance in listening comprehension and reading comprehension contributed significantly to listening comprehension (β = .58). The final model explained 51% of the variance in listening comprehension.

Table 3 Explained variance of the opposite comprehension type controlling for grade

The relationship between reading and listening comprehension was furthermore explored by examining the unique (modality-specific) and shared (general) foundational contributors (word reading fluency, vocabulary, verbal short-term memory, verbal working memory, visual memory, sustained aural attention and inhibition) to both comprehension types (Table 4). Again, grade was entered as a first step. Then, all foundational skills were added simultaneously. In the hierarchical model for reading comprehension, word reading fluency (β = .56) and vocabulary (β = .48) were significant contributors. Of the variance in reading comprehension, 61% was explained. Regarding listening comprehension, again word reading fluency as a significant contributor (β = .25), as well as vocabulary (β = .50). This model explained 49% of the variance in listening comprehension. None of the other foundational skills contributed significantly to reading nor to listening comprehension.

Table 4 Contributions of foundational skills to reading comprehension and listening comprehension after controlling for grade

Lastly the practice within the framework of the simple view of reading of using either listening comprehension or vocabulary as a proxy for general linguistic comprehension was examined by analyzing the unique contributions of word reading fluency, and especially listening comprehension and vocabulary (Table 5). First grade was entered in the model. Next, word reading fluency, listening comprehension and vocabulary were added simultaneously. Word reading was found to be a significant contributor (β = .49). More importantly, both listening comprehension (β = .37) and vocabulary (β = .27) were unique contributors to reading comprehension. The model explained 63% of the variance in reading comprehension.

Table 5 Contributions of skills determined by the simple view of reading to reading comprehension after controlling for grade

Discussion

The present study was aimed at understanding the relationship between reading and listening comprehension to investigate whether comprehension is a general skill or whether it has modality-specific aspects. In both theory and the educational practice, comprehension is treated as a general process with little room for modality-specific effects. To evaluate this assumption, three questions were addressed. Firstly, the overlap between the two comprehension types in terms of explained variance of one type in the other was investigated, to understand whether comprehension in these two modalities overlaps and thus is a general skill, or whether they are partly distinct comprehension skills. Secondly, shared and unique foundational cognitive contributors (word reading fluency, vocabulary, verbal short-term memory, verbal working memory, visual memory, sustained aural attention, and inhibition) of reading and listening comprehension were explored to assess which subskills and sub processes of comprehension are in fact general or modality-specific. Thirdly, since it is common practice in studies that use the simple view of reading framework to operationalize general linguistic comprehension with either a listening comprehension task or a vocabulary task, it was studied whether these two skills contribute uniquely to reading comprehension.

About 34 and 40% of the variance in either comprehension type was explained by the other comprehension type. These results imply that the situation model built through comprehension of written and spoken material partly taps a general comprehension process. Moreover, both vocabulary and word reading fluency were found to be shared subskills of both reading and listening comprehension. Thus, during this general comprehension process, the foundational subskill vocabulary seems essential. This might be due to the fact that vocabulary is a key skill for constructing and possessing background knowledge, as well as for inference making. These are components that are required for constructing the situation model: comprehenders need to integrate pieces of information in the text with each other and with their background knowledge (Kintsch & Rawson, 2005) in a coherent and cohesive manner (Van den Broek, Risden, & Husebye-Hartmann, 1995). Having a vast semantic network helps in using interrelations between different concepts while inferring the meaning of words or the relation between words in a text (Cain & Oakhill, 2014; Perfetti, Yang, & Schmalhofer, 2008). It seems that the part of the reading and listening comprehension process in which integration takes place and inferences are made through the activation of the vocabulary, is a general comprehension process that transcends modalities.

However, this study also shows that the majority of the variance in a comprehension type cannot be explained by the opposite comprehension type. This part of the reading and listening comprehension process is modality-specific and cannot be subsumed under a general comprehension skill. The findings of this study could not pinpoint as to which processes might be modality-specific, since none of the foundational skills contributed uniquely to either reading or listening comprehension. Correlations revealed indications of an important modality-specific subskill for listening comprehension, as attention measures only correlated significantly with listening comprehension. Due to the fleeting nature of auditory information, attention might be an important subskill of listening comprehension to keep up with the pace of the speaker and process all information conveyed (Kim & Phillips, 2014).

Unexpectedly, word reading fluency was found to contribute not only to reading comprehension, but also to listening comprehension. Word reading fluency was a likely candidate for a modality-specific subskill of reading comprehension on the basis of the simple view of reading (Hoover & Gough, 1990). Instead, it was found to be a shared contributor to both reading and listening comprehension. The listening comprehension task used in the present study also contained (limited) written information, allowing for strategic reading of the questions and the answers. The information from which the children had to infer the answers was, however, not presented orthographically. Thus, word reading fluency can be seen as a general comprehension skill only whilst comprehending the questions and answers in our task, but not whilst comprehending the information from which the answers had to be derived. Therefore, the finding that word reading fluency is a shared contributor to both reading and listening comprehension will probably not generalize to studies that use pure listening comprehension tasks.

Together, the results of the present study indicate that part of the reading and listening comprehension process taps a general comprehension skill that operates regardless of modality. Vocabulary might aid in understanding the relations between words and clauses, improving integration of the text and aiding in situation model construction. Importantly, conflicting with the status of modality-specific aspects of comprehension in some comprehension theories (Gernsbacher et al., 1990; Hoover & Gough, 1990) and the educational practice, in this study a distinct part of the reading and listening comprehension process seems to be modality-specific. Similar to Kintsch and Van Dijk (1978) we cannot yet pinpoint the exact modality-specific aspects of reading and listening comprehension, or the subskills that contribute to these specific processes, since in this study none of the foundational skills contributed uniquely to either reading or listening comprehension. This might be due to the contemporary measures of these skills. In the past decade there has been a growing consensus that measures of executive functions (amongst which memory and attention) lack ecological validity (Burgess et al., 2006; Wallisch, Little, Dean, & Dunn, 2017). This means that, for example, a test measuring sustained aural attention does not capture sustained aural attention as it occurs during the comprehension process. Thus, memory and attentional skills might still influence reading and listening comprehension, despite not surfacing as contributors on the basis of the tests used in this study. Furthermore, previous studies did find a contribution of attention to reading comprehension, but only when attention was rated by teachers (Cain & Bignell, 2014). When rated by parents (Cutting & Scarborough, 2006) or measured with a neuropsychological measure, such as in the present study, no such associations are found. One avenue for further research is to use other types of measures in tandem with traditional executive functions tasks to capture executive functions in a more ecologically valid way. For example, teacher ratings of attention might add an extra dimension of information to a child’s attentional skills in the ‘real world’ (Cain & Bignell, 2014; Wallisch et al., 2017). Additionally, physiological indexes can be used as measures to assess even more basic mechanisms related to executive functions (see for instance Scrimin, Patron, Florit, Palomba, & Mason, 2017).

A third approach in studying the relationship between reading and listening comprehension was to examine whether listening comprehension and vocabulary are the same contributors to reading comprehension or whether they contribute separately. Studies into the simple view of reading tend to use either listening comprehension or vocabulary as a proxy of general linguistic comprehension. For example, Protopapas et al. (2012) previously suggested that vocabulary is a better indicator of the print-independent component of reading comprehension than listening comprehension, since vocabulary measures are often more reliable than measures of listening comprehension. Our study, however, showed that it is not the case that the more reliable vocabulary measure explained all variance in reading comprehension, and that listening comprehension explained none of the variance. Vocabulary measures should thus not be used as a sole proxy for general linguistic comprehension. Likewise, because vocabulary also explained additional variance in reading comprehension over listening comprehension, listening comprehension should neither be used as sole operationalization of general linguistic comprehension. This interpretation is also confirmed by studies in the English language with larger samples using structural equation modeling (Foorman et al., 2015; Tunmer & Chapman, 2012) in which measures of vocabulary and listening comprehension loaded separately on a latent construct which could be termed ‘general linguistic comprehension’. The present study implies that this latent structure is also present in more transparent languages, such as Dutch. With this latent structure in mind, the findings of presented study support the simple view of reading (Hoover & Gough, 1990) in that reading ability is predicted by decoding ability (word reading fluency in the present study) and linguistic comprehension (comprising of listening comprehension and vocabulary).

There are at least five limitations to this study. First, the results of this study might be partly task-specific. Muijselaar et al. (2017) found that the relationship between reading and listening comprehension can vary when two tests differ largely (for example, when one test is timed where the other is not). We tried to overcome this by using a reading and listening comprehension test with the same task format that comprised multiple text types and question types, consisted of longer paragraphs and was not timed. Thus, the results of this study are generalizable to situations in which similar comprehension tests are administered. Comparing our results to findings obtained with a comprehension task with a different task format, that for example consists of paragraphs of only one or two sentences, or is timed, must be done with great care. Second, related to the previous limitation, generalizing the findings of the present study in Dutch to studies with children speaking a different native language should be done with caution. Especially in orthographic opaque languages (such as English) children learn to read fluently at a later age than children whose native language has a more transparent orthography (such as Dutch) (Ellis et al., 2004; Florit & Cain, 2011) This could mean that the contribution of reading comprehension to listening comprehension and vice versa could differ in an opaque orthography, as could the contribution of word reading fluency to both comprehension measures. Third, we could only determine concurrent contributors on the basis of these cross-sectional data. A longitudinal and cross-lagged design is needed to allow conclusions about predictors of reading and listening comprehension. A fourth limitation is that our selection of foundational skills was not exhaustive. Future studies should also include grammar, since syntactic knowledge has been found to contribute to both reading comprehension (Goff, Pratt, & Ong, 2005; Hagtvet, 2003; Van den Bosch et al., 2018) as well as listening comprehension (Hagtvet, 2003; Kim, 2016). Furthermore, since the construct of vocabulary has many distinct aspects (Cain & Oakhill, 2014; Swart et al., 2017) such as vocabulary breadth, vocabulary depth and semantic relatedness, it would be worthwhile to investigate whether these different measures of vocabulary contribute differently to reading and listening comprehension. Fifth, the effect of grade in the model with reading comprehension was negative. This negative effect is probably due to suppression: in a model with grade as the only predictor of reading comprehension, the effect of grade was positive. The effects of the other variables did not change drastically when removing grade from the regression models reported in Tables 3 and 4: only inhibition became just significant (from p =.08 to p = .04) but the change in strength was negligible (from β = .14 to β = .17).

Despite these limitation, this study has implications for theory and practice. Theoretically, the results of this study indicate that reading and listening comprehension are not two versions of the same general comprehension skill as proposed by Gernsbacher et al. (1990). Instead, only a part of the reading and listening comprehension process is a general comprehension process, with vocabulary being an important sub skill, whereas other parts of the comprehension process are modality-specific. Thus, in line with Kintsch and Van Dijk (1978), the comprehension process will differ due to modality-specific demands. As for now, however, we cannot yet identify these modality-specific processes and subskills. This notion that acknowledges modality effects in comprehension research, is both important and necessary, since the lack of acknowledgement has led to confoundedness and difficulties in the interpretation of results within the framework of the ‘old’ comprehension theories. One example, being addressed in this study, is that of the simple view of reading, in which general linguistic comprehension has been operationalized as listening comprehension, whilst not taking modality effects into account, or vocabulary, a different construct. Based on the results of this study, neither listening comprehension nor vocabulary should be used as sole proxies of general linguistic comprehension in the simple view of reading, but both measures should be used in tandem to operationalize this construct more adequately.

Practically, the interpretation that reading and listening comprehension have both general aspects as well as modality-specific aspects should be considered in education. A child’s listening comprehension aptitude should be monitored alongside reading compression, and if necessary, specific interventions need to be offered to help the child overcome these specific difficulties. For interventions that tackle modality-specific reading and listening comprehension deficits, more research is needed to pinpoint modality-specific comprehension processes and subskills. If a child faces difficulty with both reading and listening comprehension, a vocabulary training might help it to overcome this difficulty with general comprehension. This study calls for a reconsideration of modality-specific aspects of reading and listening comprehension in both research and the educational practice.