Schools or Pools of Democracy? A Longitudinal Test of the Relation Between Civic Participation and Political Socialization

Abstract

In this contribution we demonstrate how the usage of panel data offers possibilities for testing new hypotheses in a research tradition with a long history in political science. Focusing on citizens’ transitions in and out of voluntary associations, we tested four possible explanations for the well-documented correlation between civic engagement and political socialization. Two are due to self-selection effects (pools of democracy), and two are due to socialization effects (schools of democracy). Our analyses offer little support for the idea of voluntary associations playing a major role in political socialization processes: our latent growth curve models showed no or very little increase of political discussion, interest, efficacy, and action among those who became actively involved in voluntary associations. In contrast, we found convincing evidence for our pools-of-democracy hypotheses, and the self-selection turns out to be a double-edged sword: politically engaged citizens are more likely to join voluntary associations and less likely to leave them. These findings challenge the conclusions of many studies based on cross-sectional data.

Introduction

A longstanding tradition in political science considers voluntary associations schools of democracy, which engage their members in politics. Participation in voluntary associations would introduce citizens to politics on a small scale (Van Deth 1997), where they learn to deal with dissimilar others (Putnam 2000), practice civic and organizational skills (Ayala 2000; Baggetta 2009), and become interested in wider societal and political issues (Halpern 2005). Members obtain the abilities (civic skills and political efficacy) and the urge (civic-mindedness and political interest) that further engagement in politics (Lichterman 2005; Myrberg 2011; Quintelier 2013). The modern ‘neo-Tocquevillian’ interpretation emphasizes that such socializing effects may be expected especially from horizontally-organized leisure organizations like reading groups, choirs, bird watching clubs and bowling teams (Putnam 2000; Baggetta 2009). If associational life functions in the way the schools of democracy theorem argues, voluntary associations would make a fine stepping stone towards citizens’ wider democratic engagement. Supportive of this reasoning is the fact that virtually all of the abovementioned studies have found positive correlations between civic participation and political engagement.

However, there are competing explanations for this correlations. An alternative interpretation of this common finding emphasizes associations’ ability to draw a politically engaged crowd (see e.g., Armingeon 2007). It is “self-evident that not everyone will have the same inclination to join voluntary associations” (Hooghe 2003), and similarly that not everyone will have the same inclination to participate politically. Underlying individual resources (like time, money or skills) or personality traits (pro-sociality, outgoingness or assertiveness) are likely to stimulate citizens to undertake both civic and political activities. “Rather than schools of democracy, this makes voluntary associations pools of democracy” (Van der Meer and Van Ingen 2009: 303): places that draw a politically engaged crowd rather than places where citizens are trained for politics.

We thus have two rivaling theoretical explanations for the empirical relationship between associational involvement and political engagement. Fifty years of empirical research in this field since Almond and Verba (1965) has provided us with a wealth of evidence that indicates that members of voluntary associations are more politically active and interested than non-members (e.g. Putnam 1993; Verba et al. 1995; Pattie et al. 2004; McFarland and Thomas 2006). However, these cross-sectional findings are only weak evidence for the proposition that voluntary associations are schools of democracy. Studies that tried to come up with stricter tests have produced ambiguous evidence: some found encouraging results (e.g. McFarland and Thomas 2006), while others found mixed results (e.g. Sobieraj and White 2004) or discouraging results (Van Deth 2000; Van der Meer and Van Ingen 2009). Quintelier (2013) found political socialization effects among adolescents, but her study was restricted to quasi-political associations.

Although voluntary associations are associated with greater political participation, the causal mechanisms are thus still unclear. The fundamental question remains: Do voluntary associations socialize individuals to become more engaged (schools of democracy) or are politically engaged individuals more likely to join these associations (pools of democracy)?

The overreliance on correlations and cross-sectional data have undermined the validity of the conclusions in the literature. The neo-Tocquevillian approach assumes a rather strict causal ordering: associational involvement should causally precede pro-democratic attitudes and political action. A positive relationship is a necessary precondition for the schools-of-democracy effect, but far from sufficient evidence for a causal effect. From cross-sectional studies it is impossible to conclude whether members are politically engaged due to their participation (the socialization effect), whether they joined associations because of their political engagement (reversed causality), or whether the relationship is spurious (e.g. because higher educated individuals are simultaneously more involved in politics and associations). The latter two give rise to pools-of-democracy effects.

A test of both mechanisms requires a stricter research design, employing change models (using latent growth curves) based on panel data, which allow researchers to disentangle schools—from pools-of-democracy effects. We use such an analytical strategy to test the causality of the effect of active involvement in associational life on various political outcomes using representative, four-wave panel data. We contribute to the debate by using the long-requested panel data, but also by taking a rather long time span of 3 years and modeling the effect of changes (participation trajectories) on changes (in political engagement). We test four explanations of the well-documented correlation between civic participation and political engagement. Two explanations constitute pools-of-democracy effects: selective entry in voluntary associations and selective exit of voluntary associations. The other two constitute schools-of-democracy (or socialization) effects: growing political engagement as a result of increased involvement in voluntary associations, and—as the opposite side of the same coin—declining political engagement as a result of decreased involvement in voluntary associations.

Theory and Hypotheses

Schools of Democracy

The theory about political socialization effects of voluntary associations is well-documented and summarized in various contributions (e.g. Lichterman 2005; Van der Meer and Van Ingen 2009). Associations are considered to be small-scale learning environments (Van Deth 1997). In associations members gain experience in dealing with dissimilar others (Coffé and Geys 2007; Putnam 2000), which may give rise to overarching identities (Putnam 2000), tolerance toward minority groups (Hooghe and Quintelier 2013), ultimately “cultivating the disposition to cooperate” (Rosenblum 1998). Simultaneously, by taking part in internal activities (such as informal discussions, formal meetings, or editing a newsletter) and external activities (such as contacting or negotiating with public authorities) active members enhance their civic skills and obtain higher levels of efficacy (cf. Ayala 2000; Burns et al. 2001; Wollebaek and Selle 2002). Thus, associations would socialize members towards civic attitudes and civic skills.

Evidently, this socialization mechanism of voluntary associations is unlikely to be unconditional. Two commonly recognized preconditions are (1) active involvement or face-to-face contact with fellow members, and (2) repeated interactions or prolonged involvement.¹

A first crucial precondition of socialization is active involvement, i.e., undertaking activities or voluntary work with fellow members of the organization. Various authors have convincingly argued that passive involvement of an association (constrained to donating money, checkbook membership, or reading news letters or magazines) should not affect the likelihood of becoming politically involved (e.g. Putnam 2000; Skocpol 2003). Few effects are to be expected from passive involvement, as the “social spiral” requires members to get into contact with each other (Lichterman 2005). Although passive members could be socialized by reading news letters or by identifying with presupposed associational norms (Selle and Stromsnes 2001; Wollebaek and Selle 2002), such socialization effects of passive involvement should be very small compared to socialization effects related to active involvement. Hence, we will focus our analyses on active involvement in voluntary associations.

Although there is a lack of understanding of the theoretical mechanisms that account for the presumed socialization effect (Mondak and Mutz 1997; Stolle 2001; Baggetta 2009), it is evident that socialization by voluntary associations can only occur after an extended period of involvement (Stolle 1998). Shortly after joining a voluntary association, new members become acquainted with the activities, ideas and norms within that association. The socialization process starts when an individual becomes involved in formal and informal conversations with fellow participants. The theoretical implication of this is that the socialization effect should increase over time, and it probably takes at least several months before these effects begin to manifest themselves. On the other hand, it is self-evident that at some point the marginal socialization effect of extended membership should diminish. Once members have been exposed to the “voluntary association treatment” long enough, they will reach a point where it is no longer possible to acquire additional civic skills or further strengthen democratic attitudes. Therefore, we take into account length of participation period in our analyses (by looking at different “participation transitions”; see below).

Although the schools-of-democracy literature tends to focus on pro-democratic socialization as a one-way street, it is not self-evident that the effects of socialization remain after citizens stop participating in associational life. Socialization effects may erode when peer pressure stops and skills are no longer maintained. In other words, the principles behind the socialization mechanism imply that these socialization effects may decay, which is not to say that these socialization effects will necessarily disappear completely.

Although this “desocialization effect” has not been tested before, several studies in other areas have shown decay of similar socialization effects. For instance, the effects of civic education among college students were found to weaken progressively within a span of 2 years (Claassen and Monson in press). Similarly, in the very short run electoral campaigns affect voters’ attitudes, but both persuasion effects (Hill et al. 2013) and learning effects (Van der Meer et al. in press) decay within days after the end of the campaign. Finally, after a long period of socialization migrants’ trust in politics is affected by characteristics of their country of origin, but this socialization effect becomes weaker with the number of years spent in the country of destination (Adman and Stromblad 2013). In other words, desocialization effects occur everywhere.

Scholars have looked for relationships between associational involvement and a range of political outcomes, including involvement in political discussions (Wollebaek and Selle 2002), political interest (Bekkers 2005; Halpern 2005; Van Deth 2006; Quintelier 2013), political efficacy (Myrberg 2011) and—ultimately—political action (Van der Meer and Van Ingen 2009; Schulz and Bailer 2012). We examine these four indicators, although we do not expect these socialization effects to be equally strong. Theoretically, some outcomes should be more sensitive to change and should come earlier in the causal chain than others. It should be easier to socialize members towards political discussions and political interest than to enhance political efficacy and political action. Moreover, changes in the latter probably presuppose preceding changes in interest and/or efficacy. These outcomes differ in the extent to which they require skills, a higher level of civic-mindedness, and connections to the like-minded. Therefore, the four indicators mentioned in the hypotheses below are in order of expected effect size (from the largest to the smallest effect).

H1

Compared to non-participants, those who become actively involved in a voluntary association experience a growth of (a) political discussion, (b) political interest, (c) political efficacy, and (d) political action.

H2

Compared to persistent participants, those who quit being actively involved in a voluntary association experience a decrease of (a) political discussion, (b) political interest, (c) political efficacy, and (d) political action.

Pools of Democracy

In contrast to the schools-of-democracy argument, the pools-of-democracy idea suggests that members of voluntary associations were already more politically engaged before the joined. The most likely cause for this is that involvement in voluntary associations is (at least partly) determined by factors that are also linked to politics, thereby causing correlation between associational involvement and political engagement (Mondak and Mutz 1997; Hooghe 2003; Van Deth 2006; Armingeon 2007). There is a long list of variables suggested in previous empirical studies which are related to both civic participation and political attitudes and behavior (see Van der Meer and Van Ingen 2009). A well-documented example is education: it enhances all modes of associational involvement (membership, participation, volunteering, donations) (Bekkers 2005; Gesthuizen et al. 2008), but it is also a well-known determinant of political interest and action (e.g. Milligan et al. 2004). Another one is personality. Several dimensions of personality have been found to affect civic engagement (Bekkers 2005) as well as political engagement (Mondak et al. 2010). Analyses based on longitudinal data provide better tests for pools-of-democracy hypotheses as well. Although spurious effects can be detected in cross-sectional studies, it remains unclear whether the disturbing factors explain away socialization or self-selection effects.

Another possible reason for the occurrence of pools-of-democracy effects is reversed causality: politically engaged individuals are drawn into voluntary associations because of their political interest or ambitions (cf. Fowler et al. 2011). This is intuitive in the case of quasi-political organizations, such as environmental or humanitarian organizations. It is probably less intuitive in the case of other types of organizations (e.g. religious or leisure organizations).

One indication of pools-of-democracy effects may be that the difference between passive members and non-members is often found to be bigger than the difference between active members and passive members (e.g. Van Deth 2006). This is theoretically inconsistent with the schools-of-democracy hypothesis. It implies (although this is somewhat dependent on the interpretation of passive membership) that the higher levels of political interest and action these members show did not result from interactions and activities within the association (because by way of definition passive members are not involved in these activities).

Similar to the socialization effect, the selection effect can be twofold: the entry into voluntary associations may be selective, but the exit as well. The latter is not often recognized in the literature. Even if there is no relation whatsoever between being politically engaged and becoming a member of a voluntary association, if politically engaged members are more likely to retain their membership this will show up as a correlation between civic engagement and politics in cross-sectional analyses.

H3

Citizens who become actively involved in voluntary associations already show higher levels of (a) political discussion, (b) political interest, (c) political efficacy, and (d) political action before they become actively involved.

H4

Citizens who quit being actively involved in voluntary associations already show lower levels of (a) political discussion, (b) political interest, (c) political efficacy, and (d) political action before they quit being actively involved.

It should be noted that the schools- and pools-of-democracy hypotheses can both hold at the same time. Even if the bulk of the correlations between associational involvement and political attitudes and activities can be attributed to selection effects, subsequent socialization effects may still occur (Hooghe 2003; Iglic 2010; Quintelier 2013).

Data and Methods

LISS

The Longitudinal Internet Studies for the Social sciences (LISS; see www.lissdata.nl) is a panel representative of the population of the Netherlands (16 years and older). Together with the US, Canada and the Scandinavian countries, participation rates in the Netherlands are among the highest in the World (e.g. Curtis et al. 2001). This makes it a good case for our current purpose: if schools of democracy are widespread anywhere it should be in these countries.

The LISS panel is designed to follow changes in the life course and living conditions of the panel members. The yearly retention rate is about 90 percent and refreshment samples are drawn to maintain the representativeness of the panel (see Leenheer and Scherpenzeel 2013 for more information). Questionnaires are answered online, and households have been equipped with a computer and/or Internet access when necessary. Monthly questionnaires are answered, taking 15–30 min in total. Most of our data come from the yearly modules Politics and Values, Social Integration and Leisure, and Background Variables. The latter are provided (on a monthly basis) by the household head. Respondents are paid (15 euros per hour) for each completed questionnaire.

Political Discussion, Interest, Efficacy, and Action

Political discussion has two dimensions and originates from a name generator in the survey. First, respondents were asked: “Most people discuss important things with other people. If you look back on the last 6 months, with whom did you discuss important things?” (max. 5 persons). Subsequently, people were asked how often they discussed political issues with these personal contacts (known as alters in social network studies), with the following answer categories: (1) almost every day, (2) once or twice a week, (3) a few times per month, (4) about once a month, (5) a number of times per year, (6) about once a year, and (7) never. These scores were reversed and recoded to a quasi-continuous measure (number of discussions per year). Subsequently, we took the maximum score across the alters, i.e. when a respondent talks about politics every day with one alter and never with another alter, the “every day” score is assigned. This means that our frequency measure should be interpreted as: respondent talks X times about politics per year with at least one alter. If respondents indicated that alter X was a fellow member of an association or organization that person was not included in the count in order to avoid tautology problems. The second dimension of political discussion is the number of alters (sum) with whom politics are discussed (regardless of frequency). Table 1 provides descriptive statistics of the political indicators.

Table 1 Descriptive statistics of political indicators (pooled dataset)

Our measure of political interest is a scale measured through two attitudinal components (self-reported interest in news and in politics) and two behavioral components (reading national and international political news in newspapers) The attitudinal variables’ answer categories ranged from 1 (not interested) to 3 (very interested), the behavioral components ranged from 1 (seldom or never) to 4 (almost always). These 4 variables form very strong and significant Mokken scales in each individual panel wave: H-coefficients range from .70 to .74, and even the weakest item (reading international news) has an H_i value of minimally .67.

Political efficacy is a combination of six items: (1) “I am well capable of playing an active role in politics”, (2) “I have a clear picture of the most important political issues in our country”, (3) “Politics sometimes seems so complicated that people like me can hardly understand what is going on”, (4) “Parliamentarians do not care about the opinions of people like me”, (5) “Political parties are only interested in my vote and not in my opinion”, (6) “People like me have no influence at all on government policies”. The answering options were either yes (1) or no (0). Its internal consistency (α = .65) is somewhat downwardly biased because of the fact that the items are dichotomous (auxiliary analyses showed that the tetrachoric inter-item correlations are considerably higher than the Pearson’s r correlations as used in calculating Cronbach’s alpha).

To measure political action (or “unconventional” political participation), respondents were asked the following question: “There are different ways of raising a political issue or of influencing politicians or government. Can you indicate which of the following ways you have exercised over the past 5 years?”. We counted the response to the following items (yes/no): (1) calling in radio, television or a newspaper, (2) calling in a political party or organization, (3) participated in a government-organized public hearing, discussion or citizens’ participation meeting, (4) contacted a politician or civil servant, (5) participated in a protest action, protest march or demonstration, (6) participated in a political discussion or campaign by Internet, e-mail or SMS, and (7) something else.

Comparing the means of the political indicators across the different waves, we find evidence for period effects on political interest and political activism: both show a modest downward trend. This effect is remarkable, as elections took place in June 2010, directly before the final panel wave. If anything, elections should have boosted interest and activism compared to the pre-election waves. The occurrence of these period effects demonstrates the importance of a research design that incorporates within-person changes and a relevant control group. It should be noted that—in the presence of period effects—the interpretation of socialization or schools-of-democracy effects may change: an effect of active involvement in associations could also mean ‘less decline’ rather than a ‘boost’ (i.e. an absolute increase) of interest and activism.

Active Involvement in Voluntary Associations

The question about (active) associational participation was similar to the question in the European Social Survey of 2002, and the 1999/2000 survey Citizenship, Involvement and Democracy. Respondents are asked to indicate whether they participated in a list of different voluntary associations in the past 12 months. For each association, respondents reported yes or no to five modes of involvement: (1) no connection, (2) donated money, (3) participated in an activity, (4) member, and (5) performed voluntary work. Whereas modes 2 through 5 all count as associational involvement, we only include (3) participated in an activity and (5) performed voluntary work in our measure of active involvement.

The list of voluntary associations in our analyses consisted of the following: (1) a sports club or club for outdoor activities, (2) a cultural association or hobby club, (3) a trade union, (4) a business, professional or agrarian organization, (5) a consumers’ organization or automobile club, (6) an organization for humanitarian aid, human rights, minorities or migrants, (7) an organization for environmental protection, peace organization or animal rights organization, (8) a religious or church organization, (9) a science, education, teachers’ or parents’ association, (10) a social society; an association for youth, pensioners/senior citizens, women; or friends’ clubs, and (11) other organizations that you can freely join. We left out political parties to avoid circular reasoning.² The final measure we used is a categorical variable that included different participation trajectories or transitions in these associations (see “Analytical strategy” section).

Control Variables

Income is the monthly net household income, divided by 1000 (mean 2.96; SD 4.72). We used the imputed version, provided by the coordinators of the survey (the calculations can be found at the following location: http://www.lissdata.nl/dataarchive/hosted_files/download/1579). Education is a 6-point scale, ranging from primary education to university degree (mean 3.57; SD 1.48). Occupational status was one of the following three categories: high (higher academic, independent, or supervisory profession), intermediate (intermediate academic, independent, supervisory, or commercial profession), and low (other mental work or manual work). Those without a job were asked about their last job; if respondents never worked their scores are missing. Furthermore, our analyses included controls for age (mean 46.97; SD 15.98) and gender. Finally, personality was measured by the well-known inventory of the “big-five” personality traits (Goldberg 1992). The control variables were measured at the start of the panel. When values were missing we used the nearest non-missing value (if possible).

Analytical Strategy

Our analytical strategy is similar for all four political indicators. Figure A.1 (online Appendix) provides an overview the measurement of our variables. P1 represents the first wave of the questionnaire about politics and values. This module contained the political interest, internal efficacy, and political action variables. S1 represents the first wave of the questionnaire about social integration and this module contained the civic participation variables as well as the indicators of political discussion. We divided respondents into groups according to the participation transitions they reported (questionnaires S1, S2, and S3). The groups that are of substantive interest are listed and labeled in Figure A.1. For example, “incidental joiners” (pattern 010) are respondents who did not participate actively in a voluntary association at S1 (0 meaning not involved), then joined (at least) one between S1 and S2 (1 meaning involved), and subsequently quit between S2 and S3 (0 again).

Our main focus in the interpretation of the results is on the difference between non-participants (pattern 000) and joiners (011) for the entry effects and on the difference between persistent participants (111) and leavers (100) for the exit effects. See Van Ingen and Bekkers (2015) for a similar strategy as well as a discussion about modelling longitudinal effects of multiple memberships. The largest groups are in a stable state, i.e. they are either non-participants (“000”; 29 %) or persistent participants (“111”; 26 %). Among the respondents who joined (at least one) voluntary association between waves 1 and 2, around 50 % decided to quit participating again between wave 2 and 3: the groups early joiners (011) and incidental joiners (010) are of roughly equal size (both around 8 % of the sample). The late joiners (001) constitute 7 % of the sample.

We apply latent growth curve models to examine our data (using Stata 13). Based on the four-wave measurement of the political indicators, we estimate a (latent) intercept and (latent) slope of the individual political socialization trajectories of respondents: the slope represents the amount of growth, the intercept represents the initial score (wave 1) on the political indicator. Respondents with other participation transitions (e.g. with missing values) than the ones listed in Figure A.1 were not included in our models. We estimated our structural equation models using “maximum likelihood with missing values” (see StataCorp. 2013).³ The advantage of this method is that respondents did not have to complete all four questionnaires to be included in the analyses.

In order to test our pools-of-democracy hypotheses we need to find out whether members were already more politically socialized before they entered an association. This can be tested with our models by comparing the intercepts of the “joiners” with the intercept of “non-participants”: as can be seen in Fig. A.1, P1 is prior to joining the association between S1 and S2. Additionally, a selection effect may exist with regard to remaining involved in a voluntary association. This can be tested by comparing the intercepts of “persistent participants” (111) with “leavers” (100) (the intercepts represent the scores prior to the decision to exit).

In order to test our schools-of-democracy hypotheses, we need to find out whether members became more politically socialized after they joined an association. This can be tested by comparing the growth “curve” (estimated as a linear trend in our models) of the joiners with the growth curve of the non-participants. Similarly, desocialization effects are tested by comparing the growth curves of persistent participants” (111) with “leavers” (100).

By comparing participation transition groups we avoid bias caused by period effects (which are present in our data): the non-participants (000) act as a quasi-control group. Furthermore, we note that the group of “persistent participants” (111) is also of interest, but the interpretation of their scores is not straightforward. If their intercept is different from non-participants, this can reflect both selection and causation (just like in cross-sectional research); when their growth curve is different it may represent a late, or lagged effect (since they had already been participating for an unknown period before we started monitoring them at S1).

Results

Figure 1 illustrates the average degree of political engagement in each of the four subsequent waves across the theoretically relevant groups of non-participants (000), joiners (011), persistent participants (111), and leavers (100). Some of the differences between the groups in the first wave (black bars) are small. However, the differences between non-participants (000) and persistent participants (111) are often considerable. For instance, the standardized difference in political action between these groups equals .42 (0.78–0.38/0.943). These differences are the main reason why cross-sectional studies often report intermediate or large correlations between civic engagement and political attitudes and behavior. All five indicators of political engagement suggest pools-of-democracy effects: joiners tend to have somewhat higher scores than non-participants (before they join), leavers somewhat lower scores than persistent participants (before they leave).

Fig. 1

Observed differences between transition groups

If schools-of-democracy effects exist, we would expect that over time political engagement increases among joiners, or at least that their trend is more positive than the trend of non-participants. Figure 1 shows, however, that the trends hardly differ, let alone consistently. It also shows that socialization effects seem more likely in the case of political discussions and political interest than they do in the cases of political efficacy and political action.

Next, we turn to a more formal test, using growth curve models. Table 2 shows the results of our analyses of political discussion, which has two dimensions: the number of alters with whom politics is discussed (or the size of the political network; models I and II) and the frequency of discussion (models III and IV).

Table 2 Growth curve models of political discussion (standard errors within parentheses)

First, we look at the effects on the latent intercept variable, which gives us an indication of the extent to which voluntary associations are pools of democracy. The constant in the uncontrolled intercept equation (model I: b = 2.001) reflects the average number of alters non-participants discussed politics with. The other coefficients reflect the differences between this group and other participation transition groups. In other words, the point estimates of the intercept equation in model I provide the same information as the black bars in Fig. 1, but now accompanied by statistical tests. We find significant, positive differences between the reference group and all three participant groups (Table A.1 in the Appendix shows a complete list of other participation transitions). The significant coefficient of joiners (b = 0.475) in model I implies that individuals who decided to join a voluntary association already had a larger political network than non-participants (000) before joining, thereby contributing to the pool of democracy. The difference remained significant after controlling for personality, education, income, occupational status, gender, and age (model II), thereby supporting H3a. Judging from the standardized coefficients (not shown), education (β = .29) and openness to experience (β = .13) are the most important explanations of differences in the size of the political discussion network before joining an association (Tables A.1–A.4 in the online appendix show the effects of the control variables).

Persistent participants also have a larger political discussion network than non-participants: the difference in model I corresponds to roughly 0.30 standard deviations. Model II shows that at least part of this effect is spurious (coefficient is reduced from 0.557 to 0.309). As indicated in the analytical strategy section, and similar to cross-sectional studies, it is not possible to judge whether the difference that remains is due to causation or selection (although the analyses below suggest the latter).

Auxiliary analyses showed that the difference between persistent participants (111) and leavers (100) was significant (p = .003), as expected in H4a. This difference dropped below significance levels after adding control variables in model II. We conclude that this is a case of double selection: those with larger political discussion networks are more likely to join and less likely to quit. In turn, this can be explained to a large extent by the fact that these individuals have more privileged social positions (most importantly: a higher education) and different personalities (mainly higher scores on openness).

We find similar evidence for our pools-of-democracy argument with regard to the frequency of discussion (models III and IV). The difference between joiners and non-participants was significant in both the controlled and uncontrolled model (supporting H3a), although the difference is partly explained by the control variables, again most importantly education and openness to experience. The difference between leavers and persistent participants was significant in the uncontrolled model and non-significant in the controlled model. In other words, those who decide to leave the voluntary association discuss politics less frequently than those who stay (supporting H4a), and this can be explained by their social status and personality.

Second, we turn to schools-of-democracy effects. The bottom part of Table 2 provides tests of hypotheses 1a and 2a. If the schools of democracy idea is true then those who joined (011) should show a larger increase in political discussion than those who remain uninvolved (000). The results are inconsistent. Among joiners (011), there is a significantly stronger increase in the number of people with whom politics is discussed than among non-participants (both models I and II). However, there is no such difference when it comes to the frequency of discussion (models III and IV), which makes the support for H1a ambivalent.

There are a few things we have to note. First, the difference between joiners and non-participants is small: it represents a yearly growth of .08 on a variable with an average of 2.22 and SD of 1.78 (see Table 1). Second, since the “growth” of the reference group is negative (b = −0.052)—meaning that the size of the political discussion network decreased slightly in the period of the research among non-participants—the real growth of the joiners is only 0.027 (−0.052 + 0.079). Third, there are other substantive interpretations of the growth effect than socialization: it may (also) indicate a network effect (joiners obtain a larger network).

By contrast, we found no exit effects on political discussion: the differences in the slope of leavers (110) and persistent participants (111) were not significantly different from zero (not shown in the table). This rejects H2a.

With Table 3 we move to political interest. First, we turn to pools-of-democracy effects. Model I shows that joiners already had significantly more political interest than non-participants before they joined an association. This difference is to a large extent due to differences in social status and personality: (model II) after the control variables are entered the difference is no longer significant. The intercept of persistent participants was even higher, but the interpretation of this coefficient is somewhat more ambiguous (as we explained in the “data and methods” section). We also found a pools-of-democracy effect with regard to quitting participation: the difference in intercepts between leavers and persistent participants is significant (p = .000), regardless of the inclusion of control variables. This means that we find both types of selection effects and thus consistent support for our pools-of-democracy hypotheses (H3b and H4b). Judging from the standardized effects (not shown), the most important determinants of the level of political interest before joining an association are age (β = .40), education (β = .21), and openness to experience (β = .21) (see Table A.2 for the effects of all control variables).

Table 3 Growth curve models of political interest (standard errors within parentheses)

The bottom block of Table 3 again tests socialization effects by showing the differences in growth curves (slopes). As models 1 and 2 show, we find no schools-of-democracy effects among the groups listed (see Appendix A.2 for a more elaborate list of participation patterns). Thus, we reject H1b. The constant in model I (slope equation) suggests that among non-participants there was a small decrease of political interest (b = −0.122). Finally, we do not find that leaving an association reduces interest: The slope of leavers was not significantly different from the slope of persistent participants (p = .296). Hypothesis H2b is thus rejected.

Our analyses of political efficacy in Table 4 show a pattern that is largely similar to the findings among the other indicators. There was a double pools-of-democracy effect: joiners reported higher political efficacy (before) they joined in comparison to non-participants, and leavers reported lower political efficacy (before they left) than persistent participants (the latter difference was significant in both models (p = .000 and p = .002)). These results strongly support H3c and H4c. Education (β = .35) and openness to experience (β = .21) were by far the most important determinants of the level of political efficacy (see online Appendix).

Table 4 Growth curve models of political efficacy (standard errors within parentheses)

Our analyses of the growth curves in the bottom block of Table 4 provided no support for socialization or schools-of-democracy arguments: none of the effects were significant (H1c is rejected). We also found no exit effect: the difference between leavers and persistent participants was non-significant in both models (H2c is rejected).

Table 5 shows the results of our analyses with regard to political action and shows again a similar picture. Our findings show clearly that pools-of-democracy effects exist, with regard to both the decision to join a voluntary association and retain involvement. The difference between leavers and persistent participants was also significant in models I and II (both p = .000). This provides strong support for H3d and H4d. Our analyses of the slopes consistently show no evidence of growth of political action after becoming involved in (at least one) voluntary association, and neither did we find a decline of political action after becoming uninvolved. H1d and H2d are thus rejected.

Table 5 Growth curve models of political action (standard errors within parentheses)

Discussion and Conclusions

In this study we tried to contribute to a research tradition with a long history in political science, which studies political socialization processes in non-political or quasi-political organizations. Focusing on citizens’ transitions in and out of voluntary associations, we tested four possible explanations for the correlation between participation in voluntary associations and political socialization: selective entry and selective exit (pools of democracy), and socialization and de-socialization effects (schools of democracy). This innovative approach was facilitated by nationally representative panel data, in which respondents answer yearly questions about their civic engagement and political attitudes and behavior. These data not only allow better tests of the validity of well-known theories about voluntary associations’ role in political socialization, they also force researchers to be more specific about the mechanisms that operate, such as the timing of the effects and possibility of exit effects next to entry effects.

Where does this study leave us? First, it is quite evident from our analyses that voluntary associations do not live up to the lofty ideals of being schools of democracy and agents of political socialization. We found little support for the idea that civic engagement boosts political engagement, and the scarce effects we found were small. This does not mean that no single voluntary association exists where members are politically socialized or that there are no groups for which associational involvement leads to more political interest and action. For instance, effects may be stronger among adolescents (McFarland and Thomas 2006; Smith 1999). However, our results do indicate that in a general population and averaged across different types of associations, there is no meaningful, general schools-of-democracy effect.

We have considerable confidence in the validity of this conclusion, not only because of the research design of our study (longitudinal analyses based on a large representative sample) but also because of the double test (entry + exist) we introduced. If there is something in the “participation treatment” that boosts political interest and action, this should—in all likelihood—also result in erosion of political interest and action when citizens quit being actively involved. However, both tests fail to support the schools-of-democracy hypothesis.

Second, we looked for evidence of voluntary associations being pools of democracy, attracting politically engaged citizens. For that purpose, we tested whether differences between members and non-members already existed before the former entered a voluntary association. We found vast evidence supporting this idea: most of the correlation between associational involvement and political engagement is due to self-selection effects. This self-selection is a double-edged sword: politically engaged citizens are more likely to join voluntary associations and also less likely to leave them. In turn, these differences can—to a large extent—be attributed to the socioeconomic status, age, and gender of active members.

A few shortcomings of our study need to be discussed. First, the length of the “participation treatment” in our models (1.5 years on average) may be too short, as one of our reviewers suggested. To explore this possibility we ran additional models in which this period was extended to 2.5 years on average (by adding an additional wave). The results were identical: no (significant) difference in the growth curves of those who started participating and those who remained uninvolved. This does not exclude the possibility of effects emerging after 3 or 4 years, but it seems very unlikely that—if schools-of-democracy effects exist—they would not manifest themselves until the third year of participation. Second, our data did not allow us to separate between types of associations (e.g. between those with (quasi-)political aims and those with other aims). Future research may want to examine whether there are special circumstances under which political socialization effects occur. However, our results suggest that—if these circumstances exist—they are likely rare: otherwise, we should have been able to detect them in our more generic test. Third, our measure of political action asked respondents about the past 5 years. This means that within-person change can result from recent changes but also from changes in behavior longer ago. On the other hand, there are numerous studies that show that respondents mainly recall and report recent autobiographical events in surveys (e.g. Bradburn et al. 1987), which is actually an advantage in this case. Nonetheless, we need to be cautious when interpreting the results of our analyses of political action.

Our findings challenge many of the conclusions drawn in cross-sectional studies, also the ones with a more sophisticated theoretical approach of school-of-democracy effects, like the idea of a cycle of selection and adaptation (Hooghe 2003; Quintelier 2013), in which—based on the idea of value congruence—socialization effects should be strongest among homogeneous associations with politically engaged members. Our results are also not very promising for this suggested mechanism of political socialization, because even if it exists it did not result in a general, positive participation effect in our analyses. This means that the effect was too small to reach levels of significance in our (large) data set, or that it is counterbalanced by a negative political socialization effect in other kinds of voluntary associations (e.g. intolerant and non-democratic attitudes may also be strengthened by interactions with similar-minded fellow members). In both cases, the overall contribution of voluntary associations to political socialization is very modest at best. Voluntary associations may (cf. Fung 2003) play a relevant role in political processes by mobilizing politically engaged citizen or by monitoring the performance of governments, but they contribute little to the democratic schooling of citizens, or at least not in the adult population.