1 Introduction

We study the role of transformism as it applies to the political survival of all Italian members of parliament (MPs) from 1946 to 2013. We define political transformism (as distinct from party switching) as the practice of being co-opted from the political opposition (government support) and transformed into a government force (opposition). Transformism or “crossing the aisle,” in a broad sense, has been a recurrent feature of the Italian political landscape since unification.Footnote 1 Transformist MPs are perceived as sacrificing their principles in exchange for immediate reward, and transformism is often considered to be one of the main determinants of the (in)stability of both governments and political parties.

Following Vilfredo Pareto (1916/1954),Footnote 2 we consider transformist MPs as engaging in a type of opportunistic behavior wherein their own interests in gaining power and prestige dominate professed party affiliations or previous voting records. In that respect, switching from one political party or faction to another for reasons other than dissatisfaction with the political and moral behavior of one’s own party/faction or for more general ideological reasons is a subcategory of the opportunistic behaviors of politicians, where betrayal is also included (Buchanan, 1954, 1986, 1996).

The rational ignorance of voters makes monitoring politicians extremely costly. Electors might be reluctant to replace opportunistic public officials; elections thus might be ineffective in constraining such behavior. Moreover, analyzing the US Congress, Parker (2004) supports the view that rational politicians do not necessarily exploit voters’ rational ignorance to behave opportunistically, because the reward for ethical conduct is in maintaining their reputations, which serves both as a re-election advantage and a benefit when seeking post-parliamentary employment. Nevertheless, rational politicians do act opportunistically; such behavior can be thought of as a cost of their principal-agent relationships with voters, also known as “shirking.” That certainly has been the case in Italy; we test whether and how MPs’ opportunism has influenced voters’ choices, and whether trust in MPs’ parliamentary performance has been a sufficient condition for their electoral successes.

Whether or not MPs remain faithful to party labels (and their electioneering promises) is crucial for representative democracies. It speaks to questions about political accountability, especially so in countries with apparently weak institutions delegating broad powers to elected politicians. Since Barro (1973) and Ferejohn (1986), political agency models study the choices of politicians facing the threat of re-election to gauge the extent to which elections can resolve the conflict of interest between citizens and their elected representatives. Here, we argue that the representation of parties in legislative bodies is also determined by how political institutions function in practice. Therefore, the contribution of our paper encompasses predictions from agency models regarding politicians’ coherent (or opportunistic) behavior once elected (i.e., when MPs are voting in the parliament) which have not been tested before. Specifically, we ask (1) whether elected politicians who behave as transformists in the eyes of the voters are likely to be replaced, and (2) whether formal and informal rules related to the delegation of powers to representatives (see below) matter. Concerning the latter issue, a key feature of our study is that institutions are the rules of the game in any society, but that institutional filter, which contributes to determining policy outcomes, is not necessarily efficient.

Departing from the prevailing party-centered view found in political science studies of party switching, we look at whether the opportunistic behavior of individual MPs who might change the destiny of the government in charge determines the lengths of their terms of office in the Italian parliament. Clearly, the ideological or nonideological nature of Italian political parties may still be relevant, but when the ideological basis of a political movement is weak, transformism is more likely to occur.Footnote 3 Nevertheless, instead of focusing on the fluidity and clarity of party labels and on the levels of party discipline, we look at the institutional features of the Italian parliament and divide Italian parties (actually the Italian parliamentary groups present in parliament, as will be explained below) into factions supporting the government and those opposing it. The substantive focus of our study on the Italian parliament and on the voting behavior of its members singles out the opportunistic behaviors of MPs once they are elected.

To the best of our knowledge, this is the first time that the role of transformism has been considered in the context of the survival of politicians. Our analysis takes advantage of a unique and newly built dataset that contains detailed information on all members of both the Chamber of Deputies and the Senate from 1946 to 2013.Footnote 4 The dataset contains recurrent event outcomes for 15,344 repeated observations related to 7128 MPs. For individual MPs, the dataset contains their dates and places of birth, gender, education, professions, electoral district, political affiliations, and eventual changes in those affiliations (whether of the transformist type or not). Within the entire period, we observe 1984 changes, 471 of which are categorized as political transformist behavior. Table 1 reports the numbers of MPs who switched from government to opposition and vice versa as well as the number of other changes apart from transformism.

Table 1 Governments, PM political affiliation, transformists, and other changes by legislature, 1946–2013

As suggested by Box-Steffensmeier and Zorn (2001), we build on the Cox (1972) model to generate estimates of the effect of a set of explanatory variables on the risk of an MP leaving parliament. On that basis, we study whether transformism helps politicians to survive in parliament, with re-election being the prize tracked by the fact that the MPs are still in office in subsequent legislatures; punishment, by analogous reasoning, is non-re-election. We refer to voters’ punishment as instances of MPs exiting the parliament (note that the event is technically incorporated in the survival analysis; see below). For the same reason, the voting rules in place (both internal to the parliament and the electoral system) are important.

As in Parker (2004) and in the main strands of the literature in the political agency tradition, which predict that only those politicians that perform better than some threshold value will be re-elected, voters do punish opportunistic MPs; general elections are instruments for ridding parliament of transformists. Our results suggest that political transformists have a probability of survival of about 25.9 percentage points less than MPs sticking to their initial affiliations. That conclusion is similar for the First Republic (with and without the secret ballot as an internal voting rule) and the Second Republic. Our analysis also shows that transforming MPs capture immediate benefits from their actions: the probability of survival for political transformists is about 4.8 percentage points higher than that for MPs who remain loyal to their original group affiliation. Facing (long-term) punishment at the hands of voters may not fully deter MPs’ future opportunistic behavior.

2 Related literature and motivation

Although its aims and purposes diverge from those of the present paper, the current body of literature already considers the broad issue of politicians changing political parties. Antonio Gramsci (1975) offers one of the earliest analyses of the narrower definition of political transformism and points to its relationship to crises in political parties and institutional authority, the spread of apoliticism amongst the electorate at large, the decline in parliamentary prestige, and Caesarism. In that line of research, some of the literature on party switching studies the effects of changes in the party system rather than in legislator turnover. Often, the body of such studies favors the alternative terms “party switching,” “defection,” and “crossing the floor,” focusing on the implications for governmental and party-system instability.Footnote 5 Some scholars regard party switching as an issue limited to newly developing non-Western democracies (Mainwaring, 1991). According to McElroy and Benoit (2009, p. 2), party switching has traditionally been “viewed as an aberration or an indicator of a weak, ill-formed party system, a phenomenon associated with newly emerging democracies or unstable ones.” Desposato (2006) supports the same view and argues that while switching is rare in most countries, it has been common in others; such behavior is usually dismissed as an indication that parties do not matter in the latter countries. Recent studies challenge the conventional wisdom that party switching is an exceptional occurrence, because it is becoming more frequent in many Western democracies. For example, from 1947 to 1994, 20 members of the US Congress changed party affiliations while in office (Nokken, 2000). In France, several high-ranking socialists left the party to become officials in Sarkozy’s government (Sciolino, 2007). Likewise, Heller and Mershon (2005) observe a good deal of party switching in several European countries, including Italy.

Various scholars discuss the motivational conflicts confronting deputies in their parliamentary performance. Heller and Mershon (2008, p. 912) identify four factors affecting a legislator’s decision to switch, which include “some function of her ideal policy, her party’s policy position, her party’s ability to influence outcomes, and her contribution to that influence.” Other scholars describe the legislator’s dilemma when voting on policy issues: legislators can either choose to cater to their constituents’ interests and stand good chances of re-election, or they can consistently support their party and vote with it, thereby ensuring their ability to rise up the ranks of party power, nomination for the next election, and other benefits by virtue of their loyalty. Conflicts may occur when legislators believe that their constituents’ wishes deviate from their party’s position or when legislators’ beliefs clash with their constituents’ opinions, regardless of party positions.

A rather different conflict arises when deputies are tempted to defect from their party in return for an appointment in another party. Defections in such instances—which are more likely to occur in nascent rather than in established democracies—can provide the votes necessary to create a new government and open up positions in the governing party, as seen in India in 1967 and 1968 (Malhotra, 2006). Typically, studies focus on finding solutions to prevent MPs from voting in their own interest and defecting to another party for personal gain; governments may even enact anti-defection laws to promote party stability (Janda, 2009).

Finally, research on party switching seeks to explain why MPs do or do not change their party affiliations; examples include Cox and McCubbins (1994), Samuels (2000), Castle and Fett (2000), Laver and Benoit (2003), Shabad and Slomczynski (2004), Heller and Mershon (2005), Desposato (2005, 2006) and McElroy and Benoit (2009). Some of those studies are concerned with the political consequences for members who switch parties, and typically examine two consequences for individual switchers: their subsequent voting behavior and their likelihood of re-election.

Our analysis focuses on the impact of politicians changing party affiliations once elected and political transformism on the survival of Italian MPs. We test whether the possibility of facing punishment at the hands of voters on Election Day deters MPs from engaging in opportunistic behavior and whether elections are mechanisms for ridding parliament of transformists. Electoral consequences also emerge as constraints from the two strands of work in the political agency tradition. In the first-generation models (e.g., Barro, 1973; Ferejohn, 1986), elections are politician-control devices. Voters express their preferences, and underperforming politicians are dismissed from office in the next election.Footnote 6 In the second-generation models, politicians are described as having different motivations or competencies (e.g., Banks & Sundaram, 1998; Coate & Morris, 1995; Fearon, 1999; Rogoff, 1990).Footnote 7 A shortcoming of those models is that voters might not be in a position to replace current politicians with better ones. Sometimes, the literature overcomes that problem by looking at a different type of agency models, inspired by career concerns, according to which voters care about politicians’ characteristics, such as competence, that affect election outcomes. Then, forward-looking voters look at past performance to estimate the politicians’ abilities and thus their electability.Footnote 8 Also borrowing from the literature on worker incentives, for which higher pay (or pay that is more sensitive to performance) not only affects effort but also influences employee selection (through differential hiring or retention policies), the political economy literature supports the view that different institutional arrangements (different rents) not only affect incentives but also may change the composition of the pools of political candidates and elected officeholders. The empirical literature provides some evidence that politician behavior and effort respond to electoral incentives and that voters, deliberately or otherwise, provide such incentives.

Fedeli et al. (2014) argue that an MP’s survival (as the ability to be re-elected) depends on various characteristics of the party system. Indeed, parties articulate choices, aggregate preferences, and organize legislatures (Cox & McCubbins, 1994). On the one hand, they gather individual politicians under a party label, impose discipline on them, and determine their electoral fortunes. On the other hand, politicians belonging to a party renounce their freedom of action in exchange for membership in a stable, identifiable electoral and policymaking organization (Cox, 1987; Cox & McCubbins, 1994). Although the importance of parties to democratic political life should encourage politicians to hold fast to the party labels under which they were elected, opportunistic politicians might resist subordinating their own goals to party dictates and be tempted to change parties. Moreover, in the Italian institutional context, the role of political parties in the parliament is determined by how a given set of formal and informal rules and institutions function in practice. We refer to both the Italian Constitution and the internal rules of procedures regulating the House of Representatives and the Senate.

In the Italian parliament, transformism is not revealed during general elections, but after the election has been held (i.e., once a candidate is elected and enters parliament) and over the course of the following parliamentary session, i.e., when an elected MP might decide to vote for legislation opposed by her/his own political party or faction, thus transforming her/himself from a member of the political opposition to the ruling coalition or moving in the opposite direction (from a government supporter to opponent). Such behavior is recorded formally because, other than the official act of voting in parliament, a vote against the MP’s own parliamentary group requires a formal switch of that MP to another group.

It is important to note that the Italian parliament is not simply divided into political parties, but into parliamentary groups that are formed by MPs immediately after the election: once elected, each MP must adhere to a parliamentary group (affiliation is compulsory and regulated, respectively, by the Chamber of Representatives and Senate Rules of procedures, which are independent sources of law determining the internal organizations of the chambers). Moreover, according to the Italian Constitution, Article 67 (prohibiting imperative mandates), every member of parliament represents the nation and performs his/her functions unrestrained by their individual constituencies. National representation, in principle, implies that the MP elected with a given party label might join, once elected, any parliamentary group, even that of a different party. Moreover, if an MP is not happy with the chosen parliamentary group, the initial affiliation can be changed at any time, under the constraint that affiliation with a parliamentary group is compulsory. The parliamentary majority supporting (or opposing) the government is determined on the basis of the numbers of MPs belonging to parliamentary groups voting pro (cons) the government. In other words, once the MP decides not to vote in line with his/her original group, s/he must change parliamentary groups, and can do so without consulting her/his constituents. Moreover, according to both chambers’ Rules of Procedures, new parliamentary groups can always be formed during the legislature’s term, subject to the constraint that the new group being assembled reaches a minimum membership threshold.Footnote 9 Thus, when some MPs are unhappy with their parliamentary policy position (to be voted on in the assembly), the unhappy MPs can switch to another existing group or can form a new one under the just-stated conditions. If the membership threshold of the new group is not reached, the MPs can affiliate with the “mixed group” (which is internally organized into homogeneous subgroups without being constrained to a minimum size).Footnote 10 Hence, transformation—or, more generally, switching—from a parliamentary group to another is almost always, with few exceptions, a formal act recorded by the two houses.

We test whether MPs’ opportunism is a determinant of voter choice that governs the lengths of service of incumbent legislators, their trustworthiness, or both is a sufficient condition for electoral success. Apparently, an MP’s trustworthiness might not be essential to their political survival (Parker, 2004). Transformists seem to be unusually adept at staying in office, and voters might be reluctant to oust them—possibly because opportunism is often perceived as more unethical than illegal. The ability of incumbent transformists to provide services to their constituents (e.g., through MPs’ presumed monopoly over bureaucratic fix-it services or clientelism) makes the electorate virtually silent on (or tolerant of) opportunistic behavior. Another reason that transformist legislators might survive electoral challenges is that voters lack salient information and have weak incentives to overcome their rational ignorance. On the other hand, voters might consciously elect opportunistic politicians by voting for candidates willing to exchange material benefits for electoral support. In other words, voters might tolerate and enthusiastically support politicians meeting their material demands.Footnote 11

We ask whether the phenomenon of political transformism—as distinct from changes in political affiliation—helps incumbent legislators to remain in office longer, or whether sticking with a political group that clearly supports the government (opposition) is a better plan, with fickle MPs being punished across legislatures. Related to these issues, we also consider the (changes in the) institutional context. In particular, we test whether the Italian electoral system and internal parliamentary voting rules affect MPs’ survival in the presence of phenomena relating to changes in both political affiliation and transformism.

3 Data and preliminary evidence

Our analysis takes advantage of a unique and newly built dataset that contains detailed information on all members of both the Chamber of Deputies and the Senate from 1946 to 2013. Our main source is La Navicella, an official publication produced at the beginning of each legislature that contains self-reported biographical information on all MPs, and the official website of the Italian parliament (http://www.parlamento.it). For each MP, the dataset contains the date and place of birth, gender, education, profession, electoral district, political affiliation, and eventual changes in political affiliation, if any. The latter two characteristics warrant further explanation.

3.1 Political affiliation

The postwar Italian Constitution established a perfect bicameral legislature whose members serve five-year terms. Elections may be called before the end of the legislature if the President of the Republic acknowledges that the majority is no longer capable of holding a government. Until 1994, a proportional electoral law was in place, with different rules for election to each house. For the Chamber, each voter could select three candidates from the list, regardless of the number of seats in the constituency, which were allocated based on the population. During the first stage of vote-counting, the winners were determined based on the votes cast. In the next stage, the surplus votes (not needed for election at the constituency level) were allocated nationally according to the Hare quota. For the Senate, each elector could vote for only one candidate of the regional sub-constituency. Each region was divided into single-member sub-constituencies, and candidates were expected to obtain 65% of the vote to win. When this was not achieved, as was almost always the case, the party votes were aggregated at the regional level, and seats were assigned using the D’Hondt method.

In the early 1990s, several shocks affected Italy’s political institutions: a series of judicial inquiries into corruption were opened on the existing political class; most of the old parties disappeared; a new electoral system was created, spurred by a popular referendum; and Italy moved to a mixed-plurality electoral system in 1993. From 1994 to 2005, in the Chamber of Deputies, 75% of the MPs were elected via a plurality system, and the remaining 25% according to a proportional system. In the Senate, the numbers were 232 members and 83 members, respectively. In 2005, Law n.270 modified the electoral system to one that is proportional but oriented toward plurality without votes of preference. In the Senate, seats are assigned at the regional level, with additional seats awarded to the party that wins the relative majority within each region; in the Chamber, there is a double threshold to obtain the premium. Italian electoral systems, mainly in the Second Republic, have always been hybrid forms of plurality mixed with proportional rules (see Appendix 1).

During the First Republic, the Democratic-Christian Party (DC) always obtained a (relative) majority of seats and led most of the governments. Typically relegated to the opposition (except for a period of external support given to the government during the 1970s), the Communist Party (PCI) was the second-largest party in Italy. Other relevant parties during the First Republic were the Socialist Party (PSI), the Social Democrats (PSDI), the Liberals (PLI), the Republican Party (PRI), and the Italian Social Movement (MSI). All these parties, with the exception of the MSI (composed of former fascists), supported the government. During the Second Republic, parties often changed names, split, and re-aggregated. As early as 1991, the PCI transformed into the Democratic Party of the Left (PDS first, then DS). Part of the PCI’s membership did not join the new group, forming instead the Communist Refoundation (RC), which later split into the Communist Refoundation–European Left (RC-SE) and the Italian Communist Party (PdCI). The Northern League and La Rete (meaning “the Network”—a small left-wing party) obtained seats in parliament in 1992.

In 1994, the new electoral system governed the beginning of the Second Republic. The electoral competition was characterized by three main coalitions: (1) a center coalition, Pact for Italy, which included the Italian Popular Party (PPI, composed of a part of the former DC) and parts of the former PSDI, PRI, PLI, and PSI; (2) a left-wing coalition led by the PDS that included the RC, the Green Party, part of the old PSI, and the Social Christians (formerly the DC); and (3) a right-wing coalition led by Forza Italia (FI, founded by Silvio Berlusconi) that included the Northern League, the National Alliance (AN, whose members used to belong to the MSI), and the Christian Democratic Party of the Center (CCD). Due to the principle requiring a threshold of votes to be met in order for a party to enter parliament, the new electoral rule favored the formation of two large coalitions. On the right, FI allied with the AN and the Northern League. On the left, the DS (formerly the PDS) formed a center-left coalition called the Olive Tree (L’Ulivo) with minor parties including the Green Party and some on the extreme left. In 2008, some of these parties merged to form the Democratic Party (PD).

Political parties enter our analysis according to whether they support the government or the opposition via parliamentary groups. Therefore, for each legislature, we distinguish between MPs belonging to parliamentary groups supporting the government and those in the opposition (see Table 5 in Appendix 2). On this basis, the variable Government is coded 1 if the MP belongs to a parliamentary group that supports the government and 0 otherwise. The variable Opposition is coded 1 if the MP belongs to a parliamentary group in the opposition and 0 otherwise.

3.2 Change in affiliation and political transformism

For each MP, we consider any changes that occurred during her/his tenure in parliament. The moves recorded occur between parliamentary groups, not parties per se. Given all the government coalitions of the period under study (Table 5 in Appendix 2), for each MP we find four possible changes within a legislature, plus two possible changes between legislatures as follows: moves from a group (or mixed subgroup) supporting the majority to another group (or mixed subgroup) supporting either (1) the majority or (2) the minority; and moves from a group (or mixed subgroup) supporting the minority to another group (or mixed subgroup) supporting either (3) the majority or (4) the minority.Footnote 12 For MPs elected to consecutive legislatures, we record the changes in both (5) electoral constituency and (6) political group, with respect to the previous legislature. Through this process, we capture the phenomenon of political transformism; the variable Political transformists when changing affiliation describes, in a given legislature, the MP’s moves from a majority group (or mixed subgroup) to a group or mixed (sub)group supporting the minority, and the MP’s moves from a minority group (or mixed subgroup) to the majority group or a mixed (sub)group supporting the government. Our definition allows us to also identify a broad group called political transformists, which includes transformist MPs who were re-elected after the switch. In other words, this includes members identified as political transformists in the previous legislatures. The category Other changes includes MPs who switch parties without being transformists.

We do not consider transformists to be (1) MPs who leave a group to form a new political party (e.g., the split of the Socialist Party in 1947 into the PSI and the Italian Labor Socialist Party, PSLI; later the PSDI); (2) MPs belonging to the Radicals who were traditionally elected from different parties, or the Radicals who formed a new party, the Rose in the Fist (“Rosa nel Pugno”) in 2005.Footnote 13 In these special cases, Hirschman’s (1970) exit, voice, and loyalty framework may apply. If party leaders demand absolute loyalty in voting, they deny legislators their voice (to express dissenting opinions) and thus tempt frustrated legislators to exit the party. Because crossing the aisle in Italy does not necessarily lead to leaving parliament, an exit in Hirschman’s terms may remove the motivation to cross the aisle even without becoming a supporter of the incumbent government or without helping an existing party to form an alternative government, thus becoming a political transformist.Footnote 14

Across the 15,344 repeated observations that refer to 7128 individuals, we observe 1984 changes, of which 471 involve transformists and 1513 refer to other changes. Overall, 1125 observations are recognized as political transformist. In Appendix 2, Table 6 defines the main variables, and Table 7 reports some summary statistics.

3.3 Political transformism and re-election in the Italian parliament

According to the legislature (horizontal axis) and inclusive of the Constituent Assembly (CA), Fig. 1 reports the number of MPs who changed political affiliation (vertical axis) according to those who changed for any reason (black line), those defined as political transformists in the current legislature (red line), “other changes” (dashed line), and the larger group of transformists, including those in the legislature under study and those labeled as such during a legislature different from the one considered in the horizontal axis (dotted line).

Fig. 1
figure 1

MPs changing affiliations

The evidence suggests that transformism was more frequent during the Second Republic. This is unsurprising, because the secret ballot was utilized during the First Republic. This voting method possibly obscures instances of political transformism because, even when voting against their own parliamentary group, MPs did not need to disclose their decision or leave the group. In Legislature X of the First Republic, the abolition of the secret ballot in 1988 revealed MPs’ opportunistic behavior. This behavior was accentuated after the fall of the Berlin Wall with the disappearance of the ideological parties, but it clearly emerged during the Second Republic.

Figure 2 reports the re-election rates (vertical axis) across legislatures (horizontal axis). The number of re-elected MPs who changed their political affiliation is much lower than the overall number of re-elected MPs during the First Republic until Legislature XII. In contrast, their number increased during the Second Republic, suggesting that changing affiliation can help candidates win re-election. The re-election rates for MPs who changed their political affiliation, despite their relatively small proportion within the overall membership, are high if compared with those of the whole parliament (all indexes have the same denominator). Moreover, until Legislature X (when the secret ballot was abolished), there were few differences in the re-election rates among changing politicians, transformists, and those changing for other reasons. Subsequently, changes of any type became evident, as they were no longer hidden by the secret ballot, and re-election rates for transformists increased steadily.

Fig. 2
figure 2

Re-election rate of MPs changing affiliation over legislatures

In the econometric analysis, we control for age, gender, and education. The average age of MPs in the Italian parliament is among the highest in Europe (Boeri et al., 2010). Likewise, the average proportion of male MPs in the Italian parliament is 92.21%. The majority of MPs have a university degree (73.77%); however, there are also members of both houses with only an elementary/primary education (2.26%).

4 Empirical framework

Our dataset contains recurrent events that are represented in the data by subjects with multiple observations (i.e., MPs elected to more than one legislature). The data are therefore suitable for a counting process, with a time interval defined for each observation. In this context, subjects are not restricted to equal numbers of time intervals or recurrences, and the first and last events may differ between subjects. The repeated event studied is the recurrence of re-election before exit.

We use the Cox model because it enables us to estimate the hazard of the average MP leaving parliament as a function of a set of explanatory variables. This hazard is estimated between the first and last times the MP is recorded in the sample. In our setup, this period coincides with the length of their term of office, which can span more than one legislature if they are re-elected. The model is as follows:

$$ h(t,X) = h_{0} (t)\exp \left[ {\sum\limits_{i} {\beta_{i} X_{i} } } \right] $$
(1)

The model is defined by the product of the baseline hazard function, \(h_{0} (t)\), which is independent of the set of covariates, X, and \(\exp \left[ {\sum\nolimits_{i} {\beta_{i} X_{i} } } \right]\), i.e., the exponential of the sum, which ensures that the fitted model always gives a non-negative hazard ratio (HR). If all predictors are equal to zero, the formula reduces to the baseline function. Note that \(h_{0} (t)\) is an unspecified function that is taken as a function of time, t, and is assumed to be independent of the predictors; X, the exponential expression, does not involve t as long as the hypothesis of time-independent predictors holds. These mild assumptions are only needed to estimate the parameters of interest.

The assumption that the set of covariates X does not vary with t is called the proportionality hazard (PH) assumption. The hazard function gives the instantaneous potential of the event’s occurrence per unit of time, given that the individual has survived up to time t; by contrast, the survivor function focuses on not failing. Being a rate and not a probability, the hazard ranges from zero to infinity. The impact of each variable on the HR can be determined by taking the natural log (ln) of the estimated parameter of the hazard. In our case, the PH assumption is unlikely to hold given the long time span and the large number of events. Following Kleinbaum and Klein (2005), we adopt the stratified Cox model with recurrent events using the counting process, with Legislature as the stratifying variable. The stratum variable treats the time interval as a categorical variable. This approach allows us to focus on the time in office between the two events (the first and last times the MP is in the sample) and to consider the actual time of the two events from the study entry. The approach uses the exact time data layout, and the risk set is determined for the strata based on events after the first. In other words, Legislature indicates whether subjects were at risk of not being re-elected to their first, second, third, or fourth legislature (and so on). This helps to distinguish the order in which recurrent events occur. In this way, the model captures the re-election of an MP in consecutive elections, which considers MPs’ incumbency advantages. Moreover, it allows us to study the effects of variables that change within the legislature without fitting separate Cox models for each value of the relevant time-varying variable inside the stratum.

This approach also controls for incumbency and persistence. However, for a given subject, the covariates may still be time-independent or time-dependent, and the long period under analysis certainly indicates that time dependence is likely to be the case for many of them (Singer & Willett, 1993). Therefore, we also test for this because if the assumption is violated, the estimates of the coefficients of interest are certain to be biased (Box-Steffensmeier & Zorn, 2001). To test the violation of the PH assumption, we analyze the residuals of a generalization of Eq. (1):

$$ h(t,X) = h_{0} (t)\exp \left[ {\sum\limits_{i} {\beta_{i} X_{i} } + (\gamma f(t)X_{i} )} \right] $$
(2)

where γ is a parameter and f(t) is a function of time. If the variables violate the PH assumption, they should be stratified, or the model should be estimated by keeping the interaction term γif(t)Xi in the set of regressors; it is suggested to set f(t) = ln(t). The function of time adopted is related to the continuous growth of the variables; however, using the alternative specification of this function, f(t) = t, does not alter the conclusions. The set of control variables (Gender, Age, and Education) builds on the literature (Fedeli et al., 2014). We estimate a base model by removing statistically nonsignificant variables from the set of regressors, and we report the effect of each variable individually and interacted with (the ln of) time (Kleinbaum & Klein, 2005).

This general-to-specific approach helps by increasing the degrees of freedom of the estimate and its precision, and by reducing the likelihood that the results will be driven by the high correlation between regressors. The process is conducted as follows. For each pair of nonsignificant variables and its interaction with time, we test the joint significance of the pair, beginning with the least significant. Next, we test the significance of the interaction of each of the remaining variables with time. Finally, we remove the remaining nonsignificant variables, again beginning with the least significant. With this base model, we augment the set of variables by adding those that measure the parliamentary changes: being a “political transformist” as opposed to “other changes,” and the different impact of being a “political transformist when changing” in the legislature. Given the nature of our study, we add two variables that capture whether the MP’s parliamentary group always supported the government or the opposition throughout an entire legislature.

5 Results

5.1 The full period (1946–2013)

Table 2 reports the findings for the period 1946–2013. The PH assumption is always violated for Age and Government. In the absence of switching politicians of any type, the remaining MPs in the opposition groups do not significantly affect the results. On the other hand, while supporting the government has a negative impact on an MP’s re-election, belonging to the majority makes a difference over time, given that the HR of its interaction with time is greater than unity. The results for the control variables suggest that men survive less than women. The HR estimated for Age is slightly greater than unity; the coefficient associated with the time interaction is slightly lower than unity. The evidence supports the hypothesis that age is neutral in determining MPs’ survival, with the clear exception of death. The estimates also show an HR less than 1 for education, which supports the hypothesis that more educated MPs tend to survive less than others.

Table 2 Survival in the Italian parliament: 1946–2013

The results of the base model in column (a) of Table 2 are stable and consistent across all models estimated over the entire 1946–2013 period [columns (b)–(e)]; the set of regressors relevant for survival when politicians switch from one parliamentary group to another refers to MPs supporting either the government or the opposition. This helps to explain the length of their term of office, considering the different aspects of the phenomenon of changing politicians: we consider in column (b) all MPs who changed affiliation; in column (c), we divide the changes into Political transformism and Other changes.

In column (d), we check whether the results are driven by the use of the secret ballot. We create a dummy variable coded 1 for the period when the secret ballot was allowed (until 1988) and 0 afterward, and we interact it with the variables related to switching politicians (Other changes, Political transformists). Finally, we distinguish, in column (e), Political transformists from Political transformists when changing affiliation during the legislature of the stratum.

With respect to the base model, column (b) shows that changing MPs survive longer than those who do not change. In column (c), we find that the changing MPs’ longer survival is driven by Other changes, suggesting that being recognized as a political transformist does not help MPs to serve longer (HR < 1). This result is in line with the literature inspired by career concerns models, where voters care about a politician’s “ability” and its effects on policy outcomes. In other words, forward-looking voters—who consider MPs’ past performance—estimate politicians’ abilities and, thus, their electability. When it comes to transformists, who are likely motivated by the benefits they can receive from remaining in office, voters appear to kick out politicians who (badly) misbehave. The use of the secret ballot in parliament influenced the disclosure of transformism, as shown in column (d). The interacted variables are all significant, and the log-likelihood of the model improves significantly with their inclusion. Secret ballot has a negative impact on re-election chances when interacted with Political transformists and Other changes, for which the HR is less than 1.

When transforming within the legislature (i.e., our stratum), a high HR suggests an immediate reward for betrayal among MPs who helped the government or opposition to change the status quo emerging during the general election. When stratifying the estimation by legislature, we allow the baseline hazard functions to differ for the groups of MPs elected to any legislature. This is equivalent to fitting separate Cox proportional hazards models under the constraint that the coefficients are equal but the baseline hazard functions are not.

In this context, the variable Political transformist when changing affiliation is an internal time-dependent variable that captures changes within the legislature. By construction, it helps us analyze the results in terms of short-term benefits within the stratum, but it has little effect on the expected long-run benefit. Our conclusion in terms of re-election is confirmed, yet the effects of these short-term benefits inside the stratum support the view that a transformist’s re-election is mainly benefitted by changing during the legislature of the stratum. Column (e) shows that the HR for political transformists reduces by more than half when we consider transformists changing affiliation during the legislature of the stratum.

Column (e) allows for a detailed comparison of the probabilities of survival associated with different changes in MPs’ affiliation.Footnote 15 The estimate for Other changes implies a 5.6-percentage-point increase in the probability of survival compared with MPs not changing affiliation. On the contrary, being a Political transformist is significantly associated with an effect of −25.9 percentage points compared with all other non-transformist MPs. The conclusion is similar if we consider the Secret Ballot period, which is associated with a −34.1-percentage-point change in the probability of survival. Finally, Political transformist when changing affiliation corresponds to a probability of survival that is similar to that of MPs changing affiliation; it is 4.8 percentage points higher than that for all other non-transformist MPs.

5.2 The First Republic (1946–1994) versus the Second Republic (1994–2013)

We expect our results to depend on the electoral period, because transformism became more common during the Second Republic when the electoral system was governed by plurality-oriented rules. Here, we study the impact of the electoral system (proportional vs. plurality-oriented systems) on MPs’ political loyalty. Table 3 reports the results for the First Republic.

Table 3 Survival in the Italian parliament: First Republic (1946–1993)

The PH assumption is rejected for the variable Government. This result is expected given that the First Republic represents the larger fraction of the time span under investigation. The variable Government, indicating an MP’s support for the ruling government, is always significant, with an HR less than 1 indicating that government support does not help MPs to survive in parliament. However, the HR for government support becomes greater than 1 when interacted with time. During the First Republic, belonging to the opposition is significant, although it is nearly neutral for MPs’ duration in office (with the HR close to unity in all model specifications).

As for the controls, Gender is significant in all model specifications, with an HR lower than that obtained for the entire period. Likewise, Age is always significant, with an HR close to unity, which is in line with the hypothesis that this variable is neutral. Again, Education is significant, with an HR less than 1. Column (b) gauges the effect of changing affiliation. The HR greater than 1 associated with changes shows that, during the First Republic, switching for any reason helped MPs to survive. Column (c) differentiates between transformism and Other changes. Longer-serving MPs’ changes in affiliation are driven by Other changes; that is, being a transformist does not help an MP to survive.

Column (d) considers whether the results are driven by the use of the secret ballot. The discontinued use of the secret ballot occurs almost simultaneously with the end of the First Republic; therefore, we consider this variable only in interaction with Other changes and Political transformists. These interacted variables are statistically significant, and the log-likelihood associated with the model improves significantly. The secret ballot had a negative impact on re-election chances only when interacted with both Other changes and Political transformists.

Table 4 reports the findings for the Second Republic. Columns (a)–(d) show the results for the entire period, and columns (e) and (f) cover the two subperiods (1994–2006 and 2006–2013). In column (a), the base model shows that the variables never violate the PH assumption, possibly because the period is short. In all model specifications, Age is significant and neutral to the time in office. Gender is never significant, whereas Education (HR < 1) signals higher turnover for the most educated MPs. A peculiar result regarding the Second Republic is that, in the presence of political switchers, being affiliated with a majority parliamentary group significantly increases an MP’s survival. Supporting the opposition is significant in all specifications of the model, but with a negative impact on the time in office.

Table 4 Survival in the Italian Parliament: Second Republic (1994–2013)

The results in column (b) suggest that, for the Second Republic compared with the baseline model, the effect on survival of changing affiliation for any reason produces an immediate return on the term of office (HR > 1). In column (c), this result is divided between Political transformists and Other changes: the higher survival for a changing MP is driven by Other changes, whereas being recognized as a transformist does not help an MP to survive (HR < 1). Again, being a transformist in the legislature of the stratum (column d) produces an immediate reward for MPs who have worked to sway the election results.

Columns (e) and (f) check the validity of the model for the subperiods of the Second Republic. Column (e) refers to the mixed-plurality period. The results are similar to those obtained for the entire Second Republic, with the main difference being due to Education, which is not significant for survival (this period had the highest turnover and a relatively low number of university graduates among the MPs). Belonging to a government coalition helped MPs to survive (p < 0.10), whereas belonging to the opposition is associated with an HR of less than 1. Note that the HR for transformists in the legislature of the stratum takes on the highest value of all the estimated models for the Second Republic. Column (f) refers to a proportional electoral system plurality-oriented and is limited to a few legislatures. Age and Education take on values obtained in the base model of the Second Republic. Belonging to a government coalition helps MPs to survive, whereas belonging to the opposition is not significant. Changes, not transformism, help MPs to survive.

Several empirical exercises testing the robustness of our conclusions, especially regarding the confounding factors and causality concerns, are reported in Appendices 3 and 4.

6 Conclusion

We quantified the phenomenon of political transformism in Italy—separate from the phenomenon of MPs simply changing parties—by considering it a type of opportunistic behavior wherein an MP’s personal interests of power and prestige, clientelism, and pressure groups prevail. We evaluated the impacts of “changing” and “transforming” politicians in a complex multiparty system where the role of parties in parliament emerges via the support that parliamentary groups give to either the government or the opposition. We tested whether these phenomena affect incumbent MPs’ survival by considering the type of electoral system (proportional vs. plurality-oriented) and the parliamentary voting system (open vs. secret ballot). This framework allowed us to capture the differences between the First and Second Republics.

Overall, transformism, always present in Italy, appeared mainly during the Second Republic. This is unsurprising, because the First Republic is characterized by the use of the secret ballot, which contained the emergence of transformism until 1988. When looking at the electorate’s reactions in terms of re-election of incumbent legislators over 1946–2013, MPs who changed political affiliation for any reason survived longer than MPs who did not. By dividing these changes into Political transformism and Other changes, we find that MPs’ longer survival is driven by Other changes, suggesting that being recognized as a transformist does not help. Nevertheless, those transformists who helped the government or opposition to change the status quo emerging from the elections gained an immediate reward for betrayal in terms of higher survival with respect to other/previous transformists.

The Secret ballot had a negative impact on MPs’ survival when interacted with Political transformists; that is, MPs who emerged as transformists during the secret ballot’s use survived a shorter time than those who did so after its abrogation. Similarly, MPs who were transformists outside the stratum saw their opportunistic behavior identified by voters who sometimes punished them accordingly.

We verified that parliamentary survival in the presence of simple switching and transformism is conditional on the electoral laws, and we find some differences between the First and Second Republics. Under the pure proportional system of the First Republic, supporting the government did not immediately reward MPs by ensuring their survival, but it did help over time, whereas belonging to the opposition was neutral. The opposite occurred for the Second Republic under the plurality-oriented electoral system. In this case, supporting the government helped to ensure an MP’s immediate re-election, whereas supporting the opposition did not. Changes for any reason and “other changes” had the same impact on MPs’ time in office during both the First and Second Republics. Nevertheless, transformism during the legislature of the stratum offered a greater immediate reward during the First Republic despite the higher number of transformists in the Second Republic. This is confirmed by the finding that transformists refining their strategies outside of the legislature in which they acted as such have low chances of survival, whereas they are immediately rewarded after coming out as transformists.

The result that MPs’ identification as transformists leads to their punishment by the electorate while those just transformed enjoy a comparative short-term advantage holds true for the overall period and for all subperiods. Along with the evidence of a long-lasting and increasing presence of transformists in the Italian parliament, this finding suggests that an MP’s ability to transform may not fully allow the electorate to rid the parliament of transformists.