Abstract
What explains the variation in tone in politics? Different literatures argue that changes in the tone of politicians reflect changes in the economy, general language, well-being, or ideology. So far, these claims have been empirically tested only in isolation, in single country studies, or with a small subset of indicators. We offer an overarching view by modelling the use of tone in European national parliaments in 7 countries across 30 years. Using a semi-supervised sentiment-topic model to measure polarity and arousal in legislative debates, we show in a preregistered multiverse analysis that the tone in legislative debates is not systematically related to previously claimed factors. We also replicate the absence of such systematic relationships using national leader speeches and parties’ election manifestos. There is also no universal trend towards more negativity or emotionality in political language. Overall, our results highlight the importance of multi-lingual and cross-country multiverse analyses for generalizing findings on emotions in politics.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Introduction
Modern politics is overwhelmingly negative in tone1, and there is widespread belief that the tone of politicians is becoming increasingly more emotional and negative among academics (e.g2,3,4 and journalists (e.g.5,6,7,8). Politicians use their tone to get support for their policies (e.g.9,10,11,12). Yet, if it is correct that the tone of politicians is becoming more emotional and negative, then this is also worrying: a highly emotional and polarized political arena on the one hand encourages voters to vote with their gut instead of their mind, and on the other hand scares off voters disliking the tone13. Especially for marginalized groups the highly emotional and negative tone discourages them to enter politics amplifying unequal representation14. At a macro level, highly emotional and negative tone could prevent cooperation across political parties and ideological lines. But what explains this emotional and negative tone in politics?
Several grand theories contend to explain the rise in emotional and negative tone in the political arena. On the one hand, language, and therefore tone, is seen as fluctuating: for example, responsive to broader societal developments in general language use in society15 or as strategic responses to the changing electoral environment16 and audience17. On the other hand, tone is rather fixed, characterized by an ideological asymmetry between conservatives and liberals18. Research teams from different disciplines develop and test these theories in isolation with specific cases, unique operationalizations, and analysis strategies, in total producing scattered evidence (e.g.4,16,19,20,21,22,23).
We offer an overarching view using a multiverse approach that juxtaposes all data processing, variable operationalization, and modeling choices we deem reasonable24. This allows us to test multiple theories in multiple ways. In total, we estimate and present the results from 12,096 model specifications across seven European national parliaments and three decades, using legislative debate transcripts. These data speak directly to claims that the conduct of politics is becoming more negative and more emotional. This way we bridge disciplines, reconceptualize the dependent variable, and improve on research designs. Overall, we do not find support for a trend towards more negative or more emotional speeches in European parliaments. We are also not able to systematically replicate most previous findings on the determinants of tone in politics across countries. In addition, we also find no consistent evidence to support previous findings in our replication using election manifesto and leader speech data. This absence of evidence suggests that to explain the ups and downs in the tone of political language we require theories with a stronger role for context and agency.
In this paper, we are using the term tone. Terms such as sentiment, emotive rhetoric, and negativity have also been used to analyze the tone politician strike (e.g.17,22,25) in what we call political texts such as speeches, debates or election manifestos. In such texts politicians use emotional tone to engage with their audience. Following the core affect model26, tone differs in polarity (positive or negative) and arousal (emotional intensity). Tone can be used in both strategic or spontaneous utterances to convey a message. Thus, an important distinction here is that politicians who express emotional tone are not necessarily feeling emotional themselves.
What then explains the variation in tone? A finding that is systematically replicated is that (politicians of) government parties use more positive tone than (politicians of) opposition parties (e.g.16,19,20,21,25). In addition to this, various disciplines in the social sciences and humanities propose different arguments, to which we will turn now.
First, language itself changes. While common words are passed down through multiple generations for centuries, language evolves dynamically27 with some words getting in and out of fashion28. Also the meaning and concepts attached to words changes over time29,30. This is also the case for the emotions expressed in language. For instance, the language in American books, song lyrics, and newspapers has become more negative over the last decades31,32. At the same time, English language books became less emotional over time, while polarity fluctuates between periods33. Temporal changes are also observed in political language. For example, compared to previous decades, English-speaking politicians today use fewer words connected to analytical thinking15. Speeches of politicians also became less complex over time34,35,36,37. We, however, do not know if polarity and arousal in politics exhibit similar trends. Expecting that general language changes over time and political language following suit, we propose:
-
H1: More positive general language use in society leads to more positive language of parliamentary debates.
-
H2: More arousal in general language use in society lead to more arousal in the language of parliamentary debates.
Second, politicians have incentives for reelection, and therefore need to be perceived as responsive to (changing) citizen demands38. For example, a deep economic recession requires a response from politicians. Economic performance affects voting39, with government parties typically punished for poor economic performance, and opposition parties rewarded. Politicians, therefore, are incentivized to respond to changes in the economy. This may also be reflected in their tone: when the economy is underperforming politicians may be motivated to express the negative emotions felt by their constituents, when the economy is performing well they may wish to fuel a positive feeling in their constituents16,19,40. In total, we expect that the better the economy, the more positive the tone.
-
H3: Increases in economic performance lead to more positive language of parliamentary debates.
We can also interpret the strategic perspective more broadly. Politicians have been found to be responsive to a public mood41. With mood political scientists refer to the public’s preference for a certain set of policies. For example, if citizens increasingly favor restrictive immigration policies, politicians follow or anticipate this and propose such policies42. Psychologist instead define mood as a long-lasting, persistent emotional state43. We define a public mood, then, as an aggregated persistent emotional state of citizens. Like the public mood of political science, politicians may be equally responsive to the public mood we define here. This means that politicians are incentivized, to some extent, to express the emotions their constituents feel. For example, in response to a national disaster, politicians may have to display sadness because this reflects the public mood. On the macro level, the public mood—how we define it—varies between countries and over time44. Importantly, this public mood does not necessarily become more positive as countries get richer45, suggesting that happiness includes more than economically motivated well-being. We hypothesize that these public moods should also be reflected in parliament, with politicians not only representing the policy preferences of their electorate, but also their emotional state.
-
H4: Increases of subjective happiness in society lead to more positive language of parliamentary debates.
What these expectations have in common is that they are motivated by strategic considerations, and that politicians can change their tone. Psychology, however, also offers another perspective that argues that politicians should be much more consistent in tone in their political texts.
Particularly relevant is the negativity bias—the inclination to respond stronger to negative stimuli compared to positive ones. Conservatives, arguably, have stronger negativity biases than liberals do46,47. This is also reflected in the more negative tone conservatives use in political texts compared to liberals18,48,49. Negativity bias and ideology are rooted in personality, therefore, this a much more stable feature than any of the strategic conditions discussed. Psychologists consistently report correlations between personality and ideology. Personality describes a set of stable, long-term patterns of thinking, feeling and behaving. Personality traits such as extraversion, openness and conscientiousness systematically correlate with ideology, with for example low openness and high conscientiousness associated with conservatism. This is relevant because personality also correlates with tone50,51,52,53. For instance, neuroticism is linked to negative emotion experience54,55 and extraversion correlates positively with positive emotions56,57. Further, a study finds that both agreeableness and conscientiousness are negatively related to negative emotions53. Such patterns in the words we use (also think about use of pronouns, six-letter-words, words indicating vagueness) are relatively stable over time across a variety of contexts52,58. Personality is thus associated with preferences for tone and ideology. Because specific personality traits are more strongly associated with sociocultural conservatism than with economic conservatism59,60,61, we expect polarity to be most likely related to sociocultural conservatism:
-
H5.1: Culturally conservative politicians speak more negatively than culturally liberal politicians.
There is, however, a growing body of research that more critically assesses the alleged ideological asymmetry between conservatives and liberals. For instance, recent studies did not find support for the link between negativity biases and political ideology in a series of cross-country psychophysiological experiments62 or for physiological correlates of ideology63. These results are in line with other recent work that failed to find evidence for a causal effect of personality on ideology64,65,66. In sum, the tone of conservative and liberal politicians might not differ after all. But even if there is a difference in negativity bias and tone, we don’t know if it is innate or can be strategically adapted to the goals of the politician. We thus also pose a contrasting hypothesis:
-
H5.2: Cultural conservatism is not associated with the polarity in the language of parliamentary debates.
Within parties, politicians also need to build their personal brand and compete for resources such as public exposure. Especially new politicians are often limited in their public visibility and need to build a brand, a long-lasting associations between their name, their issue positions and communication strategy in a competitive market67. Emotions are typically an important part of a brand identity68. Political marketing views political parties and politicians from a brand perspective, assuming that voters make their electoral choices similar to how consumers make purchasing decisions69. To increase their visibility and recognition, politicians can attract attention by attacking their opponents70. In addition, this can benefit their reputation within their party for carrying out the “dirty” work of negative attacks. To increase their visibility, we expect less experienced politicians to speak more negatively.
-
H6.1: More experienced legislators speak more positively in parliamentary debates.
Are they also more emotional than more experienced politicians? New politicians are also typically younger, and age generally correlates with a lower intensity of emotional experience71. Also, older people display emotions to a smaller extent and are more effective with regulating their emotions72. In addition, new and unexpected experiences can cause stronger emotional experiences73. We would thus expect that less experienced politicians are more emotional in their communication. We thus pose the following hypothesis:
-
H6.2: More experienced legislators speak with less arousal in parliamentary debates.
It is difficult to compare and generalize previous findings (e.g.4,16,19,20,21,22,23 regarding the use of emotions in political speeches because they differ in samples of political texts, country selection, time selection, operationalization of variables and specification of statistical models (e.g. time-series models vs. multilevel models). We move beyond these limitations by adopting a multiverse approach24. This allows us to include all justifiable analytical choices regarding sample, operationalization and model specification and generate robust evidence.
We analyse the effects of these mechanisms on both the polarity and arousal of legislators’ tone in parliamentary debates using the ParlSpeech v274 dataset. Parliamentary proceedings provide the perfect type of data because they are full records of political texts across long time spans, with comparable recording procedures between countries. The also speak directly to claims that the everyday conduct of politics is becoming more negative and emotional. We preregistered our study on OSF (https://osf.io/ur5xg/). Overall, we do not find evidence for any of our hypotheses. Instead, our multiverse analysis shows that the direction of the associations can go either way or are not statistically significant, depending on the specific model specification or country. To ensure our results are not driven by this specific type of data (parliamentary speeches), we replicated all analyses on two additional datasets that have been used in previous work on political communication: election manifestos75 and EU leader speeches76, also preregistered as a follow-up study (https://osf.io/v958t). Our conclusion remain the same.
Results
To answer if tone in parliament indeed became increasingly negative and emotional over the last decades, Fig. 1 presents quarterly measures of speech polarity and arousal in the studied European parliaments. These measures have been normalized by country, thus negative (positive) values indicate quarterly scores below (above) the country mean. Overall, no uniform trends towards more negativity and emotionality are visible. Only in one country (Spain) parliamentary language became more negative, and a minority of European parliaments (Denmark, Spain, Sweden) show a trend towards more emotional language in parliament. This is in contrast to finding from the U.S., where language became more emotional77 and negative4. In sum, European parliaments show a heterogeneous picture when it comes to trends in the tone legislators strike.
Using a multiverse approach24, we specify up to 1296 multilevel models per country and dependent variable, each using different measurements of variables and model specifications. Each of these analytical choices is arbitrary in the sense that they are all equally justifiable. Table 2 in the “Methods” section gives an overview of all choices we considered. There we also explain each variable operationalization in detail. We measure polarity and arousal in the speeches of each individual legislator per quarter, using a semi-supervised sentiment-topic model78,79,80 seeded with validated multilingual Lexicoder sentiment dictionaries81,82. We explain this measure in detail in the “Methods” section (under Emotional polarity and Emotional arousal), and validate it in Appendix C. Our hypotheses, analytical strategy, and a replication using different data sources are preregistered (https://osf.io/ur5xg/). Deviations from these plans are explained in Appendix D. When interpreting effect sizes, it is important to keep in mind that even small changes in textual measures can indicate a substantive difference in the tone of a speech (see e.g.16).
Figure 2 present the results from the multiverse analysis, and shows the estimated effects of 1,296 multilevel models per country (432 models for arousal). The dependent variable in panel A is the quarterly aggregated polarity of speeches given by an individual legislator. Panel B shows speech arousal. To illustrate, the top-right plot shows the specification curve of the experience variable on speech polarity in Austria. All dots of the specification curve are grey, thus each model estimate is insignificant with \(p \ge 0.05\) using a two-sided test. In contrast, the top-left plot (the estimated effects of the general language polarity in Austria) includes statistically significant positive and negative effects shown in red. In this case, about 30% of the models result in a statistically significant effect of general language polarity on speech polarity in parliament. However, some of these effects are positive, and some are negative, giving an inconclusive picture.
Preregistered analyses
We expected that with general language becoming more positive (H1) or more arousing (H2), parliamentary debates should follow in the same direction. Overall we do not find support for either hypothesis. Across all countries, we find conflicting results for the relationship between general language and tone in parliament. While in the majority of models the estimates are non-significant, the they also differ in direction between countries. Regarding polarity (H1) the results point into a positive direction in Germany, but towards a negative relationship in Sweden. The picture is similarly mixed for arousal (H2), with positive (Austria, Germany) and negative (Netherlands) estimates. Again, most results are not statistically significant.
We preregistered that increases in economic performance are positively associated with more positive language of parliamentary debates (H3). Again our results are inconclusive: For most countries we find both positive and negative, and mostly insignificant, estimates. The only exception is the United Kingdom, where our results show a positive relationship between economic performance and polarity across almost all multiverse specifications, replicating previous findings from this country (e.g.20).
Similarly to economic performance, we expected that increases of subjective happiness in society are associated with more positive language of parliamentary debates (H4). Across all models our results are inconclusive. While some models do produce statistically significant effects, they are positive in Germany and the Netherlands, but negative in Austria, Denmark, and the United Kingdom.
Turning to ideology, we had two competing hypotheses. H5.1 predicted ideological asymmetry (culturally conservative politicians speak more negatively than liberal politicians), while H5.2 predicted ideological symmetry (no difference between culturally conservative and liberal politicians). Overall, we do not find support for either hypothesis: Conservatism is associated with more negative tone in legislators’ speeches in Austria (half of the models), the Netherlands, and Sweden, but for some countries the effect is reversed (Denmark, Germany, United Kingdom). For Spain the results point towards a negative relationship, but the estimated effects are not statistically significant across the multiverse. While ideology and tone seem to be related, this relationship differs in direction between countries. We thus conclude that the effect of ideology on polarity is context-specific and cannot be generalized. In addition we looked at the effect of ideological extremism (not preregistered), and we expected more extreme politicians to speak more negatively. We do not find conclusive evidence for this either.
We formalize the interpretation of the effect of ideology on polarity across specifications using a bootstrapping procedure. We use bootstrap resampling to create a distribution of specification curves under the null hypothesis (no relationship between the independent and dependent variable), and test how inconsistent our obtained results are with the null hypothesis of no effect. We explain this procedure in detail in the “Methods” section (under Joint inference tests across multiverse specifications). Table 1 presents the results of these joint inference tests. Each line in the table presents the median effect of conservatism and extremism across the multiverse of specifications for each country, as well as the associated bootstrapped p-value. As already indicated visually in Fig. 2, there is no systematic effect of ideology (cultural conservatism or ideological extremity) on language polarity across countries. In all but one countries we do find a robust statistically significant association between ideology and polarity, but the direction of the association differs between countries. We thus conclude that we neither find support for the ideological asymmetry hypothesis H5.1 nor for the ideological symmetry hypothesis H5.2.
We also expected experienced politicians to speak more positively (H6.1) and with less arousal (H6.2). For both hypotheses our results provide conflicting evidence. In most countries the effects of experience on polarity are not statistically significant across the entire (Austria, Denmark, Spain) or majority (Sweden) of the multiverse. They are, however, consistently positive in Germany and the United Kingdom, but point towards a negative relationship in the Netherlands. Regarding arousal our results paint a similar conflicting picture.
Exploratory analyses
In addition to our preregistered hypotheses we also explored additional correlates of tone in politics. Across countries and multiverse specifications, our single consistent finding is that legislators of government parties speak more positively compared to their colleagues from the opposition, replicating previous studies (e.g.16,19,20,21,25). We had no hypothesis about the relationship between ideology and arousal, and do not find evidence for ideological asymmetry when it comes to speech arousal. Unlike parliamentary debates in the U.S.77, there is no consistent relationship between speech arousal and ideology or ideological extremism. Previous studies found a relationship between political polarization and polarity in the United Kingdom19, with more positive language being used in times of low positional party polarization. We, however, find the opposite correlation across multiverse specifications in the United Kingdom, with similar results in Germany. In all other countries, our results are either not statistically significant or point in both positive and negative directions. Also, unlike previous studies17,83,84 we do not find a systematic relationship between gender and polarity or arousal. The only notably exception is Sweden were male legislators speak with more arousal compared to female legislators. We also explored interaction effects between the economy and government and between happiness and government in Appendix B. We do not find any systematic relationship here.
Replication
Do our results generalize to other types of political text? To test this we replicated our analysis with two additional datasets: the Manifesto Project dataset75 and the EUSpeech v2 dataset76 using the 7 countries from the original analyses. These new analyses were preregistered after finishing the original analysis and follow the same procedure where possible. These results, presented in Appendix B.1 and B.2, do not change the general conclusion: there are no systematically positive or negative effects across countries and specifications.
Discussion
Modern politics is overwhelmingly negative in tone1, and many believe that political language is increasingly negative and emotional (e.g.2,3,4,5,6,7,8). This has sparked interest in possible explanations of the ups and downs of emotions in politics (e.g.16,19,20). To systematically test several contending theories we conducted a multiverse analysis to explain the variation in the polarity and arousal of tone in 7 national parliaments. We find no evidence of a systematic effect of any of our theorized relationships. We do replicate the single, systematic finding that politicians from government parties use more positive tone than politicians from opposition parties.
Our multiverse approach produces findings across a large set of model and variable specifications. These results highlight that generalizations from existing theories, so far tested only in isolation and limited cases, are weak. They also illustrate that choosing a single specification could lead to biased conclusions. Other researchers might consider different analytical decisions, leading to a differently specified multiverse. Given the variation in the results, we believe it to be unlikely that an even larger multiverse leads to more systematic results. In sum, the multiverse approach produces a robust evaluation of the evidence.
In this paper we tell it like it is. Our results are statistically significant at times, but the direction of the effects varies between positive and negative across countries. Rather our suggestion is that we require theory with a stronger role for context and agency.
To illustrate, the ideological asymmetry claim stems from an assumed personality difference between liberals and conservatives. Personality is closely linked with linguistic habits, such as using particular emotion language. Yet, ideology does not explain all variation in personality. Therefore, personality may be linked to tone in a much richer way than ideology alone. For one, agreeableness is often linked with anger expressions but not with ideology. But also, personality may explain why two politicians would use entirely different tone in response to the same event. In sum, personality remains relevant, but rather as a way to theorize more complex individual-specific relationship with the polarity and arousal of tone.
Also, the hypothesised effects may be context-specific because not all mechanisms can work the same way in different political systems. For instance, national parliaments differ in the ability of individual members to speak, with high party control in most of them. It thus might be that the individual ability to strategically respond to changing environments is more pronounced in parliaments like the House of Commons where all members have an equal opportunity to speak. Different political systems also provide different electoral incentives to respond verbally. Further, it might also be the case that only specific time periods in the legislative cycle or types of debates allow for these mechanism to play out. The challenge here is that there are few countries we can compare, and many variables on which they differ.
While our study provides valuable insights using legislative debates, it is important to recognize the characteristics of this data source. Legislative debates might exhibit different trends in polarity and arousal compared to campaign advertising, news coverage, or social media communication. While legislative debates, like election manifestos or leader speeches, represent a highly formalized domain distinct from other platforms, they enable us to identify intentional decisions shaping the tone of politics. Therefore, our conclusions are limited to the platforms we have studied, and different patterns might emerge from campaign materials or other communication platforms. Future research would benefit from expanding our study to include these different platforms.
In addition, it’s worth exploring how political leaders might influence citizens’ emotional preferences. Drawing from research on the influence politics elites have on public preferences85,86,87 leaders might not just reflect public sentiment, but actively shape it. Understanding this potential feedback loop—where leaders’ tones impact public emotion—would enhance our understanding of political discourse dynamics.
Substantively, you may read a positive note in our conclusions. First, there is not a universal trend towards more negativity or more emotionality in political language. Rather, we observe ups and downs in polarity and arousal. Second, the suggestion that agency is more important than currently thought, proposes that politicians are not bound by some “iron cage” of emotionality, but that they themselves have a choice.
Materials and methods
Data
The data for our dependent variables is based on parliamentary speeches and come from the ParlSpeech v2 dataset74. This dataset contains annotated full-text vectors of roughly 6.3 million plenary speeches in the key legislative chambers of Austria, the Czech Republic, Germany, Denmark, the Netherlands, New Zealand, Spain, Sweden, and the United Kingdom, covering periods between 21 and 32 years. The covered periods lie between 1987 and 2019. New Zealand is excluded from the analysis because of missing data in the independent variables. The Czech speeches were dropped because there is no Czech language stemmer in R. Additional data to measure independent variables come from the OECD Statistics Data88, the Manifesto Project dataset (MP)75, the ParlGov dataset89, and the Eurobarometer surveys
Multiverse analysis
We follow a multiverse approach24 and display our results in the form of a specification curve90: Instead of only presenting one dataset and model resulting from our selection of variables, operationalizations, and modelling choices, we present the multiverse of datasets and models resulting from all choices we consider possible and reasonable. We then run all analyses on all of these datasets and present these results across all datasets and models. For each country we study, we use legislator level models (speeches aggregated by legislator and quarter) to test our hypotheses. We analyze each country individually, because formal and informal rules about who speaks in parliament differ between countries91. Table 2 lists the choice of variables and models we consider equally justifiable for the analysis. All options represent multiple ways the datasets and models can be constructed. The dependent variable is either polarity or arousal. In the remainder of this “Methods” section we provide additional details about these alternatives.
Model specification
Our models deal with variation in our dependent and independent variables over time, within, and in-between legislators. To deal with this nested and time-dependent data structure, different ways of modelling have been employed in the literature on legislative speech making (e.g.92,93). The major difference compared to that literature is that our data deals with the content of legislative speeches, and not with the number of speeches given. We use multilevel models (quarterly measures clustered within legislators) using legislator random intercepts. To account for the repeated measurement of the dependent variables, we include models with a lagged dependent variable. In addition, following papers treating time as clusters on their own (e.g.94), we also estimate models with observations clustered within legislators and quarters, both with and without a lagged dependent variable. We also specify models with interaction effects between the government status of a legislator and economic performance/subjective happiness (see Table 2).
Joint inference tests across multiverse specifications
To simulate p values for inference tests across the multiverse of model specifications we use a bootstrapping-under-the-null procedure95. In contrast to a simpler permutation test this procedure does not assume randomly assigned independent variables, and is suitable for observational data90. We force the null-hypothesis of no effect on the data, and test how surprising our obtained results are given the null-hypothesis of no effect. Applying this approach to our multiverse analysis leads to the following steps:
-
1.
We estimate all K specifications with the observed data. These result in K different point estimates: \(\hat{b}_k\) with \(k = 1 \ldots K\).
-
2.
We generate K different dependent variables under the null, \(y_k* = y_k - \hat{b}_k \times x_k\). Now every row of data has x values and K different \(y*\) values.
-
3.
We draw at random (with replacement) N rows from this dataset, using the same drawn rows of data for all K specifications.
-
4.
We estimate the K specifications on the drawn data.
-
5.
We repeat steps 3 and 4500 times.
-
6.
For each bootstrapped sample we now have K estimates, one for each specification. We calculate how many of the resampled specification curves result in a significant effect at \(\alpha = 0.05\). We then calculate the percentage of resamples that exhibit an equal or larger number of significant effects compared to the results from the observed data. This percentage is the p-value of the joint inference test.
Emotional polarity
We use the polarity dimension of the core affect model26 to operationalize positive language use. We use a semi-supervised joint sentiment-topic model (JST)78,79 to measure polarity in the transcripts of parliamentary speeches. Compared to a plain application of sentiment dictionaries, this procedure improves the overall estimate of speech sentiment because it takes into account the context of a topic in which a word is used80, and we show a validation of the measure in appendix C. Importantly, JST models models take an emotion dictionary as input, and combine it with an unsupervised Latent Dirichlet Allocation (LDA) model96 that estimates the occurrence of topics in a text. To estimate these joint sentiment-topic model we use the sentitopics package for R. It follows the original implementation of JST78 and requires a sentiment dictionary as input. We use the Lexicoder Sentiment Dictionary81 and its machine-translated versions82, which have been extensively validated on political texts, including parliamentary speeches82. After feeding JST with these dictionaries, it estimates topic-specific sentiment and combines it into one overall document-level sentiment probability. For each text the model returns probabilities that the text is positive, negative, or neutral: If the model finds many words associated with positive topic-sentiment, the probability of the positive label increases. Vice versa, the probability of the negative label increases if the model finds many words associated with negative topic-sentiment. The literature operationalizes polarity in different ways. With our multiverse approach we can take into account these different specifications. The first option is to subtract the probability of negative sentiment from the probability of positive sentiment. This can be written as:
We also consider a transformation that weights the scores obtained from Eq. (1) by the arousal of a text (probability a text is positive or negative) in the following form:
Finally, following other studies on parliamentary speech polarity82, we conceptualize polarity as the logged ratio of probabilities of positive to negative sentiment labels:
In all three cases, the polarity measure is bound between -1 (extremely negative) and 1 (extremely positive).
Emotional arousal
Our second dependent variable reflects the intensity dimension of the Circumplex model. The measurement of this variable essentially follows the procedure described above. In fact we are using the same output from the JST model to measure arousal. To arrive at a continuous measure of arousal we sum the probabilities of the positive and negative labels. This can be written as:
Since we are summing probabilities, this measure of arousal is bound between 0 and 1, where 0 indicates a text is entirely neutral (in this case the probability of the third, neutral category from the JST model would be 1), and 1 indicates a text is extremely emotional. This way, the difference between positive and negative probabilities can be small, while still containing high levels of arousal.
The preprocessing we apply to the speech data (text of speeches) includes removing speeches by the chair (who mainly cover procedural aspects), lower-casing, removal of non-alphabetic characters, removal of stopwords, and stemming. We also remove speaker-quarter observations with less than 50 words because they would make the measurement of the dependent variable unreliable. After this procedure, features that occur less than 10 times and in more than 95% of all documents within each legislature are removed to increase computational efficiency.
General language
We use two data sources to measure the polarity and arousal of the general language used in a country: (1) the written words produced in each of the languages included in our dataset using the Google Books corpus, and (2) movie subtitles for each language using the opensubtitles.org corpus97. The polarity and arousal of the movie subtitles are measured using the Lexicoder dictionaries applied to the corpus, while for the Google Books corpus we used the Google Ngram Viewer, accessed via the ngramr R-package98, to look up the word shares of the words from the Lexicoder dictionaries in the respective language specific corpus and time period. We also use the (3) mean of these two measures. This allows us to investigate the combined effect of language change as well as differences between cultural institutions. Because the Google Books corpus is only available in German, English, and Spanish, the measurement of general language is limited to movie subtitles for Denmark, the Netherlands, and Sweden.
Subjective happiness
Our measure of subjective happiness in society follows previous research on happiness and politics using self-reports of life satisfaction from large, representative samples (e.g.99,100,101,102). The variable is measured as the mean of all respondents per country to the life satisfaction question that has been asked in the Eurobarometer surveys since 1973. For that, the four ordinal answers of surveyed individuals are recoded into numeric values from 1 to 4. As our data source we use a dataset containing the combined Eurobarometer subjective happiness data from our studied time period102.
Economic performance
To measure economic performance we use different indicators of economic prosperity. Economic growth is the percentage growth in real GDP expenditures from the OECD Statistics Data88. We consider the economy to be in a recession if growth is negative in two consecutive quarters. Also the unemployment rates come from the OECD Statistics Data. In addition, we create an index of economy prosperity by combining the growth and unemployment indicators. We include these different measures because different measures of objective well-being have been used in previous studies (e.g.16,20).
Cultural conservatism and extremism
We measure cultural conservatism on the party level using a cultural liberal-conservative scale. Using the CMP dataset, we subtract attention to liberal issues in the dataset from the attention to the conservative issues. Liberal issues include pro-EU, pro-immigration, anti-national way of life, anti-traditional morality, pro-multiculturalism, anti-military, pro-internationalism, anti-imperialism, pro-peace, pro-environment, pro-culture, and support for under-privileged minority groups statements. Conservative issues include anti-EU, anti-immigration, pro-national way of life, pro-traditional morality, anti-multiculturalism, pro-military, anti-internationalism, pro-Freedom and Human Rights and pro-political authority, pro-law and order statements. Similar to previous work creating a composite scale from manifesto data (e.g.37,103), we use the log-transformed sums of attention to these individual issues. By squaring this score we arrive at the extremism measurement.
Party system polarization
We measure party system polarization using the index by Dalton104. This index uses the left-right score of the CMP data, and calculates party system polarization as:
Legislator experience
To measure the experience of a legislator in a given quarter, we count the number of quarters since the first time they entered parliament, independent of weather they served in parliament without interruptions.
Government status
We control for the government status of the party a legislator belongs to. This is measured using the information on cabinet composition from the ParlGov dataset89, and equals 1 if a legislator’s party is in government during a quarter, and 0 otherwise.
Topic saliency
We control for the selection of topics MPs speak about using the topic estimates of the joint sentiment topic model, which can be interpreted as the percentage a document is about a given topic. We aggregate these topics into 5 different thematic categories, and use these meta-topics for the further analyses. These topics are: (1) EU/European Integration, (2) Economy, (3) Security, (4) Healthcare, and (5) Immigration. The selection of these meta topics is based on an initial analysis of speeches from the UK ParlSpeech v1 data, where these meta-topics emerged as meta topics covering a large share of speeches.
Party size
We also control for party size, measured as the seat share of the party a legislator belongs to using the ParlGov dataset89.
Elections
We also control for possible effects of elections on speech polarity and arousal. We consider three ways to specify this variable and set a dummy variable to 1 for: (1) quarters preceding a general election, (2) quarters where an election takes place, and (3) quarters preceding a election and quarters where an election takes place.
Data availability
All data analyzed in this study are publicly available. Links to all data sources can be found in the preregistration document and the OSF project site: https://osf.io/ur5xg/.
Code availability
All scripts used for the analyses presented in this study will be made available upon publication on the OSF project site: https://osf.io/ur5xg/.
References
Soroka, S. N. Negativity in Democratic Politics: Causes and Consequences (Cambridge University Press, 2014).
Külz, J., Spitz, A., Abu-Akel, A., Günnemann, S. & West, R. United States politicians’ tone became more negative with 2016 primary campaigns. Sci. Rep. 13(1), 10495 (2023).
Lengauer, Günther., Esser, Frank & Berganza, Rosa. Negativity in political news: A review of concepts, operationalizations and key findings. Journalism 13(2), 179–202 (2012).
Rhodes, J. H. & Vayo, A. B. The historical presidency: Fear and loathing in presidential candidate rhetoric, 1952–2016. Pres. Stud. Q. 49(4), 909–931 (2019).
Caryl, C. The world is awash in the politics of fear. The Washington post (2018).
Davies, W. How feelings took over the world. The Guardian (2018).
Freeman, J. America descends into the politics of rage. The Atlantic (2018).
Albert Arnold Gore. The Assault on Reason: How the Politics of Blind Faith Subvert Wise Decision-Making (The Penguin Press, 2007).
Erisen, C. & Villalobos, J. D. Exploring the invocation of emotion in presidential speeches. Contemp. Politics 20(4), 469–488 (2014).
Ojala, Maria, Cunsolo, Ashlee, Ogunbode, Charles A. & Middleton, Jacqueline. Anxiety, worry, and grief in a time of environmental and climate crisis: A narrative review. Annu. Rev. Environ. Resour. 46(1), 35–58 (2021).
Stapleton, Carey E. & Dawkins, Ryan. Catching my anger: How political elites create angrier citizens. Political Res. Q. 75(3), 754–765 (2022).
Werlen, E., Imhof, C., & Bergamin, P. Emotions in the parliament: Lexical emotion analysis of parliamentarian speech transcriptions, in SwissText (2021).
Lau, R. R. & Pomper, G. M. Effects of negative campaigning on turnout in U.S. senate elections, 1988–1998. J. Politics 63(3), 804–819 (2001).
Hobbs, William & Lajevardi, Nazita. Effects of divisive political campaigns on the day-to-day segregation of Arab and Muslim Americans. Am. Political Sci. Rev. 113(1), 270–276 (2019).
Jordan, K. N., Sterling, J., Pennebaker, J. W. & Boyd, R. L. Examining long-term trends in politics and culture through language of political leaders and cultural institutions. Proc. Natl. Acad. Sci. U.S.A. 116(9), 3476–3481 (2019).
Crabtree, C., Golder, M., Gschwend, T. & IndriĐason, I. H. It is not only what you say, it is also how you say it: The strategic use of campaign sentiment. J. Politics 82(3), 1044–1060 (2020).
Osnabrügge, M., Hobolt, S. B. & Rodon, T. Playing to the gallery: Emotive rhetoric in parliaments. Am. Political Sci. Rev. 115(3), 885–899 (2021).
Wojcik, S. P., Hovasapian, A., Graham, J., Motyl, M. & Ditto, P. H. Conservatives report, but liberals display, greater happiness. Science 347(6227), 1243–1246 (2015).
Kosmidis, S., Hobolt, S. B., Molloy, E. & Whitefield, S. Party competition and emotive rhetoric. Comp. Pol. Stud. 52(6), 811–837 (2019).
Rheault, L., Beelen, K., Cochrane, C. & Hirst, G. Measuring emotion in parliamentary debates with automated textual analysis. PLoS one 11(12), e0168843 (2016).
Schwalbach, J. Going in circles? The influence of the electoral cycle on the party behaviour in parliament. Eur. Political Sci. Rev. 14, 1–20 (2021).
Valentim, V. & Widmann, T. Does radical-right success make the political debate more negative? Evidence from emotional rhetoric in German state parliaments. Political Behav. 45(1), 243–264 (2021).
Widmann, T. How emotional are populists really? Factors explaining emotional appeals in the communication of political parties. Polit. Psychol. 42(1), 163–181 (2021).
Steegen, S., Tuerlinckx, F., Gelman, A. & Vanpaemel, W. Increasing transparency through a multiverse analysis. Perspect. Psychol. Sci. 11(5), 702–712 (2016).
Haselmayer, Martin & Jenny, Marcelo. Sentiment analysis of political communication: Combining a dictionary approach with crowdcoding. Qual. Quant. 51(6), 2623–2646 (2017).
Russell, James A. A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980).
Lieberman, E., Michel, J. B., Jackson, J., Tang, T. & Nowak, M. A. Quantifying the evolutionary dynamics of language. Nature 449(7163), 713–716 (2007).
Johnson, E. Lexical Change and Variation in the Southeastern United States, 1930–1990 (University of Alabama Press, 1996).
Kozlowski, A. C., Taddy, M., & Evans, J. A. the geometry of culture: Analyzing meaning through word embeddings. Am. Sociol. Rev. 000312241987713 (2019).
Rodman, E. A timely intervention: Tracking the changing meanings of political concepts with word vectors. Political Anal. 28, 1–25 (2019).
Brand, C. O., Acerbi, A. & Mesoudi, A. Cultural evolution of emotional expression in 50 years of song lyrics. Evol. Hum. Sci. 1, e11 (2019).
Iliev, R., Hoover, J., Dehghani, M. & Axelrod, R. Linguistic positivity in historical texts reflects dynamic environmental and psychological factors. Proc. Natl. Acad. Sci. U.S.A. 113(49), E7871–E7879 (2016).
Acerbi, A., Lampos, V., Garnett, P. & Bentley, R. A. The expression of emotions in 20th century books. PLoS one 8(3), 59030 (2013).
Lim, E. T. The Anti-Intellectual Presidency: The Decline of Presidential Rhetoric from George Washington to George W. Bush (Oxford University Press, 2011).
Spirling, Arthur. Democratization and linguistic complexity: The effect of franchise extension on parliamentary discourse, 1832–1915. J. Politics 78(1), 120–136 (2016).
Teten, R. Evolution of the modern rhetorical presidency: Presidential presentation and development of the state of the union address. Pres. Stud. Q. 33(2), 333–346 (2003).
Schoonvelde, Martijn, Brosius, Anna, Schumacher, Gijs & Bakker, Bert N. Liberals lecture, conservatives communicate: Analyzing complexity and ideology in 381,609 political speeches. PLoS one 14(2), e0208450 (2019).
Müller, W. C. & Strøm, K. Policy, Office, or Votes? (Cambridge University Press, 1999).
Lewis-Beck, M. S. Comparative economic voting: Britain, France, Germany, Italy. Am. J. Political Sci. 30(2), 315 (1986).
Traber, D., Schoonvelde, M. & Schumacher, G. Errors have been made, others will be blamed: Issue engagement and blame shifting in prime minister speeches during the economic crisis in Europe. Eur. J. Political Res. 59(1), 45–67 (2019).
Stimson, J. A. Public Opinion in America: Moods, Cycles, and Swings (Taylor and Francis, 1999).
Erikson, R. S., Mackuen, M. B. & Stimson, J. A. The Macro Polity (Cambridge University Press, 2001).
Ekman, P. & Davidson, R. J. The Nature of Emotion (Oxford University Press, Oxford, UK, 1994).
Frey, B. S. & Stutzer, A. What can economists learn from happiness research?. J. Econ. Lit. 40(2), 402–435 (2002).
Easterlin, R. A., McVey, L. A., Switek, M., Sawangfa, O. & Zweig, J. S. The happiness - Income paradox revisited. Proc. National Acad. Sci. U.S.A. 107(52), 22463–22468 (2010).
Hibbing, J. R., Smith, K. B. & Alford, J. R. Differences in negativity bias underlie variations in political ideology. Behav. Brain Sci. 37(3), 297–307 (2014).
Tritt, S. M., Peterson, J. B., Page-Gould, E. & Inzlicht, M. Ideological reactivity: Political conservatism and brain responsivity to emotional and neutral stimuli. Emotion 16(8), 1172–1185 (2016).
Sylwester, K. & Purver, M. Twitter language use reflects psychological differences between democrats and republicans. PLoS one 10(9), e0137422 (2015).
Turetsky, K. M. & Riddle, T. A. Porous chambers, echoes of valence and stereotypes: A network analysis of online news coverage interconnectedness following a nationally polarizing race-related event. Soc. Psycholo. Personal. Sci. 9(2), 163–175 (2018).
Hirsh, J. B. & Peterson, J. B. Personality and language use in self-narratives. J. Res. Pers. 43(3), 524–527 (2009).
Lee, C. H., Kim, K., Young, S. S. & Chung, C. K. The relations between personality and language use. J. General Psychol. 134(4), 405–413 (2007).
Pennebaker, James W. & King, Laura A. Linguistic styles: Language use as an individual difference. J. Pers. Soc. Psychol. 77(6), 1296–1312 (1999).
Yarkoni, T. Personality in 100,000 words: A large-scale analysis of personality and word use among bloggers. J. Res. Pers. 44(3), 363–373 (2010).
Costa, Paul T. & McCrae, Robert R. Influence of extraversion and neuroticism on subjective well-being: Happy and unhappy people. J. Pers. Soc. Psychol. 38(4), 668–678 (1980).
Larsen, R. J. & Ketelaar, T. Personality and susceptibility to positive and negative emotional states. J. Pers. Soc. Psychol. 61(1), 132–140 (1991).
Lucas, R. E. & Diener, E. D. Understanding extraverts’ enjoyment of social situations: The importance of pleasantness. J. Personal. Soc. Psychol. 81(2), 343–356 (2001).
Pavot, W., Diener, E. D. & Fujita, F. Extraversion and happiness. Personal. Individ. Differ. 11(12), 1299–1306 (1990).
Words, O., Selves, O., James, W. P., Matthias, R. M. & Kate, G. N. Psychological aspects of natural language use. Annu. Rev. Psychol. 54, 547–77 (2003).
Bakker, B. N. Personality traits, income, and economic ideology. Polit. Psychol. 38(6), 1025–1041 (2017).
Gerber, A. S., Huber, G. A., Doherty, D., Dowling, C. M. & Shang, E. H. Personality and political attitudes: Relationships across issue domains and political contexts. Am. Political Sci. Rev. 104(1), 111–133 (2010).
Malka, A., Soto, C. J., Inzlicht, M. & Lelkes, Y. Do needs for security and certainty predict cultural and economic conservatism? A cross-national analysis. J. Pers. Soc. Psychol. 106(6), 1031–1051 (2014).
Fournier, P., Soroka, S. & Nir, Lilach. Negativity Biases and political ideology: A comparative test across 17 countries. Am. Political Sci. Rev. 114(3), 775–791 (2020).
Bakker, B. N., Schumacher, G., Gothreau, C. & Arceneaux, K. Conservatives and liberals have similar physiological responses to threats. Nat. Hum. Behav. 4(6), 613–621 (2020).
Ludeke, S., Tagar, M. R. & DeYoung, C. G. Not as different as we want to be: Attitudinally consistent trait desirability leads to exaggerated associations between personality and sociopolitical attitudes: Not as different as we want to be. Polit. Psychol. 37(1), 125–135 (2016).
Hatemi, P. K., Crabtree, C. & Smith, K. B. Ideology justifies morality: Political beliefs predict moral foundations. Am. J. Political Sci. 63(4), 788–806 (2019).
Hatemi, P. K. & Verhulst, B. Political attitudes develop independently of personality traits. PLoS one 10(3), e0118106 (2015).
Ghodeswar, B. M. Building brand identity in competitive markets: A conceptual model. J. Product Brand Manag. 17(1), 4–12 (2008).
Whan Park, C. & Macinnis, D. J. Introduction to the special issue: Brand relationships, emotions, and the self. J. Assoc. Consum. Res. 3(2), 123–129 (2018).
Reeves, P., de Chernatony, L. & Carrigan, M. Building a political brand: Ideology or voter-driven strategy. J. Brand Manag. 13(6), 418–428 (2006).
Dolezal, M., Ennser-Jedenastik, L. & Müller, W. C. Who will attack the competitors? How political parties resolve strategic and collective action dilemmas in negative campaigning. Party Politics 23(6), 666–679 (2017).
Diener, E. D., Sandvik, E. D. & Larsen, R. J. Age and sex effects for emotional intensity. Dev. Psychol. 21(3), 542–546 (1985).
Gross, J. J. et al. Emotion and aging: Experience, expression, and control. Psychol. Aging 12(4), 590–599 (1997).
Frijda, N. H. The laws of emotion. Am. Psychol. 43(5), 349–358 (1988).
Rauh, C., & Schwalbach, J. The ParlSpeech V2 data set: Full-text corpora of 6.3 million parliamentary speeches in the key legislative chambers of nine representative democracies. Harvard Dataverse, v2 edition (2020).
Volkens, A., Krause, W., Lehmann, P., Matthieß, T., Merz, N., Regel, S., & Weßels, B. The manifesto data collection. Manifesto project (MRG/CMP/MARPOR) (2019).
Schumacher, G., Berk, N., Pipal, C., Kantorowicz, J., Schoonvelde, M., Traber, D., & Vries, E. D. EUSpeech V2 (2020).
Gennaro, G. & Ash, Elliott. Emotion and reason in political language. Econ. J. 132(643), 1037–1059 (2022).
Lin, C., & He, Y. Joint sentiment/topic model for sentiment analysis, in International Conference on Information and Knowledge Management, Proceedings, 375–384 (2009).
Lin, C., He, Y., Everson, R. & Rüger, S. Weakly supervised joint sentiment-topic detection from text. IEEE Trans. Knowl. Data Eng. 24(6), 1134–1145 (2012).
Pipal, C., Schoonvelde, M. & Schumacher, G. Taking Context Seriously: Joint Estimation of Sentiment and Topics in Textual Data (Publisher, OSF Preprint, 2021).
Young, L. & Soroka, S. Affective news: The automated coding of sentiment in political texts. Polit. Commun. 29(2), 205–231 (2012).
Proksch, S. O., Lowe, W., Wäckerle, J. & Soroka, S. Multilingual sentiment analysis: A new approach to measuring conflict in legislative speeches. Legis. Stud. Q. 44(1), 97–131 (2019).
Ennser-Jedenastik, L., Dolezal, M. & Müller, W. C. Gender differences in negative campaigning: The impact of party environments. Politics Gender 13, 81–106 (2017).
Hargrave, L. & Langengen, T. The gendered debate: Do men and women communicate differently in the house of commons?. Politics Gender 17, 1–27 (2020).
Canes-Wrone, B. Who Leads Whom?: Presidents, Policy, and the Public (University of Chicago Press, UK, 2010).
Lenz, G. S. Follow the Leader?: How Voters Respond to Politicians’ Policies and Performance (University of Chicago Press, 2012).
Soroka, S. N. & Wlezien, C. Degrees of Democracy: Politics, Public Opinion, and Policy (Cambridge University Press, 2010).
OECD. OECD Stat: Quarterly national accounts (2019).
Döring, H., & Manow, P. Parliaments and governments database (ParlGov): Information on parties, elections, and cabinets in modern democracies. Infrastruct. Empir. Inf. Parties Elections Gov. Mod. Democr. Version 12(10) (2015).
Simonsohn, U., Simmons, J. P. & Nelson, L. D. Specification curve analysis. Nat. Hum. Behav. 4(11), 1208–1214 (2020).
Proksch, S. O. & Slapin, J. B. The Politics of Parliamentary Debate: Parties (Cambridge University Press, 2014).
Bäck, H. & Debus, M. When do women speak? A comparative analysis of the role of gender in legislative debates. Political Stud. 67(3), 576–596 (2019).
Bäck, H., Baumann, M., Debus, M. & Müller, J. The unequal distribution of speaking time in parliamentary-party groups. Legis. Stud. Q. 44(1), 163–193 (2019).
Takens, J., Kleinnijenhuis, J., Van Hoof, A. & Van Atteveldt, W. Party leaders in the media and voting behavior: Priming rather than learning or projection. Polit. Commun. 32(2), 249–267 (2015).
Flachaire, E. A better way to bootstrap pairs. Econ. Lett. 64(3), 257–262 (1999).
Blei, D. M., Ng, A. Y. & Jordan, M. I. Latent Dirichlet allocation. J. Mach. Learn. Res. 3(4–5), 993–1022 (2003).
Lison, P., & Tiedemann, J. OpenSubtitles2016: Extracting large parallel corpora from movie and TV subtitles, in Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016, 923–929 (2016).
Carmody, S. ngramr: Retrieve and plot Google n-gram data, January (2023).
Álvarez-Daz, Á., Gonzlez, L. & Radcliff, B. The politics of happiness: On the political determinants of quality of life in the American states. J. Politics 72(3), 894–905 (2010).
Pacek, A. & Radcliff, B. Assessing the welfare state: The politics of happiness. Perspect. Politics 6, 267–277 (2008).
Tavits, M. Representation, corruption, and subjective well-being. Comp. Pol. Stud. 41(12), 1607–1630 (2008).
Ward, G. Happiness and Voting: Evidence from four decades of elections in Europe. Am. J. Political Sci. 64(3), 504–518 (2019).
Lowe, W., Benoit, K., Slava, M. & Laver, M. Scaling policy preferences from coded political texts. Legis. Stud. Q. 36(1), 123–155 (2011).
Dalton, R. J. The quantity and the quality of party systems: Party system polarization, its measurement, and its consequences. Comp. Pol. Stud. 41(7), 899–920 (2008).
Bernardi, L., Bischof, D. & Wouters, R. The public, the protester, and the bill: Do legislative agendas respond to public opinion signals?. J. Eur. Public Policy 28(2), 1–22 (2020).
De Boef, S. & Keele, L. Taking time seriously. Am. J. Political Sc. 52(1), 184–200 (2008).
Andreevskaia, A., & Bergler, S. Mining WordNet for fuzzy sentiment: Sentiment tag extraction from WordNet glosses, in EACL 2006 - 11th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the Conference 209–216 (2006).
Subasic, P. & Huettner, A. Affect analysis of text using fuzzy semantic typing. IEEE Trans. Fuzzy Syst. 9(4), 483–496 (2001).
Van Atteveldt, W., Van der Velden, M. A. & Boukes, M. The validity of sentiment analysis: Comparing manual annotation, crowd-coding, dictionary approaches, and machine learning algorithms. Commun. Methods Measures 15(2), 121–140 (2021).
Widmann, T. & Wich, M. Creating and comparing dictionary, word embedding, and transformer-based models to measure discrete emotions in German political text. Political Anal. 31, 1–16 (2022).
Acknowledgements
We would like to thank Lea Kaftan, Hauke Licht, and the members of the Hot Politics Lab for their helpful comments on earlier drafts of this manuscript. Our work also benefited from the feedback received during presentations at MPSA 2022, the Zurich Text-as-Data workshop, COMPTEXT 2022, and Hot Politics Lab meetings at the University of Amsterdam. We thank the audiences at these events for their valuable insights. We are also thankful to the reviewers at Scientific Reports, including Stuart Soroka and one anonymous reviewer, whose comments have significantly strengthened the manuscript.
Funding
Pipal and Schumacher received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme under grant agreement No 759079, POLEMIC.
Author information
Authors and Affiliations
Contributions
C.P.: Conceptualization, Methodology, Software, Formal Analysis, Investigation, Data Curation, Writing—Original Draft, Writing—Review and Editing, Visualization. B.N.B.: Conceptualization, Methodology, Writing—Review and Editing, Supervision. G.S.: Conceptualization, Methodology, Formal Analysis, Writing—Review and Editing, Supervision, Project administration, Funding acquisition. M.A.C.G.v.d.V.: Conceptualization, Methodology, Writing—Review and Editing, Supervision.
Corresponding author
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Pipal, C., Bakker, B.N., Schumacher, G. et al. Tone in politics is not systematically related to macro trends, ideology, or experience. Sci Rep 14, 3241 (2024). https://doi.org/10.1038/s41598-023-49618-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-49618-9
- Springer Nature Limited