Abstract
The Covid-19 pandemic challenged global governance in unprecedented ways by requiring intergovernmental meetings to be held online. For the Intergovernmental Panel on Climate Change (IPCC), this meant that the intergovernmental approval of the key findings of the Sixth Assessment Report (AR6) had to be conducted virtually. In this paper, we assess how the move away from face-to-face meetings affected country participation in IPCC approval sessions. Our findings demonstrate that virtual meetings increased the size of member governments’ delegations, but this did not necessarily translate into a greater number of interventions during the approval of the Summary for Policymakers (SPM) as time zone differences reduced engagement levels significantly—particularly for countries from the Pacific, East Asian, and Latin American regions whose delegations often found themselves in IPCC meetings late at night and early in the morning. These results offer initial, empirically robust evidence about what online meetings can and cannot achieve for promoting more inclusive global governance at a time when the IPCC and other organizations reflect on the future use of virtual and hybrid meeting formats.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Almost all social interactions in private and professional life were moved online during the Covid-19 pandemic. In the case of global governance, this meant that intergovernmental negotiations between country delegations—the core of high-level diplomatic exchange and collective action—could no longer take place face-to-face and had to be conducted virtually. Digital diplomacy is not new as such (Seib 2012; Adesina 2017; Adler-Nissen and Drieschova 2019; Bach and Martin 2023), yet the speed and comprehensiveness with which the pandemic forced organizations to adapt was unprecedented, fueling debates about challenges and opportunities of virtual multilateral negotiations (Chasek 2021; Vadrot et al. 2021; Hughes et al. 2021; Vadrot and Ruiz Rodriguez 2022). At the time, the Intergovernmental Panel on Climate Change (IPCC) was halfway through its Sixth Assessment Report (AR6) cycle, which meant the final lead author meetings and the intergovernmental approval of the Summary for the Policymakers (SPM) for the three Working Groups (WGs) were moved online.
Face-to-face meetings are credited with creating trust between negotiators through “precedence, predictability, (and the) ability to build relationships” (Chasek 2021, 61). On a personal, delegation-to-delegation level, trustful relations are essential for successful multilateral cooperation (Touval 1989; Coleman 2011; Chasek and Wagner 2016). Aside from venues of information exchange, in-person meetings allow negotiators to empathize with each other, which helps reduce uncertainty and increases understanding each others’ bargaining positions and “red lines” (Holmes 2013; Kamau et al. 2018; Shukla et al. 2020). The multiple sites of physical meetings also facilitate informal discussions and proposals in huddles, corridors, and over coffee (Bansard 2023). This offers more direct and immediate ways to resolve outstanding issues and clear up misunderstandings that might otherwise get protracted in plenary sessions (Chasek 2021; Vadrot and Ruiz Rodriguez 2022).
Despite these advantages, face-to-face meetings are costly in terms of time, money, and their carbon footprint. According to a recent report by the International Institute for Sustainable Development (IISD) the largest benefits from virtual negotiations are lower costs and greater participation (Williams and St John 2021). Among some, moving multilateral negotiations online, hence, comes with hopes for more transparency, better access, and greater inclusion in international negotiations for and participation from the Global South. The extent to which this optimism is justified, however, depends on how organizations design virtual negotiation spaces because digital diplomacy can intensify existing inequalities and, indeed, create new ones (Vadrot and Ruiz Rodriguez 2022; Wagner and Allan 2020).
Our paper contributes to the growing literature of scholarly assessments of the impact of virtual meetings on negotiations, and in particular, on country delegations’ attendance in meetings and their capacity to actively engage and shape a negotiated document (Wagner and Allan 2020; Chasek 2021; Vadrot and Ruiz Rodriguez 2022; Williams and St John 2021). It does so through a study of the IPCC’s virtual approval of the key findings of AR6 as presented in the Working Group SPM documents. As was the case for many other intergovernmental processes, the timeline for finalizing the AR6 was delayed by the pandemic. However, the assessments were ultimately completed by moving to virtual author meetings to finalize the drafting of the reports and by conducting the line-by-line approval of the SPMs online.
Complementing the IPCC’s own analysis of virtual lead author meetings (Shukla et al. 2020), this study focuses on the virtually conducted, intergovernmental approval sessions. We conceptualize participation as the combination of countries’ attendance at and engagement during these meetings. Without attendance, there is no participation; yet, attendance can be on paper only, so distinguishing between attendance and engagement is important. Our research design uses a two-pronged strategy to assess the impacts of virtual meetings on countries’ attendance and engagement levels. First, we compare the size of member governments’ delegations in the approval of the AR5 and the AR6 to identify how the virtual meeting format impacted participation. Second, we map attendance onto countries’ engagement levels during AR6, while scrutinizing the role of time zone differences, as these have repeatedly been brought up as a downside of virtual negotiations (Shukla et al. 2020; Chasek 2021). This allows us to evaluate the impacts of this distinctive feature of digital diplomacy on delegations’ engagement levels in the intergovernmental approval of SPM text. While our analysis is primarily descriptive, the mostly exogenous variation in meeting formats and time zones helps increase the credibility of our research design.
Our results indicate that although there was only a modest increase in the total number of member governments participating across WG and Synthesis Report approval sessions in AR6 (147 countries) compared to AR5 (134 countries), the composition of which countries attended changed: 18 governments with a presence at an approval session in AR5 did not send a delegation to any of the approval sessions at AR6, while 31 countries attended at least one of the approval sessions at AR6 without having attended any of these meetings in AR5—many of which are from highly climate vulnerable nations, such as small island states.Footnote 1 Aside from total counts, we additionally show that most countries increased the size of their delegations during the virtual approval of the AR6 Working Group reports over AR5, and this effect is particularly pronounced in WGII and WGIII. Our analysis suggests that the online setting has increased delegation sizes, on average, by two additional delegates compared to in-person meetings. From this point of view, conducting IPCC approval sessions virtually seems to have enhanced countries’ delegation sizes among attending governments. However, we also find that larger delegations do not necessarily result in a greater number of interventions in IPCC discussions of the SPM text. Although delegation size and engagement levels are positively correlated, time zone differences dampen this relationship significantly. In particular, the statistical association between attendance and engagement levels disappears for countries that were hit the hardest by being located in time zones furthest away from Europe, such as those in the Pacific, East Asian, and Latin American regions.
Our findings make two main contributions. First, they speak to existing research that identifies asymmetries in participation in the assessment of global climate knowledge in the IPCC (Agrawala 1998; Corbera et al. 2016; Blicharska et al. 2017; Schipper et al. 2021; Hughes 2024). As the IPCC currently finds itself at an important constituting moment for the new assessment cycle, our evidence suggests that virtual negotiations can increase attendance at (yet not necessarily engagement during) IPCC meetings from country delegations that are otherwise often limited to a single delegate during in-person meetings. Acknowledging that resolving conflicts can take longer in online than in in-person environments, greater use of virtual preparatory sessions and hybrid formal meeting formats may chart a way forward for the least resourced developing countries to have well-informed, larger delegations with a broader range of expertise in attendance during relevant IPCC meetings. Second, our findings add to a growing literature that assesses the opportunities and challenges of digital diplomacy more broadly (Williams and St John 2021; Chasek 2021; Vadrot et al. 2021). Here, we add nuance to the role of delegation sizes and the relationship to engagement levels during meeting discussions, which helps inform debates about more inclusive forms of global governance through technological advances.
2 Government participation in the IPCC
The IPCC is understood as a site for producing authoritative scientific assessments of climate change and response options to inform negotiated actions within the United Nations Framework Convention on Climate Change (UNFCCC). To achieve this mandated task, the IPCC produces assessment reports of the latest knowledge of the scientific basis of climate change (Working Group I); impacts, vulnerability and adaptation to climate change (Working Group II); and mitigation (Working Group III). To date, the IPCC has completed six assessment cycles and is in the process of undertaking its seventh one. The reports are produced by authors who are nominated by governments or observer organizations and selected by each Working Group Bureau to ensure the relevant scientific expertise to assess the latest knowledge on climate change alongside organization criteria for a range of views and geographical and gender balance within author teams. Authors produce reports guided by the government approved outlines. Each WG produces both a comprehensive assessment report and a summary of key findings in the Summary for Policymakers (SPM). Member governments play a central role in the production of this assessment, through approving the report outline, reviewing the draft report, and approving the final SPM document (Hughes 2022). It is this line-by-line approval process that is the focus of this article (De Pryck 2021, 2022).
While the SPM is distinct from most intergovernmentally negotiated documents because it is drafted by scientific authors and the key messages it contains are drawn from and supported by the underlying assessment report (Hughes 2024), the wording and figures describing and depicting the key messages to inform collective action are negotiated (Kouw and Petersen 2018). As such, new research conceptualizes this intergovernmental component of global environmental assessment processes like the IPCC and the Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services (IPBES) as central sites of negotiation in the making of collective action on the environment (Hughes and Vadrot 2019; Hughes et al. 2021; Hughes and Vadrot 2023). Given our substantive interest in how digital meetings affect countries’ participation in multilateral negotiations, this makes the IPCC an important case for studying how the virtual setting shapes a country’s capacity to participate and actively engage in the negotiating process.
Participation has been a central issue to the IPCC since its formation in 1988 (Bolin 2007). Those leading the establishment of the organization and tasked with producing an international assessment of climate change realized the critical importance of the participation of all countries in intergovernmental decision-making in the IPCC and the authorship of its reports, which turned barriers to meaningful engagement for developing countries into a core organizational concern (Agrawala 1998). Despite quickly establishing funding to support developing country travel and attendance at IPCC panel, bureau and author meetings, developing country participation has remained a significant issue on the IPCC agenda shaping the organization, its assessment practice and the reports produced (Hughes 2015).
Research on developing country participation in the IPCC has largely been focused on the involvement of experts in the assessment (Bhandari 2020; Ho-Lem et al. 2011; Hulme and Mahony 2010; Standring and Lidskog 2021; Standring 2022). This literature has illuminated significant asymmetries in the number of developing country authors across assessment cycles and explored the national political and research contexts that contribute to this (Biermann 2002; Borland et al. 2018; Ibarra et al. 2022; Kandlikar and Sagar 1999; Lahsen 2004; Mahony 2014). This research indicates that even when appointed as authors, scientists and other expertise from the Global South face significant barriers in their capacity to meaningfully contribute to and impact the assessments’ content.
These barriers operate both at the material and social level. Materially, countries’ economic wealth and national investment in research are critical factors (Blicharska et al. 2017; Ho-Lem et al. 2011) and translate into less national and institutional support in the authorship role compared to authors from the Global North. Internet quality and access to the international journals required to review and assess the state of climate knowledge have also been identified as significant issues (Schipper et al. 2021). These material effects combine with social scientific dynamics within the chapter teams, where contribution to knowledge is measured through institutional affiliation and publication record (Hughes and Paterson 2017). As a result, authors from the Global South, particularly those who are less confident English speakers, are often perceived as less accomplished and authoritative in the assessment of knowledge, shaping the social space for participation (Hughes 2024). While the AR6 boasted greater diversity over previous assessments, the shift to a virtual process augmented the material asymmetries identified above, which made it hard for some authors to contribute at all (Chasek 2021; Ketcham 2022; Shukla et al. 2020; Vadrot and Ruiz Rodriguez 2022).
One of the core conclusions of this literature is that ultimately global knowledge and assessments on climate change are dominated by authors and institutions from the Global North (Corbera et al. 2016). As a consequence, the knowledge in IPCC reports is predominantly produced and assessed by authors from the Global North about these regions of the world (Blicharska et al. 2017; Karlsson et al. 2007). Authors have suggested that this dominance may contribute to controversy in the approval of a report’s key findings and the collective response (Corbera et al. 2016; Blicharska et al. 2017), although there is no evidence that more diverse voices will necessarily lessen this.
While the literature on author participation clearly demonstrates how participation is shaped by material and social factors (Bolin 2007; Ho-Lem et al. 2011; Corbera et al. 2016; Hughes and Paterson 2017; Vardy et al. 2017; De Pryck and Hulme 2022; Hughes 2024), much less is known about how these factors shape member government capacity to participate in organizational decision-making in the IPCC and the approval of the report’s key findings. If we know that institutional setting and internet access shape the participation of authors, to what extent does this impact on member government participation? To what extent did the shift to the virtual approval of the AR6 content shape and impact governments’ capacity to actively participate in proceedings?
3 Research design
We take a first step towards answering these questions with original data that allow us to examine empirical patterns in country participation, delegation size, and engagement levels during IPCC approval sessions. Conceptually, we distinguish participation into a minimalist notion which comes in the form of a country’s mere presence at multilateral negotiations, or what we call attendance, and a country’s efforts to actively participate in negotiated outcomes, which we refer to as engagement. Attendance and engagement levels are our key outcome variables of interest.
3.1 Attendance: Measurement and empirical strategy
We measure attendance—as the most minimal form of participation—through country delegations’ presence at IPCC approval sessions. For this, we rely on participant lists as documented in the official IPCC reports that are published after each session and are available from the IPCC website.Footnote 2 These data provide us with information about: (i) which countries attended IPCC meetings and (ii) the size of delegations. Since we are interested in the impacts of virtual meeting formats on country participation, we compare attendance rates and delegation size across AR5 (negotiated in-person in 2013/14) and AR6 (negotiated virtually in 2021/22, except for the Synthesis Report). At least descriptively, over-time changes between AR5 and AR6 in country attendance and delegation size can be indicative of potential effects from moving meetings online.
These changes over time are not solely the result of the shift in meeting format as climate politics also shifted. During the eight years between the approval of AR5 and AR6, the Paris Agreement was negotiated and ratified, renewing political interest in climate change and in the IPCC assessment process; climate impacts around the world intensified; and countries struggled to recover from the Covid-19 pandemic. While these broader developments matter for the interpretation of our results, the credibility of our empirical analysis is strengthened by the fact that both AR5 and AR6 Synthesis Reports were negotiated in-person. Any changes in outcome measures for the two Synthesis Reports between assessment rounds might result, for instance, from the increased salience of climate change over time, yet, by design, they cannot be the result of variation in meeting formats as both meetings were conducted face-to-face. This allows us to use differences in outcome measures from the Synthesis Report negotiations in 2014 and 2022 to “net” out the effect of all other variables that shape country participation in IPCC plenaries that are unrelated to differences in meeting format.
To illustrate, assume the fictitious country abc-land had sent 3 delegates to the in-person WGI plenary in 2014 and 6 delegates to WGI plenary in 2022, which was held virtually. A naïve estimate of the effect of virtual meetings in this case is an increase of \(+3\) delegates. However, we cannot be sure whether this increase in delegation size is due to the meeting format or for any other reason, such as greater issue salience of climate change or increased climate impacts. Knowing that abc-land delegations for Synthesis Report meetings, all held in-person, increased from 1 delegate to 3 delegates allows us to calculate an adjusted effect of virtual meeting formats of \(+1\) delegate (i.e., \((6-3)-(3-1)=1\)). This empirical strategy is akin to a difference-in-differences estimator which cancels out over-time changes in outcome measures that are not driven by differences in meeting formats (Angrist and Pischke 2008; Card and Krueger 1994). Since we cannot assess the extent to which identifying assumptions hold, our results remain correlational, but they offer a more credible estimate of the “true” effect of meeting formats on country participation.
3.2 Engagement levels: Measurement and empirical strategy
Country delegations can attend negotiations, but that does not mean they will actively engage in discussions during meetings. Observational research on the IPCC has highlighted that not all governments appear to participate in IPCC plenary meetings and has identified a small group of highly active member governments (Hughes 2022, 2023, 2024). However, to date there is no quantitative data on this relationship in the approval of a report’s key findings. In order to explore this, we operationalize government delegations’ engagement levels in IPCC discussions by whether they make interventions during IPCC sessions. We measure levels of engagement as the total number of country mentions in Earth Negotiations Bulletin (ENB) reporting of the IPCC meetings.Footnote 3 ENB summary reports are built from systematic observation of meetings by ENB writers that provide an account of the event, including which member governments intervened on what issue. In the absence of verbatim transcripts of IPCC approval sessions, ENB records—which are systematic, coordinated across ENB writers, provide granular information, and undergo quality control before publication—allow us to construct a replicable and fine-grained measure of countries’ engagement levels. That said, ENB reports are not word-by-word minutes of meetings, so they naturally focus on notable interventions by country delegations and there is a risk that not every country’s intervention is recorded.
We use this measure of countries’ engagement levels to assess how it varies with delegation size and time zone differences. Larger delegations and delegations from countries located in time zones that are geographically closer to Europe, where the Working Group Technical Support Units (TSUs) were based and whose office hours dictated the majority of the overall negotiating schedule, are likely to find it easier to actively engage in negotiations. Relationships between delegation sizes and engagement levels are descriptively important, while time zone differences offer us greater analytical leverage. Unlike decisions about delegation sizes, resourcing, and meeting schedules, the time zone of any given country is beyond the control of country governments, which helps us to isolate the effect of time zones on engagement levels more cleanly. Although a country’s research capacity, its vulnerability to climate change, and its domestic climate politics are likely to shape engagement levels to a greater extent, variation in time zones might have an important conditional effect. This expectation is consistent with qualitative evidence that time zone differences were perceived as a major downside of virtual meetings by negotiators across the board (Chasek 2021; Vadrot and Ruiz Rodriguez 2022).
4 Results
We present three sets of empirical results: First, we show that delegation sizes in IPCC meetings increased between AR5 and AR6, on average. Second, by focusing on online negotiations in AR6, we assess the extent to which delegation size matters for countries’ engagement levels during approval sessions, where we find mixed results. Third, we provide evidence that differences in time zones did mute the positive effect of larger delegations on engagement levels in WGII and WGIII.
4.1 Changes in delegation sizes from AR5 to AR6
We begin by demonstrating that country delegations increased in size across all three Working Groups for virtual meetings. Figure 1 shows average increases when we pool our data across all three WGs (left panel) and for each WG separately (other three panels). The solid line documents that, across the board, delegations were, on average, larger by about two delegates in virtual approval sessions in AR6 compared to in-person approvals in AR5. This increase is most pronounced in WGs II and III and consistent with evidence that WGII in AR6 “had the highest number of delegates ever registered for an approval session” (ENB 2022, 22).
Average delegation size in AR5 and AR6. Solid lines show changes in average delegation size from in-person IPCC approval sessions in AR5 to virtual IPCC approval sessions in AR6. Dotted lines show changes in delegation size for Synthesis Report approval sessions in AR5 and AR6, both of which were conducted face-to-face. The left panel shows results for pooled data across all three Working Groups; the other three panels show results separately for each Working Group
Average changes in delegation sizes do, however, mask important variation at the country level. Out of a total of 156 countries which sent delegates to either the AR5 or AR6 Working Group approval sessions, roughly 6 out of 10 increased their average delegation size (93 countries), while one third, or 52 countries, reduced it; 7% held delegation sizes constant (11 countries). The increase in countries’ delegation sizes—averaged across WGs for each of the ARs—were much larger (\(+\)3.6 delegates on average) than reductions in those countries that sent fewer delegates (−0.8 delegates on average). Aside from Japan, whose delegation size decreased substantially from an artificially high baseline of 53 delegates in WGII in AR5, which was hosted in Yokohama, most countries that reduced their delegation sizes did so by less than one delegate on average.
Compared to attendance in AR5, 31 countries no longer had a presence in Working Group sessions of AR6, whereas 25 countries attended AR6 Working Group sessions but were absent in the approval of AR5, including many small island states like Antigua and Barbuda (1.33 delegates), Samoa (2.33 delegates), St. Kitts and Nevis (5.33 delegates), and Vanuatu (8 delegates). The three largest delegations came from the United States (25.3 delegates, \(+\)19.3 from AR5), Canada (23 delegates, \(+\)19.7 from AR5), and South Korea (21.3 delegates, \(+\)10.3 from AR5). Some countries, such as Turkey (10.7 delegates, up from 0.3 delegates in AR5), Malaysia (15 delegates, up from 1 delegate in AR5), and Argentina (13.7 delegates, up from 1 delegate in AR5) increased their delegations more than ten-fold for the approval of the AR6. Figure SI1 in Appendix C visualizes these changes for all countries and all approval sessions.
As discussed in the Research Design section above, the increases in delegation sizes may not relate to the virtual format of the approval sessions, but may instead reflect the greater salience of climate change in domestic politics (Colgan et al. 2021; Bayer and Genovese 2020). To caution against concerns that the identified empirical patterns are purely a result of broader societal and political trends, Fig. 1 also plots, as dotted lines, average sizes of negotiating delegations in Synthesis Report approval sessions in AR5 and AR6. Relying on the fact that Synthesis Reports were negotiated face-to-face in both assessment rounds, we find that delegation size has grown only minimally between the two ARs’ Synthesis Report approvals, which suggests a modest increase in delegation size for reasons that are plausibly unrelated to the virtual format. We also note that the average delegation size remains remarkably similar across all four AR5 approval sessions, which minimizes concerns that the approval of the Synthesis Report draws systematically larger or smaller delegations than the WG approvals. We are, hence, confident that the increase in member governments’ delegation sizes results largely from changes in meeting formats rather than the increased salience of climate politics. If the latter was indeed the case, we would expect much larger average delegations in the approval of the Synthesis Report of AR6.
We quantify the effect of virtual negotiations on countries’ average delegation size in a linear regression model using the difference-in-differences estimator. Table 1 summarizes the results when we pool data across Working Groups (Model 1) and when estimating the models separately for each Working Group (Models 2−4). The four models correspond to the four panels in Fig. 1 above. The coefficient estimate in the top row (AR\(\times \)WGI-III) shows the effect of virtual negotiations on delegation size as an increase of between 1.2−2.0 delegates on average. This effect is strongest for WGII (Model 3) and WGIII (Model 4), and all estimates are statistically distinguishable from zero at conventional levels of significance.
Lending further credibility to our empirical strategy, we find that delegation sizes for Synthesis Report approval sessions in AR5 and AR6 were not statistically significantly different (as indicated by the AR6 estimates). Similarly, delegations in Working Group and Synthesis Report approval sessions in AR5 were roughly of the same size (as indicated by the WGI-III estimate). This strengthens claims that the observed increase in delegation size indeed stems from virtual session formats because changes in delegation size between AR5 and AR6 only occurred for exactly those approval sessions that happened online (i.e., WGI−III approvals), but not for the ones that were conducted face-to-face (i.e., Synthesis Report approvals).
4.2 Delegation sizes and engagement levels in AR6
Building on the above finding that delegation sizes increased in AR6, we now examine whether larger delegations translate into greater engagement levels in IPCC negotiations. We provide a first answer to this question by describing the relationship between countries’ delegation sizes and delegations’ engagement levels, as approximated by country mentions in ENB reports. Figure 2 plots the distributions for both variables for the 30 largest countries by delegation size. For each of the three Working Groups in AR6, the bar plots to the right show a country’s delegation size; the “\(\times \)” marks delegation sizes in AR5 for comparison. Colors denote gender breakdowns, where female and male delegates are shown in red and blue, while gray indicates delegates whose gender we could not assign based on information about their first names. Bar plots to the left show countries’ engagement levels.
Confirming what we described in the previous section, delegations in AR6 were substantially larger compared to AR5 for almost all countries in the figure. With the exception of WGII delegations of Japan (53 delegates in AR5, 17 delegates in AR6) and Saudi Arabia (9 delegates in AR5, 7 delegates in AR6) and WGIII delegations of Germany (22 delegates in AR5, 17 delegates in AR6) and China (16 delegates in AR5, 15 delegates in AR6), AR6 delegations became larger for all top-30 countries.Footnote 4 Among our 30 largest countries, delegations in WGI had an average size of 9.6 delegates, which was significantly smaller than delegations in WGII (12.8 delegates, \(p<0.025\)) and WGIII (13.8 delegates, \(p<0.006\)). Many countries therefore seem to have used the online setting as a way to increase their presence at IPCC negotiations.
Delegation sizes and engagement levels for 30 largest countries (by delegation size) in AR6 for WGI−III. Colors indicate gender breakdowns for each of the delegations, where we distinguish between female delegates (red), male delegates (blue), and those for whom we could not assign gender based on first name information (gray); “\(\times \)” marks delegation size in AR5 for comparison. Note: Japan nominated 53 delegates for WGII in AR5 (as it hosted the approval session in Yokohama). We omit this count in the plot for ease of visualization
However, delegation size does not directly translate into engagement levels as measured by country mentions in the ENB reports. While the 30 largest countries account for 77% (537 of 695 mentions in WGI), 74% (616 of 831 mentions in WGII), and 80% (1,145 of 1,424 mentions in WGIII) of mentions compared to all other countries, and hence account for a vast majority of total interventions, considerable variation exists within this diverse set of states. As indicated by the gray histograms, countries at the top of the list in Fig. 2 do not necessarily engage more in the approval sessions. This pattern is robust across Working Groups.
India, Saudi Arabia, and the United States are consistently the countries with the largest number of interventions, accounting for about one third of total mentions in each of the Working Groups (32%, 221 total mentions in WGI; 31%, 254 mentions in WGII; 35%, 500 mentions in WGIII). While mentions do not tell us anything about the direction or success of the interventions, these data indicate that these countries are actively involved in shaping SPM text. Other countries that engaged heavily were Germany (50 mentions) and the UK (36 mentions) in WGI, Norway (46 mentions) and France (36 mentions) in WGII, and Germany (95 mentions) and Norway (91 mentions) in WGIII. At the same time, this also means that several countries with sizable delegations remained largely silent, such as, for instance, Argentina, Indonesia, Malaysia, Turkey, and Vanuatu. Similar to a conclusion reached for IPCC plenary sessions (Hughes 2022, 2023) and authorship contributions (Hughes and Paterson 2017), these results identify a core group of IPCC member countries actively involved in approving the key findings of the AR6 Working Group reports. We also notice that the number of interventions in Working Group III on mitigation options was about twice the number of interventions in the other two Working Groups on the physical science basis and climate impacts and adaptation.
4.3 Engagement levels and time zone differences
So far, we have shown that large delegations are not synonymous with high engagement levels as captured by country mentions in ENB reporting; and, in fact, in some instances smaller delegations were more actively involved in the approval than larger delegations. This may not come as a surprise, as other factors, like a country’s research capacity, its domestic economic and political constraints and priorities, or its vulnerability to climate impacts may be more important drivers of engagement levels in IPCC approval sessions. Nevertheless, our results document stark differences in levels of country engagement. Clearly, the “grueling” schedule of the meeting (ENB 2022, 23), with longer days as the approval sessions progressed, did not have the same impact on all delegations.
In order to better understand country-level variation, we turn to the role of time zone differences. Despite the IPCC’s efforts to recognize time zone differences in scheduling meeting sessions (IPCC 2022, 2), negotiators and observers alike complained heavily about this particular feature of the online negotiation sessions in AR6. As delegations attended virtual meetings from their own respective time zones, they often experienced negotiations that stretched far beyond standard work hours late into the night and early mornings, disrupting delegates’ personal life and resulting in fatigue and exhaustion (Chasek 2021; Vadrot and Ruiz Rodriguez 2022). Notwithstanding that in-person meetings also run long hours, this problem was especially acute for delegations in time zones that were the most distant from Europe.
To analyze the effect of time zone differences on country participation during the approval, we first convert the day-by-day negotiation schedules for WGII (14−26 February 2022) and WGIII (24 March−4 April 2022) approval sessions from Coordinated Universal Time (UTC) into each delegation’s home time zone.Footnote 5 We then compute, on an hour-by-hour basis, whether negotiations took place during or after standard 9am-5pm office hours in a delegation’s home time zone. Aggregating these data up to the country level provides us with a measure that captures the share of negotiation hours that fall outside of each delegation’s normal office hours.
In Fig. 3 we plot this measure for the 30 delegations that were the most exposed to time zone differences. The bar plots show the share of negotiation hours outside of normal work hours. To illustrate, for the delegation of Vanuatu only eight out of a total of 106 negotiation hours in WGII approval sessions took place during normal 9am-5pm work hours. Over the duration of two weeks of virtual negotiations, Vanuatu delegates worked outside of normal hours more than 92% of the time. This is but one example since other countries in the Pacific region, including Australia, South Korea, Japan, the Cook Islands, Samoa, New Zealand, and Kiribati experienced similarly high shares outside core working hours. The same, albeit to a slightly smaller degree, is true for countries in East and Central Asia as well as in Latin America, whose delegations participated in the approval at least half of the time outside of their 9am-5pm work hours.
While larger country delegations are undeniably more likely to engage more actively in negotiations, purely as a result of greater numbers, we also expect that this effect might dissipate when delegations are located in geographies with unfavorable time zones. Indeed, countries furthest away from Europe, which expected negotiations to take place out of core 9am-5pm work hours for most of the time, may purposefully have nominated larger delegations to mitigate these negative effects on engagement levels.
Marginal effect plots of delegation size on engagement levels as a function of the share of negotiation hours that fall outside 9am-5pm office hours. Black lines indicate estimates from a linear regression model with 95% confidence bounds shown in gray for pooled data (left panel), WGII (middle panel) and WGIII (right panel). Dots and vertical whiskers are point estimates and confidence intervals from a non-linear binning estimator (Hainmueller et al. 2019). The histogram along the x-axis shows the distribution of the data
We model this conditional effect with an interaction regression model and show the estimated relationships in Fig. 4 for pool data (left panel) and separately for WGII (middle panel) and WGIII (right panel).Footnote 6 Black lines report the effect of an additional delegate on countries’ engagement levels (with associated 95% confidence intervals shown in gray) for different levels of our measure of time zone exposure from linear regression models. Dots and vertical whiskers produce the same effects of interest from a non-linear binning estimator (Hainmueller et al. 2019).
Across the board, we observe that larger delegations are associated with greater engagement levels, so the “strength in numbers” logic finds support in our data in general and for both Working Groups individually. However, this positive relationship attenuates as time zone differences become pronounced. This becomes clear when comparing estimates along the horizontal axis of each of the panels in Fig. 4. Estimates are positive when the shares of the session hours outside of core work hours are small (left end of x-axis), such as for European delegations. However, these effects are statistically no longer different from zero for delegations in time zones with very large shares of hours outside of 9am-5pm work hours (right end of x-axis) as in the case of delegations from the Pacific and Latin American regions. In other words, while increasing delegation size tends to increase delegations’ engagement levels, this is much less the case for delegations that are located in time zones that are greatly different from the time zone that IPCC meetings take place in. These results are correlational because delegations in remote time zones will clearly have expected this effect, but they nonetheless shed important light on the conditional impacts of time zones on countries’ abilities to substantially and meaningfully engage in the virtual approval of the key findings of the AR6.
5 Concluding discussion
Effective global governance rests on countries’ meaningful participation in multilateral negotiations. Much of this intergovernmental exchange has traditionally been conducted in face-to-face meetings, which was thrown into disarray with the outbreak of the Covid-19 pandemic, fast-tracking discussions about the opportunities and challenges of digital diplomacy. With good arguments on both sides, ranging from travel costs, carbon footprints, time zone differences, internet access to power asymmetries (Williams and St John 2021; Vadrot and Ruiz Rodriguez 2022; Sanderson 2023), this paper provides empirically robust, descriptive evidence about how the virtual approval of the AR6 impacted member governments’ attendance, the size of their delegations, and their delegations’ engagement levels in the line-by-line approval of the Working Group SPMs. In doing so, we complement existing studies on various aspects of virtual negotiations (Williams and St John 2021; Chasek 2021; Vadrot et al. 2021).
Our main theoretical and methodological contribution is to separate government participation into attendance, i.e., the presence at intergovernmental meetings, and engagement, i.e., the effort to actively shape the approved text. Building on original data from official IPCC delegation lists, hourly schedule information of IPCC approval sessions, and ENB reports, we find three main results. First, while the total number of attending countries increased modestly across all approval sessions from AR5 (134 delegations) to AR6 (147 delegations), delegation size increased on average by two delegates in virtual meetings. Second, delegation size does not directly translate into greater engagement levels in the form of government interventions during IPCC discussions of SPM text. Third, time zone differences attenuate the otherwise positive relationship of larger delegations on engagement levels—which was particularly marked for delegations located in the Pacific, East Asian, and Latin American regions. Practically, this means that delegations from some of the most climate vulnerable countries provided less input into the discussions over the SPM text than one would expect given how these countries are impacted by the issue and their large delegation sizes. Some of this effect, we show, results from differences in time zones, even though other, and possibly much stronger drivers may include countries’ research capabilities, their economic, political, social, and cultural constraints, and their general long-term engagement levels with IPCC and UNFCCC processes (Hughes 2024). Our analysis of time zone differences is nonetheless important and carries even more weight given that the IPCC, conscientious of the challenge and as one of the only organizations (Chasek 2021), deliberately scheduled sessions in ways to minimize disadvantaging delegations based on time zone differences (IPCC 2022).
These findings have important implications for the IPCC at the start of the seventh assessment cycle, as its leadership reflects on the role of virtual and hybrid meeting formats in this next cycle (IPCC 2024). Existing research has emphasized unequal access and asymmetric participation in the IPCC for some time (Agrawala 1998; Corbera et al. 2016; Blicharska et al. 2017; Schipper et al. 2021; Hughes 2023). Conducting IPCC meetings virtually can, as we show, increase countries’ delegation sizes. These effects appear to be strongest among delegations from developing countries, where only one delegate is funded by the IPCC Trust Fund to attend in-person meetings. We caution that delegation size is not an immediate fix to ensure greater engagement by member governments, but having a larger number of delegates is an important enabling factor to increase country engagement, as measured by interventions, especially for contentious issues that are often discussed in parallel sessions.
Supplementing first-hand evidence from negotiators who attended virtual approval sessions (Chasek 2021; Williams and St John 2021), our results provide systematic empirical support that attending meetings outside of core work hours stymies delegations’ interventions significantly. In order for virtual meetings to enable more effective participation by all member governments in the future, meeting schedules will need to be carefully crafted around time zones and ideally, would provide a detailed breakdown of the meeting schedule by SPM section or agenda item to enable countries to distribute and organize their expertise and participation effectively within and across parallel sessions. In this respect, hybrid meetings may be particularly useful for ensuring that small delegations can be supported virtually from expertise within their expert communities and government at home. The practicalities around achieving this and creating organizational policy to support its realization in the next assessment will require further research and data collection to better understand the barriers and enablers within and across different national contexts.
Beyond the IPCC, this paper contributes to a growing literature that assesses strengths and weaknesses of digital diplomacy (Williams and St John 2021; Chasek 2021; Vadrot et al. 2021). Our findings indicate that the extent to which virtual and/or hybrid intergovernmental meetings can improve inclusiveness in global governance depends on how international organizations design and apply them. Virtual formats in themselves are neither good nor bad. They can increase participation in multilateral negotiations—for instance, for governments that do not have the resources to send large delegations for long overseas travels to in-person meetings—but equally, if organized around European time zones and dependent on national internet infrastructure, they can equally reinforce power asymmetries in the existing international order (Vadrot and Ruiz Rodriguez 2022). Especially in view of the accelerating climate crisis (Sanderson 2023), international organizations have an important obligation to promote greater research into the conditions and practices through which virtual formats can supplement in-person meetings, for example by providing preparatory sessions and enabling hybrid participation, and when they cannot.
Availability of data and materials
All data and replication code is available from Harvard Dataverse.
Notes
Appendix A reports a full list of countries that attended at least one approval session only in AR5, only in AR6, or in both.
Appendix B reports links to this data source.
We exclude mentions of the European Union when referred to as an actor of its own, but, of course, include mentions of individual EU member states.
Countries that host IPCC approval sessions will have larger delegations in that Working Group and year. This accounts for the large delegations of Japan, which hosted WGII approval sessions in Yokohama in AR5, and Germany, which hosted WGIII approval sessions in Bonn in AR5.
We focus our analysis on WGII and WGIII (for which we have detailed, hourly schedule information) and on those countries that nominated at least one delegate to any of these two WGs. For countries with multiple time zones, we use the time zone which a country’s capital is located in.
We regress the logged number of ENB mentions \(+\)1 (to reduce skewness in the outcome measure) on delegation size, the share of negotiation hours outside of office hours, and their interaction.
References
Adesina OS (2017) Foreign Policy in an Era of Digital Diplomacy. Cogent Soc Sci 3(1):1–13
Adler-Nissen R, Drieschova A (2019) Track-Change Diplomacy: Technology, Affordances, and the Practice of International Negotiations. Int Stud Q 63(3):531–545
Agrawala S (1998) Structural and Process History of the Intergovernmental Panel on Climate Change. Clim Chang 39:621–642
Angrist JD, Pischke J-S (2008) Mostly Harmless Econometrics: An Empiricist’s Companion. Princeton University Press, Princeton, NY
Bach T, Martin B (2023) Negotiations: Navigating Global Environmental Conferences. In: Hughes H, Vadrot ABM (eds) Conducting research on global environmental agreement-making. Cambridge University Press, Cambridge, pp 93–120
Bansard J (2023) Beyond Negotiations: Studying Side Events, Exhibition Booths, and Other Neglected Conference Spaces. In: Vadrot ABM (ed) Hughes H. Conducting research on global environmental agreement-making, Cambridge University Press, pp 121–140
Bayer P, Genovese F (2020) Beliefs About Consequences from Climate Action Under Weak Climate Institutions: Sectors, Home Bias, and International Embeddedness. Global Environ Polit 20(4):28–50
Bhandari MP (2020) Getting the Climate Science Facts Right: The Role of the IPCC. River Publishers, Gistrup
Biermann F (2002) Institutions for Scientific Advice: Global Environmental Assessments and Their Influence in Developing Countries. Glob Goverance 8(2):195–219
Blicharska M, Smithers RJ, Kuchler M, Agrawal GK, Gutiérrez JM, Hassanali A, Huq S, Koller SH, Marjit S, Mshinda HM, Masjuki HH, Solomons NW, Van Staden J, Mikusiński G (2017) Steps to Overcome the North-South Divide in Research relevant to Climate Change Policy and Practice. Nat Clim Chang 7:21–27
Bolin B (2007) A History of the Science and Politics of Climate Change: The Role of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge
Borland R, Morrell R, Watson V (2018) Southern Agency: Navigating Local and Global Imperatives in Climate Research. Glob Environ Polit 18(3):47–65
Card D, Krueger AB (1994) Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania. Am Econ Rev 84(4):772–793
Chasek PM (2021) Is It the End of the COP As We Know It? An Analysis of the First Year of Virtual Meetings in the UN Environment and Sustainable Development Arena. Int Negot 28:37–68
Chasek PS, Wagner LM (2016) Breaking the Mold: A New Type of Multilateral Sustainable Development Negotiation. Int Environ Agreements Polit Law Econ 16:397–413
Coleman KP (2011) Locating Norm Diplomacy: Venue Change in International Norm Negotiations. Eur J Int Relat 19(1):163–186
Colgan JD, Green JF, Hale TN (2021) Asset Revaluation and the Existential Politics of Climate Change. Int Organ 75(2):586–610
Corbera E, Calvet-Mir L, Hughes H, Paterson M (2016) Patterns of Authorship in the IPCC Working Group III Report. Nat Clim Chang 6:94–99
De Pryck K (2021) Intergovernmental Expert Consensus in the Making: The Case of the Summary for Policy Makers of the IPCC 2014 Synthesis Report. Glob Environ Polit 21(1):108–129
De Pryck K (2022) Governmental Approval. In: De Pryck K, Hulme M (eds) A Critical Assessment of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge, pp 187–196
De Pryck K, Hulme M (eds) (2022) A Critical Assessment of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge
ENB (2022) Summary Report, 14-27 February 2022: 55th Session of the IPCC (IPCC-55) and 12th Session of Working Group II (WGII-12). Available online at https://enb.iisd.org/55th-session-intergovernmental-panel-climate-change-ipcc-55-12th-session-working-group-II-summary
Hainmueller J, Mummolo J, Xu Y (2019) How much should we trust estimates from multiplicative interaction models? Simple tools to improve empirical practice. Polit Anal 27(2):163–192
Ho-Lem C, Zerriffi H, Kandlikar M (2011) Who Participates in the Intergovernmental Panel on Climate Change and Why: A Quantitative Assessment of the National Representation of Authors in the Intergovernmental Panel on Climate Change. Global Environmental Change
Holmes M (2013) The Force of Face-To-Face Diplomacy: Mirror Neurons and the Problem of Intentions. Int Org 67(4):829–861
Hughes H (2015) Bourdieu and the IPCC’s Symbolic Power. Glob Environ Polit 15(4):85–104
Hughes H (2022) Governments. In: De Pryck K, Hulme M (eds) A Critical Assessment of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge, pp 79–87
Hughes H (2023) Actors, Activities, and Forms of Authority in the IPCC. FirstView in Review of International Studies
Hughes H (2024) The IPCC and the Politics of Writing Climate Change. Cambridge University Press, Cambridge
Hughes H, Vadrot ABM (2019) Weighting the World: IPBES and the Struggle over Biocultural Diversity. Glob Environ Polit 19(2):14–37
Hughes H, Vadrot ABM (2023) Introduction: A Broadened Understanding of Global Environmental Negotiations. In: Hughes H, Vadrot ABM (eds) Conducting Research on Global Environmental Agreement-Making. Cambridge University Press, Cambridge, pp 1–22
Hughes H, Vadrot A, Allan JI, Bach T, Bansard JS, Chasek P, Gray N, Lenglet A, Leiter T, Suiseeya KRM, Martin B, Paterson M, Ruiz-Rodriguez SC, von Wysocki IT, Tolis V, Thew H, Goncalves MV, Yamineva Y (2021) Global Environmental Agreement-making: Upping the Methodological and Ethical Stakes of Studying Negotiations. Earth Syst Governance 10:100121
Hughes H, Paterson M (2017) Narrowing the Climate Field: The Symbolic Power of Authors in the IPCC’s Assessment of Mitigation. Rev Pol Res 34(6):744–766
Hulme M, Mahony M (2010) Climate Change: What Do We Know about the IPCC? Prog Phys Geogr Earth Environ 34(5):705–718
Ibarra C, Jimenez G, O’Ryan R, Blanco G, Cordero L, Insunza X, Moraga P, Rojas M, Sapiains R (2022) Scientists and Climate Governance: A view from the South. Environ Sci Pol 137:396–405
IPCC (2022) 56th Session of the IPCC and 14th Session of Working Group III Electronic Sessions from 21 March - 1 April 2022 Guidance Document. Available at https://apps.ipcc.ch/eventmanager/documents/74/140320220911-Guidance%20Note%20IPCC-56%20&%20WGIII-14.pdf
IPCC (2024) Lessons Learned from the Sixth Assessment Cycle. Available at https://apps.ipcc.ch/eventmanager/documents/83/301220231149-INF.%209%20-%20Lessons%20learned%20from%20AR6.pdf
Kamau M, Chasek P, O’Connor D (2018) Transforming Multilateral Diplomacy: The Inside Story of the Sustainable Development Goals. Routledge, New York
Kandlikar M, Sagar A (1999) Climate Change Research and Analysis in India: An Integrated Assessment of a South-North Divide. Glob Environm Chang 9(2):119–138
Karlsson S, Srebotnjak T, Gonzales P (2007) Understanding the North-South Knowledge Divide and its Implications for Policy: A Quantitative Analysis of the Generation of Scientific Knowledge in the Environmental Sciences. Environ Sci Pol 10:668–684
Ketcham C (2022) How Scientists From the “Global South” Are Sidelined at the IPCC. The Intercept. Available at https://theintercept.com/2022/11/17/climate-un-ipcc-inequality/
Kouw M, Petersen A (2018) Diplomacy in Action: Latourian Politics and the Intergovernmental Panel on Climate Change. Sci Technol Stud 31(1):52–68
Lahsen M (2004) Transnational Locals: Brazilian Experiences of the Climate Regime. In: Jansanoff S, Martello ML (eds) Eartly Politics: Local and Global Environmental Governance. MIT Press, Cambridge, MA, pp 151–172
Mahony M (2014) The Predictive State: Science, Territory and the Future of the Indian climate. Martin Mahony 44(1):109–133
Sanderson BM (2023) Against Climate Hypocrisy: Why the IPCC Needs Its Own Net-zero Target. Nature 617:653
Schipper LF, Ensor J, Mukherji A, Mirzabaev A, Fraser A, Harvey B, Totin E, Garschagen M, Pathak M, Antwi-Agyei Tanner T, Shawoo Z (2021) Equity in Climate Scholarship: A Manifesto for Action. Clim Dev 13(10):853–856
Seib P (2012) Real-Time Diplomacy: Politics and Power in the Social Media Era. Palgrave Macmillan, New York
Shukla PR, Skea J, Fradera R, Kissick K, Slade R, Belkacemi M, van Diemen R, Al Khourdajie A, Lisboa G, Luz S, Malley J, Pathak M, Smoker-Mulhern M Vyas P (2020) The IPCC’s first virtual Lead Author Meeting: An evaluation by the Technical Support Unit of Working Group III of the Intergovernmental Panel on Climate Change. Available at https://www.ipcc.ch/site/assets/uploads/2020/07/IPCC-WG-III-TSU-Report-Evaluating_the_IPCCs_first_Virtual_Lead_Author_Meeting.pdf
Standring A (2022) Participant Diversity. In: De Pryck K, Hulme M (eds) A Critical Assessment of the Intergovernmental Panel on Climate Change. Cambridge University Press, Cambridge, pp 61–70
Standring A, Lidskog R (2021) (How) Does Diversity Still Matter for the IPCC? Instrumental, Substantive and Co-Productive Logics of Diversity in Global Environmental Assessments. Climate 9(6):99
Touval S (1989) Multilateral Negotiation: An Analytic Approach. Negot J 5(2):159–173
Vadrot ABM, Langlet A, Tessnow-von Wysocki I (2021) Who Owns Marine Biodiversity? Contesting the World Order Through the ‘common Heritage of Humankind’ Principle. Environ Polit 31(2):226–250
Vadrot ABM, Ruiz Rodriguez SC (2022) Digital Multilateralism in Practice: Extending Critical Policy Ethnography to Digital Negotiation Sites. Int Stud Q 66(3):sqac051
Vardy M, Oppenheimer M, Dubash NK, O’Reilly J, Jamieson D (2017) The Intergovernmental Panel on Climate Change: Challenges and Opportunities. Ann Rev Environ Resour 42:55–75
Wagner L, Allan JI (2020) How Multilateralism Handles a Pandemic. IISD Insight. Available at https://www.iisd.org/articles/insight/how-multilateralism-handles-pandemic
Williams Z, St John T (2021) Reflecting on a Year Online: Lessons from a Survey of International Investment Negotiators. IISD Report
Acknowledgements
For the purpose of open access, the authors have applied a Creative Commons Attribution (CC BY) to any Author Accepted Manuscript version arising. Rosanna Harvey-Crawford and Stuart Brown provided excellent research assistance. All errors are our own.
Funding
This work was supported by research funding from the Economic and Social Research Council (ESRC) in the United Kingdom for the project “The Politics of Science in International Climate Cooperation” (ES/W001373/2).
Author information
Authors and Affiliations
Contributions
This paper is the result of a larger collaborative research project and as such Patrick Bayer, Lorenzo Crippa, Hannah Hughes, and Erlend Hermansen all contributed to the conceptualization of the study. Patrick Bayer devised the methodology together with Lorenzo Crippa, wrote the first draft of the paper, oversaw the study, and led the acquisition of research funding. Lorenzo Crippa curated and analyzed the data, created all visualizations, and holds primary responsibility for the results section. Hannah Hughes wrote the literature review section. All authors commented on previous versions of the manuscript. All authors read, edited and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable as study does not involve any human subjects.
Consent for publication
Not applicable as study does not involve any human subjects.
Competing interests
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Bayer, P., Crippa, L., Hughes, H. et al. Government participation in virtual negotiations: evidence from IPCC approval sessions. Climatic Change 177, 132 (2024). https://doi.org/10.1007/s10584-024-03790-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10584-024-03790-7