1 Introduction

Why do home teams in sport win more often than visiting teams? Researchers from, among other disciplines, psychology, economics, and statistics, have long been trying to figure that out.Footnote 1

One popular suggestion for the home advantage (HA) is that fans impact officiating (Moskowitz and Wertheim 2012). Whether it is crowd noise (Unkelbach and Memmert 2010), duress (Buraimo et al. 2010; Lopez 2016), or the implicit pressure to appease (Garicano et al. 2005), referee decision-making appears cued by factors outside of the run of play. If those cues tend to encourage officials to make calls in favor of the home team, it could account for some (or all) of the benefit that teams receive during home games.

A unique empirical approach for understanding HA contrasts games played in empty stadia to those played with fans, with the goal of teasing out the impact that fans have on HA. If fans impact referee decision making, it stands that an absence of fans would decrease HA. As evidence, both Pettersson-Lidbom and Priks (2010) (using Italian soccer in 2007) and Reade et al. (2020) (two decades of European soccer) found that games without fans resulted in a lower HA.

The coronavirus (Covid-19) pandemic resulted in many changes across sport, including the delay of most 2019–2020 soccer seasons. Beginning in March of 2020, games were put on pause, eventually made up in the summer months of 2020. Roughly, the delayed games account for about a third of regular season play. Make-up games were played as “ghost games”—that is, in empty stadia—as the only personnel allowed at these games were league, club, and media officials. These games still required visiting teams to travel and stay away from home as they normally would, but without fans, they represent a natural experiment with which to test the impact of fans on game outcomes.

Within just a few months of these 2020 “ghost games”, more than 10 papers have attempted to understand the impact that eliminating fans had on game outcomes, including scoring, fouls, and differences in team performances. The majority of this work used linear regression to infer causal claims about changes to HA. By and large, research overwhelmingly suggests that the home advantage decreased by a significant amount, in some estimates by an order of magnitude of one-half (McCarrick et al. 2020). In addition, most results imply that the impact of no fans on game outcomes is homogeneous with respect to league.

The goal of our paper is to expand the bivariate Poisson model (Karlis and Ntzoufras 2003) in order to tease out any impact of the lack of fans on HA. The benefits of our approach are plentiful. First, bivariate Poisson models consider home and visitor outcomes simultaneously. This helps account for correlations in outcomes (i.e., if the home team has more yellow cards, there is a tendency for the away team to also have more cards), and more accurately accounts for the offensive and defensive skill of clubs (Thompson 2018). We simulate soccer games at the season level and compare regression models (including bivariate Poisson) with respect to home advantage estimates. We find that the mean absolute bias in estimating a home advantage when using linear regression models is about six times larger when compared to bivariate Poisson. Second, we separate out each league when fit on real data, in order to pick up on both (i) inherent differences in each league’s HA and (ii) how those differences are impacted by “ghost games.” Third, we use a Bayesian version of the bivariate Poisson model, which allows for probabilistic interpretations regarding the likelihood that HA decreased within each league. Fourth, in modeling offensive and defensive team strength directly in each season, we can better account for scheduling differences pre- and post-Covid with respect to which teams played which opponents. Altogether, findings are inconclusive regarding a drop in HA post-Covid. While in several leagues a drop appears more than plausible, in other leagues, HA actually increases.

The remainder of this paper is outlined as follows. Section 2 reviews post-Covid findings, and 3 describes our implementation of the bivariate Poisson model. Section 4 uses simulation to motivate the use of bivariate Poisson for soccer outcomes, Sects. 5 and 6 explore the data and results, and Sect. 7 concludes.

2 Related literature

To date, we count 11 efforts that have attempted to estimate post-Covid changes to soccer’s HA. The estimation of changes to HA has varied in scope (the number of leagues analyzed ranges from 1 to 41), method, and finding. Table 1 summarizes these papers, highlighting the number of leagues compared, whether leagues were treated together or separately, methodology (split into linear regression or correlation based approaches), and overview of finding. For clarity, we add a row highlighting the contributions of this manuscript.

Table 1 Comparison of post-Covid research on home advantage in football

Broadly, methods consider outcome variables Y as a function of T and \(T'\), the home advantages pre-and post-Covid, respectively, as well as W, where W possibly includes game and team characteristics. Though it is infeasible to detail choice of W and Y across each of the papers, a few patterns emerge.

Several papers consider team strength, or proxies thereof, as part of W. This could include fixed effects for each team (Ferraresi et al. 2020; Cueva 2020; Bryson et al. 2020), other proxies for team strength (McCarrick et al. 2020; Fischer and Haucap 2020b; Krawczyk et al. 2020), and pre-match betting odds (Endrich and Gesche 2020). The Cueva (2020) research is expansive and includes 41 leagues across 30 countries, and likewise finds significant impacts on home and away team fouls, as well as foul differential. Other pre-match characteristics in W include if the game is a rivalry and team travel (Krawczyk et al. 2020), as well as match referee and attendance (Bryson et al. 2020).

Choices of Y include metrics such as goals, goal differential, points (3/1/0), yellow cards, yellow card differential, whether or not each team won, and other in-game actions such as corner kicks and fouls. Several authors separately develop models for multiple response variables. Linear regression and versions of these models including t-tests stand out most common approaches for modeling Y. This includes models for won/loss outcomes (Cueva 2020), goal differential (Bryson et al. 2020; Krawczyk et al. 2020), and fouls (Scoppa 2020). Two authors model goals with Poisson regression (McCarrick et al. 2020; Bryson et al. 2020). McCarrick et al. (2020) used univariate Poisson regression models of goals, points and fouls, finding that across the entirety of 15 leagues, the home advantage dropped from 0.29 to 0.15 goals per game, while Bryson et al. (2020) found a significant drop in yellow cards for the away team using univariate Poisson regression.

In addition to choice of Y, W, and method, researchers have likewise varied with the decision to treat each league separate. As shown in Table 1, all but three papers have taken each of the available leagues and used them in a single statistical model. Such an approach boasts the benefit of deriving an estimated change in HA that can be broadly applied across soccer, but requires assumptions that (i) HA is homogeneous between leagues and (ii) differences in HA post-Covid are likewise equivalent.

Our approach will make two advances that none of the papers in Table 1 can. First, we model game outcomes using an expanded version of the bivariate Poisson regression model, one originally designed for soccer outcomes (Karlis and Ntzoufras 2003). This model allows us to control for team strength, account for and estimate the correlation in game outcomes, and better model ties. Second, we will show that the assumption of a constant HA between leagues is unjustified. In doing so, we highlight that the frequent choice of combining leagues into one uniform model has far-reaching implications with respect to findings.

3 Methods

Poisson regression models assume the response variable has a Poisson distribution, and models the logarithm of response as a linear combination of explanatory variables.

Let \(Y_{Hi}\) and \(Y_{Ai}\) be outcomes observed in game i for the home (\(H_i\)) and away teams (\(A_i\)), respectively. For now we assume \(Y_{Hi}\) and \(Y_{Ai}\) are goals scored, but will likewise apply a similar framework to yellow cards. The response \((Y_{Hi}, Y_{Ai})\) is bivariate Poisson with parameters \(\lambda _{1i}, \lambda _{2i}, \lambda _{3i}\) if

$$\begin{aligned} \begin{aligned}&(Y_{Hi}, Y_{Ai}) = BP(\lambda _{1i}, \lambda _{2i}, \lambda _{3i}), \end{aligned} \end{aligned}$$
(1)

where \(\lambda _{1i} + \lambda _{3i}\) and \(\lambda _{2i} + \lambda _{3i}\) are the goal expectations of \(Y_{Hi}\) and \(Y_{Ai}\), respectively, and \(\lambda _{3i}\) is the covariance between \(Y_{Hi}\) and \(Y_{Ai}\). As one specification, let

$$\begin{aligned} \begin{aligned}&\text {log}(\lambda _{1i}) = \mu _{ks} + T_k + \alpha _{H_{i}ks} + \delta _{A_{i}ks}, \\&\text {log}(\lambda _{2i}) = \mu _{ks} + \alpha _{A_{i}ks} + \delta _{H_{i}ks}, \\&\text {log}(\lambda _{3i}) = \gamma _{k}. \end{aligned} \end{aligned}$$
(2)

In Model (2), \(\mu _{ks}\) is an intercept term for expected goals in season s (which we assume to be constant), \(T_k\) is a home advantage parameter, and \(\gamma _{k}\) is a constant covariance, all of which correspond to league k. The explanatory variables used to model \(\lambda _{1i}\) and \(\lambda _{2i}\) correspond to factors likely to impact the home and away team’s goals scored, respectively. Above, \(\lambda _{1i}\) is a function of the home team’s attacking strength (\(\alpha _{H_{i}ks}\)) and away team’s defending strength (\(\delta _{A_{i}ks}\)), while \(\lambda _{2i}\) is a function of the away team’s attacking strength (\(\alpha _{A_{i}ks}\)) and home team’s defending strength (\(\delta _{H_{i}ks}\)), all corresponding to league k during season s. For generality, we refer to \(\alpha _{ks}\) and \(\delta _{ks}\) as general notation for attacking and defending team strengths, respectively. In using \(\mu _{ks}\), \(\alpha _{ks}\) and \(\delta _{ks}\) are seasonal effects, centered at 0, such that \(\alpha _{ks} \sim N(0, \sigma ^2_{{\mathrm{att}}, k})\) and \(\delta _{ks} \sim N(0, \sigma ^2_{{\mathrm{def}}, k})\).

If \(\lambda _3 = 0\) in Eq. 2, then \(Y_{H} \perp \!\!\! \perp Y_{A}\), and the bivariate Poisson reduces to the product of two independent Poisson distributions. Using observed outcomes in soccer from 1991, Karlis and Ntzoufras (2003) found that assuming independence of the Poisson distributions was less suitable for modeling ties when compared to using bivariate Poisson. More recently, however, Groll et al. (2018) suggest using \(\lambda _3 = 0\), as there are now fewer ties when compared to 1991. Structural changes to professional soccer—leagues now reward three points for a win and one point for a tie, instead of two points for a win and one point for a tie—are likely the cause, and thus using \(\lambda _3 = 0\) in models of goal outcomes is more plausible.

There are a few extensions of bivariate Poisson to note. Karlis and Ntzoufras (2003) propose diagonally inflated versions of Model (1) and also included team indicators for both home and away teams in \(\lambda _{3}\), in order to test of the home or away teams controlled the amount of covariance in game outcomes. However, models fit on soccer goals did not warrant either of these additional parameterizations. Baio and Blangiardo (2010) use a Bayesian version bivariate Poisson that explicitly incorporates shrinkage to team strength estimates. Additionally, Koopman and Lit (2015) allows for team strength specifications to vary stochastically within a season, as in a state-space model (Glickman and Stern 1998). Though Model’s (2) and (3) cannot pick up team strengths that vary within a season, estimating these trends across 17 leagues could be difficult to scale; Koopman and Lit (2015), for example, looked only at the English Premier League. Inclusion of time-varying team strengths, in addition to an assessment of team strengths post-Covid versus pre-Covid, is an opportunity for future work.

3.1 Extending bivariate Poisson to changes in the home advantage

3.1.1 Goal outcomes

We extend Model (2) to consider post-Covid changes in the HA for goals using Model (3).

$$\begin{aligned} \begin{aligned}&(Y_{Hi}, Y_{Ai}) = BP(\lambda _{1i}, \lambda _{2i}, \lambda _{3i}), \\&\text {log}(\lambda _{1i}) = \mu _{ks} + T_k\times (I_{{\mathrm{pre-Covid}}}) + T'_k\times (I_{{\mathrm{post-Covid}}}) + \alpha _{H_{i}ks} + \delta _{A_{i}ks}, \\&\text {log}(\lambda _{2i}) = \mu _{ks} + \alpha _{A_{i}ks} + \delta _{H_{i}ks}, \\&\text {log}(\lambda _{3i}) = \gamma _{k}, \end{aligned} \end{aligned}$$
(3)

where \(T_k'\) is the post-Covid home advantage in league k, and \(I_{{\mathrm{pre-Covid}}}\) and \(I_{{\mathrm{post-Covid}}}\) are indicator variables for whether or not the match took place before or after the restart date shown in Table 3. Of particular interest will be the comparison of estimates of \(T_k\) and \(T_k'\).

3.1.2 Yellow card outcomes

A similar version, Model (4), is used for yellow cards. Let \(Z_{Hi}\) and \(Z_{Ai}\) be the yellow cards given to the home and away teams in game i. We assume \(Z_{Hi}\) and \(Z_{Ai}\) are bivariate Poisson such that

$$\begin{aligned} \begin{aligned}&(Z_{Hi}, Z_{Ai}) = BP(\lambda _{1i}, \lambda _{2i}, \lambda _{3i}), \\&\text {log}(\lambda _{1i}) = \mu _{ks} + T_k\times (I_{{\mathrm{pre-Covid}}}) + T'_k\times (I_{{\mathrm{post-Covid}}}) + \tau _{H_{i}ks} , \\&\text {log}(\lambda _{2i}) = \mu _{ks} + \tau _{A_{i}ks}, \\&\text {log}(\lambda _{3i}) = \gamma _{k}, \end{aligned} \end{aligned}$$
(4)

where \(\tau _{ks} \sim N(0, \sigma _{{\mathrm{team}}, k}^2)\). Implicit in Model (4), relative to Models (2) and (3), is that teams control their own yellow card counts, and not their opponents’, and that tendencies for team counts to correlate are absorbed in \(\lambda _{3i}\).

3.1.3 Model fits in Stan

We use Stan, an open-source statistical software designed for Bayesian inference with MCMC sampling, for each league k, and with models for both goals and yellow cards. We choose Bayesian MCMC approaches over the EM algorithm (Karlis and Ntzoufras 2003; Karlis et al. 2005) to obtain both (i) posterior distributions of the change in home advantage and (ii) posterior probabilities that home advantage declined in each league. No paper referenced in Table 1 assessed HA change probabilistically.

We fit two versions of Models (3) and (4), one with \(\lambda _3 = 0\), and a second with \(\lambda _3 > 0\). For models where \(\lambda _3 = 0\), prior distributions for the parameters in Models (3) and (4) are as follows. These prior distributions are non-informative and do not impose any outside knowledge on parameter estimation.

$$\begin{aligned} \begin{aligned}&\mu _{ks} \sim N(0, 25), \\&\alpha _{ks} \sim N(0, \sigma _{{\mathrm{att}}, k}^2),\\&\delta _{ks} \sim N(0, \sigma _{{\mathrm{def}}, k}^2), \\&\tau _{ks} \sim N(0, \sigma _{{\mathrm{team}}, k}^2), \\&\sigma _{{\mathrm{att}},k} \sim \text {Inverse-Gamma}(1, 1), \\&\sigma _{{\mathrm{def}},k} \sim \text {Inverse-Gamma}(1, 1),\\&\sigma _{{\mathrm{team}},k} \sim \text {Inverse-Gamma}(1, 1),\\&T_k \sim N(0, 25), \\&T'_k \sim N(0, 25) \end{aligned} \end{aligned}$$

For models w/ \(\lambda _3 > 0\), empirical Bayes priors were used for \(T_K, T'_k\) in order to aid in convergence. Namely, let \(\widehat{T}_{k}\) and \(\widehat{T'}_{k}\) be the posterior mean estimate of pre-Covid and post-Covid HA for from league k, respectively, from the corresponding model with \(\lambda _3 = 0\). We let

$$\begin{aligned} \begin{aligned} {\overline{T}}_{.}&= \text {mean(}\{\widehat{T}_1, ..., \widehat{T}_{17}\}) \\ \overline{T'}_{.}&= \text {mean(}\{\widehat{T'}_1, ..., \widehat{T'}_{17}\}) \\ s&= 3\times \text {SD(}\{\widehat{T}_1, ..., \widehat{T}_{17}\}) \\ s'&= 3\times \text {SD(}\{\widehat{T'}_1, ..., \widehat{T'}_{17}\}) \end{aligned} \end{aligned}$$

Priors \(T_K, T'_k\) and \(\gamma _{k}\) for the variants of Model (3) and (4) w/ \(\lambda _3 > 0\) are as follows:

$$\begin{aligned} \begin{aligned}&T_k \sim N({\overline{T}}_{.}, s^2) \\&T'_k \sim N(\overline{T'}_{.}, s'^2) \\&\gamma _{k} \sim N\biggr {(}0, \frac{1}{2}\biggr {)} \text { (Goals)} \\&\gamma _{k} \sim N(0, 2) \text { (Yellow Cards)} \end{aligned} \end{aligned}$$

The priors on \(T_K\) and \(T'_k\) are weakly informative; the variance in the priors is 9 times as large as the variance in the observed variance in \(\{\widehat{T}_1, ..., \widehat{T}_{17}\}\) estimated in the corresponding \(\lambda _3 = 0\) model variation. As \(\gamma _k\) represents the correlation term for goals/yellow cards, and exists on the log-scale, the priors are not particularly informative, and they allow for values of \(\lambda _3\) that far exceed typical number of goals and yellow cards per game. Overall, our use of priors is not motivated by a desire to incorporate domain expertise, and instead the use of Bayesian modeling is to incorporate posterior probabilities as a tool to assess changes in HA.

For models with \(\lambda _3 = 0\), Models (3) and (4) were fit using 3 parallel chains, each made up of 7000 iterations, and a burn in of 2000 draws. When \(\lambda _3 > 0\) was assumed, Models (3) and (4) were fit using 3 parallel chains, each with 20,000 iterations, and a burn-in of 10,000 draws. Parallel chains were used to improve the computation time needed to draw a suitable number of posterior samples for inference. Posterior samples were drawn using the default Stan MCMC algorithm, Hamiltonian Monte Carlo (HMC) with No U-Turn Sampling (NUTS) (Stan Development Team 2019).

To check for model convergence, we examine the \({\widehat{R}}\) statistic (Gelman and Rubin 1992; Brooks and Gelman 1998) for each parameter. If \({\widehat{R}}\) statistics are near 1, that indicates convergence (Gelman et al. 2013). To check for the informativeness of a parameter’s posterior distribution, we use effective sample size (ESS, Gelman et al. 2013), which uses the relative independence of draws to equate the posterior distribution to the level of precision achieved in a simple random sample.

For goals, we present results for Model (3) with \(\lambda _3 = 0\), and for yellow cards, we present results with Model (4) and \(\lambda _3 > 0\). Henceforth, any reference to those models assumes such specifications, unless explicitly stated otherwise. All data and code for running and replicating our analysis are found at https://github.com/lbenz730/soccer_ha_covid.

4 Simulation

4.1 Simulation overview

Most approaches for evaluating bivariate Poisson regression have focused on model fit (Karlis et al. 2005) or prediction. For example, Ley et al. (2019) found bivariate Poisson matched or exceeded predictions of paired comparison models, as judged by rank probability score, on unknown game outcomes. Tsokos et al. (2019) also compared paired comparison models to bivariate Poisson, with a particular focus on methods for parameter estimation, and found the predictive performances to be similar. As will be our suggestion, Tsokos et al. (2019) treated each league separately to account for underlying differences in the distributions of game outcomes. Bivariate Poisson models have also compared favorably with betting markets (Koopman and Lit 2015).

We use simulations to better understand accuracy and operation characteristics of bivariate Poisson and other models in terms of estimating soccer’s home advantage. There are three steps to our simulations; (i) deriving team strength estimates, (ii) simulating game outcomes under assumed home advantages, and (iii) modeling the simulated game outcomes to estimate that home advantage. Exact details of each of these three steps are shown in “Appendix”; we summarize here.

We derive team strength estimates to reflect both the range and correlations of attacking and defending estimates found in the 17 professional soccer leagues in our data. As in Thompson (2018), team strength estimates are simulated across single seasons of soccer using the bivariate normal distribution. To assess if the correlation of team strengths (abbreviated as \(\rho *\)) effects home advantage estimates, we use \(\rho * \in \{-0.8, -0.4, 0\}\) (teams that typically score more goals also allow fewer goals).

Two data generating processes are used to simulate home and away goal outcomes. The first reflects Model (2), where goals are simulated under a bivariate Poisson distribution. The second reflects a bivariate normal distribution. Although bivariate Poisson is more plausible for soccer outcomes (Karlis and Ntzoufras 2003), using bivariate normal allows us to better understand how a bivariate Poisson model can estimate HA under alternative generating processes. For both data generating processes, we fix a simulated home advantage \(T*\), for \(T* \in \{0, 0.25, 0.5\}\), to roughly reflect ranges of goal differential benefits for being the home team, as found in Figure 1 of Bryson et al. (2020).

Three candidate models are fit. First, we use linear regression models of goal differential as a function of home and away team fixed effects and a term for the home advantage, versions of which were used by Bryson et al. (2020), Scoppa (2020), Krawczyk et al. (2020) and Endrich and Gesche (2020). Second, we use Bayesian paired comparison models, akin to Tsokos et al. (2019) and Ley et al. (2019), where goal differential is modeled as a function of differences in team strength, as well as the home advantage. Finally, we fit Model (2) with \(\lambda _3 = 0\). Recall that when \(\lambda _3 = 0\), the bivariate Poisson in Eq. 2 reduces to the product of two independent Poisson distributions. The \(\lambda _3 = 0\) bivariate Poisson model variant was chosen for use in simulations given that such a choice has proven suitable for modeling goals outcomes in recent year (Groll et al. 2018), and furthermore the \(\lambda _3 = 0\) variant of Model (3) will be presented in Sect. 6.1.2.

A total of 100 seasons were simulated for each combination of \(\rho *\) and \(T*\) using each of the two data generating process, for a total of 1800 simulated seasons worth of data.

4.2 Simulation results

Table 2 shows mean absolute bias (MAB) and mean bias (MB) of home advantage estimates from each of the three candidate models (linear regression, paired comparison, and bivariate Poisson) under the two data generating processes (bivariate Poisson and bivariate normal). Each bias is shown on the goal difference scale.

Table 2 Mean absolute bias (MAB) and mean bias (MB) in 1800 estimates of the home advantage in a single season of soccer games between 20 teams, 100 for each combination of data generating process, team strength correlation (\(\rho *\)) and home advantage (\(T*\))

When goal outcomes are simulated using the bivariate Poisson distribution, bivariate Poisson model estimates of home advantage average an absolute bias of roughly 0.06–0.07, and range from 11 to 31% lower than estimated home advantages from paired comparison models. Furthermore, for large advantages of home advantage, the paired comparison is directionally biased and tends to overestimate home advantage.

Both bivariate Poisson and paired comparison models compare favorably to linear regression. The absolute biases from linear regression models vary between 0.40 and 0.53 and tend to increase with larger home advantages. More generally, when using these models across a full season’s worth of soccer games, one could expect the estimate of the home advantage from a linear regression (with home and away team fixed effects) to be off by nearly half a goal (in unknown direction), which is about six times the amount of bias shown when estimating using bivariate Poisson.

When goal outcomes are simulated using the bivariate normal distribution, bivariate Poisson and paired comparison models capture the known home advantage with equivalent accuracy (mean absolute bias’ within ± 3%, with bivariate Poisson slightly better). Linear regression performs poorly under these goal outcome models, with an average absolute bias range from 0.427 to 0.549).

Overall, there do not seem to be any noticeable patterns across \(\rho *\), the range of correlation between team strengths.

5 Data

Table 3 Breakdown of leagues used in analysis

The data used for this analysis are comprised of games from 17 soccer leagues in 13 European countries spanning 5 seasons between 2015 and 2020. The leagues selected for use in this analysis were among the first leagues to return to play following a suspension of the season to the Covid-19 pandemic. Typically, European countries have hierarchies of leagues (also referred to as divisions, tiers, or flights), with teams competing to be promoted to a better league and/or to avoid being relegated to the league below. For each of the 13 countries used in this analysis, the top league in that country was selected. Additionally, 2nd tier leagues were included for England, Spain, Italy and Germany, the countries among the “Big 5” European soccer to resume domestic competition (the final of the “Big 5” countries, France, cancelled the conclusion of its leagues’ 2019–2020 seasons). Only games from intra-league competition were used in this analysis, and games from domestic inter-league cup competitions (such as England’s FA Cup), and inter-country competitions (such as the UEFA Champions League), were dropped. A full summary of the leagues and games used in this paper is presented in Table 3.

Data were scraped from Football Reference (Sports Reference 2020) on 2020-10-28. For each league, the five most recent seasons worth of data were pulled, not including the ongoing 2020–2021 season. For 15 of the 17 leagues, this included the 2015–2016 season through the 2019–2020 season. Unlike the majority of European Soccer leagues, which run from August to May, the top flights in Sweden and Norway run from March to November. These leagues never paused an ongoing season due to the Covid-19 pandemic, but rather delayed the start of their respective 2020 seasons until June. As a result, the data used in this analysis are five full seasons worth of data for all the leagues outside of Sweden and Norway, while those two countries have four full seasons of data, plus all games in the 2020 season through 2020-10-28.

Throughout this analysis, we refer to pre-Covid and post-Covid samples. For each league, the pre-Covid sample constitutes all games prior to the league’s restart date, listed in Table 3, while the post-Covid sample includes all games which comprised of all games on or after the league’s restart date. In nearly all cases, the league’s restart date represents a clean divide between games that had fans in attendance and games that did not have any fans in attendance due to Covid restrictions. One exception is a German Bundesliga game between Borussia Monchengladbach and Cologne on 2020-03-11 that was played in an empty stadium just before the German Bundesliga paused its season. Additionally, seven games in Italy Serie A were played under the same circumstances. While leagues returned from their respective hiatuses without fans in attendance, some, such as the Danish Superliga, Russian Premier League, and Norwegian Eliteserien, began allowing very reduced attendance by the end of the sample.

Unfortunately, attendance numbers attained from Football Reference were not always available and/or accurate, and as such, we cannot systematically identify the exact number games in the sample that had no fans in attendance prior to the league suspending games, or the exact number of games in the post-Covid sample that had fans in attendance. Related, there are several justifications for using the pre-Covid/post-Covid sample split based on league restart date:

  1. 1.

    Any number of games in the pre-Covid sample without fans in attendance is minute compared to the overall size of any league’s pre-Covid sample.

  2. 2.

    Several month layoffs with limited training are unprecedented, and possibly impact team strengths and player skill, which in turn may impact game results in the post-Covid sample beyond any possible change in home advantage.

  3. 3.

    Any games in a league’s post-Covid sample played before fans have attendances significantly reduced compared to the average attendance of a game in the pre-Covid sample.

  4. 4.

    The majority of leagues do not have a single game in the post-Covid sample with any fans in attendance, while all leagues have games in the post-Covid sample without fans.

Recently started games in the 2020–2021 season are not considered, as leagues have diverged from one another in terms of off-season structure and policies allowing fans to return to the stands.

Games where home/away goals were unavailable were removed for the goals model, and games where home/away yellow cards were unavailable were removed for the yellow cards model. The number of games displayed in Table 3 reflects the sample sizes used in the goals model. The number of games where goal counts were available always matched or exceeded the number of games where yellow card counts were available. Across 5 leagues, 92 games from the pre-Covid samples used in Model (3) were missing yellow card counts, and had to be dropped when fitting Model (4) (2 in Italy Serie B, 2 in the English League Championship, 12 in the Danish Superliga, 34 in the Turkish Super Lig, and 42 in Spanish La Liga 2). 4 games had to be dropped from the Russian Premier’s Leagues post-Covid sample for the same reason.

6 Results

6.1 Goals

6.1.1 Model fit

Results from goals Model (3), using \(\lambda _3 = 0\) for all leagues, are shown below. We choose Model (3) with \(\lambda _3= 0\) because, across our 17 leagues of data, the correlation in home and away goals per game varied between − 0.16 and 0.07.

Using this model, all \({\widehat{R}}\) statistics ranged from 0.9998 to 1.003, providing strong evidence that the model properly converged. Additionally, the effective sample sizes are provided in Table 6. ESS are sufficiently large, especially HA parameters of interest \(T_k\) and \(T'_k\), suggesting enough draws were taken to conduct inference.

Figure 3 (in “Appendix”) shows an example of posterior means of attacking (\(\alpha _{ks}\)) and defensive (\(\delta _{ks}\)) team strengths for one season of the German Bundesliga. In Fig. 3, the top team (Bayern Munich) stands out with top offensive and defensive team strength metrics. However, the correlation between offensive and defensive team strength estimates is weak, reflecting the need for models to incorporate both aspects of team quality.

6.1.2 Home advantage

The primary parameters of interest in Model (3) are \(T_k\) and \(T'_k\), the pre- and post-Covid home advantages for each league k, respectively. These HA terms are shown on a log-scale, and represent the additional increase in the home team’s log goal expectation, relative to a league average (\(\mu _{ks}\)), and after accounting for team and opponent (\(\alpha _{ks}\) and \(\delta _{ks}\)) effects.Footnote 2

Posterior distributions for \(T_k\) and \(T'_k\) are presented in Fig. 1. Clear differences exist between several of the 17 leagues’ posterior distributions of \(T_k\). For example, the posterior mean of \(T_k\) in the Greek Super League is 0.409, or about 2.5 times that of the posterior mean in the Austrian Bundesliga (0.161). The non-overlapping density curves between these leagues add further support for our decision to estimate \(T_k\) separately for each league, as opposed to one T across all of Europe.

Fig. 1
figure 1

Posterior distributions of \(T_k\) and \(T'_k\), the pre-Covid and post-Covid HAs for goals. Larger values of \(T_k\) and \(T'_k\) indicate larger home advantages. Prior to the Covid-19 pandemic, the Greek Super League and Norwegian Eliteserien had the largest home advantages for goals, while the Austrian Bundesliga and Swiss Super League had the smallest home advantages for goals. Across the 17 leagues in the sample, a range of differences exist between posterior distributions of \(T_k\) and \(T'_k\)

Table 4 Comparison of posterior means for pre-Covid and post-Covid goals HA parameters from Model (3), \(\widehat{T}_{k}\) and \(\widehat{T'}_{k}\), respectively

Table 4 compares posterior means of \(T_k\) (denoted \(\widehat{T}_{k}\)) with those of \(T'_k\) (denoted \(\widehat{T'}_{k}\)) for each of the 17 leagues. Posterior means for HA without fans are smaller than the corresponding posterior mean of HA w/ fans \((\widehat{T'}_{k} < \widehat{T}_{k})\) in 11 of the 17 leagues. In the remaining 6 leagues, our estimate of post-Covid HA is larger than pre-Covid HA (\(\widehat{T'}_{k} > \widehat{T}_{k}\)).

Our Bayesian framework also allows for probabilistic interpretations regarding the likelihood that HA decreased within each league. Posterior probabilities of HA decline, \(P(T'_k < T_k)\), are also presented in Table 4. The 3 leagues with the largest declines in HA, both in absolute and relative terms, were the Austrian Bundesliga \((\widehat{T}_{k} = 0.161, \widehat{T'}_{k} = -0.202)\), the German Bundesliga \((\widehat{T}_{k} = 0.229, \widehat{T'}_{k} = -0.024)\), and the Greek Super League \((\widehat{T}_{k} = 0.409, \widehat{T'}_{k} = 0.167)\). The Austrian Bundesliga and German Bundesliga were the only 2 leagues to have post-Covid posterior HA estimates below 0, perhaps suggesting that HA disappeared in these leagues altogether in the absence of fans. We find it interesting to note that among the leagues with the 3 largest declines in HA are the leagues with the highest (Greek Super League) and lowest (Austrian Bundesliga) pre-Covid HA.

We estimate the probability the HA declined with the absence of fans, \(P(T'_k < T_k)\), to be 0.999, 0.995, and 0.972 in the top flights in Austria, Germany, and Greece respectively. These 3 leagues, along with the English League Championship (0.912), Swedish Allsvenskan (0.907), and both tiers in Spain (0.959 for Spanish La Liga, 0.903 for Spanish La Liga 2) comprise seven leagues where we estimate a decline in HA with probability at least 0.9.

Two top leagues—the English Premier League \((\widehat{T}_{k} = 0.246, \widehat{T'}_{k} = 0.264)\) and Italy Serie A \((\widehat{T}_{k} = 0.204, \widehat{T'}_{k} = 0.292)\)—were among the six leagues with estimated post-Covid HA greater than pre-Covid HA. The three leagues with largest increase in HA without fans were the Swiss Super League \((\widehat{T}_{k} = 0.180, \widehat{T'}_{k} = 0.362)\), Italy Serie A \((\widehat{T}_{k} = 0.204, \widehat{T'}_{k} = 0.292)\), and the Portuguese Liga \((\widehat{T}_{k} = 0.256, \widehat{T'}_{k} = 0.338)\).

Figure 4 (provided in “Appendix”) shows the posterior distributions of \(T_k - T'_k\), the change in goals home advantage, in each league. Though this information is also partially observed in Table 4 and Fig. 2, the non-overlapping density curves for the change in HA provide additional evidence that post-Covid changes were not uniform between leagues.

Fitting Model (3) with \(\lambda _3 > 0\) did not noticeably change inference with respect to the home advantage. For example, the probability that HA declined when assuming \(\lambda _3 > 0\) was within 0.10 of the estimates shown in Table 4 in 14 of 17 leagues. In only one of the leagues did the estimated probability of HA decline exceed 0.9 with \(\lambda _3 = 0\) and fail to exceed 0.9 with \(\lambda _3 > 0\) (Swedish Allsvenskan: \(P(T'_k < T_k) = 0.907\) w/ \(\lambda _3 = 0\) and 0.897 w/ \(\lambda _3 > 0\)).

6.2 Yellow cards

6.2.1 Model fit

The yellow cards model presented in this paper is Model (4), using \(\lambda _3 > 0\) for all leagues. Unlike with goals, where there was inconsistent evidence of a correlation in game-level outcomes, the correlation in home and away yellow cards per game varied between 0.10 and 0.22 among the 17 leagues.

\({\widehat{R}}\) statistics for Model (3) ranged from 0.9999 to 1.013, providing strong evidence that the model properly converged. Effective sample sizes (ESS) for each parameter in Model (4) are provided in Table 7. ESS are sufficiently large, especially HA parameters of interest \(T_k\) and \(T'_k\), suggesting enough draws were taken to conduct inference.

6.2.2 Home advantage

Fig. 2
figure 2

Posterior distributions of \(T_k\) and \(T'_k\), the pre-Covid and post-Covid HAs for yellow cards. Smaller (i.e., more negative) values of \(T_k\) and \(T'_k\) indicate larger home advantages. Prior to the Covid-19 pandemic, the English League Championship and Greek Super League had the largest home advantages for yellow cards, while the Swedish Allsvenskan and Turkish Super Lig had the smallest home advantages for yellow cards. Across the 17 leagues in the sample, a range of differences exist between posterior distributions of \(T_k\) and \(T'_k\)

Table 5 Comparison of posterior means for pre-Covid and post-Covid yellow cards HA parameters from Model (4), \(\widehat{T}_{k}\) and \(\widehat{T'}_{k}\), respectively

As with Model (3) in Sect. 6.1.2, the primary parameters of interest in Model (4) are \(T_k\) and \(T'_k\), the pre- and post-Covid home advantages for each league k, respectively. Unlike with goals, where values of \(T_k\) are positive, teams tend to want to avoid yellow cards, and thus estimates of \(T_k\) are \(< 0\). Related, a post-Covid decrease in yellow card HA is reflected by \(T_k < T'_k\).

As in Sect. 6.1.2, \(T_k\) and \(T'_k\) correspond to a log-scale and represent the additional increase on the home team’s log yellow card expectation, relative to a league average (\(\mu _{ks}\)) after accounting for team and opponent (\(\tau _{ks}\)) tendencies. Additionally, note that the same value of \(T_k\) represents a larger home advantage in a league where fewer cards are shown (i.e., smaller \(\mu _{ks}\)).

Posterior distributions for \(T_k\) and \(T'_k\) are presented in Fig. 2. Posterior means of \(T_k\) range from − 0.196 (Swedish Allsvenskan) to − 0.478 (English League Championship).

Table 5 compares posterior means of \(T_k\) (denoted \(\widehat{T}_{k}\)) with those of \(T'_k\) (denoted \(\widehat{T'}_{k}\)) for each of the 17 leagues for the yellow cards model. Posterior means for \(T_k\) are smaller than that the corresponding posterior mean of \(T'_k\), \((\widehat{T}_{k} < \widehat{T'}_{k})\) in 15 of the 17 leagues, suggesting that yellow card HA declined in nearly every league examined in the absence of fans.

The two leagues with the largest declines in HA, both in absolute and relative terms, were the German 2. Bundesliga \((\widehat{T}_{k} = -0.392, \widehat{T'}_{k} = -0.090)\) and the Austrian Bundesliga \((\widehat{T}_{k} = -0.251, \widehat{T'}_{k} = 0.063)\). In addition the top Austrian division and the 2nd German division, \(\widehat{T'}_{k} > 0\) in the German Bundesliga \((\widehat{T}_{k} = -0.340, \widehat{T'}_{k} = 0.039)\) and Russian Premier League \((\widehat{T}_{k} = -0.404, \widehat{T'}_{k} = 0.037)\).

Posterior probabilities of HA decline, \(P(T'_k > T_k)\), are also presented in Table 5. This probability exceeds 0.9 in 5 of 17 leagues: Russian Premier Liga (.997), German Bundesliga (0.986), Portuguese Liga (0.984), German 2. Bundesliga (0.982), and Spanish La Liga 2 (0.917).

Alternatively, \(\widehat{T}_{k} > \widehat{T'}_{k}\) in 2 leagues, the English Premier League \((\widehat{T}_{k} = -0.293, \widehat{T'}_{k} = -0.366)\) and Italy Serie A \((\widehat{T}_{k} = -0.344, \widehat{T'}_{k} = -0.489)\). However, given the overlap in the pre-Covid and post-Covid density curves, this does not appear to be a significant change.

Figure 5 (provided in “Appendix”) shows the posterior distributions of \(T_k - T'_k\), the change in yellow card home advantage, in each league. In Fig. 5, there is little, if any, overlap between estimates of the change in Serie A’s yellow card home advantage, and, for example, the change in German 2. Bundesliga and the Russian Premier League, adding to evidence that the post-Covid changes in HA are not uniform across leagues.

Fitting Model (4) with \(\lambda _3 = 0\) changed inference with respect to the home advantage slightly more than was the case between the two variants of Model (3). For example, the probability that HA declined when assuming \(\lambda _3 = 0\) was within 0.10 of the estimates shown in Table 5 in only 9 of 17 leagues. With \(\lambda _3 = 0\), we estimated the probability HA declined to be 0.979 in the Austrian Bundesliga and 0.944 in the Danish Super Liga, compared to 0.863 and 0.874, respectively, with \(\lambda _3 > 0\). Other notable differences include the English Premier League and Italy Serie A, whose estimated probability of HA decline rose from 0.075 and 0.073 to 0.376 and 0.240, respectively. Such differences are to be expected given the much larger observed correlation in yellow cards as compared to goals, and suggest that failure to account for correlation in yellow cards between home and away teams might lead to faulty inference and incorrect conclusions about significant decreases (or increases) in home advantage.

6.3 Examining goals and yellow cards simultaneously

To help characterize the relationship between changes in our two outcomes of interest, Fig. 6 (shown in the “Appendix”) shows the pre-Covid and post-Covid HA posterior means of each of goals and yellow cards in the 17 leagues. The origin of the arrows in Fig. 6 is the posterior mean of HA for pre-Covid yellow cards and goals, and the tip of the arrow is the posterior mean of post-Covid HA for yellow cards and goals.

Of the 17 leagues examined in this paper, 11 fall into the case where yellow cards and goals both experienced a decline in HA. In four leagues, the German Bundesliga, Spanish La Liga 2, Greek Super League, and Austrian Bundesliga, the probability that HA declined was greater than 0.8 for both outcomes of interest.

Despite the posterior mean HA for goals being higher post-Covid when compared to pre-Covid, the Turkish Super Lig, German 2. Bundesliga, Portuguese Liga, and Swiss Super League show a possible decrease in yellow card HA. For example, we estimate the probably that HA for yellow cards declined to be 0.984 for the Portuguese Liga and 0.982 for the German 2. Bundesliga.

Both the English Premier League and Italy Serie A show posterior mean HAs that are higher for both outcomes. Of the four countries where multiple leagues were examined, only Spain’s pair of leagues showed similar results (decline in HA for both outcomes). No leagues had showed posterior means with a lower HA for goals but not for yellow cards.

7 Discussion

Our paper utilizes bivariate Poisson regression to estimate changes to the home advantage (HA) in soccer games played during the summer months of 2020, after the outbreak of Covid-19, and relative to games played pre-Covid. Evidence from the 17 leagues we looked is mixed. In some leagues, evidence is overwhelming that HA declined for both yellow cards and goals. Alternatively, other leagues suggest the opposite, with some evidence that HA increased. Additionally, we use simulation to highlight the appropriateness of bivariate Poisson for home advantage estimation in soccer, particularly relative to the oft-used linear regression.

The diversity in league-level findings highlights the challenges in reaching a single conclusion about the impact of playing without fans, and implies that alternative causal mechanisms are also at play. For example, two of the five major European leagues are the German Bundesliga and Italy’s Serie A. In the German Bundesliga, evidence strongly points to decreased HA (> 99% with goals), which is likely why Fischer and Haucap (2020a) found that broadly backing away Bundesliga teams represented a profitable betting strategy. But in Serie A, we only find a 10% probability that HA decreased with goal outcomes. Comparing these two results does not mesh into one common theme. Likewise, Figs. 1, 2, 4 and 5 imply that both (i) HA and (ii) changes in HA are not uniform by league.

Related, there are other changes post Covid-19 outbreak, some of which differ by league. These include, but are not limited to:

  1. 1.

    Leagues adopted rules allowing for five substitutions, instead of three substitutions per team per game. This rule change likely favors teams with more depth (potentially the more successful teams) and suggests that using constant estimates of team strength pre-Covid and post-Covid could be inappropriate.Footnote 3

  2. 2.

    Certain leagues restarted play in mid-May, while others waited until the later parts of June. An extra month away from training and club facilities could have impacted team preparedness.

  3. 3.

    Covid-19 policies placed restrictions on travel and personal life. When players returned to their clubs, they did so in settings that potentially impacted their training, game-plans, and rest. Additionally, all of these changes varied by country, adding credence to our suggestion that leagues be analyzed separately.

Taken wholly, estimates looking at the impact of HA post-Covid are less of a statement about the cause and effect from a lack of fans (McCarrick et al. 2020; Bryson et al. 2020), and as much about changes due to both a lack of fans and changes to training due to Covid-19. Differences in the latter could more plausibly be responsible for the heterogenous changes we observe in HA post-Covid.

Given league-level differences in both HA and change in HA, we do not recommend looking at the impact of “ghost games” using single number estimate alone. However, a comparison to McCarrick et al. (2020), who suggest an overall decline in per-game goals HA from 0.29 to 0.15 (48%), is helpful for context. As shown in Table 4, our median league-level decline in goals HA, on the log scale, is 0.07. Extrapolating from Model 3, assuming attacking and defending team strengths of 0, and using the average posterior mean for \(\mu _k\), averaged across the 17 leagues, this equates to a decline in the per-game goals HA from 0.317 to 0.243 (23%). This suggests the possibility that, when using bivariate Poisson regression, the overall change in HA is attenuated when compared to current literature.

We are also the first to offer suggestions on the simultaneous impact of HA for yellow cards and goals. While traditional soccer research has used yellow cards as a proxy for referee decisions relating to benefits for the home team, we find that it is not always the case that changes in yellow card HA are linked to changes to goal HA. In two leagues, German 2. Bundesliga and Portuguese Liga, there are overwhelming decreases in yellow card HA (probabilities of a decrease of at least 98% in each), but small increases in the net HA given to home team goals. Among other explanations, this suggests that yellow cards are not directly tied to game outcomes. It could be the case that, for example, visiting teams in certain leagues fouled less often on plays that did not impact chances of scoring or conceding goals. Under this hypothesis, yellow cards are not a direct proxy for a referee-driven home advantage, and instead imply changes to player behavior without fans, as suggested by Leitner and Richlan (2020a). Alternatively, having no fan support could cause home players to incite away players less frequently. Said FC Barcelona star Lionel Messi (Reuters 2020), “It’s horrible to play without fans. It’s not a nice feeling. Not seeing anyone in the stadium makes it like training, and it takes a lot to get into the game at the beginning.”

Finally, we use simulations to highlight limitations of using linear regression with goal outcomes in soccer. The mean absolute bias in HA estimates is roughly six times higher when using linear regression, relative to bivariate Poisson. Absolute bias when estimating HA using bivariate Poisson also compares favorably to paired comparison models. Admittedly, our simulations are naive, and one of our two data generating processes for simulated game outcomes aligns with the same Poisson framework as the one we use to model game results. This, however, is supported by a wide body of literature, including Reep and Benjamin (1968), Reep et al. (1971), Dixon and Coles (1997), and Karlis and Ntzoufras (2000). Despite this history, linear regression remains a common tool for soccer research (as shown in Table 1); as an alternative, we hope these findings encourage researchers to consider the Poisson distribution.