Introduction

It has been known since the era of the Earth Radiation Budget Satellites in the 1980s [1] that clouds tend to cool the Earth by approximately 20 W m−2. In other words, the cloud radiative effect or forcing is R cld = R − R 0 ≈  − 20 W m−2 where R is the temporally and globally averaged net radiation at the top of the atmosphere and superscript 0 denotes clear sky. This tendency to cool the Earth system is about five times the magnitude and of opposite sign to the external radiative perturbation (dR ext) due to a doubling of CO2. Assuming that the climate system is represented by changes to the globally averaged surface temperature (\( \delta \overset{-}{T_{\mathrm{sfc}}} \)), the change in top of atmosphere net radiative flux (dR), associated with changes in the climate system, is defined as a feedback [λ, W m−2 K−1]. A thorough discussion of the primary feedbacks in the climate system is given in [2], and a review of cloud feedbacks (λ cld) is given in [3]. Uncertainty in the equilibrium climate sensitivity (ECS) defined as \( \overset{-}{{\delta T}_{\mathrm{sfc}}} \) due to CO2 doubling has been persistently large due primarily to uncertainties in λ cld [4, 5].

Our understanding of feedbacks in the climate system has become much more nuanced in recent years [6,7,8,9,10,11,12,13,14,15,16] with the insights that (1) evaluation of λ cld must account for changes in the system not associated with clouds that appear to mask R cld [11, 12] and (2) that certain changes in the system that appear as contributing to λ cld are actually due to rapid changes in the system that are independent of \( \overset{-}{{\delta T}_{\mathrm{sfc}}} \) [6,7,8,9,10] and therefore not associated with λ cld. Furthermore, the concept that short-term (interannual to decadal) records from the current climate can provide empirical or emergent constraints on climate model simulations [17] has provided a theoretical foundation for examining the existing observational record for physical mechanisms that correlate cloud radiative effects with feedbacks in the climate system [18,19,20,21,22,23,24].

In this paper, we consider what aspects of the cloud feedback problem might be accessible to evaluation using space-based active remote sensing. We consider the existing record of active measurements from the A-Train era [25] and what might be possible were that observational record extended and perhaps expanded in the future. To address these issues, we first briefly review our current understanding of the cloud forcing and feedback concepts.

The Nature of the Cloud Response—Forcing and Feedback

Consider that even if the distribution and properties of clouds in the climate system did not change with increasing greenhouse gasses, cloud radiative forcing, R cld, as defined earlier would tend to become smaller just because the infrared opacity of the clear sky atmosphere would increase as greenhouse gas concentrations increase. In other words, a non-zero λ cldwould be inferred even if clouds did not change. This highlights the need to carefully interpret changes to R cld (dR cld) in terms of λ cld. In a paradigm introduced by Soden et al. [12], the change in dR cld can be expressed in terms of dR adjusted for the effects of changes to the net radiation in the cloud-free sky (dR 0):

$$ \mathrm{d}{R}_{\mathrm{cld}} = \mathrm{d} R-\left({K}_T^0\mathrm{d} T+{K}_w^0\mathrm{d} w+{K}_a^0\mathrm{d} a+{G}^0\right) $$
(1)

where the terms in the parentheses represent dR 0. In Eq. 1, G refers to R ext, and the quantities K x refer to the globally averaged radiative kernels (\( \frac{\partial R}{\partial x} \)) due to x where x can be temperature (T), water vapor (w), and albedo (a). K x are functions of the radiative transfer physics such as the radiative properties of clouds and the atmosphere, and they allow for an intuitive evaluation of the feedbacks [13,14,15]. Alternatively, dR can be expressed in terms of the total sky (clear plus cloudy) changes,

$$ {\lambda}_{\mathrm{cld}}\overset{-}{{\delta T}_{\mathrm{sfc}}}=\mathrm{d} R-\left({K}_T\mathrm{d} T+{K}_w\mathrm{d} w+{K}_a\mathrm{d} a+ G\right) $$
(2)

where now the terms in the parentheses represent changes to the all-sky net radiation not associated with changes to clouds. Subtracting Eq. 2 from 1, the relationship between R cld and λ cld then becomes

$$ {\delta \overset{-}{T_{\mathrm{sfc}}}\lambda}_{\mathrm{cld}}=\mathrm{d}{R}_{\mathrm{cld}} + M $$
(3)

where M is the difference of the parenthesized terms in Eqs. 1 and 2 and represents the extent to which clouds mask changes to non-cloud feedback terms. This relationship between the cloud forcing, feedbacks, and cloud masking was first derived in [12]. The important insight is the relationship between dR cld and λ cld. A decrease in cloud cover with warming that decreases R cld with all else remaining constant, for instance, would result in a positive shortwave λ cld and a negative longwave λ cld with the net depending on their relative magnitudes. If the cloud properties remained the same with decreasing cloud cover, dR cld would approach zero as R approaches R 0.

It is generally understood when evaluating ECS, for instance, that Eq. 3 is considered between two equilibrium climate states that differ by a doubling in CO2. However, it was found that following an instantaneous CO2 doubling, some changes in clouds happened very quickly (within days or months of the CO2 change) independent of \( \delta \overset{-}{T_{\mathrm{sfc}}} \) that ultimately drove a top of atmosphere (TOA) radiative flux change [6,7,8,9,10]. These rapid adjustments (F cld) were independent of \( \delta \overset{-}{T_{\mathrm{sfc}}} \) and therefore independent of λ cld, such that dR cld = F cld + \( {\delta \overset{-}{T_{\mathrm{sfc}}}\lambda}_{\mathrm{cld}}. \) With this understanding, we would rewrite Eq. 3 to account for the adjustments since the radiative change that defines the feedback response (\( {\delta \overset{-}{T_{\mathrm{sfc}}}\lambda}_{\mathrm{cld}} \)) is due to changes in R cld that are not associated with rapid adjustments.

$$ {\overset{-}{{\delta T}_{\mathrm{sfc}}}\lambda}_{\mathrm{cld}}=\mathrm{d}{R}_{\mathrm{cld}} - {F}_{\mathrm{cld}}+\left({M}^{\prime}\right) $$
(4)

where the prime on M indicates that M now includes masking adjustments for the rapid response of the climate system to the instantaneous CO2 doubling. Equation 4 illustrates the relationship between the cloud feedback, the cloud forcing, the adjustments, and the cloud masking.

In a further innovation, Zelinka et al., [14, 15] introduced an approach for calculating λcld using a cloud occurrence (C) radiative kernel K c where the terms in the K c matrix would be \( \frac{\partial R}{\partial C} \) as a function of the column optical depth (τ) and cloud top pressure (P CT) based on the International Satellite Cloud Climatology Project (ISCCP) [26] convention . Then λ cld is expressed in terms of the matrix of K c times the change in an occurrence frequency matrix (δC) of the various cloud types defined in terms of P CT and τ, λ cld = K c*(\( \delta C/\overset{-}{{\delta T}_{\mathrm{sfc}}}\Big) \). Note that δC is normalized by the globally averaged temperature change over which the changes in cloud occurrence were determined. In addition, methodologies for decomposing the cloud feedback into contributions from δC, from changes to P CT, and changes to τ were introduced [9, 16]. This decomposition effectively separates the occurrence frequencies from cloud properties and separates the cloud properties into important orthogonal and observable macrophysical components. For instance, one would expect that R cld for a given type defined by P CT and τ would be reasonably constant at a given latitude over some averaging period like a month while the distribution of cloudiness type might shift as the climate changes [27, 28].

From an observational perspective, there are several challenges to interpreting Eq. 4. First, the distinction between F cld and dR cld are pedagogical in a practical sense since the distinction between F cld and δT sfc λ cld are not observable. However, it is important to know which processes that drive observable changes to the system are and are not associated with feedbacks since they can indicate over what timescales and under what conditions certain change-related processes might emerge from the noise of the climate system. Active remote sensors are uniquely able to observe C with very high accuracy and relatively little ambiguity. As we discuss in the following, the influence of cloud-type changes within the δC matrix have distinct signatures in the climate system. Also, while it is generally assumed that K c is more or less constant [9, 14,15,16], changes to the diurnal distribution of cloud occurrence and changes to radiative properties due to microphysical processes that may be a function of temperature can modulate K c. In the next section, we elaborate on these issues using specific examples from the measurement record and from recent literature.

The Role of Active Remote Sensors

Using Eq. 5 as a roadmap, we consider the role of active remote sensing in contributing to our understanding. The challenge that must be overcome is that the conceptual thinking that produced Eq. 5 is rooted in global modeling where equilibrium climate states can be generated numerically from instantaneously perturbed approximations of nature. Because of the drastically different space and timescales of such global modeling exercises compared to measurements and because it is difficult to conduct controlled experiments using the actual Earth, the observational record has played a limited role in developing understanding and in constraining predictions regarding climate feedbacks and forcings. We argue that the primary contribution of active and combined active and passive remote sensors such as the A-Train will be in populating the C matrix on global spatial scales and on timescales that are becoming climate-relevant. This is especially true in light of the emergent constraint concept [17]. To illustrate how active remote sensors can contribute to the cloud feedback/forcing problem, we present an example.

K c C = R cld : an Example

Active remote sensors, particularly millimeter wavelength radar and elastic lidar, are uniquely suited to observing the vertical distribution of clouds and precipitation [29, 30] and important first-order properties such as cloud top phase [31,32,33,34]. In Figs. 1, 2, 3, and 4, we present an example of using combined space-borne lidar and radar data to diagnose R cld in terms of the radiative kernel and occurrence matrix.

Fig. 1
figure 1

Atmospheric radiative kernels in units of W m−2 %−1 following the approach by Zelinka [9, 16] calculated from single-layer cloud properties from A-Train data over the North Atlantic [35] between 45° N–65° N and 10° W–30° W during calendar year 1997. a In-atmosphere longwave kernel. b In-atmosphere shortwave kernel. c In-atmosphere net radiative kernel

Fig. 2
figure 2

As in Fig. 1 except a the TOA net radiative kernel and b the surface net radiative kernel

Fig. 3
figure 3

The cloud-type occurrence matrix C from the North Atlantic analysis region during 2007 as derived from A-Train active and passive remote sensing data [36]

Fig. 4
figure 4

Cloud radiative effect (R cld) matrix resulting from multiplying the cloud fraction with the TOA (a), atmosphere (b), and surface (c) net cloud radiative kernels, calculated from cloud layer properties derived from A-Train data over the North Atlantic for calendar year 2007 [37]. The sum of each matrix (W m−2) is shown in the title. The uncertainty in the net CRE estimates is approximately 7 W m−2

Examples of C, K c, and R cld matrices were developed following the methodology of [14] using data collected in a 20° × 20° region in the North Atlantic centered roughly on 55° N and 20° W. An entire annual cycle is used in this analysis, and we present an average of day and night measurements. The in-atmosphere K c or K c,atm in Fig. 1 is an observationally derived radiative kernel that was created using fluxes calculated by combining active and passive A-Train measurements and retrievals as described in detail in [37]. Here, we present K c in terms of the geometric cloud top height (CTH) instead of P CT to illustrate the advantage provided by active remote sensors in avoiding the inherently ambiguous P CT [35, 38]. Unlike the K c shown in [9], these matrices are not necessarily smooth since each CTH-τ bin averages flux data from cloud layers with varying microphysical properties (phase, water path, effective radius). In addition, the observationally derived radiative kernel is limited by the sample size in each CTH-τ bin (Fig. 3) and is influenced by the diurnal variation of cloud layers, with some cloud types occurring more frequently during the night overpass and vice versa.

The net K c,atm is largely dominated by longwave radiation and demonstrates the bifurcation in upper tropospheric heating and lower tropospheric cooling by clouds over these middle-latitude regions. Conversely, the net TOA and surface K c in Fig. 2 are similar to one another, implying that most clouds strongly cool the surface, and this cooling is predominant in the column. Note the difference in the color scale between Figs. 1 and 2.

The cloud occurrence matrix or C in Fig. 3 shows that the distribution of cloud layer occurrence in this region is dominated by optically thick high-level clouds associated with fronts and moderately optically thick low-level clouds that have tops below 3 km. However, the extremely high cloud fraction in this region of 86% indicates the predominance of clouds to the radiation budget of the North Atlantic. Multiplying K c,TOA, K c,atm, and K c,sfc by C allows us to derive matrices of cloud radiative forcing, R cld (Fig. 4). Interestingly, the net radiative forcing of clouds to the atmosphere of the North Atlantic region balances to be effectively zero over the annual cycle considered. Since the atmosphere cloud radiative effect (CRE) balances, the net surface and TOA CRE are effectively identical. The cooling diagnosed in this region on an annual cycle results from optically thick low-level clouds and frontal clouds that have tops in the upper troposphere.

The nuances provided in this example highlight the unique strength of combined space-borne cloud radar and lidar to the cloud feedback problem using the K c kernel approach. Because we can place hydrometeor layers in the atmosphere with very high accuracy using the active remote sensors, we can also derive their radiative properties with improved accuracy. This allows us to demonstrate not only that the atmosphere CRE effectively balances, but that this balance is achieved through cooling in the lower troposphere and heating aloft. Presumably, the energy that is deposited in the upper troposphere is then exported to higher latitudes where it is ultimately radiated to space. It is noteworthy that analyzing only the TOA radiative quantities misses the interesting radiative processes that occur in the atmosphere [37].

Observations: Practical Questions

While the overall picture of forcing and feedbacks is a complicated one, we make an attempt at extreme simplification. Two primary phenomena associated with temperature-mediated feedbacks and rapid adjustments seem to predominate.

  1. 1.

    High-level clouds ascend in height as the climate warms inducing a positive longwave feedback [39].

  2. 2.

    Marine boundary layer (MBL) clouds decrease in coverage inducing a positive shortwave feedbackFootnote 1 [40].

These feedbacks would be realized by changes to the δC matrix. Ascending high clouds would be realized by a migration of non-MBL cloud tops (particularly upper tropospheric ice clouds hereafter referred to as cirrus) upward. The MBL cloud feedbacks would be realized as a decrease in overall cloud coverage resulting in more solar radiation absorbed at the surface, while the ascent of high clouds is thought to be understood [39, 41] and is a robust feature of climate predictions [13]. It is important to note that both of these are positive feedbacks, and neither has been observationally verified although the use of interannual variability in the measurements as climate feedback proxies is providing hints that the model predictions are credible [17,18,19,20, 42, 43].

With these issues in mind, we argue that solving the cloud feedback problem in general or even the two simplified aspects of the problem listed earlier has two necessary conditions. The first would be understanding. Why is a particular feedback happening? For ascending high clouds, the answer to whether we understand the phenomenon is thought to be yes [39, 41]. All models seem to agree more or less that high clouds will ascend with warming and there are physically plausible explanations for it [13] and measurements are hinting that it is happening [44,45,46,47]. For decreasing MBL coverage, it is very clear, given the disparity in ECS that has been linked to decreasing MBL coverage, that we do not understand this phenomenon [4, 36, 40, 42, 43, 48,49,50,51,52] although physically plausible mechanisms have been proposed [36, 48]. A second necessary condition to solving the cloud feedback problem would be observational verification. Have the processes associated with the phenomenon been observed and/or has the feedback itself been observed? More importantly perhaps, at what point do we expect the signal of a particular phenomenon to emerge from the natural noise in the climate system so that observational verification can take place [53, 54]?

High Clouds

Regarding the ascent of high clouds, we will not elaborate on our first condition for solution (understanding) since a series of papers have documented a plausible theoretical mechanism for it. Our second condition for solution (verification) however raises very interesting questions. The recent report by Norris et al., [55] examines a 30-year record of P CTC from ISCCP and PATMOS-x [56] compared to similarly processed model statistics. They report statistically significant spatial shifts in cloud occurrence as well as changes to the vertical distribution of cloudiness (Fig. 3 of [55]). In particular, they identify an increase in high cloud occurrence that seems to confirm model predictions of similar changes although caution is warranted given the ambiguities associated with the use of passive remote sensing to populate P CT-τ-dependent C histograms [35, 38].

While the TOA radiative signature of climate change is not expected to emerge from natural variability for decades [57, 58], the δC for tropical cirrus may be accessible to remote sensing observations in the relatively near future [53, 54]. If model predictions are realistic, the emergence of this feedback signal in observations could occur in the 2020s. Identifying such a signal in measurements (or not) would represent a unique observational constraint on climate models. Regardless, use of the existing observational record is producing intriguing examples of λ cldderived from CALIPSO data [18,19,20] using the emergent constraint concept [17] that suggests that this signal indeed may be emerging from climate system noise although caution is warranted [44].

MBL Clouds

The feedback problem associated with MBL clouds is very nearly the mirror image of the high cloud problem. With models widely disagreeing on the magnitude and even the sign of this feedback (although evidence is suggesting that it is positive), it is clear that we are not close to a sufficient understanding of the physical processes that will drive the climate system one way or another [4, 36, 40, 42, 43, 48,49,50,51,52]. Our second condition for solution—observational verification—seems somewhat out of reach for the cloud coverage problem since the signal of MBL cloud coverage decrease is not expected to emerge from the climate system noise until beyond the 2030s [53, 54] although the existing data record is providing hints about the nature of this feedback mechanism [21,22,23,24]. We argue that focusing on understanding the dominant physical processes involved in MBL cloud coverage changes is a critical activity to which active remote sensing from space can uniquely contribute.

A series of competing processes appear to be at work in MBL cloud feedbacks. These processes range from how free tropospheric air is mixed into deeper and warmer boundary layers [36, 48] and how latent heat fluxes required to maintain a constant relative humidity dry the MBL [50, 51] to the fact that moist adiabatic lapse rates become steeper with warming. This latter process results in higher liquid water paths [36] especially at colder temperatures and higher latitudes where cloud phase changes will also vary and additional negative feedbacks could modulate the overall response [21,22,23,24]. Other processes are expected to play a role including aerosol-cloud interactions [52]. Few of these processes have specifically been constrained observationally although there is evidence that the overall interannual responses in many climate models are not consistent with bulk cloud properties derived from measurements [21]. While the process of mixing dry air into the MBL seems to be gaining consensus as an explanation for why models produce decreasing low-level clouds, it is important to note that the properties of the free tropospheric air that mixes depends on the degree to which this air has been modified by shallow penetrative convection [36, 49].

The life cycles of these shallow convective clouds are thought to be linked to the aerosol-mediated droplet number via the processes that modulate precipitation formation [36, 50,51,52]. Quantitative empirical knowledge of these processes is uniquely provided only by simultaneous knowledge of cloud and precipitation properties within turbulent MBLs [59,60,61,62,63,64]. An observational capacity for diagnosing CTH, cloud droplet number, and associated precipitation microphysics in cloud elements is one necessary aspect to provide an observational constraint on competing feedbacks and processes that may cause changes to boundary layer cloud cover over the coming decades. Diagnosing CTH, cloud droplet number, and precipitation microphysics in cloudy vertical columns is an extremely challenging proposition that cannot be accomplished with any single instrument but requires combinations of passive and active remote sensing consisting minimally of millimeter radar, lidar, solar reflectance, and passive microwave measurements as demonstrated with A-Train data [59,60,61,62,63,64].

Summary and Conclusions

In a recent discussion of grand challenges, Bony et al. [49] report that most of the leading advances in our understanding of cloud feedback and climate processes have come primarily from idealized modeling, yet there remain major outstanding uncertainties that must be addressed observationally if we are to reduce the spread in ECS. It is, therefore, incumbent on the observational community to keep pace with the questions being posed by the theoretical community. Because it typically takes a decade or more to move a new observational platform or concept to space, the observational community must be thinking well ahead.

The real strength of the A-Train has been, first and foremost, to accurately and unambiguously map the vertical distributions of hydrometeor layers in the atmosphere. This accurate mapping relates directly to the occurrence matrix, C, alluded to in “The Nature of the Cloud Response—Forcing and Feedback” section and illustrated in Fig. 3. Additionally, the radar and lidar in the A-train illustrate how active remote sensing characterizes important moments of the vertical hydrometeor distributions that can be combined synergistically with passive measurements to provide integral constraints on the column properties [65, 66]. With more than a decade of A-Train data, opportunities exist for innovative exploration of this data to increase our understanding of cloud and precipitation processes and properties within the general circulation. This is especially true with the evolving concept of using the interannual measurement record to constrain the cloud responses in climate models [17].

With the A-Train era ending late this decade or earlier as the active instruments reach end of life, we have argued that there is very good reason to continue a constellation-based active and passive measurement strategy. Models predict that δC signals in cirrus may be identifiable from the natural noise in the system sometime in the third decade of this century [53, 54] and thereby provide a unique observational constraint on GCMs and our understanding of the Earth’s climate. Beyond this, the cloud feedback decomposition into K c and C allows us to examine cloud-circulation coupling using longer data records. Furthermore, with the technological advances of the last decade [67,68,69,70,71,72,73] and our increasing understanding of how to exploit multi-instrument, multi-frequency active and passive synergy that began with the A-Train, the observational community is well positioned to address the aerosol-cloud-precipitation processes that presently drive the large uncertainty in ECS.