1 Introduction

Oxides of nitrogen and sulfur are key species in tropospheric chemistry. Nitrogen dioxide (NO2), in particular, is a critical component in the process that leads to the formation of photochemical smog and tropospheric ozone (O3), and thus greatly influences the troposphere’s oxidizing capacity. Furthermore, NO2 is the gas-phase precursor of nitric acid, which can lead to the formation of particles, influences greenhouse-gas mixing ratios, and has both direct and secondary impacts (via O3 and particulate formation) on health and the environment (Krishna et al. 1997; Lin et al. 1988; Liu et al. 1987; Maheswaran et al. 2010; Meng et al. 1997; Thompson 1992). Rapidly changing, high-NO2 events, on the order of hours, have been linked with significantly higher mortality in subsequent days, in addition to threats by chronic high-exposure (Amiot et al. 2012; Andersen et al. 2012; Brunekreef and Holgate 2002; Liu et al. 2012; van den Hooven et al. 2012). The health impacts from short-term exposure led the U.S. Environmental Protection Agency (EPA) to issue a new 1-hour National Ambient Air Quality Standard of 100 parts per billion (ppb, by volume) for NO2 in 2010. Clearly, widespread monitoring of NO2 due to its health impacts is highly important. However, establishing a surface NO2 observation network capable of recording short time scale variability (i.e. on the order of minutes to an hour) with continental coverage is impractical. A practical alternative is making pollution observations from a geostationary satellite as currently planned in NASA’s upcoming Geostationary Coastal and Pollution Events (GEO-CAPE) mission (Fishman et al. 2012). Indeed, satellite-based tropospheric-NO2 measurements from GOME, SCIAMACHY (Ghude et al. 2009), GOME-2, and OMI (Fishman et al. 2008; Richter et al. 2005) have captured the global distribution of NO2 and illustrate the importance of anthropogenic emissions on tropospheric O3, particulate matter, and the environment. Recent global model analyses have demonstrated good agreement between OMI-derived tropospheric NO2 columns and ground-level measurements on a monthly–seasonal basis (Lamsal et al. 2008, 2010; Ordonez et al. 2006; Petritoli et al. 2004), and Boersma et al. (2009) used surface NO2 data to derive a boundary-layer column to show how OMI and SCIAMACHY capture intra-day variability caused by NO2’s diurnal variation. However, current satellite pixel footprints are large (13 × 24 km and 40 × 80 km for OMI (nadir view) and GOME-2 respectively), which can significantly bias the representation of ground conditions (Irie et al. 2012; Noguchi et al. 2009). Satellite measurements, such as GEO-CAPE, with better temporal coverage (on the order of hours) and spatial resolution are still needed to resolve diurnal and horizontally heterogeneous features associated with the sources and transport of NO2. From a health perspective, column-density observations are less informative than surface mixing ratios. Therefore, the question remains whether high temporal-resolution observations/estimates of surface-pollutant mixing ratios can be made from space.

A primary challenge in the use of satellite-based column data for air-quality and emissions monitoring applications is relating total-column observations to ambient surface mixing ratios. Elucidation of the column density to surface mole–fraction relationship, from a remote-sensing perspective, will allow comparison with surface mixing ratio measurements, which are often compared against a numerical metric associated with an established ambient air-quality standard. A significant challenge is accounting for variability in the planetary boundary layer (PBL) height, and relating variability in the column to changes in surface mixing ratios. In the early-morning hours, the PBL is shallow due to lack of turbulent mixing from surface heating. As a result, surface emissions during this time are confined to a relatively low layer near the ground, which allows the mixing ratios of emitted pollutants to increase more than they would if emitted later in the day as the PBL height increases due to daytime surface heating. Indeed, it is this PBL-height variability that introduces a disconnect between total-column observations and surface mixing ratio, which is important from a health (Amiot et al. 2012; Andersen et al. 2012; Brunekreef and Holgate 2002; Liu et al. 2012; van den Hooven et al. 2012), and attainment perspective as opposed to emission-trend studies (e.g. Richter et al. 2005; Zhang et al. 2007; Schneider and van der A 2012).

Past studies (e.g. Luo et al. 2012; Piters et al. 2012; Halla et al. 2011; Lee et al. 2011; Lamsal et al. 2008; Kramer et al. 2008; Leigh et al. 2007; Koelemeijer et al. 2006; Ordonez et al. 2006; Petritoli et al. 2004) that have compared column observations (i.e. satellite and surface-based MAX-DOAS instruments for chemical and aerosol species) with surface observations have utilized complex chemical transport models and/or large averaging times (weekly, seasonal, or annual) that effectively average out the influence of PBL variability and remove applicability of these observations to short-term, health related, NO2 fluctuations that occur on the order of minutes to hours. In this study we compare column-density measurements derived from a ground-based spectrometer system (Herman et al. 2009) that has ~90 s resolution, with coincident surface mixing ratio measurements recorded every minute. We then present a methodology developed for the analysis of data collected at NASA’s Langley Research Center (LaRC) between July 2010 and October 2011, and the July 2011 Deriving Information on Surface Conditions from COlumn and VERtically Resolved Observations Relevant to Air Quality (DISCOVER-AQ) field campaign in Baltimore, MD to convert a total-column observation to a surface mixing ratio estimate, and determine whether short-term surface NO2 variability can be qualitatively and quantitatively observed in column observations that have short integration times.

2 Locations

The data for this study were collected at three locations: Hampton, VA, Padonia, MD, and Edgewood, MD. The Hampton measurements were obtained from July 2010 through October 2011, whereas the two Maryland datasets were obtained during the July 2011 DISCOVER-AQ field campaign.

2.1 Hampton, VA

Ongoing measurements are being carried out at LaRC’s Chemistry And Physics of the Atmospheric Boundary Layer Experiment site (CAPABLE http://capable.larc.nasa.gov, 37.10°, −76.39°) in Hampton, VA, which is a moderately-urbanized area with regional NOx emissions on the order of 0.1 Tg/year (based on a 2005 generated National Emission Inventory). CAPABLE is co-located with one of three Virginia Department of Environmental Quality’s (VADEQ) Hampton Roads air-quality monitoring sites. The site can be considered as a coastal suburban site on the NW outer edge of the larger metropolitan area of Norfolk-Virginia Beach, but is considered part of the Virginia Beach-Norfolk-Newport News Metropolitan Statistical Area in the Mid-Atlantic region with a population in excess of one million. The site is subject to sporadic local and/or transported pollution events along with influences of sea-breeze effects from the southern part of the Chesapeake Bay as characterized by Martins et al. (2012). Nearby pollution sources are commuter traffic (including a service road 20 m south of the site and intermittent small-engine activity), an incinerator (0.5 km WSW), Yorktown Power Station (10 km NNW), the Newport News/Williamsburg airport (10 km NW), and Langley Air Force Base (1 km SE). In 2010, the four highest 8-hr maximum O3 events measured at the site were 86 ppb on 06 July, 91 ppb on 07 July, 97 ppb on 11 August, and 78 ppb on 31 August. The most-recent 3-year average of 4th-highest O3 days (2008–2010) is 74 ppb. All data available for the respective seasons were used to construct summer and winter diurnal NO2 and O3 profiles for this location and can be seen in Fig. 1(a, b).

Fig. 1
figure 1

Diurnal-mean plots for NO2 and O3 at the three locations studied

2.2 Padonia & Edgewood, MD

Measurements at the Padonia (39.46°, −76.63°; 20 km N of Baltimore) and Edgewood (39.41°, −76.30°; 30 km NE of Baltimore) sites were made as part of the July-2011 DISCOVER-AQ campaign, and act as case studies for exporting the methodology to sites that experience urban-level pollution (more in-depth case-study analyses from these sites will follow in subsequent publications), with the dominant pollution source being the Baltimore metropolitan area. Both sites were collocated with Maryland Department of the Environment (MDE) sites. Diurnal profiles for these locations are presented in Fig. 1(c, d). Similar to the CAPABLE site, due to Edgewood’s proximity to the Chesapeake Bay a sea-breeze effect is commonly observed (Stauffer et al. 2012, this issue).

3 Instrumentation and comparison of PBL sources

3.1 NO2 instrumentation

The current federal reference method (FRM) instrument for NO2 (TECO 49C) uses a molybdenum-oxide converter with NO detected via chemiluminescence after reaction with O3. This method also partially converts other oxides of nitrogen (collectively referred to as NOz) such as nitric acid, alkyl nitrates, and peroxyacetyl nitrate to NO, leading to potentially false-high NO2 readings (Dunlea et al. 2007; Grosjean and Harrison 1985; Steinbacher et al. 2007; Winer et al. 1974). Teledyne API 200EU monitors (limit of detection: 0.4 ppb, precision: 0.5 %) that utilize an LED-based photolytic converter followed by chemiluminescence for NO detection, effectively eliminating NOz interference (Steinbacher et al. 2007), were located at the three sites in the current study, with a TECO 49C collocated at CAPABLE. Though photolytic-converter based NOx instruments are not impervious to interference (e.g. HONO and photo-labile organic compounds, Sadanaga et al. 2010; Villena et al. 2012), none of the locations of the current study contained conditions appropriate to produce substantial amounts of NOz (Elshorbany et al. 2010; Amoroso et al. 2008; Calvert et al. 1994). Mixing ratios of these interfering compounds are typically small (with the NOx/NOz ratio consistently heavily favoring NOx), and are considered negligible in the current study. In the following analysis the API instrument was chosen over the current FRM instrument due to its highly-selective photolytic conversion of NO2 to NO.

The ground-based spectrometer system (Pandora, vertical column density (VCD) precision: ~3 × 1014 mol.cm−2) used in the current study has been validated against similar sun-tracking instruments (Wang et al. 2010), MAX-DOAS and zenith-looking instruments (Roscoe et al. 2010; Piters et al. 2012), and OMI (Herman et al. 2009). Pandora provides NO2 VCDs from direct-sun observations that serve as a proxy for satellite-derived observations, such as OMI, with 90 s resolution, thereby allowing direct comparison of in-situ/column observations throughout the day as boundary-layer dynamics, emissions, and chemistry change. Sun-tracking instruments have the advantage over current MAX-DOAS instruments due to the substantially greater incoming signal, which significantly reduces integration time and dependence of the air-mass factor on parameters such as aerosol optical depth and surface albedo. However, they suffer disadvantages, as compared to active DOAS methods, in that they work only during daytime when the sun is visible.

OMI data (Goddard product, Boersma et al. 2001) were retrieved from the Goddard repository, and are used in the current analysis for all locations.

3.2 EDAS40 PBL

Planetary boundary layer data were acquired from the Eta Data Assimilation System model (EDAS40), which is produced by The National Weather Service’s National Centers for Environmental Prediction every 3 h. The EDAS40 model provides 40 km resolution, with 26 pressure surfaces, and estimates the PBL depth from the first inversion in the temperature profile. EDAS40 was chosen for its spatial resolution and availability to the community. These data were interpolated to provide 1-min resolution to properly account for the influence of PBL variability. Diurnal profiles can be seen in Fig. 2, panels A and B. The EDAS40 data were inter-compared with sonde, aircraft, and LIDAR-derived PBL data that were collected at the Edgewood site. The results of this intercomparison will be briefly discussed below.

Fig. 2
figure 2

Diurnal-mean profiles of EDAS40 PBL height at LaRC and Padonia (a), Edgewood (b), and the month of July 2011 for Edgewood (c), Padonia/UMBC (proximal to Padonia) using ELF LIDAR (d), and Padonia/Fairhill using MPL (e). All dates are UTC

Since PBL uncertainty is not a standard product for the EDAS40 model, the uncertainty is assumed to be constant at 35 % for the current analysis. A brief discussion of the impact of this uncertainty is presented in Section 4.1.

3.3 Radiosonde/aircraft PBL

A total of 15 ozonesondes were launched at the CAPABLE site from June 22–July 22, 2010 and 39 ozonesondes were launched in Edgewood, MD as part of the DISCOVER-AQ project between July 1–July 31, 2011. Each ozonesonde was equipped with an electrochemical concentration cell (ENSCI, Corp. Model 2Z) to detect ozone, a radiosonde (Vaisala, Inc., RS-80 in 2010 and InterMet Systems, Inc., iMet-1 in 2011) that recorded pressure, temperature, humidity, wind speed, wind direction, and a GPS receiver (iMet only) to report location and height. Potential temperature profiles were calculated using the radiosonde data. PBL heights were determined objectively by first down-sampling the potential temperature data by block averaging every 50 m in the vertical starting at the surface. A localized lapse rate at height z was calculated by subtracting the potential temperature at height z from the potential temperature at height z + 50 m and dividing by 50 m. The PBL height was defined as the height closest to the surface and above 200 m with a localized lapse rate exceeding 7 K km−1.

As part of the 2011 DISCOVER-AQ field campaign meteorological data (e.g. temperature, pressure, and humidity) were collected during aircraft spirals flown over the measurement sites. These data were used to calculate PBL heights, analogous to sonde data.

3.4 MPL PBL

Elastic LIDAR observations at Edgewood were performed using a Sigma Space Mini Micro-pulse LIDAR (MiniMPL). The MiniMPL transmitter consists of a 532 nm (frequency-doubled Nd:YAG, 5 kHz, 3–4 μJ) LASER. The receiver (80 mm telescope) focuses co-polarized backscattered light onto a photon counting silicon avalanche photo-diode (APD, Perkin-Elmer). The APD output is recorded by a field programmable gate array (FPGA) data system that enables display and storage of range dependent averaged count rates. Recorded LIDAR profiles have temporal and vertical resolution of 1 min and 30 m, respectively.

By using aerosols as tracers of atmospheric dynamics, LIDAR is a powerful tool for visualizing PBL aerosol content and dynamics in real time with high vertical resolution. The PBL typically contains greater aerosol concentration because the aerosols are trapped by a potential-temperature inversion. Therefore, the backscatter signal strength is greatly reduced when it transits from the PBL into the free troposphere. A covariance wavelet technique (CWT) was applied to the LIDAR signal to estimate these sharp gradient changes in backscatter profiles to determine the PBL height (Davis et al. 2000; Brooks 2003; Compton et al. 2012). The LIDAR-derived PBL diurnal cycle can be observed in Fig. 2b. Comparison and validation of the various PBL-estimation methods is outside the scope of the current study, while analysis of how these various PBL methods influence the column-to-surface comparison remains the topic of this manuscript. However, to put the empirically-derived PBL values into perspective with the EDAS40 values, a brief comparison is presented below.

3.5 Comparison of PBL values

In the current analysis, EDAS40 PBL data were compared against three other PBL-determination methods (LIDAR, sonde, aircraft). Ratios of these values, with respect to EDAS40, are shown in Table 1 (perfect agreement yields a ratio of one). Ratios were calculated only for the Edgewood site since it was the only site to have a photolytic NO2 monitor collocated with an MPL. It is observed that the mean ratio is best (closest to 1) for sonde and aircraft PBL values, though the coefficient of correlation is poor. Conversely, the mean ratio is smaller for the MPL comparison, but has a higher coefficient of correlation. The EDAS40 model characteristically under predicts the MPL-based PBL which, as discussed below, helps bring column observations (after conversion to mixing ratio values) into better agreement with surface measurements than do the MPL data. While this provides a comparison of the PBL methodologies used in the current study, this does not speak to how correct each method is in representing the actual PBL.

Table 1 Statistical comparison of EDAS40-derived PBL relative to other methodologies for data collected at Edgewood

Figure 2(b–e) shows generally-poor quantitative agreement between the MPL and EDAS40-derived PBL heights for Edgewood, with moderate improvement for the other sites. Data from two additional DISCOVER-AQ sites (Fair Hill and University of Maryland Baltimore County (UMBC), MD) were used to expand the PBL comparison to include more inland sites. Indeed, sites that are further inland (e.g. Padonia and Fair Hill, panels D and E) appear to have better agreement, indicating the possibility that differences observed at Edgewood may be due to the complexities associated with marine–land interactions at that location. It was initially suspected that this disagreement may be due to the difference in temporal resolutions (EDAS40 model returning a PBL value every 3 h, vs. MPL every 1–2 min), despite the EDAS40 value being interpolated to one-minute resolution. This assumption was tested by performing three-hour averages on the MPL data, centered about the EDAS40 output times (e.g. 0000, 0300, 0600,…UTC), followed by interpolation to yield one-minute resolution data (effectively putting the three-hour MPL data through the same interpolation process as the EDAS40 data). As seen in Table 1, this averaging mechanism failed to bring the two data sets into significantly better agreement. Further discussion regarding these differences is offered below.

4 Methods

The PBL, defined as the layer that interacts with the surface on a time scale of hours, constitutes the lower-most layer of the atmosphere, and is the layer in which anthropogenic pollution is emitted, and often trapped under certain conditions. The height of the PBL is variable throughout the day (Fig. 2) as it responds to local surface heating, as well as other synoptic and mesoscale forcings. Differences in incoming solar radiation, which varies as a function of season, lead to higher PBL heights in summer than winter. Therefore, under well-mixed conditions and constant emission and removal rates, it would be reasonable to expect pollutant mixing ratios to vary inversely with PBL height while column density remains constant. Indeed, column variability appears to be independent of surface NO2 mixing ratios until a PBL correction factor is applied, which brings the two data sets into relative harmony as seen in Fig. 3.

Fig. 3
figure 3

Diurnal-mean plots for the three locations studied. Panels a and b contain data for LaRC during summer and winter respectively. Panels c and d contain only summer data (July 2011) collected at the Edgewood and Padonia sites, respectively. Pandora Surface NO2 is the surface NO2 estimated via the PBL-correction method of the tropospheric column

It has been well documented that NO2 mixing ratios are often highly variable within the PBL (e.g. Halla et al. 2011; Piters et al. 2012; Sluis et al. 2010; Volten et al. 2009; Yang et al. 2010). However, the ability for making NO2-profile measurements was not available throughout the entire measurement period; therefore, it is assumed here that surface emissions are well-mixed within the PBL as a first-order approximation (Leigh et al. 2007). The methodology for this surface estimation is presented below.

Total-column values were retrieved from the Pandora instrument with approximately 90 s resolution, and compared to surface values. Average in-situ NO2 variability was very stable at all sites (average minute-to-minute change: ±0.08 ppb/min (σ = 0.1 ppb/min), ±0.07 ppb/min (σ = .1 ppb/min), and ±0.1 ppb/min (σ = 0.1 ppb/min) for LaRC, Edgewood, and Padonia respectively) except when impacted by local emissions (e.g. service road traffic and lawn mowers), which induced changes up to ±20 ppb/min. Therefore, all time series where |ΔNO2| ≥ 1.0 ppb/min were excluded from the analysis (<2 %, 2 %, and 3 % of the total for LaRC, Padonia, and Edgewood respectively). Pandora data were smoothed via a running-weighted mean (weights: 0.025, 0.075, 0.150, 0.500, 0.150, 0.075, 0.025) to remove the short-term variability of atmospheric NO2 while retaining the high temporal resolution of the measurement. This smoothing did not impact the basic findings of this analysis.

Daily OMI-derived stratospheric NO2 (using the Goddard retrieval, Boersma et al. 2001; Bucsela et al. 2006) was subtracted from the Pandora-column observations from each site to yield tropospheric NO2 column densities. On days when no OMI overpass data were available, the following day’s value was used. This approximation is good, since the calculated day-to-day stratospheric variability is small (within 5 × 1014 mol.cm−2, or ≈10 % of the total column under polluted conditions). Because of nitrogen dioxide’s short photolytic lifetime outside the boundary layer, and temperature-dependent partitioning between NO2 and NO, most of the tropospheric NO2 column density resides in the PBL (Pisano et al. 1996; Sitnikov et al. 2005; Sluis et al. 2010; Fishman et al. 2011) and, under polluted conditions, the stratospheric contribution/variability is relatively minor throughout the day.

Pandora tropospheric NO2 values were converted to mixing ratio values via Eq. (1) where Pandora col is the total column density measured by Pandora in molec/cm2, OMI strat is the stratospheric component as measured by OMI (free-tropospheric contribution is assumed to be negligible as in Lee et al. 2011), PBL is the boundary-layer height in centimeters, and N is the number density of air in molecules/cm3. Although N is dependent on temperature and pressure, in addition to the fact that the temperature profile is variable within the PBL, we assume a constant T = 290 K for these calculations. The utility and results from this initial approach are presented in Section 5.

$$ C\left( {\pm {e_{tot }}} \right)=\frac{{Pandor{a_{col }}\left( {\pm {e_{pan }}} \right)-OM{I_{strat }}\left( {\pm {e_{omi }}} \right)}}{{PBL\left( {\pm {e_{pbl }}} \right)*N}} $$
(1)

4.1 Error analysis

The Pandora-based surface NO2 error was estimated by propagating the uncertainty of the two measured values (OMIstrat (constant 2E14 molec/cm2) and Pandora column NO2 (calculated on point-by-point basis)) and applying a constant conservative uncertainty (35 %) to the EDAS40 PBL values since uncertainty is not a standard EDAS40 model product. We believe that ±35 % is an overestimate of the error, and will, therefore, provide a reasonable boundary. The median propagated uncertainty for each site is: 35 %, 35 %, and 36 % for LaRC, Edgewood, and Padonia respectively, indicative that PBL uncertainty is the dominant source of uncertainty in the estimation. Comparison of these uncertainties with the median percent differences confirms the assumed EDAS40 error to be overly conservative (Section 5).

Though the overall uncertainty is small, there are cases where the differences between in-situ and Pandora-derived surface NO2 are significant, and vary on a site-by-site basis. This can be seen in the correlation plots in Fig. 4 wherein Pandora-based surface NO2 estimates are plotted against a photolytic-converter based NOx analyzer, and in the histogram plots (Fig. 5). While the agreement between the two methods tends to be good, accounting for these differences (i.e. spread in the data) will require further analysis including NO2 vertical structure and meteorological conditions, and will be the subject of a future study.

Fig. 4
figure 4

Correlation plots for the three sites using differing temporal resolutions. Panels a, c, e, g have approximately 90 s resolution, while panels b, d, f, h have been averaged to one-hour resolution for CAPABLE, Edgewood, and Padonia sites respectively. Blue line is 1:1

Fig. 5
figure 5

Histogram plots of the difference between the Pandora-derived boundary-layer NO2 mixing ratio and surface NO2. Data sets have been limited to values with NO2 > 1 ppb, and have approximately 90 s resolution

A source of uncertainty that is not accounted for is sampling of different air masses by the in-situ and Pandora instruments due to the Pandora viewing geometry. As the sun rises (i.e. solar-zenith and azimuth angles change), and the PBL depth changes, Pandora’s observational path length within the PBL will consequently change. Therefore, it may be possible for Pandora to observe changes in NO2 before or after the in-situ instrument, depending on wind direction and viewing geometry, and would show up in the data as a temporal offset between the two data sets. Though such discrepancies between the two instruments were not problematic in the current data sets (e.g. see Fig. 6, discussed below), the potential for such effects should be noted. As this was not observed to be problematic in the current data set, this potential source of error is neglected in the current analysis.

Fig. 6
figure 6

Coincident plots of Pandora, API, and OMI NO2 case-study days demonstrating Pandora’s ability to observe boundary-layer NO2 fluctuations. OMI VCD values are from the Goddard standard product, while the surface estimation was performed using the same methodology as the Pandora data for intercomparison. Notice change in VCD scales between LaRC and MD sites. Gold bar represents solar noon

5 Results and discussion

The data shown in Fig. 6 illustrate the qualitative agreement between the Pandora and in-situ instruments for the three locations studied, with the LaRC data set providing data from summer and winter seasons. Much of the temporal variability, on the order of 90 s to a few hours, is captured by both measurement techniques regardless of season or location, indicating the Pandora’s ability to detect short time-scale boundary-layer NO2 variations. It was observed that the direct-sun and surface NO2 observations are in qualitative agreement on a day-to-day basis, particularly during elevated NO2 events, and near solar noon. However, during high-zenith angle observations (i.e. low elevation angle) the Pandora-derived surface NO2 was typically not in good agreement with the surface measurement (e.g. 12:00–13:00 UTC on 11-August, possibly due to a poorly developed PBL, poor representation of the PBL by the model, a residual layer, or horizontal variability), but improved by mid-morning as the PBL height grew from surface heating and buoyancy forces, leading to a well-mixed layer by this time. Consequently, data collected with a solar-zenith angle greater than 75° were neglected in the current analysis. In addition, early afternoon measurements frequently showed good quantitative agreement with OMI (Fig. 6 and discussion in Herman et al. 2009). As seen in Fig. 6, OMI tropospheric NO2 data showed good agreement with surface values for the selected days after application of Eq. 1.

While the column and surface data are in general qualitative agreement (Fig. 6), there exist times when surface values change and the column remains constant (e.g. Fig. 6b from 12:00 to 14:00), or the two data sets seem to be inversely correlated (Fig. 3, panel b). Such disagreement is likely driven by PBL variability as application of a PBL-correction factor for estimation of surface NO2 tends to bring the surface and column data sets into better agreement on time scales previously not recorded (i.e. minute resolution as opposed to monthly; Fig. 6). Indeed, previous studies have made monthly and seasonal comparisons between column and surface observations. Despite the inherent limitations of directly comparing these two observations (i.e. molec/cm2 vs. parts per billion), when averaged over long time periods the two seem to correlate well (Kramer et al. 2008). Tables 2 and 3 present a correlation and regression analysis for the three sites studied. Data in Table 2 represent comparison of surface (ppb) and column (molec/cm2) values, while Table 3 represents the same analysis after conversion of column data to an estimated surface value. It was observed that the column/surface comparison exhibited strong correlation (e.g. R ≈ 0.80, not shown) when comparing week-long averaged values. However, the agreement broke down when comparing time frames that are more relevant to air-quality, health-impact, and emission inventory studies (e.g. minutes or hours). Conversion of column values to mixing ratio improved the correlation by, on average, an additional 40 percentage points (σ = ten percentage points; i.e. difference in R2 values calculated from R in Tables 2 and 3), and a maximum of 60 percentage points. This improvement in correlation is statistically significant at the 99 % confidence level according to the z-test.

Table 2 Statistical data for comparison of surface and column data prior to application of the EDAS40-derived PBL-correction factor
Table 3 Similar to Table 2, but after application of the EDAS40-derived PBL-correction factor

Correlation plots were constructed for the three sites, with summer and winter seasons separated for the LaRC data set (Fig. 4). Both LaRC and Edgewood sites experienced background NO2 conditions (NO2 < 1 ppb), while Padonia appeared to be more consistently polluted. It appears that Pandora’s retrieval technique lost sensitivity to boundary-layer NO2 when the NO2 mixing ratio fell below ≈1 ppb. At such low mixing ratios, stratospheric variability becomes significant. Future studies need to be conducted so that stratospheric content and variability is better understood and eventually incorporated into Pandora or similar ground-based spectroscopic measurements. Due to this instrumental limitation, and the limited applicability of background NO2 amounts for air-quality studies where the focus is on elevated trace gas concentrations, the remainder of the analysis was conducted only when NO2 values (both surface and Pandora-derived) were above 1 ppb. The influence of this criterion on the resultant regression and correlation calculations is readily seen in Tables 2 and 3.

Distributions of the difference between the two instruments (surface–Pandora) can be seen in Fig. 5. These differences have narrow, normal distributions, approximately centered about zero (see Table 3 for details), for LaRC and Edgewood, while Padonia has a significant positive bias; potentially indicative of a shallow NO2 scale height for this site, as previously observed at other sites (Petritoli et al. 2004). A key difference between the LaRC/Edgewood and Padonia sites is proximity to the bay, which may influence local chemistry and meteorology (Martins et al. 2012). As an example, Edgewood data were separated into bay-breeze and non-bay-breeze days where it is observed that most background NO2 was observed during non-bay-breeze days (Fig. 7).

Fig. 7
figure 7

Comparison of bay-breeze and non-bay-breeze days during the DISCOVER-AQ July 2011 field campaign for Edgewood, MD

Agreement between the column-based surface NO2 estimation and the surface measurement at the three sites, which cover moderately-polluted and polluted environments, supports the hypothesis that an accurate knowledge of the PBL depth is an important factor that connects Pandora-column measurements with surface mixing ratios. Specifically, our findings indicate the EDAS40-derived PBL correction factor accounts for ≈50–75 % (R2, Table 3) of the variability, with measurement frequency on the order of 90 s, thereby regaining high-temporal frequency information that is characteristically lost by satellite-based observations of only 1/day. As shown in Fig. 4 and Table 3, this methodology is also valid for 1-hour average values, which is important from a GEO-CAPE perspective as the GEO-CAPE mission is currently planned to achieve hourly coverage of the continental United States (Fishman et al. 2012). This may provide an important link in transitioning from a sparse network of surface-based monitors to continental coverage from a satellite-based instrument. Data presented in Figs. 4 and 6 and Table 3 are encouraging as implementation of one correction factor (PBL height), which is only an initial step of a larger problem, accounts for a significant amount of variability between the data sets.

5.1 Application of other PBL methods

PBL values were derived via three additional methods at the Edgewood, MD site during the 2011 DISCOVER-AQ field campaign, consisting of: LIDAR, sonde, and aircraft-spiral data. The MPL instrument yielded the largest, highest temporal resolution, PBL data set for the whole campaign, and will therefore be the most applicable to the current analysis.

It was observed that the MPL PBL values typically differed from the EDAS40 PBL (Figs. 2 and 8, Table 1), with the EDAS40 under representing the MPL value. Figure 9 shows side-by-side comparisons of the EDAS40-derived surface estimation (panels A and C), and surface-estimated NO2 calculated using three additional methodologies (panels B and D) for 2 days at Edgewood. Here it is observed that when empirically-derived PBL values are used, estimation of surface NO2 is characteristically underestimated as expected from Fig. 8. Figure 10 shows correlation plots for the MPL, sonde, and aircraft-derived surface NO2 estimations, similar to Fig. 4, with regression statistics presented in Table 4, where it is observed again that surface NO2 is being under-predicted (see slope values in Table 4).

Fig. 8
figure 8

Comparison of MPL and EDAS40-derived PBL values at the Edgewood site. Bin width of 1 m was used

Fig. 9
figure 9

Coincident plots for comparison of surface NO2 estimation. Panels a and c display surface estimations using EDAS40 (same as in Fig. 6, presented here for side-by-side comparison), panels b and d present estimations incorporating MPL, sonde, and aircraft data

Fig. 10
figure 10

Comparison of correlation plots for Edgewood data using the EDAS40 (a) and MPL, Sonde, and Aircraft-based PBL values (b). Blue line is 1:1

Table 4 Similar to Table 3, but with MPL, sonde, and aircraft PBL data used in the conversion, and only for the Edgewood site

We find that empirically-derived PBL heights do not perform as well as modeled values that are reported on a three-hour basis with 40 km resolution (comparing R and bias values in Tables 3 and 4, Figs. 9 and 10), which is surprising, even though the methodology for determining PBL height for both the sonde and aircraft data is the same as that used for the EDAS40 model (i.e. temperature inversion). Good agreement between the aircraft/sonde and model-derived quantities can be partially explained by the relatively few coincident points (due to limited coincident observations) between the data sets. Conversely, the MPL instrument provided nearly continuous PBL values, with temporal resolution on the order of 1–2 min. Despite the higher temporal resolution of the MPL-derived PBL heights, the agreement between MPL-derived surface NO2 was not better than those derived via EDAS40, especially under high NO2 conditions (e.g. Fig. 10) where the surface estimation levels off (i.e. slope of regression is less than when EDAS40 PBLs were used). An initial suspicion was that EDAS40 performed better than MPL due to its coarser temporal resolution, which would be more representative of general, long-term, atmospheric conditions. This assumption was tested by averaging the MPL data to three-hour resolution to coincide with EDAS40 observations, then performing a weighted interpolation between the data points to yield one-minute resolution (Table 1). The results of this test were not significantly different from those obtained with the raw MPL data.

A likely reason for the lack of good agreement between the EDAS40 and MPL-derived surface NO2 may be that the two PBL methodologies predict different variables, each of which has limitations in estimating PBL depth. While the aerosol PBL does represent one estimate of boundary layer height, and may work well under optimal conditions, it is not necessarily representative of the NO2 scale height, which experiences different sources, sinks, and removal rates than aerosols. During the 2011 DISCOVER-AQ mission, aircraft-based NO2 data were collected while the aircraft was spiraling about ground sites, from which the NO2 scale height (altitude where NO2 mixing ratio decreased to <36.7 % (1/e) of the surface value) was estimated. Figure 11 shows aircraft spiral data collected on two separate days over Edgewood, MD. Here it is observed how the vertical structure of NO2 and particulate scattering at 550 nm both differ (panel A) and agree (panel B) depending on current conditions, with a numerical comparison presented in Table 5. Panel A is likely a case with a residual or buffer layer overlying a 750 m deep PBL where the PBL has collapsed and the aerosol remains, since there is no removal mechanism. NO2 is not so well conserved, and furthermore, the overlying air may have come from a different location than the PBL air. The Panel B PBL looks to be about 1.5 km deep, with NO2 extending above the PBL, which is replenished with PBL air more rapidly than the previous case. Indeed, NO2 often has a complicated structure that is not supportive of the well-mixed assumption taken with this study, nor does it characteristically follow an exponential decay, which would be represented well by the scale height. On the contrary, it is observed to have layers aloft throughout the day, and to generally not follow the same pattern of the aerosol profile. Not understanding the NO2 vertical structure introduces limitations on the applicability of column-to-surface conversions. An appropriate analysis of this issue is outside the scope of the current methodology, and will be the focus of future studies.

Fig. 11
figure 11

Comparison of aircraft spiral data collected over Edgewood, MD. Panel a presents a case where the NO2 scale height and aerosol-derived PBL values differ substantially, while Panel b presents a case where the two are in relative agreement. For numerical comparison with EDAS40, MPL, and meteorologically-defined PBL values see Table 5

Table 5 Comparison of PBL and scale-height values from two aircraft spirals. NO2 scale height is estimated to be the first altitude where [NO2]aircraft <= [NO2]surf*1/e

5.2 Application to SO2

Applicability of this method to other atmospheric pollutants was tested for sulfur dioxide (SO2) data collected at CAPABLE. SO2 provides a significantly different set of conditions from NO2 due to its longer atmospheric lifetime, differing sources, and vertical profile. The CAPABLE station frequently experienced elevated SO2 levels due to its proximity to the Yorktown power station (≈10 km NNE, Fig. 12). As the wind shifted to NNE a spike in SO2 and NO2 is observed with corresponding O3 titration, followed by dissipation to background conditions as the wind continued to come from a more easterly direction.

Fig. 12
figure 12

Coincident plot of data collected during pollution transport from Yorktown power station showing that surface and column instruments located at CAPABLE are sensitive to point-source emissions

In contrast to NO2, SO2 over CAPABLE seemed to be more heterogeneously distributed throughout the atmosphere as seen by the poor agreement between the column and surface instruments (Figs. 13 and 14). When surface SO2 was low, the Pandora instrument frequently detected significantly more SO2 than did the surface instrument (R = 0.18), indicative of non-negligible amounts of SO2 existing above the boundary layer (example days plotted in Fig. 14). However, when the data set is limited to only include values corresponding to elevated surface SO2 (i.e. >10 ppb) the agreement significantly improved (R = 0.70).

Fig. 13
figure 13

Correlation plot of SO2 data collected at CAPABLE

Fig. 14
figure 14

Example coincident plots for SO2 as measured at the CAPABLE site wherein it is observed that during background SO2 conditions the agreement between surface-based and column observations is poor. During 11-August 2010 (b) no surface SO2 data were available

These results show that the Pandora instrument is capable of detecting rapid changes in local point-source emissions, and that the column NO2 and SO2 peaks occur simultaneously with a rapid drop in O3 indicative of NO titration. Similar events were observed throughout the 2010 summer. However, in the current state of SO2 analysis (i.e. requiring a surface measurement to filter background SO2 data) applicability is limited to potentially identifying SO2 layers aloft. Extended analysis of these events is outside the scope of the current manuscript, and will be the subject of future studies.

6 Summary

This analysis shows the correlation between surface NO2 and column observations supporting the initial assumption that daytime tropospheric NO2 is predominantly located within the PBL (Pisano et al. 1996; Sitnikov et al. 2005; Sluis et al. 2010), that, to first order, column observations can be used for estimating surface NO2 mixing ratios at the locations studied, and that information content in temporally-short observations may be significant enough to detect surface variability from geostationary space-based instruments (e.g. GEO-CAPE) with continental coverage.

The methodology presented shows encouraging agreement between column-converted and surface NO2 data with high temporal resolution (i.e. 90 s and 1-hr averages) over the period July 2010–October 2011 at the CAPABLE site, and July 2011 for the DISCOVER-AQ work in the Baltimore area with incorporation of only one correction factor (i.e. model-derived PBL depth). Column data collected with a Pandora sun-tracking instrument were converted to a surface estimation value using the EDAS40 PBL, and were compared to the surface record from a photolytic-converter-based instrument for three different sites. The correlation between these two instruments was high (typically R > 0.75), indicating that this method accounted for a significant fraction of the variability between the two techniques. The EDAS40 model was chosen due to its high spatial resolution and availability to the community at large. The methodology presented herein is applicable to both current and upcoming satellite missions (e.g. GEO-CAPE, TROPOMI), and ground-based-column-observing instruments that monitor tropospheric NO2 levels with high temporal resolution. Due to the availability of the EDAS40 data set, similar techniques may be useful in converting satellite column values on a larger scale, though feasibility studies must be carried out to investigate how these products vary as a function of regional conditions.

Incorporating a PBL correction factor greatly improved agreement between surface/column observations, corroborating that tropospheric NO2 resides predominantly in the PBL. Previous work has focused on significant temporal averaging (e.g. monthly, seasonal), which is useful for analyzing historical trends and studying climatologies. However, the data and methodology presented herein, with a 90 s resolution, will be useful in extending our capabilities from making historical observations to providing valuable insight into processes taking place on time scales of hours. Continued analysis of Pandora and surface NO2 data will help define temporal characteristics of local NO2 variability and how this relates to surface NO2 mixing ratios (e.g. for acute health impacts), with the overall goal of applying similar methodologies to space-based observations. The ability to resolve these shorter time scale episodes with coverage only available via satellite observation will significantly further our understanding of boundary-layer chemistry, the evolution and transport of pollution events, as well as provide a significant step forward in the development of regional-scale chemical/transport models. As GEO-CAPE is currently planned to make hourly continental-U.S. observations, the results of this study, which show strong correlation for hourly-averaged data, may be applicable to this mission and elucidate the relationship between column and surface observations. A key conclusion of this study is that data collected from geostationary satellite instruments, which will provide hourly continental coverage (as opposed to a sparse in-situ network), and will not have long integration time on a point-by-point basis, may be able to detect short timescale surface fluctuations in NO2 in both a qualitative and quantitative manner. It is these high-temporal resolution observations that are key from a health/air-quality perspective as mortality is significantly linked to high NO2 events that may not be observed from current daily overpass data.

It was shown that the choice of PBL definition is critical when performing column-to-surface estimations. Application of aerosol-based PBL data was significantly worse than that from the EDAS40 model, which is most likely due to differences between meteorological and chemical PBL/mixed-layer definitions.

SO2 is a primary air-quality constituent that is detectable with Pandora systems and satellite-based instrumentation. This analysis shows that under elevated SO2 conditions, the agreement between column-based surface estimation and surface conditions has an improved correlation. However, under background and moderate conditions the correlation drops significantly. This disagreement may be attributed to SO2 aloft, and the differing sources and lifetimes of SO2 and NO2. Further analysis is required to understand this relationship.

Our results show that for large zenith angles, the correlation is poorer which may be the result of a less-well-mixed PBL, a poor PBL estimation from the model, or an overlying residual layer. Further exploration is required to understand this time of day dependence, how boundary-layer dynamics influence chemical mixing/distribution, and how this influences satellite retrievals. Application of this methodology to additional case studies from the 2011 DISCOVER-AQ mission, and current satellite retrieval data, will be the focus of future analyses.

Elucidation of NO2 distribution throughout the PBL is the key to understanding how column observations relate to ground conditions, and applying the current methodology to satellite data sets. The methodology presented herein is a first step that shows promise in making satellite-based observations applicable to regulatory and emissions inventory work. Application of this methodology is limited to daytime observations (though ground-based moon-tracking instruments are available), and times when the PBL is well developed, which may be problematic for nocturnal observations. This technique also shows potential for application during high SO2 events, which requires surface measurements for identification, and observation of SO2 aloft. Indeed, future studies will focus on refining the SO2 analysis, and improving our understanding of the meteorological drivers that influence the NO2 correlations.