Advertisement

Recent Progress on Inverse and Data Assimilation Procedure for High-Latitude Ionospheric Electrodynamics

  • Tomoko MatsuoEmail author
Open Access
Chapter
Part of the ISSI Scientific Report Series book series (ISSI, volume 17)

Abstract

Polar ionospheric electrodynamics plays an important role in the Sun–Earth connection chain, acting as one of the major driving forces of the upper atmosphere and providing us with a means to probe physical processes in the distant magnetosphere. Accurate specification of the constantly changing conditions of high-latitude ionospheric electrodynamics has long been of paramount interest to the geospace science community. The Assimilative Mapping of Ionospheric Electrodynamics procedure, developed with an emphasis on inverting ground-based magnetometer observations for historical reasons, has long been used in the geospace science community as a way to obtain complete maps of high-latitude ionospheric electrodynamics by overcoming the limitations of a given geospace monitoring system. This Chapter presents recent technical progress on inverse and data assimilation procedures motivated primarily by availability of regular monitoring of high-latitude electrodynamics by space-borne instruments. The method overview describes how electrodynamic state variables are represented with polar-cap spherical harmonics and how coefficients are estimated from the point of view of the Bayesian inferential framework. Some examples of the recent applications to analysis of SuperDARN plasma drift, Iridium, and DMSP magnetic fields, as well as DMSP auroral particle precipitation data are included to demonstrate the method.

10.1 Introduction

The most dynamic electromagnetic energy and momentum exchange processes between the upper atmosphere and the magnetosphere take place in the polar ionosphere. Physical processes producing aurora involve ionization and excitation of atmospheric constituents due to energetic charged particles precipitating into the upper atmosphere from the magnetosphere along the geomagnetic field lines, which in turn modulates the ionosphere’s ability to conduct electric currents. Polar ionospheric electrodynamics plays an important role in the Sun–Earth connection chain, acting as one of the major driving forces of the upper atmosphere and providing us with a means to probe physical processes in the distant magnetosphere. Accurate specification of the constantly changing conditions of high-latitude ionospheric electrodynamics has long been of paramount interest to the geospace science community.

Global monitoring of high-latitude geospace has dramatically improved thanks to a recent expansion of ground-based and space-based observing capability. International consortiums of ground-based instrumentation such as the Super Dual Auroral Radar Network (SuperDARN) (e.g., Greenwald et al. 1995), International Real-Time Magnetic Observatory Network (e.g., Love 2013) and SuperMAG (e.g., Gjerloev 2009) have made a large volume of quality-controlled, standardized data accessible to the public. Acquisition, processing, and distribution of engineering-grade magnetometer data from the Iridium satellite constellation for scientific purposes by the Active Magnetosphere and Polar Electrodynamics Response Experiment (AMPERE) program (Anderson et al. 2000) have been instrumental in making continuous, global monitoring of geomagnetic-field-aligned currents (FAC) possible. Defense Meteorological Satellite Program (DMSP) space environment instruments have long been providing valuable measurements of precipitating electron and ion particles, magnetic fields, and ultraviolet spectrographic images (e.g., Rich 1984; Hardy et al. 1984; Paxton et al. 2002). And the Swarm multi-satellite mission (Friis-Christensen et al. 2006) provides high precision measurements of magnetic fields that complement theses existing geospace observing systems.

Data assimilation techniques such as the Assimilative Mapping of Ionospheric Electrodynamics (AMIE) procedure of Richmond and Kamide (1988) have long been used in the geospace science community as a way to obtain complete maps of high-latitude ionospheric electrodynamics by overcoming the limitations of a given geospace monitoring system. The procedure combines a number of different types of space-based and ground-based observations with an empirical model of ionospheric electrodynamics to infer distributions of ionospheric electric fields and currents, FAC, associated geomagnetic perturbation fields at both ground and low-Earth-orbit altitudes, Hall and Pedersen conductance, and Joule heating. AMIE maps have yielded a number of important insights into the coupling of the magnetosphere, ionosphere, and thermosphere that takes place at high latitudes. Lu (2017) provides a comprehensive overview of AMIE applications.

This paper presents an overview of the recent technical developments of the inverse and data assimilation procedure for high-latitude electrodynamics. Some of these developments are a consequence of a reformulation of the best linear unbiased estimation problem presented in Richmond and Kamide (1988) as a Bayesian estimation problem (Matsuo et al. 2005). Under the assumption that electrodynamic variables are Gaussian distributed, these two estimation problems are equivalent. A Bayesian perspective has helped to clarify the role of the prior model (background) error covariance as a key component in the modeling of Gaussian processes, and thus guided modeling and estimation of prior covariance functions from a large volume of SuperDARN data (Cousins et al. 2013a), DMSP particle precipitation data (McGranaghan et al. 2015, 2016), and Iridium magnetic perturbation data (Cousins et al. 2015b; Shi et al. 2019). Even though ionospheric conductivity serves as a critical linkage in electromagnetic energy and momentum exchange processes, direct monitoring of this conductivity is almost nonexistent. Another notable development led by McGranaghan et al. (2016) is an assimilative mapping of the conductance using the auroral ionization derived from DMSP electron energy flux spectra with help of the GLobal airglOW (GLOW) model (Solomon et al. 1988) without the assumption of Maxwellian distribution. Since the AMIE has been developed with an emphasis on inverting ground-based magnetometer observations for historical reasons (Kamide et al. 1981; Richmond and Kamide 1988), it is not tailored to analyses of space-based magnetometer data from DMSP, Iridium, and Swarm. In order to solve the optimization problem in terms of electrostatic potential, the space-based magnetometer data first need to be converted to electrostatic potential through the application of Ohm’s law and current continuity. To minimize the impact of conductance on the inversion of space-based magnetometer data for FAC, the optimization problem is now being solved in terms of both magnetic potential and electrostatic potential (Matsuo et al. 2015; Cousins et al. 2015a).

10.2 Method Overview

10.2.1 Representation of Electrodynamic State Variables Using Scalar and Vector Polar-Cap Spherical Harmonic Basis Functions

The ionosphere is treated as a thin conductive slab centered at a reference height \(h_r =110\) km, and the current above the ionosphere is assumed to be strictly radial. The effect of the neutral wind dynamo is not considered. Electrodynamic variables analyzed here include the electrostatic potential \(\Phi \), electric fields \(\mathbf{E}\), Pedersen and Hall conductance (height-integrated conductivity) \({\Sigma _p}\), \({\Sigma _h}\), height-integrated horizontal ionospheric current density \(\mathbf{J}_{\perp }\), toroidal magnetic potential \(\Psi \) associated with field-aligned current density \(\mathbf{J}_{\parallel }\), and equivalent current potential \(\Omega \) associated with ground-based magnetic fields. These variables are presumed to be related to each other as follows.
$$\begin{aligned} \mathbf{E}= & {} - \nabla \Phi \end{aligned}$$
(10.1)
$$\begin{aligned} \mathbf{J}_{\perp }= & {} {\varvec{\Sigma }} \cdot \mathbf{E} \end{aligned}$$
(10.2)
$$\begin{aligned} \mathbf{J}_{\parallel }= & {} - \nabla \cdot \mathbf{J}_{\perp } \end{aligned}$$
(10.3)
$$\begin{aligned} \nabla \times \mathbf{J}_{\perp }= & {} - \nabla ^2_\mathrm{hor} {\Omega } \end{aligned}$$
(10.4)
$$\begin{aligned} \mathbf{J}_{\parallel }= & {} \frac{1}{\mu _o} \nabla ^2_\mathrm{hor} {\Psi } \end{aligned}$$
(10.5)
where \(\varvec{\Sigma } = \left( \begin{array}{cc} \Sigma _p &{} -\Sigma _h \\ \Sigma _h &{} \Sigma _p \end{array} \right) \) is the conductance tensor, \(\nabla ^2_\mathrm{hor}\) is the horizontal Laplacian, and \({\mu _o}\) is permeability of free space. Equation (10.4) results from the assumption of strictly vertical \(\mathbf{J}_{\parallel }\) that allows equating the curls of \(\mathbf{J}_{\perp }\) and the equivalent current (i.e., Fukushima Theorem). If the Pedersen and Hall conductances are given, the relationship among all electrodynamic variables (10.1)–(10.5) becomes linear.
In the procedure, electrodynamic variables are expressed in terms of the polar-cap spherical harmonic basis functions developed by Richmond and Kamide (1988). Suppose that \(\varvec{\Psi }\) represents a matrix of the polar-cap spherical harmonic basis functions evaluated at discrete grid locations specified by the Modified Magnetic Apex longitude \(\phi _m\) and latitude \(\lambda _m\) at the altitude of \(h_r\) (Richmond 1995) and that \(\mathbf{x}\) denotes a vector of the coefficients. \(\varvec{\Psi }\) is furthermore given by a set of 244 polar-cap spherical harmonic basis functions up to order \(m_{ \Psi }=12\), with non-integer degrees \(n_{ \Psi }\) up to a maximum of \(n_{ \Psi }=72.6\) for \(m_{ \Psi }=0\), with a polar-cap co-latitude for the functions of \(40^{\circ }\). Therefore, x is a column vector of 244 elements and \(\mathbf{\Psi }\) is an \(n\times 244\) matrix, where n is the number of grid points. Using the Nyquist sampling rate, the effective resolution is \(15^{\circ }\) longitude and \(2.5^{\circ }\) latitude. Let’s suppose that the electrostatic potential \(\Phi \) at \(\phi _m\) and \(\lambda _m\) is given by
$$\begin{aligned} {\Phi }(\phi _m,\lambda _m) = \varvec{\Psi } \mathbf{x}_\mathrm{E} + \varvec{\epsilon }_t\;, \end{aligned}$$
(10.6)
where \(\varvec{\epsilon }_t\) is the truncation error, and the electric fields \(\mathbf{E}\) by
$$\begin{aligned} \mathbf{E}(\phi _m,\lambda _m) = - \varvec{\Psi }{'}{} \mathbf{x}_\mathrm{E} + \varvec{\epsilon }_t\;, \end{aligned}$$
(10.7)
where a (\(n \times 244\)) matrix \(\varvec{\Psi }{'}\) contains the gradients of the polar-cap spherical harmonic basis functions, which discretizes (10.1). The toroidal potential \({\Psi }\) at \(\phi _m\) and \(\lambda _m\) is then given by
$$\begin{aligned} {\Psi }(\phi _m,\lambda _m) = \varvec{\Psi } \mathbf{x}_\mathrm{M} + \varvec{\epsilon }_t\;, \end{aligned}$$
(10.8)
where \(\varvec{\epsilon }_t\) is the truncation error, and the FAC magnitude J by
$$\begin{aligned} J(\phi _m,\lambda _m) = \varvec{\Psi }{''}{} \mathbf{x}_\mathrm{M} + \varvec{\epsilon }_t\;, \end{aligned}$$
(10.9)
where a (\(n \times 244\)) matrix \(\varvec{\Psi }{''}\) contains a simplified evaluation of (10.5) using the analytical expression of the horizontal Laplacian of polar-cap spherical harmonic basis functions applicable to spherical coordinates, rather than the full expression applicable to M(110) coordinates. As explained in (Matsuo et al. 2015), this computational simplification introduces errors on the order of 10%. For a given \(\Sigma _p\) and \(\Sigma _h\), \(\mathbf{x}_\mathrm{E}\) and \(\mathbf{x}_\mathrm{M}\) are related linearly through the current continuity and Ohm’s law (10.2)–(10.3).

10.2.2 Bayesian State Estimation for Gaussian Processes

Suppose that \(\mathbf{y}\) represents a vector of j observations that may consist of electric field, ground-based magnetic field, and/or space-based magnetic field measurements at discrete observation locations. By evaluating the polar-cap spherical harmonics and their derivatives at observation locations, \(\mathbf{y}\) can be expressed as
$$\begin{aligned} \mathbf{y} = \mathbf{H} \mathbf{x} + \varvec{\epsilon }_r\;, \end{aligned}$$
(10.10)
where \(\mathbf{H}\) is a (\(j \times 244\)) matrix that contains the polar-cap spherical harmonic basis functions and their spatial derivatives with corresponding vector calculus operations as specified in (10.1)–(10.5), \(\mathbf{x}\) denotes a vector of the 244 coefficients, and \(\varvec{\epsilon }_r\) is the sum of observational and truncation errors. The objective of the Bayesian state estimation is to infer the polar-cap spherical harmonics coefficients \(\mathbf{x}\) given observations \(\mathbf{y}\) according to Bayes rule: \([\mathbf{x}|\mathbf{y}] \propto [\mathbf{y}|\mathbf{x}] [\mathbf{x}] \) The vectors \(\mathbf x\) and \(\mathbf y\) are herein assumed to be distributed according to the multivariate normal distribution denoted by \(\mathcal {MN}\) as
$$\begin{aligned} \mathbf{x}\sim & {} \mathcal {MN} [\mathbf{x}_b, \mathbf{C}_b] \;,\end{aligned}$$
(10.11)
$$\begin{aligned} \mathbf{y}\sim & {} \mathcal {MN} [ \mathbf{H} \mathbf{x}, \mathbf{C}_r]\;, \end{aligned}$$
(10.12)
where \(\mathbf{x}_b\) is the prior mean, \(\mathbf{C}_b\) is the prior (background) model error covariance \(<(\mathbf{x}_b - \mathbf{x}) (\mathbf{x}_b - \mathbf{x})^T>\), and \(\mathbf{C}_r\) is the observational error covariance \(<\varvec{\epsilon }_r \varvec{\epsilon }_r^T>\). \(\mathbf{x}_b\) is specified by using an empirical model. \(\mathbf{C}_b\) is described in the following section. The errors \(\varvec{\epsilon }_r\) are assumed to be uncorrelated, so \(\mathbf{C}_r\) is given by a diagonal matrix of the variance of observational error. The posterior distribution or the conditional distribution of \(\mathbf{x}\) given observations \(\mathbf{y}\) is given by the multivariate normal distribution as
$$\begin{aligned}{}[\mathbf{x} | \mathbf{y} ] \sim \mathcal {MN} [\mathbf{x}_a, \mathbf{C}_a] \;, \end{aligned}$$
(10.13)
where \(\mathbf{x}_a\) is the posterior mean or the data assimilation analysis and \(\mathbf{C}_a\) is the analysis error covariance \(<(\mathbf{x}_a - \mathbf{x}) (\mathbf{x}_a - \mathbf{x})^T>\). In the case of normally distributed \(\mathbf{x}\) and \(\mathbf{y}\) and linear \(\mathbf{H}\), there are closed formulae for \(\mathbf{x}_a\) and \(\mathbf{C}_a\) (e.g., Jazwinski 1970; Lorenc 1986):
$$\begin{aligned} \mathbf{x}_a= & {} \mathbf{x}_b + \mathbf{C}_b\mathbf{H}^T(\mathbf{H}{} \mathbf{C}_b\mathbf{H}^{T} + \mathbf{C}_r)^{-1} (\mathbf{y} - \mathbf{H}{} \mathbf{x}_b) \;, \end{aligned}$$
(10.14)
$$\begin{aligned} \mathbf{C}_a= & {} [\mathbf{I} - \mathbf{C}_b\mathbf{H}^T(\mathbf{H}{} \mathbf{C}_b\mathbf{H}^{T} + \mathbf{C}_r)^{-1}{} \mathbf{H}]\mathbf{C}_b \;. \end{aligned}$$
(10.15)
By specifying \(\mathbf{C}_b\), \(\mathbf{C}_r\), \(\mathbf{H}\), and \(\mathbf{x}_b\), the analysis \(\mathbf{x}_a\) and error covariance \(\mathbf{C}_a\) can be computed for given observations \(\mathbf{y}\). The prior model error covariance \(\mathbf{C}_b\) plays an important role here, not only balancing the weighting between observations and the prior model but also spreading the observation-model discrepancy information spatially according to the correlation represented in the covariance.

10.2.3 Nonstationary Covariance Modeling

Following the approach adopted in Matsuo et al. (2005) as a way to incorporate anisotropic and inhomogeneous characteristics of the prior (background) model errors into the analysis (10.14) in a computationally tractable manner, \(\mathbf{C}_b\) is modeled using the empirical orthogonal functions (EOFs, i.e., principal components). EOFs and their coefficients are estimated in advance of the data assimilation, for instance, from 50 million total SuperDARN plasma drift data points over January 2011 through August 2012 for electrostatic potential (Cousins et al. 2013a), from over 60 million DMSP electron energy flux spectra during the solar cycles 22 and 24 for conductance (McGranaghan et al. 2015), and from over 300 days of Iridium magnetic perturbation data from 2010 to 2015 for field-aligned currents (Shi et al. 2019).
Fig. 10.1

Two-dimensional correlation functions of electrostatic potential with respect to the 4 points indicated by crosses. The contour lines represent the correlation level of 0.9, 0.8, 0.7, and 0.6

(Fig. 7 of Cousins et al. 2013a)

Since observation sampling is often irregular and incomplete, a straightforward eigenvalue decomposition of sample covariance cannot be applied to the dataset. Instead, the nonlinear regression analysis of Matsuo et al. (2002) is used, wherein p principal components are expressed by a linear combination of the polar-cap spherical harmonic basis functions of Richmond and Kamide (1988), and each component is estimated sequentially by a back-fitting technique along with orthonormalization of the regression coefficients for each component. Each EOF can be expressed as \(\varvec{\Psi } \varvec{\beta }\), where \(\varvec{\beta }\) is a \(244\times p\) matrix. Then \(\mathbf{C}_b\) is given as
$$\begin{aligned} \mathbf{C}_b \approx \varvec{\beta }\mathbf{C}_\gamma \varvec{\beta }^T \;, \end{aligned}$$
(10.16)
where \(\mathbf{C}_\gamma \) is the covariance \(<\varvec{\gamma } \varvec{\gamma }^T>\) of the EOF coefficients \(\varvec{\gamma }\), where \(\varvec{\gamma }\) is a \(p \times 1\) column vector. EOFs estimated by the method of Matsuo et al. (2002) are equivalent to the eigenfunctions of a covariance matrix computed from observational data. As with other principal component analysis methods, a certain replication of data samples is required to estimate \(\mathbf{C}_\gamma \) and \({\varvec{\beta }}\) from the observations.
Figure 10.1 shows 2-dimensional correlation maps for electrostatic potential computed from the EOF-based covariance derived from SuperDARN data (Cousins et al. 2013a) where p is set to 30. It is evident that the correlation structures are highly anisotropic with a larger correlation length scales in the zonal direction in comparison to the meridional direction, and correlations vary depending on reference point locations. These are features of strong nonstationary correlation, which will enable the data assimilation procedure to spatially distribute the impact of observations with consideration of realistic location-specific correlation structures of SuperDARN plasma drifts or electric fields.
Fig. 10.2

Potential distributions for three selected times. a, d, and g Results from the standard SuperDARN mapping procedure. b, c, e, f, h, and i Results from the inverse and data assimilation procedure, with associated uncertainty shown as background coloring on the right side

(Fig. 5 of Cousins et al. 2013b)

10.3 Analysis of Electrostatic Potential and Electric Fields

Cousins et al. (2013b) presents an inverse and data assimilation procedure designed to specifically estimate \(\mathbf{x}_\mathrm{E}\) as defined in (10.6) and (10.7) from SuperDARN data. A comprehensive cross-validation study (Cousins et al. 2013b) wherein observations are systematically set aside for validation and compared to predictions by data assimilation outperforms the standard SuperDARN mapping procedure (Ruohoniemi and Baker 1998; Shepherd and Ruohoniemi 2000). The inverse and data assimilation procedure is found to reduce median prediction errors by up to 43% as compared to the standard SuperDARN mapping procedure. The procedure is built using the prior covariance modeled with EOFs obtained by Cousins et al. (2013a) and the prior mean specified by the empirical plasma convection model of Cousins and Shepherd (2010). Figure 10.2 compares the maps of electrostatic potentials obtained by the standard SuperDARN mapping procedure (Ruohoniemi and Baker 1998; Shepherd and Ruohoniemi 2000 to the ones by Cousins et al. (2013b) along with maps of the uncertainty associated with assimilative mapping as given by the diagonal elements of \(\mathbf{C}_a\) (10.15). The uncertainty reflects the observation distributions with higher uncertainty found in the area of the SuperDARN data gap. The comparison also highlights the role of the nonstationary covariance in the inverse and data assimilation procedure that help regularize assimilative mapping analysis.

10.4 Analysis of Toroidal Magnetic Potential and Field-Aligned Currents

Matsuo et al. (2015) presents an inverse and data assimilation analysis of space-based magnetometer data that directly solves for \(\mathbf{x}_\mathrm{M}\) as defined in (10.8) and (10.9) to circumvent the need to use conductance in analysis of space-based magnetometer data for FAC as has been originally done in Richmond and Kamide (1988). Figure 10.3 displays maps of the toroidal magnetic potential and FAC estimated from both AMPERE and DMSP data under four distinctive interplanetary magnetic field conditions during a magnetic cloud event on May 29, 2010, and demonstrates the Interplanetary Magnetic Field (IMF) control of high-latitude electrodynamics. Note that the uncertainty associated with the magnetic potential analysis is shown in the black-and-white contour in the background, with darker shades indicating greater errors. For comparison, the bottom row shows maps of the FAC provided by the AMPERE program. The AMPERE data product obtained from the spherical harmonic fit has an effective resolution of \({3^\circ }\) latitude and \({36^\circ }\) longitude (Anderson et al. 2014). As discussed in Matsuo et al. (2015), the overall distribution of FAC is similar to the one obtained by the current procedure, except for a few notable differences in the detail, such as the absence of high-frequency features and more longitudinally continuous FAC spatial structures are seen in the present analysis. Thanks to the regularization through the use of the prior model error covariance in solving the inverse problem, there is no need to fill the data gap with synthetic data to make a regression analysis stable, as is required in the AMPERE inversion.
Fig. 10.3

The plots in the top and middle rows are maps of toroidal magnetic potential and FAC on May 29, 2010, estimated from the AMPERE and DMSP data over a 4 min interval: a-1, a-2 IMF Bz positive, b-1, b-2 IMF By positive, c-1, c-2 IMF Bz negative, and d-1, d-2 IMF By negative. The plots in the bottom row are maps of the FAC provided by the AMPERE program, estimated from the AMPERE data over a 10 min interval using Altitude Adjusted Corrected Geomagnetic Coordinates

(Fig. 5 of Matsuo et al. 2015)

10.5 Dual Optimization Approach

The framework for the inverse and data assimilation procedure described in Sect. 10.2 has thus far been applied to assimilative analysis of individual electromagnetic variables. In this section, the same framework is applied to the analysis of multiple variables. The relationship among electrodynamic variables given in (10.1)–(10.5) is nonlinear, requiring a nonlinear optimization approach. As an intermediate step toward implementing a fully nonlinear solver, Cousins et al. (2015a) presents a dual optimization approach by combining the two linear optimization approaches presented in Sects. 10.3 and 10.4 but using both SuperDARN and Iridium magnetic perturbation data. For a given conductance \(\Sigma _p\) and \(\Sigma _h\), optimal values for \(\mathbf{x}_\mathrm{E}\) and \(\mathbf{x}_\mathrm{M}\) are estimated independently. Specifically, the optimal interpolation (or Kalman filter update) Eqs. (10.14) and (10.15) are applied to \(\mathbf{x}_\mathrm{E}\) with the prior error covariance for electrostatic potential estimated from the SuperDARN data (Cousins et al. 2013a) and with \(\mathbf{y}\) being composed of SuperDARN plasma drifts and Iridium magnetic perturbation fields. For estimation of \(\mathbf{x}_\mathrm{M}\), (10.14) and (10.15) are applied with the prior error covariance for toroidal magnetic potential estimated from the Iridium magnetic perturbation data (Cousins et al. 2015b).
Fig. 10.4

Distributions of a, d electrostatic potential, b, e field-aligned current density, and cf Poynting flux for 07400750 UT, November 29, 2011. Background color indicates estimated uncertainty. a, b, c Results using the SuperDARN and AMPERE data, independently. d, e, f Results using the SuperDARN and AMPERE data together. While SuperDARN observation locations are indicated by black dots, Iridium satellite tracks (where there are AMPERE data) are indicated by black lines

(Fig. 5 of Cousins et al. 2015a)

Figure 10.4 demonstrates the benefit of incorporating both SuperDARN and Iridium magnetic perturbation observations into the estimation of both electrostatic and magnetic potential (Cousins et al. 2015a). For example, as shown in the orange-shaded background contour in Fig. 10.4a and d, the uncertainty for electrostatic potential distributions estimated from SuperDARN data alone is higher in comparison to the uncertainty when both data are assimilated. This is particularly evident in the dawn cell where there is no SuperDARN data but there is Iridium data. McGranaghan et al. (2016) have examined the effects of using different conductances in this dual optimization approach to assimilative mapping. When \(\Sigma _p\) and \(\Sigma _h\) are estimated by assimilation of the DMSP electron precipitation data (blue in Fig. 10.5) rather than specified by a climatological model (red in Fig. 10.5), the prediction of SuperDARN plasma drifts by assimilative analysis of Iridium magnetic perturbation data becomes more consistent with SuperDARN plasma drifts observations, as shown in Fig. 10.5c and f. Note that SuperDARN data are not used here for prediction of Iridium magnetic perturbation data, and vice versa.
Fig. 10.5

Median Absolute Differences (MADs) between the prediction by data assimilation and the validation observation over the November 26–December 2, 2011 analysis time period. MADs are computed over the polar region. a, d Borovsky coupling function (black trace, left y-axis), b, e SuperDARN plasma drifts are used to predict Iridium magnetic fields, and c, f Iridium magnetic fields are used to predict SuperDARN plasma drifts

(Fig. 8 of McGranaghan et al. 2016)

10.6 Summary

This paper demonstrates that simultaneous analysis of multiple types of space-based and ground-based global geospace observations enabled by the inverse and data assimilation procedure provides a global perspective of high-latitude ionospheric electrodynamics. The paper summarizes important technical developments that have been made in response to the expansion of high-latitude geospace observing systems. The primary areas of the methodological extension to the AMIE (Richmond and Kamide 1988) are (a) the optimization in terms of both magnetic and electrostatic potential to minimize the impact of conductance on the inversion of space-based Iridium and DMSP magnetometer data for FAC mapping (Matsuo et al. 2015; Cousins et al. 2015a; (b) the use of realistic prior error covariance estimated from a large data set of SuperDARN (Cousins et al. 2013a), DMSP (McGranaghan et al. 2015) and Iridium magnetic perturbation data (Shi et al. 2019; (c) improved assimilative conductance/conductivity mapping (McGranaghan et al. 2016).

Notes

Acknowledgements

This study is supported by the NSF grants PLR-1443703 and ICER-1541010. We thank the International Space Science Institute (ISSI) in Bern, Switzerland for supporting the Working Group “Multi Satellite Analysis Tools—Ionosphere” from which this chapter resulted. The Editors thank Gang Lu for her assistance in evaluating this chapter.

References

  1. Anderson, B.J., K. Takahashi, and B.A. Toth. 2000. Sensing global birkeland currents with Iridium engineering magnetometer data. Geophysical Research Letters 27 (24): 4045–4048.  https://doi.org/10.1029/2000gl000094.ADSCrossRefGoogle Scholar
  2. Anderson, B.J., H. Korth, C.L. Waters, D.L. Green, V.G. Merkin, R.J. Barnes, and L.P. Dyrud. 2014. Development of large-scale birkeland currents determined from the active magnetosphere and planetary electrodynamics response experiment. Geophysical Research Letters 41: 30173025.  https://doi.org/10.1002/2014GL059941.CrossRefGoogle Scholar
  3. Cousins, E.D.P., and S.G. Shepherd. 2010. A dynamical model of high-latitude convection derived from SuperDARN plasma drift measurements. Journal of Geophysical Research 115: A12329.  https://doi.org/10.1029/2010JA016017.ADSCrossRefGoogle Scholar
  4. Cousins, E.D.P., T. Matsuo, and A.D. Richmond. 2013a. Mesoscale and large-scale variability in high-latitude ionospheric convection: Dominant modes and spatial/temporal coherence. Journal of Geophysical Research 118: 78957904.  https://doi.org/10.1002/2013JA019319.CrossRefGoogle Scholar
  5. Cousins, E.D.P., T. Matsuo, and A.D. Richmond. 2013b. SuperDARN assimilative mapping. Journal of Geophysical Research 118: 1–9.  https://doi.org/10.1002/2013JA019321.CrossRefGoogle Scholar
  6. Cousins, E.D.P., T. Matsuo, and A.D. Richmond. 2015a. Mapping high-latitude ionospheric electrodynamics with SuperDARN and AMPERE. Journal of Geophysical Research 120: 5854–5870.  https://doi.org/10.1002/2014JA020463.CrossRefGoogle Scholar
  7. Cousins, E.D.P., T. Matsuo, A.D. Richmond, and B.J. Anderson. 2015b. Dominant modes of variability in large-scale birkeland currents. Journal of Geophysical Research 120: 6722–6735.  https://doi.org/10.1002/2014JA020462.CrossRefGoogle Scholar
  8. Friis-Christensen, E., H. Lühr, and G. Hulot. 2006. Swarm: A constellation to study the Earth’s magnetic field. Earth Planets Space 58: 351–358.ADSCrossRefGoogle Scholar
  9. Gjerloev, J. 2009. A global ground-based magnetometer initiative. EOS 90 (27):Google Scholar
  10. Greenwald, R.A., K.B. Baker, J.R. Dudeney, M. Pinnock, T.B. Jones, and E.C. Thomas. 1995. DARN/SuperDARN. Space Science Reviews 71: 761796.  https://doi.org/10.1007/BF00751350.CrossRefGoogle Scholar
  11. Hardy, D.A., L.K. Schmidt, M.S. Gussenhoven, F.J. Marshall, H.C. Yeh, T.L. Shumaker, A. Huber, and J. Pantazis. 1984. Precipitating electronand ion detectors (SSJ/4) for block 5D/flights 4-10 DMSP satellites: Calibration and data presentation. Technical Report AFGL-TR-84-0317, Air Force Research Laboratory, Hanscom Air Force Base, MassGoogle Scholar
  12. Jazwinski, A.H. 1970. Stochastic processes and filtering theory. Academic Press.Google Scholar
  13. Kamide, Y., A.D. Richmond, and S. Matsushita. 1981. Estimation of ionospheric electric fields, ionospheric currents, and field-aligned currents from ground magnetic records. Journal of Geophysical Research 86 (A2): 801–813.  https://doi.org/10.1029/JA086iA02p00801.ADSCrossRefGoogle Scholar
  14. Lorenc, A. 1986. Analysis methods for numerical weather prediction. Quarterly Journal of the Royal Meteorological Society 112: 205–240.CrossRefGoogle Scholar
  15. Love, J. 2013. An international network of magnetic observations. EOS 94 (42):Google Scholar
  16. Lu, G. 2017. Large scale high-latitude ionospheric electrodynamic fields and currents. Space Science Reviews 206: 431–450.  https://doi.org/10.1007/s11214-016-0269-9.ADSCrossRefGoogle Scholar
  17. Matsuo, T., A.D. Richmond, and D.W. Nychka. 2002. Modes of high-latitude electric field variability derived from DE-2 measurements: Empirical Orthogonal Function (EOF) analysis. Geophysical Research Letters 29 (7): 1107.  https://doi.org/10.1029/2001GL014077.ADSCrossRefGoogle Scholar
  18. Matsuo, T., A.D. Richmond, and G. Lu. 2005. Optimal interpolation analysis of high-latitude ionospheric electrodynamics using empirical orthogonal functions: Estimation of dominant modes of variability and temporal scales of large-scale electric fields. Journal of Geophysical Research 110: A06301.  https://doi.org/10.1029/2004JA010531.ADSCrossRefGoogle Scholar
  19. Matsuo, T., D.J. Knipp, A.D. Richmond, L. Kilcommons, and B.J. Anderson. 2015. Inverse procedure for high-latitude ionospheric electrodynamics: Analysis of satellite-borne magnetometer data. Journal of Geophysical Research 5241–5251:  https://doi.org/10.1002/2014JA020565.
  20. McGranaghan, R., D.J. Knipp, T. Matsuo, H. Godinez, R.J. Redmon, S.C. Solomon, and S.K. Morley. 2015. Modes of high-latitude auroral conductance variability derived from DMSP energetic electron precipitation observations: Empirical orthogonal function analysis. Journal of Geophysical Research 120: 11013–11031.  https://doi.org/10.1002/2015JA021828.CrossRefGoogle Scholar
  21. McGranaghan, R., D.J. Knipp, T. Matsuo, and E. Cousins. 2016. Optimal interpolation analysis of high-latitude ionospheric Hall and Pedersen conductivities: Application to assimilative ionospheric electrodynamics reconstruction. Journal of Geophysical Research 121: 4898–4923.  https://doi.org/10.1002/2016JA022486.CrossRefGoogle Scholar
  22. Paxton, L.J., D. Morrison, Y. Zhang, H. Kil, B. Wolven, B.S. Ogorzalek, D.C. Humm, C.I. Meng. 2002. Validation of remote sensing products produced by the Special Sensor Ultraviolet Scanning Imager (SSUSI): A far UV-imaging spectrograph on DMSP F-16. In: Proceedings of SPIE Optical Spectroscopic Techniques, Remote Sensing, and Instrumentation for Atmospheric and Space Research IV, 30 January 2002, vol. 4485.  https://doi.org/10.1117/12.454268
  23. Rich, F.J. 1984. Fluxgate magnetometer (SSM) for the Defense Meteorological Satellite Program (DMSP) block 5D-2, Flight 7. Technical Report AFGL-TR-84-0225, Air Force Research Laboratory, Hanscom Air Force Base, Mass.Google Scholar
  24. Richmond, A.D. 1995. Ionospheric electrodynamics using magnetic Apex coordinates. Journal of Geomagnetism and Geoelectricity 47: 191–212.ADSCrossRefGoogle Scholar
  25. Richmond, A.D., and Y. Kamide. 1988. Mapping electrodynamic features of the high-latitude ionosphere from localized observations: Technique. Journal of Geophysical Research 93 (A6): 5741–5759.ADSCrossRefGoogle Scholar
  26. Ritter, P., and H. Lühr. 2006. Curl-B technique applied to Swarm constellation for determining field-aligned currents. Earth Planets Space 58: 463–476.ADSCrossRefGoogle Scholar
  27. Ruohoniemi, J.M., and K.B. Baker. 1998. Large-scale imaging of high-latitude convection with super dual Auroral Radar network HF radar observations. Journal of Geophysical Research 103 (20): 797.Google Scholar
  28. Shepherd, S.G., and J.M. Ruohoniemi. 2000. Electrostatic potential patterns in the high latitude ionosphere constrained by SuperDARN measurements. Journal of Geophysical Research 105 (23): 005.Google Scholar
  29. Shi, Y., D.J. Knipp, T. Matsuo, L. Kilcommons, B.J. Anderson. 2019. Modes of field-aligned currents variability and their hemispheric asymmetry revealed by inverse and assimilative analysis of Iridium magnetometer data. Journal of Geophysical Research Submitted.Google Scholar
  30. Solomon, S.C., P.B. Hays, and V.J. Abreu. 1988. The auroral 6300 Å emission: Observations and modeling. Journal of Geophysical Research 93 (A9): 9867–9882.  https://doi.org/10.1029/JA093iA09p09867.ADSCrossRefGoogle Scholar

Copyright information

© The Author(s) 2020

Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  1. 1.Ann and H.J. Smead Department of Aerospace Engineering SciencesUniversity of ColoradoBoulderUSA

Personalised recommendations