Ionospheric Multi-Spacecraft Analysis Tools pp 219-232 | Cite as
Recent Progress on Inverse and Data Assimilation Procedure for High-Latitude Ionospheric Electrodynamics
Abstract
Polar ionospheric electrodynamics plays an important role in the Sun–Earth connection chain, acting as one of the major driving forces of the upper atmosphere and providing us with a means to probe physical processes in the distant magnetosphere. Accurate specification of the constantly changing conditions of high-latitude ionospheric electrodynamics has long been of paramount interest to the geospace science community. The Assimilative Mapping of Ionospheric Electrodynamics procedure, developed with an emphasis on inverting ground-based magnetometer observations for historical reasons, has long been used in the geospace science community as a way to obtain complete maps of high-latitude ionospheric electrodynamics by overcoming the limitations of a given geospace monitoring system. This Chapter presents recent technical progress on inverse and data assimilation procedures motivated primarily by availability of regular monitoring of high-latitude electrodynamics by space-borne instruments. The method overview describes how electrodynamic state variables are represented with polar-cap spherical harmonics and how coefficients are estimated from the point of view of the Bayesian inferential framework. Some examples of the recent applications to analysis of SuperDARN plasma drift, Iridium, and DMSP magnetic fields, as well as DMSP auroral particle precipitation data are included to demonstrate the method.
10.1 Introduction
The most dynamic electromagnetic energy and momentum exchange processes between the upper atmosphere and the magnetosphere take place in the polar ionosphere. Physical processes producing aurora involve ionization and excitation of atmospheric constituents due to energetic charged particles precipitating into the upper atmosphere from the magnetosphere along the geomagnetic field lines, which in turn modulates the ionosphere’s ability to conduct electric currents. Polar ionospheric electrodynamics plays an important role in the Sun–Earth connection chain, acting as one of the major driving forces of the upper atmosphere and providing us with a means to probe physical processes in the distant magnetosphere. Accurate specification of the constantly changing conditions of high-latitude ionospheric electrodynamics has long been of paramount interest to the geospace science community.
Global monitoring of high-latitude geospace has dramatically improved thanks to a recent expansion of ground-based and space-based observing capability. International consortiums of ground-based instrumentation such as the Super Dual Auroral Radar Network (SuperDARN) (e.g., Greenwald et al. 1995), International Real-Time Magnetic Observatory Network (e.g., Love 2013) and SuperMAG (e.g., Gjerloev 2009) have made a large volume of quality-controlled, standardized data accessible to the public. Acquisition, processing, and distribution of engineering-grade magnetometer data from the Iridium satellite constellation for scientific purposes by the Active Magnetosphere and Polar Electrodynamics Response Experiment (AMPERE) program (Anderson et al. 2000) have been instrumental in making continuous, global monitoring of geomagnetic-field-aligned currents (FAC) possible. Defense Meteorological Satellite Program (DMSP) space environment instruments have long been providing valuable measurements of precipitating electron and ion particles, magnetic fields, and ultraviolet spectrographic images (e.g., Rich 1984; Hardy et al. 1984; Paxton et al. 2002). And the Swarm multi-satellite mission (Friis-Christensen et al. 2006) provides high precision measurements of magnetic fields that complement theses existing geospace observing systems.
Data assimilation techniques such as the Assimilative Mapping of Ionospheric Electrodynamics (AMIE) procedure of Richmond and Kamide (1988) have long been used in the geospace science community as a way to obtain complete maps of high-latitude ionospheric electrodynamics by overcoming the limitations of a given geospace monitoring system. The procedure combines a number of different types of space-based and ground-based observations with an empirical model of ionospheric electrodynamics to infer distributions of ionospheric electric fields and currents, FAC, associated geomagnetic perturbation fields at both ground and low-Earth-orbit altitudes, Hall and Pedersen conductance, and Joule heating. AMIE maps have yielded a number of important insights into the coupling of the magnetosphere, ionosphere, and thermosphere that takes place at high latitudes. Lu (2017) provides a comprehensive overview of AMIE applications.
This paper presents an overview of the recent technical developments of the inverse and data assimilation procedure for high-latitude electrodynamics. Some of these developments are a consequence of a reformulation of the best linear unbiased estimation problem presented in Richmond and Kamide (1988) as a Bayesian estimation problem (Matsuo et al. 2005). Under the assumption that electrodynamic variables are Gaussian distributed, these two estimation problems are equivalent. A Bayesian perspective has helped to clarify the role of the prior model (background) error covariance as a key component in the modeling of Gaussian processes, and thus guided modeling and estimation of prior covariance functions from a large volume of SuperDARN data (Cousins et al. 2013a), DMSP particle precipitation data (McGranaghan et al. 2015, 2016), and Iridium magnetic perturbation data (Cousins et al. 2015b; Shi et al. 2019). Even though ionospheric conductivity serves as a critical linkage in electromagnetic energy and momentum exchange processes, direct monitoring of this conductivity is almost nonexistent. Another notable development led by McGranaghan et al. (2016) is an assimilative mapping of the conductance using the auroral ionization derived from DMSP electron energy flux spectra with help of the GLobal airglOW (GLOW) model (Solomon et al. 1988) without the assumption of Maxwellian distribution. Since the AMIE has been developed with an emphasis on inverting ground-based magnetometer observations for historical reasons (Kamide et al. 1981; Richmond and Kamide 1988), it is not tailored to analyses of space-based magnetometer data from DMSP, Iridium, and Swarm. In order to solve the optimization problem in terms of electrostatic potential, the space-based magnetometer data first need to be converted to electrostatic potential through the application of Ohm’s law and current continuity. To minimize the impact of conductance on the inversion of space-based magnetometer data for FAC, the optimization problem is now being solved in terms of both magnetic potential and electrostatic potential (Matsuo et al. 2015; Cousins et al. 2015a).
10.2 Method Overview
10.2.1 Representation of Electrodynamic State Variables Using Scalar and Vector Polar-Cap Spherical Harmonic Basis Functions
10.2.2 Bayesian State Estimation for Gaussian Processes
10.2.3 Nonstationary Covariance Modeling
Two-dimensional correlation functions of electrostatic potential with respect to the 4 points indicated by crosses. The contour lines represent the correlation level of 0.9, 0.8, 0.7, and 0.6
(Fig. 7 of Cousins et al. 2013a)
Potential distributions for three selected times. a, d, and g Results from the standard SuperDARN mapping procedure. b, c, e, f, h, and i Results from the inverse and data assimilation procedure, with associated uncertainty shown as background coloring on the right side
(Fig. 5 of Cousins et al. 2013b)
10.3 Analysis of Electrostatic Potential and Electric Fields
Cousins et al. (2013b) presents an inverse and data assimilation procedure designed to specifically estimate \(\mathbf{x}_\mathrm{E}\) as defined in (10.6) and (10.7) from SuperDARN data. A comprehensive cross-validation study (Cousins et al. 2013b) wherein observations are systematically set aside for validation and compared to predictions by data assimilation outperforms the standard SuperDARN mapping procedure (Ruohoniemi and Baker 1998; Shepherd and Ruohoniemi 2000). The inverse and data assimilation procedure is found to reduce median prediction errors by up to 43% as compared to the standard SuperDARN mapping procedure. The procedure is built using the prior covariance modeled with EOFs obtained by Cousins et al. (2013a) and the prior mean specified by the empirical plasma convection model of Cousins and Shepherd (2010). Figure 10.2 compares the maps of electrostatic potentials obtained by the standard SuperDARN mapping procedure (Ruohoniemi and Baker 1998; Shepherd and Ruohoniemi 2000 to the ones by Cousins et al. (2013b) along with maps of the uncertainty associated with assimilative mapping as given by the diagonal elements of \(\mathbf{C}_a\) (10.15). The uncertainty reflects the observation distributions with higher uncertainty found in the area of the SuperDARN data gap. The comparison also highlights the role of the nonstationary covariance in the inverse and data assimilation procedure that help regularize assimilative mapping analysis.
10.4 Analysis of Toroidal Magnetic Potential and Field-Aligned Currents
The plots in the top and middle rows are maps of toroidal magnetic potential and FAC on May 29, 2010, estimated from the AMPERE and DMSP data over a 4 min interval: a-1, a-2 IMF Bz positive, b-1, b-2 IMF By positive, c-1, c-2 IMF Bz negative, and d-1, d-2 IMF By negative. The plots in the bottom row are maps of the FAC provided by the AMPERE program, estimated from the AMPERE data over a 10 min interval using Altitude Adjusted Corrected Geomagnetic Coordinates
(Fig. 5 of Matsuo et al. 2015)
10.5 Dual Optimization Approach
Distributions of a, d electrostatic potential, b, e field-aligned current density, and c, f Poynting flux for 07400750 UT, November 29, 2011. Background color indicates estimated uncertainty. a, b, c Results using the SuperDARN and AMPERE data, independently. d, e, f Results using the SuperDARN and AMPERE data together. While SuperDARN observation locations are indicated by black dots, Iridium satellite tracks (where there are AMPERE data) are indicated by black lines
(Fig. 5 of Cousins et al. 2015a)
Median Absolute Differences (MADs) between the prediction by data assimilation and the validation observation over the November 26–December 2, 2011 analysis time period. MADs are computed over the polar region. a, d Borovsky coupling function (black trace, left y-axis), b, e SuperDARN plasma drifts are used to predict Iridium magnetic fields, and c, f Iridium magnetic fields are used to predict SuperDARN plasma drifts
(Fig. 8 of McGranaghan et al. 2016)
10.6 Summary
This paper demonstrates that simultaneous analysis of multiple types of space-based and ground-based global geospace observations enabled by the inverse and data assimilation procedure provides a global perspective of high-latitude ionospheric electrodynamics. The paper summarizes important technical developments that have been made in response to the expansion of high-latitude geospace observing systems. The primary areas of the methodological extension to the AMIE (Richmond and Kamide 1988) are (a) the optimization in terms of both magnetic and electrostatic potential to minimize the impact of conductance on the inversion of space-based Iridium and DMSP magnetometer data for FAC mapping (Matsuo et al. 2015; Cousins et al. 2015a; (b) the use of realistic prior error covariance estimated from a large data set of SuperDARN (Cousins et al. 2013a), DMSP (McGranaghan et al. 2015) and Iridium magnetic perturbation data (Shi et al. 2019; (c) improved assimilative conductance/conductivity mapping (McGranaghan et al. 2016).
Notes
Acknowledgements
This study is supported by the NSF grants PLR-1443703 and ICER-1541010. We thank the International Space Science Institute (ISSI) in Bern, Switzerland for supporting the Working Group “Multi Satellite Analysis Tools—Ionosphere” from which this chapter resulted. The Editors thank Gang Lu for her assistance in evaluating this chapter.
References
- Anderson, B.J., K. Takahashi, and B.A. Toth. 2000. Sensing global birkeland currents with Iridium engineering magnetometer data. Geophysical Research Letters 27 (24): 4045–4048. https://doi.org/10.1029/2000gl000094.ADSCrossRefGoogle Scholar
- Anderson, B.J., H. Korth, C.L. Waters, D.L. Green, V.G. Merkin, R.J. Barnes, and L.P. Dyrud. 2014. Development of large-scale birkeland currents determined from the active magnetosphere and planetary electrodynamics response experiment. Geophysical Research Letters 41: 30173025. https://doi.org/10.1002/2014GL059941.CrossRefGoogle Scholar
- Cousins, E.D.P., and S.G. Shepherd. 2010. A dynamical model of high-latitude convection derived from SuperDARN plasma drift measurements. Journal of Geophysical Research 115: A12329. https://doi.org/10.1029/2010JA016017.ADSCrossRefGoogle Scholar
- Cousins, E.D.P., T. Matsuo, and A.D. Richmond. 2013a. Mesoscale and large-scale variability in high-latitude ionospheric convection: Dominant modes and spatial/temporal coherence. Journal of Geophysical Research 118: 78957904. https://doi.org/10.1002/2013JA019319.CrossRefGoogle Scholar
- Cousins, E.D.P., T. Matsuo, and A.D. Richmond. 2013b. SuperDARN assimilative mapping. Journal of Geophysical Research 118: 1–9. https://doi.org/10.1002/2013JA019321.CrossRefGoogle Scholar
- Cousins, E.D.P., T. Matsuo, and A.D. Richmond. 2015a. Mapping high-latitude ionospheric electrodynamics with SuperDARN and AMPERE. Journal of Geophysical Research 120: 5854–5870. https://doi.org/10.1002/2014JA020463.CrossRefGoogle Scholar
- Cousins, E.D.P., T. Matsuo, A.D. Richmond, and B.J. Anderson. 2015b. Dominant modes of variability in large-scale birkeland currents. Journal of Geophysical Research 120: 6722–6735. https://doi.org/10.1002/2014JA020462.CrossRefGoogle Scholar
- Friis-Christensen, E., H. Lühr, and G. Hulot. 2006. Swarm: A constellation to study the Earth’s magnetic field. Earth Planets Space 58: 351–358.ADSCrossRefGoogle Scholar
- Gjerloev, J. 2009. A global ground-based magnetometer initiative. EOS 90 (27):Google Scholar
- Greenwald, R.A., K.B. Baker, J.R. Dudeney, M. Pinnock, T.B. Jones, and E.C. Thomas. 1995. DARN/SuperDARN. Space Science Reviews 71: 761796. https://doi.org/10.1007/BF00751350.CrossRefGoogle Scholar
- Hardy, D.A., L.K. Schmidt, M.S. Gussenhoven, F.J. Marshall, H.C. Yeh, T.L. Shumaker, A. Huber, and J. Pantazis. 1984. Precipitating electronand ion detectors (SSJ/4) for block 5D/flights 4-10 DMSP satellites: Calibration and data presentation. Technical Report AFGL-TR-84-0317, Air Force Research Laboratory, Hanscom Air Force Base, MassGoogle Scholar
- Jazwinski, A.H. 1970. Stochastic processes and filtering theory. Academic Press.Google Scholar
- Kamide, Y., A.D. Richmond, and S. Matsushita. 1981. Estimation of ionospheric electric fields, ionospheric currents, and field-aligned currents from ground magnetic records. Journal of Geophysical Research 86 (A2): 801–813. https://doi.org/10.1029/JA086iA02p00801.ADSCrossRefGoogle Scholar
- Lorenc, A. 1986. Analysis methods for numerical weather prediction. Quarterly Journal of the Royal Meteorological Society 112: 205–240.CrossRefGoogle Scholar
- Love, J. 2013. An international network of magnetic observations. EOS 94 (42):Google Scholar
- Lu, G. 2017. Large scale high-latitude ionospheric electrodynamic fields and currents. Space Science Reviews 206: 431–450. https://doi.org/10.1007/s11214-016-0269-9.ADSCrossRefGoogle Scholar
- Matsuo, T., A.D. Richmond, and D.W. Nychka. 2002. Modes of high-latitude electric field variability derived from DE-2 measurements: Empirical Orthogonal Function (EOF) analysis. Geophysical Research Letters 29 (7): 1107. https://doi.org/10.1029/2001GL014077.ADSCrossRefGoogle Scholar
- Matsuo, T., A.D. Richmond, and G. Lu. 2005. Optimal interpolation analysis of high-latitude ionospheric electrodynamics using empirical orthogonal functions: Estimation of dominant modes of variability and temporal scales of large-scale electric fields. Journal of Geophysical Research 110: A06301. https://doi.org/10.1029/2004JA010531.ADSCrossRefGoogle Scholar
- Matsuo, T., D.J. Knipp, A.D. Richmond, L. Kilcommons, and B.J. Anderson. 2015. Inverse procedure for high-latitude ionospheric electrodynamics: Analysis of satellite-borne magnetometer data. Journal of Geophysical Research 5241–5251: https://doi.org/10.1002/2014JA020565.
- McGranaghan, R., D.J. Knipp, T. Matsuo, H. Godinez, R.J. Redmon, S.C. Solomon, and S.K. Morley. 2015. Modes of high-latitude auroral conductance variability derived from DMSP energetic electron precipitation observations: Empirical orthogonal function analysis. Journal of Geophysical Research 120: 11013–11031. https://doi.org/10.1002/2015JA021828.CrossRefGoogle Scholar
- McGranaghan, R., D.J. Knipp, T. Matsuo, and E. Cousins. 2016. Optimal interpolation analysis of high-latitude ionospheric Hall and Pedersen conductivities: Application to assimilative ionospheric electrodynamics reconstruction. Journal of Geophysical Research 121: 4898–4923. https://doi.org/10.1002/2016JA022486.CrossRefGoogle Scholar
- Paxton, L.J., D. Morrison, Y. Zhang, H. Kil, B. Wolven, B.S. Ogorzalek, D.C. Humm, C.I. Meng. 2002. Validation of remote sensing products produced by the Special Sensor Ultraviolet Scanning Imager (SSUSI): A far UV-imaging spectrograph on DMSP F-16. In: Proceedings of SPIE Optical Spectroscopic Techniques, Remote Sensing, and Instrumentation for Atmospheric and Space Research IV, 30 January 2002, vol. 4485. https://doi.org/10.1117/12.454268
- Rich, F.J. 1984. Fluxgate magnetometer (SSM) for the Defense Meteorological Satellite Program (DMSP) block 5D-2, Flight 7. Technical Report AFGL-TR-84-0225, Air Force Research Laboratory, Hanscom Air Force Base, Mass.Google Scholar
- Richmond, A.D. 1995. Ionospheric electrodynamics using magnetic Apex coordinates. Journal of Geomagnetism and Geoelectricity 47: 191–212.ADSCrossRefGoogle Scholar
- Richmond, A.D., and Y. Kamide. 1988. Mapping electrodynamic features of the high-latitude ionosphere from localized observations: Technique. Journal of Geophysical Research 93 (A6): 5741–5759.ADSCrossRefGoogle Scholar
- Ritter, P., and H. Lühr. 2006. Curl-B technique applied to Swarm constellation for determining field-aligned currents. Earth Planets Space 58: 463–476.ADSCrossRefGoogle Scholar
- Ruohoniemi, J.M., and K.B. Baker. 1998. Large-scale imaging of high-latitude convection with super dual Auroral Radar network HF radar observations. Journal of Geophysical Research 103 (20): 797.Google Scholar
- Shepherd, S.G., and J.M. Ruohoniemi. 2000. Electrostatic potential patterns in the high latitude ionosphere constrained by SuperDARN measurements. Journal of Geophysical Research 105 (23): 005.Google Scholar
- Shi, Y., D.J. Knipp, T. Matsuo, L. Kilcommons, B.J. Anderson. 2019. Modes of field-aligned currents variability and their hemispheric asymmetry revealed by inverse and assimilative analysis of Iridium magnetometer data. Journal of Geophysical Research Submitted.Google Scholar
- Solomon, S.C., P.B. Hays, and V.J. Abreu. 1988. The auroral 6300 Å emission: Observations and modeling. Journal of Geophysical Research 93 (A9): 9867–9882. https://doi.org/10.1029/JA093iA09p09867.ADSCrossRefGoogle Scholar
Copyright information
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.