# AE9, AP9 and SPM: New Models for Specifying the Trapped Energetic Particle and Space Plasma Environment

- First Online:

- Received:
- Accepted:

DOI: 10.1007/s11214-013-9964-y

- Cite this article as:
- Ginet, G.P., O’Brien, T.P., Huston, S.L. et al. Space Sci Rev (2013) 179: 579. doi:10.1007/s11214-013-9964-y

- 47 Citations
- 1.1k Downloads

## Abstract

The radiation belts and plasma in the Earth’s magnetosphere pose hazards to satellite systems which restrict design and orbit options with a resultant impact on mission performance and cost. For decades the standard space environment specification used for spacecraft design has been provided by the NASA AE8 and AP8 trapped radiation belt models. There are well-known limitations on their performance, however, and the need for a new trapped radiation and plasma model has been recognized by the engineering community for some time. To address this challenge a new set of models, denoted AE9/AP9/SPM, for energetic electrons, energetic protons and space plasma has been developed. The new models offer significant improvements including more detailed spatial resolution and the quantification of uncertainty due to both space weather and instrument errors. Fundamental to the model design, construction and operation are a number of new data sets and a novel statistical approach which captures first order temporal and spatial correlations allowing for the Monte-Carlo estimation of flux thresholds for user-specified percentile levels (e.g., 50th and 95th) over the course of the mission. An overview of the model architecture, data reduction methods, statistics algorithms, user application and initial validation is presented in this paper.

### Keywords

Radiation belt modeling Energetic trapped particles Space environment climatology Space weather## 1 Introduction

Since the launch of simple Geiger counters into space on the first Explorer satellites in 1958 and the subsequent discovery of the Van Allen radiation belts, there have been ongoing efforts to model the space radiation environment. These efforts were—and still are—driven not only by scientific curiosity, but also by the practical need of engineers to understand better and mitigate the significant radiation hazards to spacecraft reliability and survivability. Many anomaly resolution reports and several scientific studies have shown that there is a direct association between the dynamic radiation environment and system or sub-system performance (e.g. Wrenn and Sims, 1996; Koons et al., 2000; Brautigam, 2002). Spacecraft systems and discrete component performance may gradually deteriorate with accumulated dose or may experience abrupt failure (temporary or permanent) due to discrete events associated with Single Event Effects (SEEs) or electrostatic discharge. The radiation environment specification to which system engineers design is a critical factor driving capability versus survivability tradeoffs. Spacecraft flown in orbits where a more severe radiation environment is anticipated require more expensive radiation hardened components and/or greater shielding mass which constrain launch options, limit performance and drive costs higher.

The first definitive empirical models of the radiation belts were sponsored by the National Aeronautics and Space Administration (NASA) and developed in the 1960s–1970s to represent the average radiation environment during the minimum and maximum phase of the solar cycle. They have been incrementally updated since then, the most recent proton and electron models being AP8 and AE8, respectively (Sawyer and Vette, 1976; Vette 1991a, 1991b; Fung, 1996). These radiation belt models are still widely used, having enjoyed close to three decades as industry’s de facto standard. However, there are well-known limitations on their validity including the under-prediction of dose for orbits in the “slot region”, i.e. low inclination orbits between about 6000–12000 km, and no coverage of the hot and cold plasma populations below 0.1 MeV (Fung, 1996; Gussenhoven et al., 1994; Daly et al., 1996; Armstrong and Colborn, 2000; Fennell et al., 2003; Brautigam et al., 2004). The former limitation is especially relevant to dose arising from long-lived higher energy protons (>40 MeV) and electrons (>1 MeV) injected during geomagnetic storms. In addition, the models are simple averages representing either solar maximum (AP8/AE8 MAX) or minimum (AP8/AE8 MIN) with no error bars or cumulative probability distributions provided. A broad consensus has been building over the past decades among both engineers and scientists that a more accurate, comprehensive, and up-to-date space radiation environment model is needed. Modern design and systems engineering techniques require models with error bars, finite-time duration probability distributions, and a larger spectral range, especially as increasingly complex technologies are flown and missions are being considered for non-traditional orbit regimes.

The development of a global space radiation model such as the AP8 or AE8 is a tremendous effort involving the analysis and combination of data sets from numerous missions over periods of time measured in solar cycles. Progress has been made on some fronts by developing models using data acquired onboard the CRRES (Meffert and Gussenhoven, 1994; Brautigam and Bell, 1995), NOAA/TIROS (Huston et al., 1996; Huston, 2002), LANL-GEO (Boscher et al., 2003; Sicard-Piet et al., 2008), SAMPEX (Heynderickx et al., 1999) and Polar (Roeder et al., 2005) satellites. Data assimilative techniques that ingest a variety of data sets to drive physics-based models have also been developed (Bourdarie et al., 2009; Reeves et al., 2012). Whereas the NASA models span the entire inner magnetosphere over a very wide range of energies, these more recent models face various limitations, either in energy range, spatial range (e.g., exclusively at geosynchronous orbit (GEO), medium-Earth orbit (MEO) or low-Earth orbit (LEO)), temporal range (limited to a small portion of the solar cycle), or possibly all three. Although newer individual models may be an improvement for the restricted parameter range to which they apply, it is likely that the NASA models will remain the industry standard until the space physics community develops a single, comprehensive and engineer-friendly replacement model with increased functionality addressing the known deficiencies.

To meet this need the National Reconnaissance Office (NRO) and the Air Force Research Laboratory (AFRL) have supported an effort to develop a new set of models. Denoted “AE9” for trapped energetic electrons, “AP9” for trapped energetic protons and “SPM” for space plasma, the naming continues the “AE”, “AP” convention to maintain an association of functional purpose, i.e. use in space system design. The project has been led by principal investigators from the Aerospace Corporation and MIT Lincoln Laboratory and has involved personnel from AFRL, Boston College, Atmospheric and Environmental Research (AER) and Los Alamos National Laboratory. Development of Version 1.0 (V1.0) of AE9/AP9/SPM was under the auspices of the NRO Proton Spectrometer Belt Research (PSBR) program which also supported the development of the Relativistic Proton Spectrometer (RPS) instruments (Mazur et al. 2012) currently flying on the Van Allen Probes (formerly Radiation Belt Storm Probes, or RBSP). Future versions of the model are expected to include data from RPS as well as the many other particle and plasma detectors on the Van Allen Probes. Furthermore, with AE9/AP9/SPM source code and data sets released in the public domain it is hoped that the national and international radiation belt communities will participate in expanding the data sets and analysis, perhaps working together through an organization such as the National Geophysical Data Center or the Committee on Space Research (COSPAR) Panel on Radiation Belt Models (PRBEM), so as to truly maintain a continually improving standard radiation belt model (perhaps with a new name).

The purpose of this document is to present an overview of AE9/AP9/SPM V1.0 (publicly released in September 2012) for a general audience including both engineers interested in understanding what is behind the application and space scientists interested in contributing data sets and algorithms for future versions. Over five years in development (O’Brien, 2005; Ginet et al., 2008; Huston et al., 2009) the model comprises 33 satellite data sets, is comprehensively cross-calibrated, makes extensive use of spectral inversion techniques and introduces a new statistical methodology for combining the data to produce realistic probabilities of occurrence for varying flux levels along a user-defined orbit. Section 2 reviews the requirements for the model as gleaned from the satellite design community. Coordinate systems and associated grids used in the model are discussed in Sect. 3. Data set processing techniques and cross-calibration are outlined in Sect. 4. The architecture and construction of the model is described in Sect. 5 to include discussion of flux maps, the time-evolution algorithm and user-application. A comparison of V1.0 output to other models and data sets is presented in Sect. 6 and the paper concludes with a summary in Sect. 7. A comprehensive discussion of all the components can be found in the V1.0 Requirements Specification (Ginet and O’Brien 2010), Technical Documentation (Johnston et al. 2013) and User’s Guide (Roth et al. 2013).

## 2 Requirements

Prioritized list of space particle specification requirements for AE9/AP9/SPM. Parentheses indicate higher priority subsets

Priority | Species | Energy | Location | Period | Effects |
---|---|---|---|---|---|

1 | Protons | >10 MeV (>80 MeV) | LEO & MEO | Mission | Dose, SEE, DD, nuclear activation |

2 | Electrons | >1 MeV | LEO, MEO & GEO | 5 min, 1 hr, 1 day, 1 week & mission | Dose, internal charging |

3 | Plasma | 30 eV–100 keV | LEO, MEO & GEO | 5 min, 1 hr, 1 day, 1 week & mission | Surface charging, dose |

4 | Electrons | 100 keV–1 MeV | MEO & GEO | 5 min, 1 hr, 1 day, 1 week & mission | Internal charging, dose |

5 | Protons | 1 MeV–10 MeV (5–10 MeV) | LEO, MEO & GEO | Mission | Dose |

There has been a universal emphasis from the workshops on the need for an authoritative new model recognized by spacecraft buyers and relatively easy-to-use by spacecraft engineers. Given their role in limiting total system lifetimes, energetic ions (10–500 MeV) and electrons (>1 MeV) in the inner magnetosphere (∼400–15000 km altitude) were the primary concern. Models of the poorly characterized lower energy plasma environment (<10 keV) were also a high priority considering the large surface areas and novel materials and coatings under consideration for use in modern space systems. Better characterization of the dynamic MeV electrons (>0.5 MeV) in the slot and outer zone (6000–36000 km altitude) was also universally recognized as important for improving designs to withstand deep dielectric charging events. Relatively low energy protons (1–10 MeV) can cause dose degradation of solar panels and are not yet adequately specified.

In addition to the extended spectral ranges, the new model must also improve upon the statistical description of the space particle distributions. Some regions of energy-location-geophysical activity phase space will be much more accurately described than others and error bars and confidence levels are needed to reflect the uncertainties. Cumulative probability distributions of the flux values time-averaged over different periods (e.g. the 95th percentile of the >1.0 MeV, 12 hour averaged electron flux) are a necessity. The periods of interest are listed in column 5 of Table 1. This is a challenging task considering that the specification must be produced for an arbitrary orbit within the magnetosphere from a model constructed with data from a relatively small number of satellites. Indeed, for V1.0 the resolution for modeling temporal variations at a fixed location is limited to 1 day for electrons, 1 week for protons and is not explicitly captured (other than in the spread of the distribution function) for the plasma. Techniques such as the “sample solar cycle” (see Sect. 7) need to be considered for future versions of the model. For most orbits, variation on finer time scales is dominated by vehicle motion, which is accounted for in the model application at run time.

## 3 Reference Grids

The empirical basis of the AE9/AP9/SPM models is a set of flux maps derived from data measured by particle detectors and dosimeters onboard satellites traversing the radiation belts. Flux map construction requires that many individual flux measurements taken over a large extent of space and a long time span be mapped to a reference grid defined in the context of a specific coordinate system or systems. A judicious choice of coordinate system facilitates the systematic comparison and combination of the data and can significantly reduce spread of flux distribution functions within each grid bin. In particular, coordinates that are invariant over the drift-bounce motion of a particle allow a local angle-resolved flux measurement to be mapped to a 3-D surface, and measurements along an elliptical satellite orbit can therefore cover a 3-D volume.

- (a)
the particle energy

*E*, - (b)the modified second adiabatic invariant
*K*capturing the particle’s bounce motion,where$$ K = \int_{s_{m}}^{s_{m'}} \bigl[ B_{m} - B(s) \bigr]\,ds, $$(1)*B*is the magnitude of the magnetic field along the particle trajectory*s*following a magnetic field line and*B*_{m}is the magnetic field at the particle mirror points*s*_{m},*s*_{m′}, - (c)the third adiabatic invariant
*Φ*capturing the particle’s drift motion,where$$ {\varPhi} = \oint_{C} d \mathbf{L}\cdot \mathbf{A} = \oint_{S} d \mathbf{a}\cdot \mathbf{B} $$(2)**A**is the magnetic vector potential,*C*is a curve encompassing the entire drift shell of the particle,**B**is the magnetic field and*S*is the area outside the drift shell (Roederer, 1970; Schulz, 1996).

*K*,

*Φ*) coordinates were chosen. However, the energy

*E*was chosen instead of the first adiabatic invariant

*μ*(\(\mu=p_{\bot}^{2}/(2mB)\), where

*p*

_{⊥}is the particle perpendicular momentum and

*m*the mass) since most detector channels measure a range of both energy and pitch-angle

*α*, making the spread of measured

*μ*much wider than just the spread in

*E*. The more intuitive Roederer

*L*-shell

*L*

^{∗}is calculated from

*Φ*at a given magnetic epoch according to,

*k*

_{0}is the magnetic dipole parameter equal to

*μ*

_{0}

*M*

_{E}/(4

*π*) with

*μ*

_{0}the magnetic permeability of free space and

*M*

_{E}the Earth’s dipole moment.

For all coordinate and mapping calculations, the Olson-Pfitzer Quiet model (OPQ77) (Olson and Pfitzer 1977) was used for the external magnetic field and the International Geophysical Reference Field (IGRF) model (IGRF 2012) was used for the internal magnetic field. The IGRF was evaluated at the epoch appropriate for when the data was taken (for model construction) or for the orbit of interest (for user application). The OPQ77 model represents all major magnetospheric current systems and is valid for all tilt angles, i.e., angles of incidence of the solar wind on the dipole axis, and accurately represents the total magnetospheric magnetic field for conditions of low magnetic activity and to a geocentric distance of 15 *R*_{E} or to the magnetopause. OPQ77 has been shown to be a good average model for the inner magnetosphere (Jordan, 1994; McCollough et al., 2008). Although the data used in AE9/AP9/SPM were taken at all levels of magnetospheric activity, it was decided that using an activity-dependent model would be inappropriate. If an activity-dependent field model were used to map the data, the same field model would be required to “un-map” the data for a specific application. Since a user would not know *a-priori* what the activity level would be for a future mission, using such a field model would not have any practical benefit. Therefore, any deviations associated with calculating the mapping coordinates with the OPQ77 model compared to a “truer” magnetic field model are manifested in the spread in the particle distribution within each grid bin and captured by the distribution function parameterization of the flux maps (Sect. 5.1).

There are many advantages to using the adiabatic invariants as coordinates but there are also several disadvantages. For example, at low altitudes the particle flux is controlled more by the thermospheric neutral density than by the magnetic field; thus the flux is a strong function of altitude and is also affected by the density variation over the solar cycle. Another complication is the difference between the drift loss cone and the bounce loss cone. Electrons in particular can be scattered onto drift shells which intersect the surface of the Earth at some point. As the electrons drift eastward eventually they are lost due to atmospheric interactions when the local bounce loss cone becomes equal to the drift loss cone. Although these electrons are not permanently trapped, they are a persistent population and should be included in the trapped particle models. For these reasons the (*E*,*K*,*Φ*) coordinate system does a poor job representing flux variations in and near the loss-cone. To overcome this limitation an additional coordinate *h*_{min}, defined as the minimum altitude a particle reaches during its drift-bounce orbit, has been introduced in AE9/AP9/SPM to map the region below 1000 km. Obtained as a by-product of the *Φ* computation, *h*_{min} is much better than *Φ* for tracking variations in the particle distributions at low altitudes where the flux gradients are large.

Adiabatic coordinates are also less useful for the lower energy plasma where there is a strong magnetic local time (MLT) dependence and effects from electric fields and plasma waves. Consequently, the more traditional McIlwain *L*-shell *L*_{m} (McIlwain 1961) and equatorial pitch angle *α*_{eq} will be used for the space plasma models instead of (*K*,*Φ*). Though MLT variations are substantial for energies less than approximately 100 keV, the main purpose of the SPM is to establish the statistics of particle flux exposure for satellites on mission time scales, i.e. usually much longer than one day. To avoid the overhead of tracking another degree of freedom in V1.0, the MLT variations of the plasma have not been included in the SPM and are left to future versions. Because the data and simulation capabilities are not yet available to represent the spatiotemporal covariances of plasmas, the statistical linear regression model (Sect. 5.2) has also not been developed for plasmas in V1.0.

*E*,

*K*,

*Φ*), (

*E*,

*K*,

*h*

_{min}) and (

*E*,

*L*

_{m},

*α*

_{eq}) reference grids used in V1.0. The bin size (i.e. distance between grid points) was chosen to be small enough to provide adequate spatial and spectral resolution, yet large enough to contain a statistically significant number of measurements. Grid spacing for (

*K*,

*Φ*) was selected to be uniform in

*K*

^{1/2}and log

_{10}(

*Φ*) to improve resolution near the magnetic equator (small values of

*K*) and at large values of

*Φ*(the inner zone). Note that

*h*

_{min}includes negative values to accommodate particles not in the bounce loss cone for some range of longitudes, but definitely in the drift loss cone. Energy resolution is a mix of both linear and logarithmic with the specific grid values chosen to be consistent with the AP8, AE8, and CAMMICE/MICS models. Component models of SPM are denoted SPMH, SPMHE, SPMO and SPME representing the hydrogen, helium, oxygen and electron constituents, respectively. For SPME the grid is consistent with the LANL/MPA data set (Sect. 4).

Summary of the coordinate grids used in AE9/AP9/SPM. Square brackets denotes the units of the quantity inside

Model | Species | Energy | High Altitude Grid | Low Altitude Grid | ||
---|---|---|---|---|---|---|

2nd Inv. | 3rd Inv. | 2nd Inv. | 3rd Inv. | |||

AE9 | e | 0.04–10 MeV 21 channels | 0≤ Δ( [ | 0.8≤log Δ(log \([{\varPhi}]= GR_{E}^{2}\) | 0≤ Δ( [ | −500< Δ |

AP9 | H | 0.1–400 MeV 22 channels | 0< Δ | |||

SPME | e | 1–40 keV 16 channels | 5≤ Δ | 2≤ Δ | N/A | |

SPMH | H | 1.15–164 keV 12 channels | ||||

SPMHE | He | |||||

SPMO | O |

*E*,

*K*,

*Φ*) and (

*E*,

*K*,

*h*

_{min}) grids. In Fig. 1a the

*y*-axis (

*K*=0) is the magnetic equator, and the loss cone is the boundary with the white region, where fluxes are zero. The inner and outer zones are clearly visible as regions of high flux centered at log

_{10}

*Φ*values of about 0.05 and −0.4, respectively, with the slot region in between. The grey lines indicate the approximate location of the

*h*

_{min}=0 (upper) and

*h*

_{min}=1000 km (lower) contour, the latter being the upper boundary of Fig. 1b. Also shown in the figures are contours of the traditional (

*L*

_{m},

*B*/

*B*

_{0}) coordinates (used in the AP8/AE8 and CRRES models, for example), where

*B*is the magnitude of the magnetic field at a point along the field line corresponding to

*L*

_{m}and

*B*

_{0}is the magnitude of the field at the magnetic equator along the same field line. It can be seen from Fig. 1b that using

*h*

_{min}as a coordinate gives much better resolution of the fluxes at low altitudes (or near the loss cone) where the neutral density and consequently altitude becomes a dominant ordering parameter.

To compute the reference coordinates along the ephemerides of the satellites supplying data to the model the IRBEM-LIB (IRBEM 2012) library of functions was used. Ephemeris data (latitude, longitude, altitude, universal time) were input and the *K*,*Φ*,*h*_{min},*L*_{m} and *α*_{eq} parameters were output. A modification of IRBEM-LIB was required to calculate *h*_{min} in addition to *Φ* and to perform the calculation even if the drift shell dipped below the surface of the Earth. The parameters were calculated for discrete local pitch angles at 10 degree increments between 0 and 90 degrees. If higher resolution was required (e.g. for high pitch-angle resolution sensors) the above computed values were interpolated.

Calculation of the drift shells needed to evaluate *Φ* and *h*_{min} is a computer time-consuming process. Direct computation with the IRBEM-LIB routines was sufficient for construction of the flux maps since there are a relatively small number of ephemerides to compute (Sect. 4). However, in the general application where a user might evaluate many orbits for long periods of time the computational load to convert the flux map coordinates can quickly become unrealistic. A neural network interpolation algorithm was therefore developed to produce *Φ* and *h*_{min} without the computational expense of integrating over an entire drift shell. For a given satellite position and detector look direction the inputs include the Universal Time (UT), day of year, modified Julian day, *I* (\(=K/\sqrt{B}\)) and *B*_{m} thus requiring a trace of the field line only. A similar approach was used by Koller et al. (2009) and Koller and Zaharia (2011) for active magnetic field models. The neural network is an integral part of the AE9/AP9 software allowing *Φ* and *h*_{min} to be calculated almost as quickly as *L*_{m}. The algorithm is augmented with boundary models that specify the location of the loss cone at low altitudes and the onset of anomalous high altitude orbits not modeled, i.e. Shabansky orbits appearing on field lines with multiple magnetic minima (Shabansky 1971) and drift orbits intersecting the magnetopause.

## 4 Data

*t*and geographic position

**x**and the set of (

**x**,

*t*) over the entire mission forms the satellite ephemeris. An expanded satellite ephemeris to include

*K*,

*Φ*,

*h*

_{min},

*L*

_{m}and other reference grid coordinates is computed as described in Sect. 3 with (

**x**,

*t*), energy and local pitch angle used as input.

Satellites and sensors used in AE9 (Electrons), AP9 (Protons) and SPM (Plasma). The columns from left to right give the satellite/sensor (see Appendix A for acronym definitions), approximate orbital parameters (perigee × apogee, inclination), period from which data was taken and the energy range covered by the processed sensor data on the standard model grids. A ^{∗} indicates very sparse data coverage

Satellite/Sensor | Orbit | Temporal range | Energy range |
---|---|---|---|

Protons | (MeV) | ||

CRRES/PROTEL | 350 km × 33000 km, 18 | 07/1990–10/1991 | 2.0–80 |

S3-3/Telescope | 236 km × 8048 km, 97.5 | 07/1976–07/1979 | 0.1– 2.0 |

HEO-F1/Dosimeter | 500 km × 39000 km, 63 | 05/1994–02/2011 | 10–400 |

HEO-F3/Dosimeter | 500 km × 39000 km, 63 | 11/1997–02/2011 | 10–400 |

ICO/Dosimeter | 1000 km circular, 45 | 06/2001–12/2009 | 10–400 |

TSX5/CEASE | 410 km × 1710 km, 69 | 06/2001–07/2006 | 10–400 |

POLAR/IPS | 5100 km × 51000 km, 86 | 02/1996–04/2008 | 0.1–1.0 |

POLAR/HISTp | 5100 km × 51000 km, 86 | 02/1996–04/2008 | 6.0–15.0 |

Electrons | (MeV) | ||

CRRES/MEA/HEEF | 350 km × 33000 km, 18 | 07/1990–10/1991 | 0.1–7.0 |

SCATHA/SC3 | 28000 km × 43000 km, 7.8 | 01/1979–05/1991 | 0.25–4.5 |

HEO-F1/Dos/Tel | 500 km × 39000 km, 63 | 05/1994–02/2011 | 1.5–10.0 |

HEO-F3/Dos/Tel | 500 km × 39000 km, 63 | 11/1997–02/2011 | 0.5–5.0 |

ICO/Dosimeter | 1000 km circular, 45 | 06/2001–12/2009 | 1.0–7.0 |

TSX5/CEASE | 410 km × 1710 km, 69 | 06/2001–07/2006 | 0.07–3.0 |

SAMPEX/PET | 550 km × 675 km, 82 | 08/1992–07/2004 | 2.0–3.5 |

POLAR/HISTe | 5100 km × 51000 km, 86 | 02/1996–04/2008 | 1.0–6.0 |

GPS/BDDII ns18 | 20200 km circular, 55 | 01/1990–05/1994 | 0.25–1.0 |

GPS/BDDII ns24 | 20200 km circular, 55 | 08/1991–12/2000 | 0.25–1.0 |

GPS/BDDII ns28 | 20200 km circular, 55 | 05/1992–09/1996 | 0.25–1.0 |

GPS/BDDII ns33 | 20200 km circular, 55 | 04/1996–05/2004 | 0.25–1.0 |

LANL-GEO/SOPA 1989-046 | 36000 km circular, 0 | 09/1989–01/2008 | 0.05–1.5 |

LANL-GEO/SOPA 1990-095 | 36000 km circular, 0 | 11/1990–11/2005 | 0.05–1.5 |

LANL-GEO/SOPA LANL-97A | 36000 km circular, 0 | 07/1997–01/2008 | 0.05–1.5 |

LANL-GEO/SOPA LANL-02A | 36000 km circular, 0 | 01/2002–01/2008 | 0.05–1.5 |

Plasma | (keV) | ||

POLAR/CAMMICE/MICS | 5100 km × 51000 km, 86 | 03/1997–09/1999 | 1.2–1.64 |

POLAR/HYDRA | 5100 km × 51000 km, 86 | 03/1997–09/1999 | 1.0–40.0 |

LANL-GEO/MPA 1990-095 | 36000 km circular, 0 | 11/1990–11/2005 | 1.0–63.0 |

LANL-GEO/MPA 1991-080 | 36000 km circular, 0 | 11/1991–11/2004 | 1.0–63.0 |

LANL-GEO/MPA 1994-084 | 36000 km circular, 0 | 12/1994–01/2008 | 1.0–63.0 |

LANL-GEO/MPA LANL-97A | 36000 km circular, 0 | 07/1997–01/2008 | 1.0–63.0 |

Flux maps, correlation matrices and other statistical quantities underlying the model (Sect. 5) are all computed from sets of unidirectional fluxes *j* (# cm^{−2} s^{−1} MeV^{−1} sr^{−1}) derived from the measurements of each satellite sensor tagged to the reference grid via the expanded ephemeris. The standard deviation of the natural logarithm of the flux *d*ln*j* is used as the estimate of the uncertainty. Transformation of the typical raw sensor output, e.g. counts/sec, into an estimate of the differential flux with error occurs through an often lengthy process. Data cleaning, spectral inversion, angular mapping, interpolation and cross-calibration are essential components and their application is discussed in this section.

### 4.1 Cleaning

During the course of a mission data from a given sensor can be corrupted due to a variety of issues including design imperfections, fabrication flaws, degradation of components, telemetry errors, background contamination and saturation. Some simple examination procedures can often be used to examine the entire data set and generate rules that define ranges of measurement values, regions of coordinate space or periods of time where the data is suspect and not to be used for model development. Such procedures are applied to the raw data before any sophisticated reduction algorithms (e.g. spectral inversion) which might obscure the problems. The procedures considered for the AE9/AP9/SPM data sets are extensions of those discussed in the PRBEM Data Analysis Procedure document (Bourdarie et al. 2008) and discussed in O’Brien (2012b). Included are (a) scatter plots of measurements in one channel (usually color-coded by time or coordinate, for example) against measurements of another correlated measurement channel such as an adjacent energy or pitch angle channel (identifies single channel problems of all sorts and contamination when the correlated channel is the protons in an electron dosimeter channel, for example); (b) scatter plots of measurements in one channel against measurements in the same channel offset in time (identifies transient spikes); and (c) histograms of the number of occurrences of every possible value of the raw measurement (identifies saturation and bit errors). It is also helpful to plot the data as a function of time for the entire mission with different coordinates color-coded to identify potential time-dependent sensor degradation.

All of the data sets in AE9/AP9/SPM were cleaned with at least one of the procedures and in many cases (e.g. the dosimeters) several of them. Ultimately it is the judgment of the analyst as to how to generate rules on which points to exclude; however, in most cases there are clear anomalies unambiguously associated with certain spatial regions, temporal periods or background flux levels. Once the rules were generated, a new data set for each sensor was created with flags to indicate the bad measurements to be rejected in further analysis.

For the CRRES/PROTEL proton data an explicit background contamination correction was implemented similar to that done by Gussenhoven et al. (1993) but in (*K*,*h*_{min}) coordinates instead of (*L*_{m},*B*/*B*_{0}) coordinates. Unlike the cleaning procedures mentioned above, which simply remove bad points from further analysis, the contamination correction goes further and corrects measured values based on an estimated background. At each measurement interval the (*K*,*h*_{min}) values are computed for all measured pitch angles. The flux value of the first pitch angle bin with *h*_{min}<100 km (a nominal altitude within the loss cone where the trapped proton flux is zero) is then subtracted from the flux values of all bins with *h*_{min}>100 km (the correction) and the entire set of flux values for *h*_{min}<100 km is set equal to zero (the cleaning). Corrections were significant only within the inner zone *L*^{∗}<1.7 and the resulting flux maps were insensitive to different methods for estimating the loss cone.

The CRRES/HEEF and CRRES/MEA sensor data provide a unique LEO-to-GEO view of the trapped energetic electrons and are important in the development of AE9. Both sensors have been analyzed in some detail (e.g. Hanser, 1995; Dichter et al., 1993; Cayton, 2007 and Vampola, 1996) and the data is found in other models, e.g. CRRESELE. Significant additional work was done for AE9 to include more extensive proton contamination removal, spectral correction of MEA data and adjustment of HEEF data at high flux levels (Johnston et al. 2011).

### 4.2 Spectral Inversion and Pitch-Angle Mapping

It is straightforward to assign flux measurements made by sophisticated particle detectors with high spectral and pitch angle resolution (e.g. CRRES/PROTEL and POLAR/HISTp) to specific (*E*,*K*,*Φ* or *h*_{min}) bins by simple interpolation, usually of the log of the flux. These types of detectors are relatively few and far between, however, and spatial and temporal coverage of the radiation belts can be expanded considerably by using measurements from dosimeters. With wide fields-of-view and relatively small numbers of integral energy channels, dosimeters produce data that require a substantial amount of processing in order to assign a unidirectional flux value to a reference grid bin. Sensors listed in Table 3 falling into this category are the ICO/Dosimeter, the HEO-F1/Dosimeter, the HEO-F3/Dosimeter, the TSX5/CEASE dosimeter and broad-channel particle telescope, the LANL-GEO/SOPA telescopes and the GPS/BDDII dosimeters. Given the extensive use of dosimeter data sets in V1.0 and the uniqueness of the processing methods as applied to radiation belt models a brief description is given here.

*C*

_{i}in

*i*=1,…,

*N*dosimeter channels into unidirectional flux

*j*involves inverting in some manner the following relation (e.g. Sullivan, 1971),

*θ*,

*φ*) are spherical coordinate angles describing the field of view in the frame where the

*z*axis is along the detector bore sight,

*ε*

_{i}(

*E*) is the detector efficiency and

*A*

_{i}(

*E*,

*θ*) is the effective area of the detector channel assuming symmetry in azimuth. For V1.0 a two-step process was employed separating out the spectral inversion and angular mapping parts.

*R*

_{i}(

*E*) is the known channel response function defined as,

*a-priori*parameterize the spectral shapes by generating

*L*

^{∗}-dependent basis components derived from the Selesnick Inner Zone Model for protons (Selesnick et al. 2007) and the CRRES/HEEF/MEA data for electrons (Johnston et al. 2010). In the LANL-GEO/SOPA analysis a double relativistic Maxwellian was assumed as the parameterized spectral function.

For the GPS/BDDII, the flux conversion factors were determined through a cross-calibration analysis with CRRES/MEA data (Friedel et al. 2005). Gain settings for each channel were varied as a function of time throughout the mission to maximize the count statistics. This changed the channel energy threshold and consequently a set of fixed ‘virtual’ energy channels was created through interpolation for use in AE9.

A second step of angular mapping is needed to estimate a value for the locally-mirroring unidirectional flux *j*_{90} from the measurements made over the wide fields-of-view characteristic of the dosimeters. This was accomplished by finding the value of *j*_{90} which best generates the measured flux using an *a-priori* model for the local pitch angle distribution. Electron pitch-angle distributions were modeled using the work of Vampola (1996) based on the CRRES/MEA data. Proton pitch-angle distributions were taken from the CRRESPRO model (Meffert and Gussenhoven 1994) with East-West effect directionality corrections applied to the TSX5/CEASE data using the model of Lenchek and Singer (1962). For the HEO, ICO and GPS sensors the look direction of the detector was not known and therefore assumed to be random. Look direction information was available for CEASE/TSX5 and consequently a more accurate mapping to *j*_{90} was obtained.

After the inversion process is complete the net result for a single measurement interval is the flux amplitude *j*_{90} (*E*,*K*,*Φ* or *h*_{min}) where the value of *K* corresponds to locally mirroring particles, and *E* spans the range of standard energy bins where the spectral inversion is valid. Also output is the standard deviation *d*ln*j* which combines the errors of the spectral inversion and angular determination processes. Note that the uncertainty of the initial measurements (Sect. 4.3) is an input to the spectral inversion algorithm. In principle algorithms could be developed which, given knowledge of *A*_{i} and the look direction, determine *j* from the known count rates by simultaneously optimizing over both the *E* and *θ* coordinates. In LEO, where pitch-angle distributions can be sharply peaked, the combined inversion is very sensitive to the pitch-angle distribution models and successful implementation awaits more accurate characterization.

A different angle determination problem arises with the LANL-GEO/SOPA and MPA sensors. Though these sensors have relatively good angular resolution, the LANL-GEO satellites on which they are situated do not have magnetometers. Pitch-angle determination must be made with algorithms which exploit the asymmetries observed in the different angular bins over the course of a spin period (Chen et al., 2005; Thomsen et al., 1996). Not all LANL-GEO satellite data sets have been processed yet to yield the pitch-angle resolved data thereby limiting the data sets available for V1.0 to those listed in Table 3.

### 4.3 Cross-Calibration

Flux measurements exhibit considerable uncertainty due to a wide variety of effects including imperfect sensor electronics, materials degradation, contamination, inadequate calibration and error in spacecraft location, orientation and magnetic environment. Deriving an error budget for each sensor from a detailed bottom-up analysis is an impossible task in most cases. The response of key detector elements was often never measured or recorded, and detailed performance models are rare. Instead, for AE9/AP9/SPM errors were estimated using an on-orbit cross-calibration technique whereby the data from two sensors nominally measuring the same environment ( a “conjunction event”) were compared, the average bias determined and the residual error (after removing the bias) computed. Starting, for each species, with a “reference sensor” deemed to be the most accurate (call this sensor A) the data from a sensor (Sensor B) cross-calibrated with A was adjusted by the bias value and the residual error in the natural log of the flux was assigned as the variance for Sensor A and Sensor B. The next sensor in the chain (Sensor C) was cross-calibrated with Sensor B, and the error assigned to Sensor C was the residual between B and C. A bias was then assigned to Sensor C equal to the product of the A-B and B-C biases so as to put the Sensor C measurements on the same level, on average, as Sensor A. Progressing through a series of conjunction events, as described below, all the sensors were compared and corrected. Data sets of *j* (*E*,*K*,*Φ* or *h*_{min}) with errors *d*ln*j* were derived for each sensor as inputs to the flux map process (Sect. 5.1). There were a few sensor data sets where conjunctions did not exist with other sensors, e.g. S3-3/TEL, in which case a self-calibration was performed using sequential revisits to the same region of phase space to estimate the error with no applied bias corrections. The cross-calibration technique is an extension of Friedel et al.’s (2005) method with the addition of the residual error.

Prior to this inter-comparison the sensor data was processed at the lowest level required to produce a meaningful result. Differential energy channels on one sensor were sometimes summed and interpolated to produce matches with another sensor with different energy channel values or integral response channels. Detailed pitch-angle data was spin-averaged to estimate omni-directional fluxes which were used for comparison. Channels were combined so that for a given sensor-to-sensor pairing the manipulation was done, to the extent possible, on the most accurate sensor to reconstruct the energy channel on the least accurate sensor. Dosimeter channels were compared using geometric factor approximations of the response to turn count rates into integral fluxes, rather than the more complex spectral inversion that was performed after the measurement uncertainties were estimated (Sect. 4.2).

*L*shell magnetosphere in a relatively uniform flux of energetic electrons for extended periods of time, the cross-calibration of the electron sensors has to be done through magnetic conjunctions (Friedel et al. 2005). Measurements from two sensors are compared when they are made in close magnetic proximity at the same time, i.e. the Δ

*L*

_{m},Δ

*B*/

*B*

_{0},ΔMLT and Δ

*t*between the sensors are all small, where MLT is the magnetic local time, and the conjunction occurs in a period of magnetic stability, i.e.

*K*

_{p}<2 for an extended period of time preceding the measurement, where

*K*

_{p}is the planetary magnetic index. In reality, the exact values defining the small Δ criteria have to be adjusted on a case-by-case basis in order to maintain a statistically significant number of comparison points. Typical values chosen were Δ

*L*

_{m}<0.1,Δ

*B*/

*B*

_{0}<0.1 and Δ

*t*<4 hours with measurements made between 4:00 < MLT < 8:00 (dawn) or 16:00 < MLT < 20:00 (dusk) with

*K*

_{p}<2 for the prior 48 hours. The reference sensor was taken to be the combined CRRES/HEEF and CRRES/MEA data set given its broad

*L*-shell coverage and the extensive work that has been done trying to understand the response and correct for contamination (Sect. 4.1). Figure 3 shows the chain of calibration employed in V1.0 for the energetic electron sensors. The choice of conjunctions is not unique in that a single satellite could have conjunctions with several others. In these cases the conjunctions having the most points were used, which were usually the ones giving the best agreement over the entire spectrum. SAMPEX/PET was self-calibrated because even though there were conjunction events with TSX5/CEASE, SAMPEX/PET was a much more accurate sensor requiring no error-inducing spectral inversion.

## 5 Architecture

### 5.1 Flux Maps

*m*50 and

*m*95, respectively, or together as the vector \(\underline{\theta}=(m50, m95)\). An estimate of the uncertainty \(\delta\underline{\theta}\) in each bin is also made. The map generation procedure is illustrated on the left-hand side of Fig. 5 and described in some detail in Appendix B. Both uncertainty in measurement and space weather give rise to the spread of the distribution as quantified by \(\underline{\theta}\). Even if the measurements were perfect there would still be a difference between

*m*95 and

*m*50 due to the natural variations caused by geomagnetic storms, atmospheric heating, co-rotating interaction regions, and other space weather effects over the course of the solar cycle. These variations are implicitly captured in the model by independently tracking flux values corresponding to these two percentiles.

Two elements are crucial for map building: bootstrapping and gap-filling. The former process is a well-established technique whereby statistical quantities (e.g. \(\underline{\theta}\)) are computed by re-sampling with replacement from the observed sample (e.g. Efron and Tibshirani, 1993). Besides an estimate for the quantity itself, bootstrapping provides an estimate for the standard deviation of the quantity (e.g. \(\delta\underline{\theta}\)) and is very useful in “rolling up” uncertainties at lower levels of the analysis (e.g. uncertainties in the flux values, interpolation algorithms, etc.) when applied properly.

*a-priori*estimates of the shape of the \(\underline{\theta}\) dependence on the model coordinates derived from the examination of data sets, physics-based modeling and the judgment of an experienced space physicist. There is not a single best template for each species, rather, there are a variety of templates characterizing different dynamic states of the radiation belts. As an extreme example, the distributions of energetic protons and electrons in the slot region look much different before and after the March 1991 geomagnetic storm (Brautigam et al., 1992; Gussenhoven et al., 1993). In V1.0 a number of templates were created by team members based on different combinations of data sets and models as summarized in Table 4. Full reference grid maps for each satellite data set are obtained by using the templates and applying bootstrapping techniques (Appendix B) to capture both the uncertainty in the measurements and that arising from non-unique templates. Templates are very much an art involving data, experience and intuition. More diverse and hopefully accurate templates can easily be accommodated in future builds of the model.

Sources for templates used in developing AE9, AP9, and SPM

AE9 | AP9 | SPM |
---|---|---|

• AE8 profiles • CRRES/MEA + HEEF | • S3-3/TEL + CRRES/PROTEL + TSX5/CEASE ( • POLAR/IPS + CRRES/PROTEL + TSX5/CEASE ( | • POLAR/CAMMICE/ROEDER + POLAR/CAMMICE/NIEHOF data (ions) • Milillo model (Milillo et al. 2001) (ions) • POLAR/HYDRA (electrons) |

Transforming the maps of the percentile values and associated uncertainties into maps of flux *j* and uncertainty *d*ln*j* requires the choice of a two-parameter distribution function for each species. Examination of the data from some of the higher resolution sensors (e.g. CRRES/HEEF, CRRES/PROTEL and LANL/MPA) indicates that the Weibull distribution (O’Brien and Guild 2010) is a reasonable choice for the electrons and the lognormal distribution (Evans et al. 2000) is satisfactory for the energetic protons and plasmas. Armed with the functional form of the distribution function the values of (*m*50, *m*95) in each reference grid bin can be readily translated into a distribution of *j*. At this point the model already provides a capability to the user superior to existing models: a map of the flux distribution on the reference grid with an estimate of measurement and mapping uncertainties. Many re-calculations of the *j* distribution using values of \(\underline{\theta}\) randomly perturbed by a small amount consist with the deviation \(\delta\underline{\theta}\) provide estimates of the uncertainty in *j*, or any quantity computable from *j*, arising from the imperfect measurements, data processing and mapping processes.

### 5.2 Time Evolution

**q**represents the principal component amplitudes of the spatial variation of the flux over the reference grid,

**G**

_{k}is the time evolution matrix defined for

*k*=1 to

*N*

_{G}specific time lags

*τ*

_{k}and

**C**is the “innovation” term allocating the white-noise driver to the principal components. The right-hand side of Fig. 5 schematically illustrates how the aforementioned vectors and matrices are constructed from the satellite flux data and Appendix B delves into the details. Suffice it to say that a map of the flux

*j*at time

*t*on the reference grid is uniquely determined by the principal component

**q**(

*t*), the values of the percentile flux map \(\underline{\theta}\) and the choice of distribution function. A random but statistically realistic time-history of flux can be generated from Eq. (7) by choosing a random number seed at

*t*=0 which generates the initial principal component amplitudes

**q**(0) and the percentile parameters \(\underline{\theta}\) constrained by the uncertainty \(\delta\underline{\theta}\).

For AE9 *N*_{G}=6 and for AP9 *N*_{G}=4 with the time lags chosen to be 1 day (electrons only), 1 week, 2 weeks (electrons only), 27 days, 6 months and 1 year, i.e. values that capture geomagnetic storm (albeit at low-resolution), solar rotation, seasonal and solar cycle space weather variations. There is no solar-cycle phase dependence in the model, i.e. statistics are computed from all of the data sets independent of phase. The reasoning behind this is (a) missions often last longer than a solar cycle, (b) launch dates are often uncertain in the design phase and (c) solar activity is notoriously unpredictable on solar-cycle time scales. It would simply not be prudent for an engineer to design to a particular phase of the solar cycle. As mentioned in Sect. 3, the plasma models do not contain a dynamic component because an adequate description involves time scales (minutes) and spatial coordinates (MLT) requiring a more sophisticated analysis than undertaken for V1.0.

### 5.3 Application

The primary functionality of AE9/AP9/SPM is a “fly-in” software function. A user inputs the satellite ephemeris, energy range of interest, model selection and “specification mode” and is returned a time series of the flux values for the requested energy channels along the orbit. There are three specification modes delineated by the method by which the flux values are determined in each coordinate bin along the orbit: (a) mean—using only the average values for \(\underline{\theta}\) to compute the mean flux in each reference grid bin; (b) perturbed mean—using the average \(\underline{\theta}\) plus a random perturbation consistent with \(\delta\underline{\theta}\) to compute the mean flux in each bin and (c) full Monte-Carlo using the autoregressive time-evolution model with a random initial condition **q** and perturbed \(\underline{\theta}\) for flux conversion. The mean fly-in mode captures the mean behavior of the model with no uncertainty added while the perturbed mean adds the uncertainty in the flux maps due to measurement and gap-filling errors. A full Monte-Carlo run contains all of the perturbed mean uncertainty plus an estimate of the dynamic variations due to space weather processes.

The fly-in function in V1.0 is provided by a C++ object with wrappers available in C and Fortran. An application tool has also been built by the AE9/AP9/SPM team which provides an orbit propagator, scenario generator and aggregator for sets of perturbed mean and Monte-Carlo runs. It is accessible by both a command line and graphical user interface. Output is in the form of simple plot and text files. The SHIELDOSE-2 application is included as well as the historical AE8/AP8 (Sawyer and Vette, 1976; Vette, 1991b), CRRESELE (Brautigam and Bell 1995), CRRESPRO (Meffert and Gussenhoven 1994) and CAMMICE/MICS (Roeder et al. 2005) models. Plans are underway to ultimately host the project on an open source repository to facilitate broad collaboration.

## 6 Verification and Validation

Verification and validation are essential for any model aspiring to be an engineering application. That is, the model must run according to design and produce results consistent with independent data. These steps are especially important for AE9/AP9/SPM given the uniqueness and complexity of the algorithms and the diversity of the data sets.

With any Monte-Carlo (MC) type model, the statistics always improve with the number of runs performed. In testing V1.0 each perturbed mean or MC demonstration consists of 40 scenarios. Though somewhat arbitrary, this number is computationally realizable (see below) and dictates that the scenario with the 2nd largest magnitude defines the 95th percentile. The primary test suite runs the full set of models AE9, AP9, SPMH, SPMHE, SPMO and SPME in mean, perturbed mean and MC (where applicable) modes for 8 different orbits to include 3 in LEO (400 km, 800 km and 1200 km, circular, 90^{∘} inclination), GTO (500 km × 30600 km, 10^{∘} inclination), HEO (1475 km × 38900 km, 63.4^{∘} inclination), MEO (3900 km × 14100 km, 120^{∘} inclination), GPS (20200 km, circular, 55.0^{∘} inclination) and GEO (35786 km, circular, 0^{∘} inclination). The mission time was taken to be one week, certainly shorter than a typical real-world mission but long enough to observe the dynamic effects in the model. Several examples from the test suite will be presented in Sect. 6.1 and compared with historical data. Other runs were done for much longer periods and are compared to data in Sect. 6.2. As might be expected, execution of the test suite uncovered a number of data set and algorithm issues, many which have been fixed but some which have not (Sect. 7).

Computer runtimes for AP9/AE9/SPM V1.0 in mean, perturbed mean (40 scenarios) and Monte-Carlo (40 scenarios) modes covering different orbit regimes. Benchmarks were done on a standard desktop 3.4 GHz Intel Core i7-2600 CPU

Run time (minutes) | |||||||
---|---|---|---|---|---|---|---|

1 day mission | 1 year mission | ||||||

Orbit | Time step (sec) | Mean | Pert. Mean (40 Scenarios) | Monte-Carlo (40 scenarios) | Mean | Pert. Mean (40 Scenarios) | Monte-Carlo (40 Scenarios) |

GEO | 3600 | 6.7E−03 | 1.7E−02 | 1.4E−01 | 2.5E+00 | 6.2E+00 | 4.9E+01 |

MEO | 300 | 8.1E−02 | 2.0E−01 | 1.6E+00 | 3.0E+01 | 7.4E+01 | 5.9E+02 |

HEO | 60 | 4.0E−01 | 1.0E+00 | 8.1E+00 | 1.5E+02 | 3.7E+02 | 3.0E+03 |

LEO | 10 | 2.4E+00 | 6.1E+00 | 4.9E+01 | 8.9E+02 | 2.2E+03 | 1.8E+04 |

### 6.1 Comparison to Models

It is clear that AE9 indicates significant uncertainty in the levels of energetic electrons at GEO as demonstrated by the wide spread in the MC scenario runs. This is not surprising, since this population is known to be highly variable at GEO, existing at the whim of dynamic processes in the plasma sheet and the impact of high-speed solar wind streams. The amplitude of the spectra for the AE9 mean is often higher than the historic models (Fig. 8c) though the median value is in closer agreement and all the models are within the uncertainty of the 40 MC scenarios (Fig. 8d). There can also be differences between the historical models of similar or greater magnitude than their disagreement with AE9.

### 6.2 Comparison to Data

Validating AE9/AP9/SPM with independent measurements is a challenge because good data in the radiation belts are scarce and the temptation to include it all in the model is strong. Nevertheless, the temptation was resisted and several data sets were excluded to serve as a check on the final V1.0 product. Data cleaning and cross-calibration of the type discussed in Sect. 4 were not performed on the validation data and the nominal energy channels and geometric factors available publicly or from the instrument Principal Investigators were used without modification. Consequently, comparison of the model predictions to the observations presented in this section should be taken with a grain of salt—the model is certainly not perfect but the data are imperfect as well. Similar to the test suite and model-to-model comparisons, the validation served its purpose by uncovering a number of issues in preliminary versions of AE9/AP9/SPM.

^{∘}inclination orbit and the constellation has been operational since 1978. Data from POES N15 in the 13 year interval from Jul 1998–Dec 2011 were used as illustrated in Fig. 11 showing the >36 MeV channel data in the form of latitude-longitude maps for the median (Fig. 11a) and 95th percentile (Fig. 11c) flux values. Figures 11b and 11d show the corresponding AP9 median and 95th percentile maps, respectively, computed for a 3.5 year interval with 40 MC runs. Computer runtime restrictions precluded a direct 13 year AP9 simulation with 40 MC runs. Agreement is reasonable both in location and intensity with the POES data tending to be somewhat more intense. This can be seen in Fig. 12 where the >36 MeV fluence for each year of the POES data is plotted against one year of AP9 output. Most of the POES curves are between the median and 95th percentile of AP9, and the AP9 median is above the AP8 MIN curve as discussed previously.

^{∘}orbit during the period Jan 2005–Dec 2010 (Sauvaud et al. 2006). Figure 13 contains maps of the median and 95th percentile >0.322 MeV electron flux as measured by the DEMETER/IDP over 6 years (Figs. 13a and 13c) and computed from 40 MC AE9 runs for 1 year (Figs. 13b and 13d). The similarity of the general morphology of the SAA and the outer belt horns is comforting but there are some substantial differences. For example, AE9 underpredicts the median in and around the SAA, it overpredicts the 95th percentile in the same areas and it does not capture some of the 95th percentile activity in the slot regions. Indeed, AE9 suffers from a lack of electron data near the SAA manifesting itself though interpolation with templates inspired by CRRES/HEEF/MEA data with TSX5/CEASE and HEO/DOS data at higher (

*K*,

*Φ*) and lower

*h*

_{min}values. Comparing DEMETER/IDP higher energy channels to AE9 the differences are most apparent in the energy range <700 keV and decrease in magnitude with increasing energy.

*less*than DEMETER, indicating a large uncertainty in one or both data sets. With contamination always an issue in the proton-rich SAA and detector fields-of-view an issue for pitch-angle distributions peaked near 90

^{∘}local (Rodger et al. 2010) it is not surprising that in the absence of detailed response function level analysis the data sets do not agree.

## 7 Summary

The AE9/AP9/SPM V1.0 suite of models represents a transformational approach to specifying the radiation environment for modern satellite design applications. Uncertainties in the model predictions are explicitly included yielding a capability to generate arbitrary percentile flux levels (e.g. mean, median, 95th percentile) from either perturbed mean maps capturing mostly the sensor and data reduction uncertainties, or the full Monte-Carlo autoregressive scheme capturing the statistical space weather variations as well. Included in V1.0 are novel statistical algorithms, spectral inversion techniques, multiple coordinates systems and a diverse set of satellite data cleaned and cross-calibrated to the extent realistically achievable given the development program’s finite resources and schedule. Hopefully, the architectural and operational details outlined in this paper are all “under the hood” as far as the design engineer is concerned. Running V1.0 as part of a radiation effects analysis produces a probabilistic assessment that can be traded off at the system level with other bus, payload and mission risks. To a design engineer uncertainty in the environment specification is just uncertainty whether it is rooted in imperfect sensors, interpolation algorithms or the dynamic environment.

There are no reliable data for inner zone electrons at lower energy (<∼600 keV). Spectral and spatial extrapolation of the existing data set can lead to large deviations (e.g., comparison to POES and DEMETER data). However, the problem appears to be no worse than in AE8.

There are no data for high energy protons (>∼200 MeV). AP9 goes out to 400 MeV using a physics-based model extrapolation. Lack of high-energy proton data, a regime especially affecting on-board electronics, is the primary reason for flying the Relativistic Proton Spectrometer (RPS) on the Van Allen Probes (Mazur et al. 2012).

SPMH (plasma hydrogen), SPMHE (plasma helium), SPMO (plasma oxygen) and SPME (plasma electron) models have small error bars which do not adequately reflect the uncertainty in the measurements. There were limited data and spectral smoothness was imposed at the expense of reducing the error bar.

Errors in the primary flux map variables

*m*50 (log50th percentile) and*m*95′ (log95th–50th percentile) were capped at factors of 100 (electrons) and 10 (protons). Large variations in these quantities can quickly lead to obviously unrealistic variations in fluxes derived from our assumed non-Gaussian Weibull and lognormal distributions. This capping does not limit the representation of space weather variation which is captured in*m*95′ and the spatiotemporal covariance matrices.Run times are slow for large numbers of MC runs, especially for LEO.

*j*) data set mapped to the model coordinates along the satellite ephemeris, with an estimate of measurement error (

*d*ln

*j*). The error can be determined by direct observation and modeling of detector performance or by cross-calibration. This new data set becomes just another element of the collection of all data sets on which the automated process building the flux maps and covariance matrices (denoted together as the “runtime tables”) operates. Much hope is riding on the NASA Van Allen Probe mission to provide a rich set of energetic particle and plasma data from the many well-calibrated instruments of good pitch angle and energy resolution. With two satellites in a GTO orbit slated for 2–4 years of operation the coordinate coverage should be excellent. Van Allen Probe data will be used first to validate the performance of V1.0 before being incorporated into a new version of the model.

Even with the planned future data sets there will always be a need for templates (Sect. 5) to extrapolate and interpolate the data across spectral and spatial coverage gaps. Significant effort went into building the templates (Table 4) used in AE9/AP9/SPM but they are by no means unique. Additional templates based on both empirical and physics-based analysis are needed and can be easily integrated into the flux map bootstrap construction process.

The model is also fundamentally limited in that it does not capture the MLT dependence of the plasma nor the space weather variations on time scales of less than a day. Future versions can remedy the former problem in a straightforward manner by incorporating an MLT coordinate. However, the latter problem is likely beyond the capabilities of the current empirically based statistical algorithms given the required spatial and temporal data coverage. A more promising approach is to build a “sample solar cycle (or cycles)” that attempts to reconstruct past particle flux distributions using data, physics-based models, data-assimilation and other statistical techniques (O’Brien and Guild, 2010; Bourdarie et al., 2009). Such a reanalysis could provide an environment with variations on time scales limited only by the fidelity of the physics-based models. A user might then fly a mission through the reference cycle and accumulate model data in order to build the required statistical distribution on any time scale greater than the model resolution. Reanalysis introduces uncertainty through the statistical and physics-based modeling processes in addition to what is already in the data, but such a description might be far better than none when knowledge of the flux statistics for small time-averaged intervals is essential.

Solar proton events were not included in AP9, though they can be the dominant particles providing dose over time periods of hours to days at high altitudes. Merging AP9 with existing statistical models of solar proton events (e.g. Xapsos et al. 1998, 1999) is a worthwhile endeavor which would provide an integrated application of clear value to the satellite design engineers.

Perhaps the most important consideration concerning the future of AE9/AP9/SPM is the necessity of enlisting the effort of other agencies and countries in the development processes. To build a model of the scope of AE9/AP9/SPM V1.0 required a focused effort with a relatively small team and a level of resources that the NRO and AFRL were able to provide. With V1.0 built and released to the public it is the sincere hope of the V1.0 developers that the radiation belt community will eventually take ownership, incorporating new data sets, algorithms (and maybe a new name) to make the model a true global standard.

## Acknowledgements

Many people have been involved in building AE9/AP9/SPM. Much credit is due Clark Groves for getting the project started. The authors especially wish to thank Joe Mazur, Bern Blake, Jim Roeder and Joe Fennell for technical advice on the HEO, ICO and POLAR/CAMMICE data; Richard Selesnick for cleaning and analysis of the SAMPEX/PET and POLAR/HISTp data and for his physics-based proton belt climatology model; Jon Niehof and Jack Scudder for access to their versions of the POLAR/MICS and POLAR/HYDRA data; Jean-Andre Sauvaud for use of the DEMETER data; Don Brautigam, Sebastien Bourdarie, Daniel Boscher, Jay Albert, Kara Perry, Brian Wie and Seth Claudepierre for technical assistance; Bill Olson, Dave Byers, James Metcalf, Michael Starks, Tim Alsruhe and Geoff Reeves for project management; Bob Weigel and Mike Xapsos for ViRBO and LWS-SET website support; Sharon Benedict for graphics support; Dave Chenette and Michael Bodeau for helping define the requirements; and the “short list” of engineers and scientists who tested the beta versions and provided valuable feedback all along the way. This work was supported through Air Force contracts FA8718-05-C-0036, FA8718-10-C-001, FA8721-05-C-0002 and FA8802-09-C-0001 and NASA grant NNG05GM22G.