# Assessing the quality of ionospheric models through GNSS positioning error: methodology and results

- 420 Downloads

## Abstract

Single-frequency users of the global navigation satellite system (GNSS) must correct for the ionospheric delay. These corrections are available from global ionospheric models (GIMs). Therefore, the accuracy of the GIM is important because the unmodeled or incorrectly part of ionospheric delay contributes to the positioning error of GNSS-based positioning. However, the positioning error of receivers located at known coordinates can be used to infer the accuracy of GIMs in a simple manner. This is why assessment of GIMs by means of the position domain is often used as an alternative to assessments in the ionospheric delay domain. The latter method requires accurate reference ionospheric values obtained from a network solution and complex geodetic modeling. However, evaluations using the positioning error method present several difficulties, as evidenced in recent works, that can lead to inconsistent results compared to the tests using the ionospheric delay domain. We analyze the reasons why such inconsistencies occur, applying both methodologies. We have computed the position of 34 permanent stations for the entire year of 2014 within the last Solar Maximum. The positioning tests have been done using code pseudoranges and carrier-phase leveled (CCL) measurements. We identify the error sources that make it difficult to distinguish the part of the positioning error that is attributable to the ionospheric correction: the measurement noise, pseudorange multipath, evaluation metric, and outliers. Once these error sources are considered, we obtain equivalent results to those found in the ionospheric delay domain assessments. Accurate GIMs can provide single-frequency navigation positioning at the decimeter level using CCL measurements and better positions than those obtained using the dual-frequency ionospheric-free combination of pseudoranges. Finally, some recommendations are provided for further studies of ionospheric models using the position domain method.

## Keywords

Ionospheric modeling Single-frequency users Fast Precise Point Positioning (Fast-PPP) Global navigation satellite system (GNSS) International GNSS Service (IGS)## Introduction

In the case of the radio waves transmitted from the global navigation satellite system (GNSS), the Total Electron Content (TEC) of the ionosphere delays pseudorange measurements and advances carrier phase measurements by the same amount (Parkinson et al. 1996). Stand-alone user receivers operating with more than one frequency can eliminate 99.9% of ionospheric refraction by using the so-called ionospheric-free (IF) combination (\(L_{\text{IF}} = \frac{{f_{1}^{2} L_{1} - f_{2}^{2} L_{2} }}{{f_{1}^{2} - f_{2}^{2} }})\) of carrier phase measurements *L*, at two frequencies \(f_{1}\) and \(f_{2}\). By contrast, single-frequency receivers must select one of several ionospheric models (Rush 1986 and references therein) to account for the Slant TEC (STEC) as accurately as possible. Therefore, for this type of user, it is important to assess the error of the ionospheric delay correction model because the uncorrected, i.e., unmodeled, part of ionospheric delay contributes to the absolute positioning error of GNSS-based applications.

Several tests are available to assess the accuracy of global ionospheric models (GIMs). Usually, these assessments rely on a comparison of the ionospheric model prediction, \({\text{STEC}}_{\text{GIM}}\), against an ionospheric truth, \({\text{STEC}}_{\text{ref}}\). Examples of such reference STECs are measurements from dual-frequency space-borne radar altimeters (Imel 1994; Orús et al. 2003). However, errors in such reference values can reach up to several total electron content units (TECUs), where 1 TECU = 10^{16} e^{−}/m^{2} and corresponds to 16 cm at the \(f_{1}\) frequency. Therefore, the applicability of these reference values is limited for assessment of GIMs to within several TECUs of error.

Rovira-Garcia et al. (2016b) presented an assessment of GIMs based on reference values accurate to the centimeter by means of an unambiguous and unbiased geometry-free (GF) combination of carrier phase measurements \(\left( {L_{\text{GF}} = L_{1} - L_{2} } \right)\). Such precise reference values were obtained as \({\text{STEC}}_{\text{ref}} = L_{\text{GF}} - B_{\text{GF}}\), where the carrier phase ambiguities in the GF combination, \(B_{\text{GF}} = N_{1} - N_{2}\), are solved using a network solution (Blewitt 1989). Such integer ambiguity resolution (IAR) of the carrier phase ambiguities \(N_{1}\) and \(N_{2}\) (Banville et al. 2012) exploit Precise Point Positioning (PPP) techniques (Malys and Jensen 1990; Zumberge et al. 1997) to obtain the carrier phase measurements as precise and unambiguous pseudoranges. Despite its accuracy, IAR as part of PPP requires a complex data process where satellite orbits, clocks, and tropospheric delays are estimated at the centimeter level, which limits the applicability of PPP IAR.

Instead of using IAR, a more straightforward strategy to estimate the carrier phase ambiguity term is the so-called Carrier phase to Code Levelling (CCL) process (Mannucci et al. 1998). The carrier phase measurements \(L_{\text{GF}}\) are “leveled” to the GF combination of code pseudoranges, \(P_{\text{GF}} = P_{2} - P_{1}\), by averaging the difference between them for each continuous arc of the samples. Although code multipath produces leveling errors (Brunini and Azpilicueta 2009), the ionospheric references obtained as \({\text{STEC}}_{\text{ref}} = L_{\text{GF}} - \left\langle {L_{\text{GF}} - P_{\text{GF}} } \right\rangle\) exhibit an intermediate accuracy that ranges from 1.4 to 5.3 TECUs (Ciraolo et al. 2007; Rovira-Garcia et al. 2016a) without the use of a complex data handling process.

The STEC correction can be evaluated with the so-called self-consistency test (Orús et al. 2005), in which one carrier phase ambiguity per arc is estimated using least squares (LS) from the differences between \(L_{\text{GF}}\) and \({\text{STEC}}_{\text{GIM}}\). The residuals of the LS fit are the metric for GIM assessment. The advantage of the self-consistency test is its simplicity and its precision. However, its drawback is that it only accounts for the standard deviation of the error; regional biases present in the GIM are neglected because they are absorbed in the arbitrary ambiguity value. In this regard, the methods which previously estimate carrier phase ambiguities, such as IAR or CCL, are more robust for the testing.

Another testing methodology is based on computing position, velocity and time (PVT) of permanent fixed stations with known coordinates and comparing single-frequency positioning errors obtained with different GIMs. The PVT approach to study the accuracy of GIMs is straightforward, as it does not require the complexity of computing reference ionospheric values. However, it faces several difficulties that, if not properly considered, can lead to inconsistent results compared to tests on the ionospheric delay domain, based on the difference between \({\text{STEC}}_{\text{GIM}}\) and \({\text{STEC}}_{\text{ref}}\). This means that the comparison of the accuracy among different GIMs in the position domain can be contaminated by errors other than the ionosphere. For example, when using the Standard Point Positioning (SPP) method in Wu et al. (2013) or Hoque et al. (2015), two major error contributions are code pseudorange measurements (thermal noise and multipath of approximately 1 m or greater), and broadcast satellite orbits and clocks (errors at meter level). Therefore, SPP is limited to the assessment of GIMs within several TECUs of error.

In Orús (2017) and Nie et al. (2018), the error contribution from satellite orbits and clocks was mitigated by using precise products from the International GNSS Service (IGS) that are accurate to a few centimeters (Beutler et al. 1999; Dow et al. 2009). Despite this improvement, some inconsistent results remain when comparing to the conclusions of the PVT assessment presented in Orús (2017) with the assessment based on \({\text{STEC}}_{\text{ref}}\) values presented in Rovira-Garcia et al. (2016b). In particular, such inconsistent results surfaced for the GIM of the Fast Precise Point Positioning (Fast-PPP) technique, computed using about 150 permanent stations distributed worldwide (Rovira-Garcia et al. 2015), which exploits its accuracy to reduce the convergence time of the PPP navigation solution. In Orús (2017), the GIMs computed by IGS performed similarly to the Fast-PPP GIM. In contrast, in Rovira-Garcia et al. (2016a, b) the Fast-PPP GIM outperformed the IGS GIMs by a factor 2 to 3. This inconsistency has motivated us to use the same data set to compare the same GIMs that are used in Orús (2017). Overall, it is of great interest to investigate whether the accuracy of GIMs can be discriminated using the PVT assessment in a similar manner than using \({\text{STEC}}_{\text{ref}}\) values that require complex geodetic processing.

The goal of this contribution is to analyze the reason for obtaining different results when applying the ionospheric reference values and position domain methodologies. For this purpose, some of the remaining error contributions, such as measurement noise, multipath, and outlier presence, are identified. Some recommendations are provided to perform further tests because the single-frequency PPP assessment of ionospheric models is receiving increasing attention from the ionospheric research community (Prol et al. 2018).

## Data set

Coordinates of the 34 MGEX stations used in Orús (2017) and in the present work, grouped by the receiver manufacturer

JAVAD | TRIMBLE | LEICA | ||||||
---|---|---|---|---|---|---|---|---|

sta | lon | lat | sta | lon | lat | sta | lon | lat |

AUT0 | − 97.73 | 30.23 | ABMF | − 61.53 | 16.16 | KOUG | − 52.64 | 5.07 |

HRAG | 27.68 | − 25.74 | AREG | − 71.49 | − 16.36 | KRGG | 70.26 | − 49.16 |

JOG2 | 110.37 | − 7.71 | CAS1 | 110.52 | − 66.14 | OHI3 | − 57.90 | − 63.17 |

LLAG | − 16.32 | 28.32 | CUT0 | 115.89 | − 31.83 | REYK | − 21.95 | 63.99 |

LPGS | − 57.93 | − 34.73 | DLF1 | 4.39 | 51.80 | THTG | − 149.61 | − 17.47 |

MAO0 | − 156.26 | 20.58 | DYNG | 23.93 | 37.89 | |||

NURK | 30.09 | − 1.93 | FTNA | − 178.12 | − 14.22 | |||

NYA2 | 11.86 | 78.86 | KIR8 | 21.06 | 67.74 | |||

OUS2 | 170.51 | − 45.68 | METG | 24.38 | 60.08 | |||

RIO2 | − 67.75 | − 53.60 | NKLG | 9.67 | 0.35 | |||

SGOC | 79.87 | 6.85 | REUN | 55.57 | − 21.08 | |||

STFU | − 122.17 | 37.24 | STK2 | 141.84 | 43.34 | |||

TASH | 69.30 | 41.14 | TLSE | 1.48 | 43.37 | |||

ULAB | 107.05 | 47.67 | UNB3 | − 66.64 | 45.76 | |||

WUH2 | 114.36 | 30.36 |

To mitigate the errors in the GPS satellite orbits and clocks, we used the Final Combined IGS Products, at a sampling rate of 900 s for orbits and 30 s for clocks. The Antenna Phase Center (APC) corrections for satellite and receivers were obtained from ANTenna EXchange format (ANTEX) files of the corresponding GPS week.

The satellite hardware delay for the P1–P2 Total Group Delay (TGD) was corrected from the GPS broadcast navigation message. This is consistent with the testing methodology presented in Orús (2017), where the GPS broadcast TGDs substituted those computed for Fast-PPP to bring it to the same level as GPS and Galileo regarding TGD broadcasting. Although any GIM should be used in conjunction with their associated TGDs instead of the broadcast values, the agreement among satellite DCBs computed by different IGS Analysis Centers is at the level of a few tenths of nanosecond (Hernández-Pajares et al. 2009). Then, the mismodeling of using the broadcast TGDs is several times lower than the expected errors in the ionospheric delays of the GIMs under test that are in the range of several TECUs (Rovira-Garcia et al. 2016b). Therefore, using broadcast TGDs for all GIMs does not distort the PVT test and all GIMs are affected similarly.

The present comparison includes the same GIMs as in Orús (2017): the Fast-PPP GIM and two GIMs from IGS, namely the Final Combined IGS Product (IGSG, for short) and the Rapid Product from the Universitat Politècnica of Catalunya (UPC) (UQRG, for short). The STEC correction of these GIMs was obtained following the IONosphere map EXchange format (IONEX) standard defined in Schaer et al. (1998). Every IONEX file contains two types of maps for 24 h and with a fixed interval of 15 min (Fast-PPP and UQRG) and 2 h (IGSG). The first set of maps contains the vertical TEC (VTEC) at Ionospheric Grid Points (IGPs), whereas the second set of maps contains the root-mean-square (RMS) error of the VTEC at each IGP. Although the IONEX standard names it as VTEC RMS error, those values are the diagonal elements of the covariance matrix of the VTEC estimation at each IGP. Therefore, the value depends not only on GNSS measurements but also on the constraint equations imposed to fill data holes and to smooth the VTEC values. Assuming a thin-shell model of the ionosphere, we projected the VTEC and its RMS error to slant values according to the secant of the zenith angle at a mean ionospheric height (Parkinson et al. 1996).

The tested GIMs exhibit some differences. First, IGS GIMs use one single layer at an altitude of 450 km to describe the VTEC, whereas the Fast-PPP GIM uses two layers at altitudes of 268 and 1600 km. Second, IGS GIMs were computed with stations covering all longitude ranges, whereas the original Fast-PPP GIMs used in Orús (2017) involved only stations within the longitude range of − 130° to + 130° (Rovira-Garcia et al. 2016a). This was because the original coverage requirement for the Fast-PPP GIM included the longitudes within ± 110°. Since this difference is important, the figures in the manuscript indicate longitudes outside ± 130° with a gray shadow. To overcome this limitation, we have also used recomputed Fast-PPP GIMs, including all longitudes.

In the original computation of the Fast-PPP GIM, the process noise for the IGPs in the southern hemisphere was reduced to compensate for fewer available receivers. In contrast, this constraint was not imposed for the recomputed Fast-PPP GIM, then the process noise does not depend on the receiver density but on the expected ionospheric variability: large process noise is used for IGPs at low latitude and high latitude. In this sense, the recomputed VTEC RMS values in the southern hemisphere are driven mainly by the data because the constraints are down-weighted, which is a more realistic assumption. This results in low values of VTEC RMS located only at IGPs sounded by the reference stations, see the dashed lines in the bottom right panel of Fig. 1.

GIM users can only know how good the ionospheric model has been solved by noticing the magnitude of the RMS error of the VTEC. In general, it is expected that this value is low in well-sounded areas because many receivers are employed to generate the ionospheric correction. Conversely, the RMS error of the VTEC increases with the distance to the reference stations, with the rate of increase being a function of the degree of smoothing that is introduced by means of constraint equations, applied in the generation of the GIMs.

## Methodology

*K*values obtained with LS. The test is executed for every day in 2014 and the postfit residuals are accumulated to have one distribution for every GIM.

The first step in the methodology is to compute the reference position to be used as ground truth. Note that precise coordinates for MGEX receivers are available starting in 2015 (Montenbruck et al. 2017), whereas data collection started in 2014. Thus, the daily reference coordinates were estimated with PPP using \(L_{\text{IF}}\). After 24 h of data collection and coordinates processed in static mode, the typical accuracy is at the centimeter level (Sanz et al. 2013).

The second step is the PVT computation using single-frequency \(f_{1}\). At every epoch, the positioning error of every GIM is evaluated as the difference between the reference position computed in the first step and the coordinates estimated in kinematic mode, with the position coordinates modeled as white noise. We have used two types of measurements for the PVT test: the pseudorange code measurements in order to be consistent with Orús (2017), and CCL measurements to reduce the code noise. Indeed, once the noise of the input measurements has been filtered, the most important remaining source of error is the ionospheric mismodeling. Thus, the accuracy of the ionospheric correction can be properly characterized. Finally, to distinguish PVT errors caused by weak satellite geometries as expressed by high Dilution Of Precision (DOP), the dual-frequency IF solution is also computed using both pseudoranges and CCL measurements.

Using CCL measurements requires two passes over the same data set. In the first pass, the carrier phase ambiguities are determined as the average of the difference between \(P_{\text{GF}}\) and \(L_{\text{GF}}\), per each continuous arc of all samples. In the second pass, we compute the PVT in the navigation filter using CCL measurements as if they were precise pseudoranges. In this manner, carrier phase ambiguities are not estimated in the navigation filter simultaneously with the PVT parameters, which is unlike standard single-frequency PPP in which case the estimated ambiguities absorb part of the mismodeling present in the GIM predictions. Therefore, the error in the ambiguity estimation is translated into the PVT, thus impeding a thorough calibration of the GIM accuracy by means of the PVT error.

Steps 1 and 2 are repeated for each day and for each station. The third and final step is to determine the RMS, mode, mean and percentiles (50th, 68th, 95th) of the positioning error distribution. As we will show later, the distribution of 3D positioning errors is not homogeneous. Thus, reflecting the error by percentiles is better than by simple RMS. For instance, the 95^{th} percentile quantity is the value where 95% of the 3D positioning errors are contained, after having sorted all errors in ascending order.

## Results

The accuracy of the three GIMs has been assessed on the ionospheric delay domain, i.e., using \({\text{STEC}}_{\text{ref}}\), and on the position domain using pseudorange and CCL measurements. The comparison between both test domains allows detecting several difficulties that, if not properly considered, can lead to inconsistent results. The present analysis, which uses the percentiles of the distribution functions of the postfit residuals in (1) and of the 3D positioning errors, complements previous assessments based on the use of the RMS that have been reproduced. Namely, the results of the test defined in Rovira-Garcia et al. (2016b) that rely on precise ionospheric reference values and the results of the single-frequency pseudorange (P1 in short) positioning test presented in Orús (2017).

### Ionospheric delay domain results

Mode, mean, percentiles and RMS of the postfit residuals of the ionospheric domain test for different GIMs

IGSG | UQRG | Fast-PPP | ||
---|---|---|---|---|

Original | Recomputed | |||

Mode | 0.04 | 0.02 | 0.00 | 0.00 |

Mean | 3.44 | 2.64 | 1.32 | 1.11 |

50% | 2.00 | 1.62 | 0.57 | 0.60 |

68% | 3.30 | 2.62 | 1.06 | 1.00 |

95% | 11.13 | 8.27 | 5.03 | 3.81 |

RMS | 6.15 | 4.66 | 2.67 | 2.17 |

### Position domain results with pseudoranges

Figure 2 depicts that the original Fast-PPP GIM produced larger 3D positioning errors than the IF at four stations, as previously acknowledged in Orús (2017). Specifically, at the three stations located at the most western longitudes (FTNA, MAO0 and THTG) and at station SGOC. The origin of the large positioning errors is the same in these four receivers located at latitudes close to the geomagnetic equator, where the ionospheric gradients are important: the nearest reference stations used to derive the original Fast-PPP model were located at large distances causing large RMS errors in the VTEC.

As commented before, we recomputed the Fast-PPP GIMs for 2014. We added eight reference stations to improve coverage of the Pacific ocean, and we increased the process noise of the recomputed Fast-PPP GIMs to provide RMS errors of the VTEC in a more realistic manner. For the receiver SGOC, despite being selected as a reference station, an error parsing the header of its RINEX files prevented its inclusion into the generation of the original Fast-PPP GIM. Thus, the nearest stations to SGOC were located at distances of 723 and 1772 km. This problem has been solved in the recomputed Fast-PPP GIMs.

3D positioning errors obtained with code pseudorange for the dual-frequency IF solution and for the single-frequency solutions using different GIMs

IF | IGSG | UQRG | Fast-PPP | ||
---|---|---|---|---|---|

Original | Recomputed | ||||

Mode | 1.14 | 0.90 (0.84) | 0.78 (0.75) | 0.54 (0.51) | 0.54 (0.51) |

Mean | 2.53 | 2.03 (1.97) | 1.64 (1.50) | 1.64 (1.43) | 1.24 (1.08) |

50% | 1.96 | 1.53 (1.51) | 1.25 (1.16) | 1.08 (0.96) | 0.94 (0.84) |

68% | 2.77 | 2.15 (2.11) | 1.73 (1.60) | 1.60 (1.39) | 1.32 (1.16) |

95% | 6.47 | 5.47 (5.22) | 4.22 (3.83) | 4.91 (4.17) | 3.21 (2.75) |

RMS | 3.28 | 2.71 (2.58) | 2.21 (2.01) | 2.49 (2.17) | 1.71 (1.46) |

Numerically, the RMS values for the single- and dual-frequency 3D positioning errors are similar to those reported in Orús (2017) and Nie et al. (2018). Therefore, the outcome of single-frequency P1 positioning using precise ionospheric models is similar to Orús (2017); accurate GIMs can produce navigation errors smaller than those obtained with the dual-frequency IF code combination. The improvement occurs if the GIM is accurate enough, i.e., the mismodeling present in the GIM is smaller than the amplification factor of the pseudorange noise produced by the IF combination.

The two rightmost columns of Table 3 summarize the improvement of the recomputed Fast-PPP GIMs. The recomputed Fast-PPP GIMs improved the 3D positioning errors at the four stations mentioned above, whereas the results were similar for the remaining 30 stations. Because it concerns errors in the range of several tenths of meters, only the largest percentiles of the positioning error distribution and the RMS are clearly distinct in comparison with the original Fast-PPP GIMs used in Orús (2017). On the contrary, the mode does not vary, and the median is similar. As indicated in Orús (2017), outlier values affect the results of the RMS assessment.

### Assessing the use of RMS as a metric

This subsection addresses the effect of accumulating the positioning errors into a single indicator. In particular, we analyze the suitability of using the RMS of the 3D navigation errors as a widely used metric to compare the accuracy of GIMs.

In the case of the dual-frequency IF solution, large 3D positioning errors are caused by multipath and satellite geometries with large DOP. In addition to these errors, the single-frequency P1 solutions are affected by errors in each GIM, mainly determined by the topology of the network of stations used to derive the ionospheric correction that, as shown in Fig. 1, is neither dense enough nor homogeneous, due to practical reasons; e.g., oceans.

The bottom panel of Fig. 3 shows where the individual distribution of 3D errors is smaller than 5 m. These are cases referring to small DOPs and well-sounded areas, where the GIM corrections are reliable. In such a condition, the GIMs can be thoroughly tested. The peaks of the positioning error distributions, which correspond to the mode values in Table 3, are clearly observed. An important result arises from the comparison of the modes, that is, using the same data and strategy as used in Orús (2017): in well-sounded regions, the original Fast-PPP GIM reduced the mode values of the 3D errors obtained with UQRG and IGSG by 30% and 40%, respectively. In line with the results of Table 2, the mode value of the 3D positioning errors obtained with the recomputed version of the Fast-PPP GIMs is the same as the original Fast-PPP GIMs

In terms of the RMS values of 3D positioning errors, the original Fast-PPP GIM values are 8% lower than those of IGSG and 13% larger than the values of UQRG. On the contrary, the recomputed Fast-PPP GIM improves the RMS of the 3D positioning errors obtained with IGSG and UQRG by 37% and 23%, respectively. This inconsistency is related to the small number of available test receivers in poorly sounded areas outside longitudes ± 130°, highlighted in gray in Fig. 2, that produced large positioning errors, as already observed in Orús (2017).

### Position domain results with CCL

The positioning performance using pseudorange measurements observed for the recomputed Fast-PPP GIM in comparison to the IGS GIMs is still far from the results found in Table 2, where Fast-PPP GIM reduces the RMS errors of UQRG and IGSG by 53% and 65%, respectively. In this subsection, we analyze the positioning errors obtained with CCL measurements which are of lower noise.

Figure 4 depicts how in poor-sounded areas, e.g., stations JOG2 or WUH2, the CCL errors increase compared to Fig. 2. This worsening is attributable to a smaller number of satellites used to compute the PVT solution, after the necessary cycle-slip detection for the CCL process.

3D positioning errors obtained with CCL measurements for the dual-frequency IF solution and for the single-frequency solutions using different GIMs

IF | IGSG | UQRG | Recomputed Fast-PPP | |
---|---|---|---|---|

Mode | 0.27 | 0.75 (0.75) | 0.69 (0.60) | 0.24 (0.24) |

Mean | 0.54 | 1.92 (1.85) | 1.50 (1.41) | 0.88 (0.76) |

50% | 0.43 | 1.31 (1.29) | 1.08 (1.03) | 0.52 (0.46) |

68% | 0.58 | 1.90 (1.86) | 1.52 (1.44) | 0.80 (0.70) |

95% | 1.31 | 5.79 (5.46) | 4.16 (3.84) | 2.83 (2.35) |

RMS | 0.80 | 2.82 (2.67) | 2.21 (2.05) | 1.57 (1.35) |

In contrast, the bottom panel of Fig. 6 depicts 3D positioning errors obtained in nominal conditions were all GIMs can be homogeneously tested: well-sounded areas, good DOPs and low measurement noise. The peak comparison, i.e., the mode, reveals that Fast-PPP reduces the mode values of IGSG and UQRG by 68% and 65%, respectively. This improvement is in line with the results based on reference on ionospheric reference values presented in Table 2 and previous assessments (Rovira-Garcia et al. 2016a, b).

## Summary and conclusions

- 1.
*Sparsity of data*The various GIMs are computed using heterogeneous receivers and different distributions of permanent receivers. Therefore, accuracies of VTEC present in the GIMs are not homogeneous. This is accounted for in the RMS errors included in the IONEX files, which are an essential part of the ionospheric correction that should be taken into account. In this sense, comparative assessments should use receivers situated in well-sounded regions where the RMS errors of the VTEC are rather low. Thus, the accuracy of the PVT is expected to be high. On the contrary, ionospheric corrections are misleading when they are associated with large RMS errors. In such cases, GIM corrections should not be used for testing purposes. - 2.
*Metric*Although the RMS of the positioning error is a widely used metric to assess the accuracy of GIMs, the mode or percentiles of the distribution of 3D positioning errors provide a more robust statistical comparison. The more heterogeneous the actual positioning errors are, the less meaningful the RMS becomes because it is driven by the presence of outlier values in the tail of the error distribution function. - 3.
*Measurement selection and processing*The data used for calibrating the accuracy of GIMs through the PVT error should be as clean as possible from error sources (e.g., multipath, satellite orbits and clocks). In this case, the use of carrier phase measurements is preferable to pseudoranges. Computing the ambiguities offline with the CCL procedure and using the CCL measurements as precise pseudoranges, avoids estimating the carrier phase ambiguities simultaneously with the PVT as in standard single-frequency PPP that absorbs part of the GIM error.

In conclusion, tests based on the position domain are useful assessments that can be performed without a complex processing facility. Once the above-mentioned issues are considered, we are capable of thoroughly assess the accuracy of any GIM and obtain equivalent results to those tests using the ionospheric delay domain. In particular, executing the PVT test with CCL measurements, we showed that, in well-sounded areas, the two-layer Fast-PPP GIM provides mode errors of 0.24 m in 3D, which is several times lower than other GIMs. This result agrees with the tests based on the ionospheric domain presented in previous works.

## Notes

### Acknowledgements

This work was supported in part by the Spanish Ministry of Science, Innovation and Universities Project RTI2018-094295-B-I00 and in part by the Horizon 2020 Marie Skłodowska-Curie Individual Global Fellowship 797461 *NAVSCIN*. The authors acknowledge the use of data and products provided by the International GNSS Service.

## References

- Banville S, Zhang W, Ghoddousi-Fard R, Langley R (2012) Ionospheric monitoring using integer-levelled observations. In: Proceedings of ION GNSS 2012, Institute of Navigation, Nashville, Tennessee, USA, September 17–21, pp 2692–2701Google Scholar
- Beutler G, Rothacher M, Schaer S, Springer T, Kouba J, Neilan R (1999) The International GPS Service (IGS): an interdisciplinary service in support of Earth sciences. Adv Space Res 23(4):631–653. https://doi.org/10.1016/S0273-1177(99)00160-X CrossRefGoogle Scholar
- Blewitt G (1989) Carrier phase ambiguity resolution for the Global Positioning System applied to geodetic baselines up to 2000 km. J Geophys Res Solid Earth 94(B8):10187–10203. https://doi.org/10.1029/JB094iB08p10187 CrossRefGoogle Scholar
- Brunini C, Azpilicueta FJ (2009) Accuracy assessment of the GPS-based slant total electron content. J Geodesy 83(8):773–785. https://doi.org/10.1007/s00190-008-0296-8 CrossRefGoogle Scholar
- Ciraolo L, Azpilicueta F, Brunini C, Meza A, Radicella S (2007) Calibration errors on experimental slant total electron content (TEC) determined with GPS. J Geodesy 81(2):111–120. https://doi.org/10.1007/s00190-006-0093-1 CrossRefGoogle Scholar
- Dow JM, Neilan RE, Rizos C (2009) The International GNSS Service in a changing landscape of global navigation satellite systems. J Geodesy 83(3):191–198. https://doi.org/10.1007/s00190-008-0300-3 CrossRefGoogle Scholar
- Hernández-Pajares M, Juan JM, Sanz J, Orús R, Garcia-Rigo A, Feltens J, Komjathy A, Shaer S (2009) The IGS VTEC maps: a reliable source of ionospheric information since 1998. J Geodesy 83(3):263–272. https://doi.org/10.1007/s00190-008-0266-1 CrossRefGoogle Scholar
- Hoque M, Jakowski N, Berdermann J (2015) An ionosphere broadcast model for next generation GNSS. In: Proceedings of ION GNSS+ 2015, Institute of Navigation, Tampa, Florida, USA, September 14–18, pp 3755–3765Google Scholar
- Ibáñez D, Rovira-Garcia A, Sanz J, Juan JM, Gonzalez-Casado G, Jimenez-Baños D, López-Echazarreta C, Lapin I (2018) The GNSS laboratory tool suite (gLAB) updates: SBAS, DGNSS and global monitoring system. In: Proceedings of 9th ESA workshop on satellite navigation technologies (NAVITEC2018), Noordwijk, The Netherlands, December 5–7, https://doi.org/10.1109/navitec.2018.8642707
- Imel DA (1994) Evaluation of the TOPEX/POSEIDON dual-frequency ionosphere correction. J Geophys Res Oceans 99(C12):24895–24906. https://doi.org/10.1029/94JC01869 CrossRefGoogle Scholar
- Malys S, Jensen PA (1990) Geodetic Point positioning with GPS carrier beat phase data from the CAS UNO experiment. Geophys Res Lett 17(5):651–654. https://doi.org/10.1029/GL017i005p00651 CrossRefGoogle Scholar
- Mannucci AJ, Wilson BD, Yuan DN, Ho CH, Lindqwister UJ, Runge TF (1998) A global mapping technique for GPS-derived ionospheric total electron content measurements. Radio Sci 33(3):565–582. https://doi.org/10.1029/97RS02707 CrossRefGoogle Scholar
- Montenbruck O et al (2017) The Multi-GNSS Experiment (MGEX) of the International GNSS Service (IGS)—achievements, prospects and challenges. Adv Space Res 59(7):1671–1697. https://doi.org/10.1016/j.asr.2017.01.011 CrossRefGoogle Scholar
- Nie W, Xu T, Rovira-Garcia A, Juan JM, Sanz J, González-Casado G, Chen W, Xu G (2018) The impacts of the ionospheric observable and mathematical model on the global ionosphere model. Remote Sens 10(2-AN169):1–13. https://doi.org/10.3390/rs10020169 CrossRefGoogle Scholar
- Orús R (2017) Ionospheric error contribution to GNSS single-frequency navigation at the 2014 solar maximum. J Geodesy 91(4):397–407. https://doi.org/10.1007/s00190-016-0971-0 CrossRefGoogle Scholar
- Orús R, Hernández-Pajares M, Juan JM, García-Fernández M (2003) Validation of the GPS TEC maps with TOPEX data. Adv Space Res 31(3):621–627. https://doi.org/10.1016/S0273-1177(03)00026-7 CrossRefGoogle Scholar
- Orús R, Hernández-Pajares M, Juan JM, Sanz J (2005) Improvement of global ionospheric VTEC maps by using kriging interpolation technique. J Atmos Solar Terr Phys 67(16):1598–1609. https://doi.org/10.1016/j.jastp.2005.07.017 CrossRefGoogle Scholar
- Parkinson B, Spilker J, Enge P (1996) Global positioning system, vols I and II, Theory and Applications. American Institute of Aeronautics, RestonGoogle Scholar
- Prol FdS, Camargo PdO, Monico JFG, Muella MTdAH (2018) Assessment of a TEC calibration procedure by single-frequency PPP. GPS Solut 22(2):35. https://doi.org/10.1007/s10291-018-0701-6 CrossRefGoogle Scholar
- Rovira-Garcia A, Juan JM, Sanz J, González-Casado G (2015) A worldwide ionospheric model for fast precise point positioning. IEEE Trans Geosci Remote Sens 53(8):4596–4604. https://doi.org/10.1109/TGRS.2015.2402598 CrossRefGoogle Scholar
- Rovira-Garcia A, Juan JM, Sanz J, González-Casado G, Bertran E (2016a) Fast precise point positioning: a system to provide corrections for single and multi-frequency navigation. Navigation 63(3):231–247. https://doi.org/10.1002/navi.148 CrossRefGoogle Scholar
- Rovira-Garcia A, Juan JM, Sanz J, González-Casado G, Ibáñez D (2016b) Accuracy of ionospheric models used in GNSS and SBAS: methodology and analysis. J Geodesy 90(3):229–240. https://doi.org/10.1007/s00190-015-0868-3 CrossRefGoogle Scholar
- RTCA (2016) Minimum operational performance standards for global positioning system/wide area augmentation system airborne equipment. Radio Technical Commission for Aeronautics Document 229, Revision EGoogle Scholar
- Rush C (1986) Ionospheric radio propagation models and predictions—a mini-review. IEEE Trans Antennas Propag 34(9):1163–1170. https://doi.org/10.1109/TAP.1986.1143951 CrossRefGoogle Scholar
- Sanz J, Juan JM, Hernández-Pajares M (2013) GNSS data processing, vol I: fundamentals and algorithms. ESA Communications, ESTEC TM-23/1, Noordwijk, The NetherlandsGoogle Scholar
- Schaer S, Gurtner W, Feltens J (1998) IONEX: the IONosphere map exchange format version 1. In: Proceedings of the IGS AC workshop, Darmstadt, Germany, February 9–11, pp 233–247Google Scholar
- Wu X, Hu X, Wang G, Zhong H, Tang C (2013) Evaluation of COMPASS ionospheric model in GNSS positioning. Adv Space Res 51(6):959–968. https://doi.org/10.1016/j.asr.2012.09.039 CrossRefGoogle Scholar
- Zumberge JF, Heflin MB, Jefferson DC, Watkins MM, Webb FH (1997) Precise Point Positioning for the efficient and robust analysis of GPS data from large networks. J Geophys Res Solid Earth 102(B3):5005–5017. https://doi.org/10.1029/96JB03860 CrossRefGoogle Scholar

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.