The database presented in this study has been acquired during the SOuth west FOGs 3D (SOFOG3D) experiment for processes study. This international campaign led by Météo-France during the winter 2019–2020 aimed at deploying a unique network of both in situ and remote sensing measurements in order to document spatial and temporal variabilities of fog events. To support this scientific objective but also to conduct first data assimilation experiments within the French convective scale model AROME, an un-precedented network of 8 ground-based microwave radiometers (MWR) has been deployed in 7 different locations known to be prone to fog occurrences. The database gives access to vertical profiles of temperature and humidity (both absolute and relative) from the surface up to 10 km altitude as well as integrated water vapor and liquid water path estimates. The retrieved profiles offer a very large database that can be exploited for several scientific purposes: fog process studies at specific location, documentation on the variability of fog properties at the regional scale, better understanding of the atmospheric boundary layer (ABL) height and dynamics during wintertime conditions, development of nowcasting products dedicated to fog alerts, data assimilation experiments to improve fog forecasts, development of synergetical advanced products, and evaluation of new model configurations with advanced parameterization or resolutions.
Though fog events highly affect transport safety with potentially large economical and human losses (Gultepe et al. 2007), accurately forecasting fog occurrence at an exact time and location still remains difficult for the current numerical weather prediction (NWP) model. This is due to the high number of non-linear fine scale processes taking part in the fog life cycle which are not yet all entirely understood. Fog is also known to be highly sensitive to initial conditions especially temperature and humidity initialization (Bergot and Guedalia 1994; Bergot et al. 2005; Hu et al. 2014). However, a significant observation gap is observed in the atmospheric boundary layer (ABL) which is undersampled compared to surface observations over continental regions or the free troposphere well sensed by satellite data. In this context, an un-precedented network of 8 ground-based microwave radiometers (MWR) has been deployed in the South-West of France during the SOuth west FOGs 3D (SOFOG3D) experiment for processes study (Martinet et al. 2020). MWRs can provide vertical profiles of temperature and absolute humidity at a very high temporal resolution (1 s to a few minutes) under all-sky conditions but rain up to 10 km altitude (Cimini et al.2006; Löhnert and Maier 2012; Martinet et al. 2015; 2017). Additionally, MWRs provide reference measurements for highly accurate integrated water vapor (IWV) contents and liquid water path (LWP) also provided in the database. Besides the usefulness of an accurate description of the ABL before fog formation, during fog mature phase and at fog dissipation to better understand physical processes driving the fog life cycle (Temimi et al. 2020), recent studies have highlighted the expected benefit of MWR observations for data assimilation experiments in view of improving fog forecasts (Martinet et al. 2020). This is why, supported by a strong European collaboration through COST Actions ES1303 TOPROF (Illingworth et al. 2019) and CA18235 PROBE (Cimini et al. 2020), an international network of MWRs has been deployed with the primary objective to conduct data assimilation experiments within the French convective scale model AROME (Application of Research to Operations at MEsoscale, Seity et al. (2011)). Assimilation experiments using 3D-Var and advanced 3D-EnVar data assimilation schemes are currently on-going.
2 Data description
MWRs can measure brightness temperatures (BT) in two spectral-bands: the K-band from 22.24 to 31 GHz to retrieve humidity (Q) profiles, integrated water vapor (IWV) content and liquid water path (LWP), and the V-band from 51 to 58 GHz to retrieve temperature (T) profiles. Elevation scans are also used to increase the vertical resolution of temperature profiles. This dataset comes from 7 multi-channel MWRs manufactured by Radiometer Physics GmbH (RPG) and a single-channel MWR manufactured by RPO Attex in cooperation and support with IfU GmbH. Optionally, a broadband infrared radiometer measuring the downwelling emission between 9.6 and 11.5 μm is attached to the RPG radiometer housing to improve LWP retrievals through an improved cloud base detection. During the SOFOG3D experiments, all temperature and humidity RPG MWRs were alternating boundary layer scans in 10 elevation anglesFootnote 1 every 10 min with zenith measurements at 1-s time resolution.
The Attex MTP-5 instrument is measuring BT at 56.6 GHz and is dedicated to the temperature profiling up to 1 km altitude with a time resolution of 5 min (Troitsky et al. 1993; Westwater et al. 1999). To improve the vertical resolution, the MTP-5 radiometer was scanning in 9 elevation angles.Footnote 2
The location, operating institution, MWR generation, and retrieved variables at each site are defined in Table 1. The position of the different MWR units is shown in Fig. 1. Figure 2 shows the data availability for each MWR unit through the whole period of the field campaign. Following the definition of fog events provided by Tardif and Rasmussen (2007), Table 2 provides a synthesis of the total number of fog events observed at each instrumented site. Please note that the total number of fog events detected depends on the availability of visibility measurements, which might differ from one site to another. The period of availability of visibility measurements is thus provided as an additional information in Table 2 as well as the type of visibility sensor deployed at each site. The database thus contains a total of approximately 424 fog events observed at different locations, the site of Agen being the most prone to fog occurrences with a total number of 103 fog events detected while only 15 fog events have been observed at the site of Biscarrosse.
Level1 products correspond to raw BT measurements for each MWR site as well as the infrared radiometer brightness temperatures when this optional instrument is available and are described in Table 3. Examples of level1 data from the RPG and Attex instruments are shown in Figs. 5 and 7.
The MTP-5 single-channel radiometer has its own continuous self-calibration procedure ensuring a good stability of BT measurement. For HATPRO multi-channel radiometers, a liquid nitrogen calibration needs to be performed at the minimum twice per year in order to get the most optimal calibration coefficients to convert detected intensities into BTs. A liquid nitrogen calibration was thus performed for all radiometers on-site at the beginning of the experimental campaign. The quality of BT measurements from HATPRO MWRs, which accuracy depends on liquid nitrogen calibration, was thus monitored during clear-sky periods through the comparison of observations minus BT simulations from the AROME model. The method is described in De Angelis et al. (2017) and Martinet et al.(2015, 2017, 2020). Only channel 3 (23.84 GHz) of the MWR deployed at Charbonniere was found to be affected by a hardware failure. This channel has thus been removed in all level2 processing. For all the other HATPRO MWRs, only channel 5 (26.24 GHz) of the MWR deployed at Mont-de-Marsan was found to be affected by a large bias of 5 K. Contrary to the MWR at Charbonniere, this bias does not come from a hardware failure. It is roughly constant in time and can easily be corrected before the retrieval of level2 products. This first dataset release does not apply any bias correction of BT before level2 processing; the impact of a bias correction applied to BT measurements will be investigated in the future and may lead to a revised dataset release.
MWR measurements of BTs are then inverted into temperature and humidity profiles as well as IWV and LWP products. In this dataset, neural networks were developed for the RPG MWRs in collaboration with the manufacturer. Neural networks were trained from 3 years (25,000 profiles) of 1-h forecasts extracted from the french convective scale AROME model converted into the equivalent BT with a radiative transfer model taking into account an instrumental noise dependent on the instrument generation. The algorithm used is a feed-forward neural network with one hidden layer. The transfer function is tangent hyperbolic and the number of neurons in the hidden layer depends on the variable to be retrieved, the number of channel used, and the number of angles in the case of elevation scans (5 for LWP and IWV, 15 for temperature profiles with elevation scan, 15 for humidity profiles, 12 for temperature profiles zenith-only). Training of the neural network is done with standard backpropagation algorithm and adaptative learning parameters (self-written software, proprietary code).
Three temperature retrieval files are provided:
TABL files correspond to boundary layer temperature profiles every 10 min on 54 discrete levels up to 2500 m;
TAT files correspond to full troposphere temperature profiles every second on 93 discrete vertical levels up to 10 km altitude. This product only uses zenith measurements;
TACOMP files correspond to composite temperature profiles on 93 vertical levels up to 10 km altitude obtained by combining the TABL profiles with the TAT profiles.
Humidity profiles are retrieved on 93 vertical levels with a variable spacing from surface up to 10 km altitude.
For the LWP product, an offset correction has been included to improve the LWP accuracy. This correction is based on the identification of clear-sky periods during which a clear-sky LWP offset is calculated. To correct the original LWP values, a linear interpolation between the two closest LWP offset corrections is performed and this offset is subtracted from the original value.
For the Attex MTP-5 MWR, a statistical regularization method (Ilyin and Troitsky 2017) has been used to retrieve temperature profiles on 23 vertical levels. This retrieval method uses pre-calculated auto-correlation temperature matrices obtained from WMO radiosoundings depending on seasons. Figures 3 and 4 provide a flow chart synthetizing the data processing from raw BT measurements to retrieved products for both types of radiometers.
Table 6 provides a full description of all available level2 dataset with corresponding DOI (Fig. 5). Figures 6 and 7 provide an example of the main level2 products available for the RPG and Attex instruments.
The data quality of temperature and humidity products has been validated thanks to radiosonde comparison over 125 profiles launched at three sites: Charbonniere, Agen, and Toulouse (Fig. 8). Please note that radiosoundings are co-located with MWRs at Charbonniere and Agen while they are launched at a distance of 8 kms from the MWR at Toulouse.
MWR temperature retrievals agree well with RS measurements within 1.5 K RMSE below 2 km and 2.5 K below 6 km. Biases are below 0.5 K in absolute value for all sites below 2 km altitude but increase up to 1.5 K at Charbonniere and Toulouse above 4 km and 2 km altitude respectively. For absolute humidity, RMSE are below 1.8 g.m− 3 for all sites up to 6 km altitude with biases below 1.4 g.m− 3.
Table 4 shows that IWV can be retrieved with a RMSE below 0.6 kg.m− 2 at Charbonniere and Agen and below 1.4 kg.m− 2 at Toulouse.
The LWP accuracy has been validated in clear-sky conditions and has shown errors between 1 and 14 g.m− 2 depending on the site which is within the expected LWP product accuracy defined in the literature (Crewell and Löhnert 2003; Marke et al. 2016). The validation of LWP retrievals in cloudy-conditions is a much more complex task where in situ measurements from a cloud droplet probe have to be used. This is beyond the scope of this data paper and will be part of deeper investigation in the future.
The biases and uncertainties obtained from the SOFOG3D MWRs are consistent with those from other datasets for temperature profiles (Cimini et al. 2006; 2011; 2015; Martinet et al. 2015; 2020; Turner and Löhnert 2021). The uncertainty for humidity profiles is also consistent with other studies, while reported biases are either smaller (Cimini et al. 2006; 2011; 2015) or larger (Temimi et al. 2020; Turner and Löhnert 2021) than those obtained here for the SOFOG3D dataset. One possible contribution to the observed humidity bias in the lowest layers may be the use of the lowest V-band channels, which are affected by larger uncertainties in absorption models (Cimini et al. 2018). A bias correction of level1 data will be investigated in the future and may lead to a revised dataset (Tables 5 and 6).
As part of a research project, some MWR units had to face electrical failures as well instrumental breakdown during the experiment. Missing data are thus present within the database.
90∘, 30∘, 19.2∘, 14.4∘, 11.4∘, 8.4∘, 6.6∘, 5.4∘, 4.8∘, 4.2∘
89.5∘, 59.5∘, 44.6∘, 32.7∘, 23.8∘, 14.9∘, 6∘, 3∘, 1∘
Atmospheric Boundary Layer
Artificial Neural Network
Integrated Water Vapor
Liquid Water Path
Numerical Weather Prediction
Radiative transfer model
World Meteorological Organization
Bergot T, Guedalia D (1994) Numerical forecasting of radiation fog. Part I: numerical model and sensitivity tests. Mon Weather Rev 122(6):1218–1230
Bergot T, Carrer D, Noilhan J, Bougeault P (2005) Improved site-specific numerical prediction of fog and low clouds: a feasibility study. Weather Forecast 20(4):627–646
Cimini D, Hewison TJ, Martin L, Güldner J, Gaffard C, Marzano FS (2006) Temperature and humidity profile retrievals from ground-based microwave radiometers during TUC. Meteorol Z 15(1):45–56
Cimini D, Campos E, Ware R, Albers S, Giuliani G, Oreamuno J, Joe P, Koch SE, Cober S, Westwater E (2011) Thermodynamic atmospheric profiling during the 2010 winter olympics using ground-based microwave radiometry. IEEE Trans Geosci Remote Sens 49(12):4959–4969
Cimini D, Nelson M, Güldner J, Ware R (2015) Forecast indices from a ground-based microwave radiometer for operational meteorology. Atmosp Meas Techn 8(1):315–333
Cimini D, Rosenkranz PW, Tretyakov MY, Koshelev MA, Romano F (2018) Uncertainty of atmospheric microwave absorption model: impact on ground-based radiometer simulations and retrievals. Atmos Chem Phys 18 (20):15231–15259
Cimini D, Haeffelin M, Kotthaus S, Löhnert U, Martinet P, O’Connor E, Walden C, Collaud-Cohen M, Preissler J (2020) Towards the profiling of the atmospheric boundary layer at European scale – introducing the cost action probe. Bull Atmos Sci Technol
Crewell S, Löhnert U (2003) Accuracy of cloud liquid water path from ground-based microwave radiometry 2. Sensor accuracy and synergy. Radio Sci 38(3):7–1
De Angelis F, Cimini D, Löhnert U, Caumont O, Haefele A, Pospichal B, Martinet P, Navas-Guzman F, Klein-Baltink H, Dupont J-C (2017) Long-term observation minus background monitoring of ground-based microwave radiometer network. Part 1: brightness temperatures. Atmospheric Measurement Techniques Discussion in review. https://doi.org/10.5194/amt-2017-112
Gultepe I, Tardif R, Michaelides S, Cermak J, Bott A, Bendix J, Müller MD, Pagowski M, Hansen B, Ellrod G et al (2007) Fog research: a review of past achievements and future perspectives. Pure Appl Geophys 164(6-7):1121–1159
Hu H, Zhang Q, Xie B, Ying Y, Zhang J, Wang X (2014) Predictability of an advection fog event over North China. Part I: sensitivity to initial condition differences. Mon Weather Rev 142(5):1803–1822
Ilyin G, Troitsky A (2017) Determining the tropospheric delay of a radio signal by the radiometric method. Radiophysics Quantum Electron 60(4):291–299
Illingworth AJ, Cimini D, Haefele A, Haeffelin M, Hervo M, Kotthaus S, Löhnert U, Martinet P, Mattis I, O’Connor E et al (2019) How can existing ground-based profiling instruments improve European weather forecasts? Bull Am Meteorol Soc 100(4):605–619
Löhnert U, Maier O (2012) Operational profiling of temperature using ground-based microwave radiometry at Payerne: prospects and challenges. Atmos Meas Tech 5(5):1121–1134
Marke T, Ebell K, Löhnert U, Turner DD (2016) Statistical retrieval of thin liquid cloud microphysical properties using ground-based infrared and microwave observations. J Geophys Res Atmos 121(24):14–558
Martinet P, Dabas A, Donier JM, Douffet T, Garrouste O, Guillot R (2015) 1D-Var temperature retrievals from microwave radiometer and convective scale model. Tellus A 67(1):27925
Martinet P, Cimini D, De Angelis F, Canut G, Unger V, Guillot R, Tzanos D, Paci A (2017) Combining ground-based microwave radiometer and the AROME convective scale model through 1DVAR retrievals in complex terrain: an Alpine valley case study. Atmos Meas Tech 10:3385–3402. https://doi.org/10.5194/amt-10-3385-2017
Martinet P, Cimini D, Burnet F, Ménétrier B, Michel Y, Unger V (2020) Improvement of numerical weather prediction model analysis during fog conditions through the assimilation of ground-based microwave radiometer observations: a 1D-Var study. Atmos Meas Tech 13(12):6593–6611
Seity Y, Brousseau P, Malardel S, Hello G, Bénard P, Bouttier F, Lac C, Masson V (2011) The AROME-France convective-scale operational model. Mon Weather Rev 139(3):976–991
Tardif R, Rasmussen RM (2007) Event-based climatology and typology of fog in the New York City region. J Appl Meteorol Climat 46(8):1141–1168
Temimi M, Fonseca RM, Nelli NR, Valappil VK, Weston MJ, Thota MS, Wehbe Y, Yousef L (2020) On the analysis of ground-based microwave radiometer data during fog conditions. Atmos Res 231:104652
Troitsky AV, Gajkovich KP, Gromov VD, Kadygrov EN, Kosov AS (1993) Thermal sounding of the atmospheric boundary layer in the oxygen absorption band center at 60 ghz. IEEE Trans Geosci Remote Sens 31(1):116–120. https://doi.org/10.1109/36.210451
Turner DD, Löhnert U (2021) Ground-based temperature and humidity profiling: combining active and passive remote sensors. Atmosp Meas Techn 14 (4):3033–3048
Westwater E, Han Y, Irisov V, Leuskiy V, Kadygrov E, Viazankin S (1999) Remote sensing of boundary layer temperature profiles by a scanning 5-mm microwave radiometer and RASS: comparison experiments. J Atmos Oceanic Tech 16 (7):805–818
Data are managed by the French national center for Atmospheric data and services AERIS. This article is based upon work from COST actions ES1303 TOPROF and CA18235 PROBE supported by COST (European Cooperation in Science and Technology, www.cost.eu). We thank Domenico Cimini for supporting this project since the beginning and for helpful discussions during the review process. We also acknowledge the helpful comments from two anonymous reviewers to improving the article.
The SOFOG3D field campaign was supported by METEO-FRANCE and ANR through grant AAPG 2018-CE01-0004. The MWR network deployment was carried out thanks to support by IfU GmbH, the University of Cologne, the Met-Office, Laboratoire d’Aérologie, Meteoswiss, ONERA, and Radiometer Physics GmbH.
The authors declare no competing interests.
Availability of data and material
The data described in this data note can be freely and openly accessed on https://sofog3d.aeris-data.fr/catalogue/. Please see Tables 3 and 6 for details and links to each dataset.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
All the authors contributed to the instrumental deployment of microwave radiometers. Pauline Martinet and Vinciane Unger conducted the scientific evaluation, data preparation, and the data delivery on the AERIS portal.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Martinet, P., Unger, V., Burnet, F. et al. A dataset of temperature, humidity, and liquid water path retrievals from a network of ground-based microwave radiometers dedicated to fog investigation. Bull. of Atmos. Sci.& Technol. 3, 6 (2022). https://doi.org/10.1007/s42865-022-00049-w
- Microwave radiometer
- Brightness temperatures
- Liquid water path
- Integrated water vapor