The Helioseismic and Magnetic Imager (HMI) Vector Magnetic Field Pipeline: Overview and Performance
- First Online:
- Cite this article as:
- Hoeksema, J.T., Liu, Y., Hayashi, K. et al. Sol Phys (2014) 289: 3483. doi:10.1007/s11207-014-0516-8
- 2.4k Downloads
The Helioseismic and Magnetic Imager (HMI) began near-continuous full-disk solar measurements on 1 May 2010 from the Solar Dynamics Observatory (SDO). An automated processing pipeline keeps pace with observations to produce observable quantities, including the photospheric vector magnetic field, from sequences of filtergrams. The basic vector-field frame list cadence is 135 seconds, but to reduce noise the filtergrams are combined to derive data products every 720 seconds. The primary 720 s observables were released in mid-2010, including Stokes polarization parameters measured at six wavelengths, as well as intensity, Doppler velocity, and the line-of-sight magnetic field. More advanced products, including the full vector magnetic field, are now available. Automatically identified HMI Active Region Patches (HARPs) track the location and shape of magnetic regions throughout their lifetime.
The vector field is computed using the Very Fast Inversion of the Stokes Vector (VFISV) code optimized for the HMI pipeline; the remaining 180∘ azimuth ambiguity is resolved with the Minimum Energy (ME0) code. The Milne–Eddington inversion is performed on all full-disk HMI observations. The disambiguation, until recently run only on HARP regions, is now implemented for the full disk. Vector and scalar quantities in the patches are used to derive active region indices potentially useful for forecasting; the data maps and indices are collected in the SHARP data series, hmi.sharp_720s. Definitive SHARP processing is completed only after the region rotates off the visible disk; quick-look products are produced in near real time. Patches are provided in both CCD and heliographic coordinates.
HMI provides continuous coverage of the vector field, but has modest spatial, spectral, and temporal resolution. Coupled with limitations of the analysis and interpretation techniques, effects of the orbital velocity, and instrument performance, the resulting measurements have a certain dynamic range and sensitivity and are subject to systematic errors and uncertainties that are characterized in this report.
KeywordsMagnetic fields, photosphere HMI: vector field Solar active regions
The Helioseismic and Magnetic Imager (HMI, Schou et al.2012b) provides the first uninterrupted time series of space-based, full-disk, vector magnetic field observations of the Sun with a 12-minute cadence. This report summarizes the HMI vector magnetic field analysis pipeline, provides an assessment of the quality of the vector data, and characterizes some of the known uncertainties and systematic errors.
HMI was launched on 11 February 2010 as part of the Solar Dynamics Observatory (SDO, Pesnell, Thompson, and Chamberlin 2012) and began taking continuous solar measurements on 1 May. The HMI investigation (Scherrer et al.2012) studies the origin and evolution of the solar magnetic field and links to the dynamics of the corona and heliosphere by producing long uninterrupted time series of the global photospheric velocity, intensity, and magnetic fields.
Scientific observables are produced by a series of software modules operating in an analysis pipeline. HMI collects filtergrams almost continuously. The Level-0 reconstruction of the instrument data and computation of most quick-look observables is completed within a couple of minutes. Some preliminary analysis is completed using this near-real-time (NRT) data. Validation and filling of gaps in the scientific and housekeeping data stream typically takes a little more than a day, after which the final calibration and processing is initiated to produce definitive Level-1 filtergrams.
HMI magnetic field and related data series available in JSOC.
Data seriesa name
HMI data product
Level 1 Stokes-polarization images – 720 s averages 24 images: I Q U V at six wavelengths
Full-disk line-of-sight magnetic field
45-second full-disk line-of-sight magnetic field
Full-disk line-of-sight Doppler velocity
Full-disk computed continuum intensity
Ic with limb darkening removed
Full-disk computed line width
Full-disk computed line depth
HMI active region patch (harp) geometry information tracked bitmap computed from LoS magnetic field
Full-disk VFISV fd10 Milne–Eddington inversion magnetic and plasma parameters with uncertainties
Disambiguated full-disk vector magnetic field
Vector and scalar field HARPs + active-region indices region tracked for entire disk passage every 720 s
Remapped field patches and AR indices cylindrical equal area projection of Br,Bθ,Bϕ
Velocity-dependent noise masks for vector field
Active regions emerge quickly and span a large range of size and complexity. An automated code identifies and tracks HMI Active Region Patches (HARPs) using the HMI 720-second line-of-sight (LoS) magnetic field and computed continuum intensity images (Turmon et al.2014 and Section 3). HARPs are analogous to NOAA Active Regions, but there are many more smaller patches. HARPs aim to identify complete flux complexes, and so may be larger and incorporate more than one NOAA AR. HARPs follow a region during its entire lifetime or disk passage, beginning one day before the first flux emerges and continuing one day after the region has decayed. The HARP data series, hmi.Mharp_720s, defines the geometry of a rectangular bounding box on the CCD that encloses the maximum heliographic area achieved by a patch during its lifetime. At each time step a rectangular bitmap identifies which CCD pixels lie within the patch.
To recover useful information about the Sun’s vector magnetic field an inversion of the Stokes vector must be performed that requires specific assumptions about the solar atmosphere. Such an inversion can be computationally intensive. Section 4 briefly describes how the fd10 version of the VFISV code (Borrero et al.2011; Centeno et al.2013) that is based on a relatively simple Milne–Eddington atmosphere has been adapted and optimized for use in the HMI pipeline. All images since 1 May 2010 have been processed using a version of fd10 (data series: hmi.ME_720s_fd10).
The inversion applied to each pixel cannot resolve the inherent 180∘ azimuth ambiguity in the transverse field direction (Harvey 1969), so a nonlocal minimization is applied (Metcalf 1994; Barnes et al.2014). The disambiguation is sensitive to noise in the inverted values, which varies spatially and temporally in the HMI data. Section 5 describes the scheme in more detail and Section 7.1 explains the method by which the noise threshold is determined. The disambiguation requires computing resources that increase with the size of the region and when spherical geometry is required; so the near-real-time pipeline routinely processes smaller active region patches in rectilinear coordinates. Disambiguation in spherical coordinates of larger patches has been accomplished using the same module as the definitive data. Pipeline full-disk disambiguation of definitive data has begun for data collected after 19 December 2013.
The disambiguated field is being computed for each active region patch every 12 minutes. From the vector field a representative set of indices is computed that may be of interest for space weather forecasting purposes. The indices include total unsigned flux, current helicity, and mean horizontal field gradient, to name just three; see Section 6. The SHARP (Space-weather HARP) data series (hmi.sharp_720s) includes for each numbered HARP at each time record all of the indices as keywords, as well as data arrays providing maps of nearly all the HMI scalar and vector observables and uncertainties. The pipeline produces a version of SHARPs in the standard CCD coordinates and another that is remapped and projected onto heliographic cylindrical equal area coordinates centered on the HARP, (data series: hmi.sharp_cea_720s). Figure 1 shows the vector field components and derived continuum intensity for HARP 377 (NOAA AR #11158) observed at 19:00 TAI on 14 February 2011. HMI times are given in International Atomic Time (TAI), which is 35 s ahead of UTC in 2013.
The HMI vector field data are of good and consistent quality and the random noise characteristics (about 100 Mx cm−2 in the total magnetic field strength) in quiet regions are consistent with the design specifications of the instrument and the uncertainties intrinsic to the VFISV Milne–Eddington inversion code. The dominant time-varying systematic errors arise from the ±3 km s−1 daily velocity shift of the spectral line due to the geosynchronous orbit of SDO. The effects can be mitigated; nevertheless, daily variations that depend on velocity, field strength, and disk position remain in the data. See Section 7.
Comparison of the LoS magnetic field strength derived from HMI LCP and RCP observations analyzed using the simpler MDI-like method (see Section 2.3 and Couvidat et al.2012) with field strengths obtained using the fd10 inversion show differences at values as low as 1000 G. These arise from difficulties in precisely modeling the spectral line and the detailed instrument spectral characteristics. The dynamic range limitations of the instrument do not become significant until nearly 3000 G (lower in high radial-velocity regions). Comparison with higher 0.3′′-resolution Hinode/SP data qualitatively match the 1′′-resolution HMI observations in AR #11158. However, the flux density and intensity contrast reported by HMI are lower for a variety of reasons, as may be expected, see Section 7.3.2.
1.1 Paper Overview
Section 2 gives more details about the HMI pipeline processing steps relevant to the quality and interpretation of the vector field data through to the production of the Stokes observable. The active region identification and tracking analysis is summarized in Section 3. Section 4 describes the vector field inversion, specifically, improvements to the VFISV code. Section 5 explains the disambiguation processing. The SHARPs are described in Section 6. In Section 7 the sensitivity of the instrument, systematic errors, and other limitations of the data are discussed. The final section provides a summary. Three appendices provide details of the data segments in the final vector field data series, describe differences between the pipeline processing and an earlier released version of the HMI vector field, and give more details about the space weather quantities in SHARPs.
2 The HMI Magnetic Field Pipeline Processing
2.1 The HMI Instrument and Data Flow
Useful web sites with information about HMI magnetic field data.
HMI data product
HMI magnetic field images and data products
Introduction to the data in the JSOC
Introduction to JSOC data series and access
HMI magnetic product information
Description of HARP data series
SHARP coordinates and CEA remapping
Guide to HMI pipeline code and processing notes
Data exploration and request tool for JSOC
Data export tool for JSOC data
Comprehensive guide to SDO data analysis
SDO mission web site
The HMI telescope feeds a solar image through a series of bandpass filters onto two 40962-pixel CCD cameras. Each camera records a full-disk image of the Sun every 3.75 seconds in a 76 m Å wavelength band selected by tuning the final stage of a Lyot filter and two Michelson interferometers across the Fe I 6173.34 Å absorption line. Six wavelengths are measured in different polarizations in a sequence defined by a continuously repeating frame list. One camera measures right and left circular polarization at each wavelength, completing a 12-filtergram set every 45 s from which the Doppler velocity, LoS magnetic field, and intensities can be determined. The second Vector camera measures six polarization states every 135 s: nominally I±V, I±Q, and I±U, where I Q U V are the Stokes polarization parameters. From these the vector magnetic field and other plasma parameters can be derived.
The filtergrams are cropped, effectively truncated to the photon noise limit using a look-up table, and then losslessly compressed before being downlinked in real time to a ground station at White Sands, NM from geosynchronous orbit with a nominal bit rate of 55 Mb/s. The data are decoded, buffered and transmitted to the JSOC at Stanford University with a delay of about a minute. As the first step of the JSOC SDO data analysis pipeline, the telemetry are validated and checked for completeness; they can be retransmitted within 60 days from data retained at White Sands. Level 0 filtergrams are reconstructed and used together with the housekeeping and flight dynamics data to produce calibrated Level 1 filtergrams. The primary HMI observables are computed from these definitive Level 1 filtergrams.
The HMI observables are available since 1 May 2010. There are very few gaps in coverage. However, because of SDO’s inclined orbit, twice yearly, during two-week intervals around March and September, the Earth eclipses the Sun for up to 72 minutes per day near local midnight. Calibrations briefly interrupt the observing sequences each day at 6 UT and 18 UT, and there are occasional disruptions due to eclipses, station keeping, special calibrations, intense rain, ground equipment problems, etc. As one measure, through the end of 2012 98.44 % of the possible 1.876 million 45 s Dopplergrams are available. Instrument performance is constantly monitored and adjustments are made periodically to account for changes in instrument performance, such as focus, filter drift, and optical transmission.
2.2 Stokes Vector Processing Description
Weekly flat fields are obtained by offsetting the HMI field of view (FOV) with the piezo-electric transducers (Wachter and Schou 2009). Periodically observables calculated for a t_rec close to midnight use Level 1 filtergrams corrected with different flat fields. Flat fields are stored in the hmi.flatfield series. Every three months offpoint flat fields are obtained by moving the legs of the instrument.
The HMI cameras are affected by a small nonlinearity in their response to light exposure (see Figure 19 of Wachter et al.2012). This correction, on the order of 1 % for intensities below 12 000 DN/s, is implemented separately for Doppler and Vector camera data. A third-order polynomial, based on intensities obtained from ground-calibration sequences and averaged over the four quadrants of the CCDs, is applied to Level 1 values. The version of this calibration is indicated by the calver64 keyword.
De-rotation: each filtergram is re-registered to correct for the pixel shift caused by solar differential rotation. This correction is made at subpixel accuracy using a Wiener spatial-interpolation scheme. The time difference used to calculate the pixel shift is the precise observation time of the filtergram, t_obs.
Un-distortion: each filtergram is corrected for optical distortions that can be up to a few pixels in magnitude. The instrumental distortion as a function of field position is reconstructed from Zernike polynomials determined during pre-launch calibration using a random-dot target mounted in the stimulus telescope (Wachter et al.2012). The solar disk center and radius of the undistorted images are recalculated. This center and radius are slightly different from the Level 1 values calculated using distorted images.
Centering: each filtergram is spatially interpolated to a common solar-disk center and radius that are averages of the input Level 1 filtergrams used to produce the I Q U V observables at t_rec. These first three steps are performed in a single operation.
Temporal averaging: de-rotated, un-distorted, and re-centered filtergrams are combined with a weighted average for the target time t_rec.
Conceptually, the temporal averaging is performed in two steps. First a temporal Wiener interpolation of the observed filtergrams onto a regular temporal grid with a cadence of 45 s is performed; this results in a set of 25 frames for each wavelength/polarization state constructed using the ten original 135 s framelists. The full time window over which the interpolation is performed is 1350 s, which is wider than the averaging window; a wider window is required as the interpolation needs filtergrams before and after the interpolated times. That is followed by the averaging of the frames using an apodized window with a FWHM of 720 s; the window is a boxcar with cos2 apodized edges that nominally has 23 nonzero weights, of which the central nine have weight 1.0. Temporal gap filling is also performed if needed.
The pipeline next calls the calibration routine that converts the six polarizations taken by the observables sequence into a Stokes [I Q U V] vector. To perform this conversion the polarimetric model described in Schou et al. (2012b) is used, including the corrections that depend on the front window temperature and the polarization selector temperature. At each point in the image a least-squares fit is then performed to derive I Q U V from the six observed polarization states.
Two additional corrections based on post-launch analysis are applied to the model described in Schou et al. (2012a). The first compensates for what looks like telescope polarization, a spatially dependent term proportional to I that appears in the demodulated Q and U at the level of about a part in 104. The dependence of Q/I, U/I, and V/I on distance from disk center was determined using the good-quality images from 3 May – 3 September 2010. The effect on V is negligible, so no correction is performed on V. The coefficients of proportionality for Q and U are given as fourth-order polynomials in the square of the distance from the center of the image, and this allows for a correction to better than a few parts in 105. It may be noted that this is not strictly a telescope polarization term, because it depends on the polarization-selector setting.
While the need for the first correction was anticipated, the second was not. A perceptible (relative to the photon noise) granulation-like pattern appears in Q and U (again, V is largely unaffected). This signal appears to be caused by a point spread function (PSF) that differs with polarization state. The consequence is that a contamination from I convolved with a different PSF is added to the two linear polarization signals. This is corrected by convolving I with a five by five kernel and subtracting the result. At present a spatially independent kernel is used. Details can be found in the pipeline code (see PipelineCode in Table 2).
The final result of the Stokes-vector observables code are the four Stokes parameters at the six wavelengths in hmi.S_720s.
2.3 Line-of-Sight Field Processing
The line-of-sight observables code is called to compute the Doppler velocity and LoS magnetic field strength, as well as the Fe I line width, line depth, and continuum intensity, from the Stokes parameters at each time step. The LoS observables are calculated with the MDI-like algorithm detailed in Couvidat et al. (2012). Briefly, discrete estimates of the first and second Fourier coefficients of the solar neutral iron line are calculated from the six wavelengths, separately for the I±V polarizations. The Doppler velocity is proportional to the phase of the Fourier coefficients; currently, only the first Fourier coefficient is used to compute the velocity. Certain approximations made in this calculation introduce errors in the results: the HMI filter profiles are not delta functions, the discrete estimate of the Fourier coefficients is not completely reliable due to the small number of wavelength samples, and the spectral line profile is not Gaussian (an assumption made to relate the phase to the velocity). Hence Doppler velocities returned by the basic algorithm must be corrected. This is accomplished in two steps.
The first relies on tabulated functions saved in the hmi.lookup data series. These tables are based on calibrated HMI filter transmission profiles and on a more realistic Fe I line profile. They vary slightly across the HMI CCDs and with time, primarily due to drifts in the Michelson interferometers. The values also depend on the tuning of the instrument and must be re-calculated after each HMI re-tuning. However, uncertainties remain in the filter transmission profiles and, perhaps more importantly, the Fe I line profiles; consequently, the look-up tables do not completely correct the Doppler velocity.
A second correction step has also been implemented. Every day the relationship between the median Doppler velocity rawmedn (measured over 99 % of the solar disk) minus the accurately known Sun–SDO radial velocity (obs_vr) is fitted as a function of rawmedn with a third-order polynomial. A linear temporal interpolation of the polynomials closest in time to t_rec is used to further adjust the Doppler velocities. The HMI LoS magnetic field measurement is proportional to the difference between the corrected I+V and I–V Doppler velocities. Only Doppler velocities and field strengths are corrected in this way; no correction algorithm has been implemented for the other LoS observables. Table 1 lists the names of data series for the HMI pipeline quantities.
2.4 Quicklook/Near-Real-Time Pipeline Processing
Definitive data products are computed after all downlinked data have been retrieved and all housekeeping, calibration, and trend data have been analyzed. Typically it takes several days from the time data are observed until the definitive observables are complete. For instrument health and safety monitoring and for quick-look space-weather purposes, much of the data are also processed in a near-real-time mode. During the last quarter of 2012 96 % of the NRT observables were available within 60 minutes and an additional 1 % were processed in the second hour. Because of disk and data base issues, 3 % of the NRT products became available more than 2 hours after the observations were recorded. Note that the higher level vector products derived from the hmi.S_720s_nrt data series require up to three hours of additional processing time.
The algorithms for processing the NRT and definitive 720 s data products are essentially the same. The differences arise because of the lack of robust cosmic ray detection, stale flat-fielding maps, and the use of default or predicted instrument parameters and housekeeping information. Differences in the data are generally small or localized. Note that in the parallel 45 s reduction pipeline, the processing of the definitive and NRT observables are less alike because fewer images are used to perform the temporal interpolation and gap filling. Higher level NRT products are generally not archived, with the exception of the SHARP product described in Section 6.
3 The Geometry of HMI Active Region Patches – HARPs
There is no 1:1 correspondence between HARPs and NOAA ARs. Each HARP is intended to encompass a coherent magnetic structure, so two or more NOAA ARs may all belong to a single HARP region. Coherent regions that are small in extent or have no associated sunspot can be detected and tracked by our code; such faint HARPs often have no NOAA correspondence. In the interval from May 2010 through January 2012 there were 350 NOAA ARs and 1187 definitive HARPs.
HARPs are identified at each time step in the 720 s HMI data series according to the following steps: the module first identifies the magnetically active pixels: approximately, the pixels with an absolute LoS field greater than 100 G. Then, taking spherical geometry into account, active pixels are grouped into instantaneous activity patches, which generally have smooth contours, but may consist of several regions separated by quiet Sun (Turmon, Pap, and Mukhtar 2002; Turmon et al.2010). The instantaneous patches, which are the colored blobs in Figure 3, are combined into a temporal track by stringing together image-to-image associations of the patches. A simple latitude-dependent motion model is part of the association metric, so data gaps of less than two days do not cause association problems. Note that there is no requirement that the net flux be zero, so a HARP may be somewhat unipolar.
An individual HARP is therefore a list, over a time index, of all the associated instantaneous patches, plus geometric metadata and selected summary statistics. The instantaneous patches are stored as coded bitmaps coinciding with a rectangular bounding box within the CCD plane. The bitmap’s numerical code identifies the pixels that are part of the active region patch and also indicates whether each pixel is magnetically active or quiet. See Section A.6 for details. The potential exists to introduce additional encodings, such as sunspot umbra/penumbra.
The geometric information in the HARP is used to determine how parts of the solar disk are processed in the vector magnetic-field pipeline. In particular, the rectangular bounding box (shown in white in Figure 3) is the smallest pixel-aligned box enclosing an inner latitude/longitude box. The latter box has constant width in heliographic latitude and longitude, and rotates across the disk at a constant angular velocity (defined for each HARP). This latitude/longitude box is just big enough to enclose all instantaneous patches during the lifetime of the HARP. All these geometric parameters are stored in HARP keywords. Some elementary summary characteristics of each HARP at each time are also determined, e.g. the total LoS flux, net LoS flux, total area, and centroid, as well as any corresponding NOAA region number (or numbers). The keyword noaa_ar gives the number of the first NOAA active region associated with a HARP. If more than one NOAA region is associated with a HARP, the total number is given by noaa_num and a comma-separated list of regions appears in noaa_ars. Maps of the observed solar quantities are not part of the HARP data series; the observables are collected and additional parameters are provided as part of the space-weather HARPs (SHARPs) described in Section 6.
There are in fact two types of HARP, definitive and near-real-time (NRT). The main distinction is that the definitive HARP geometry is not finalized until after the associated magnetic region has decayed or rotated off the disk, so all geometric information referred to above is consistent for the lifetime of the region. In particular, the bounding box of a definitive HARP encloses the same heliographic area during its entire lifetime. The temporal life of a definitive HARP starts when it rotates onto the visible disk or one day before the magnetic feature is first identified in the photosphere. The HARP expires one day after the feature decays or when it rotates completely off the disk. Steps are taken to ensure that activity fluctuating around the threshold of detection is not separated into multiple HARPs with temporal breaks. Additionally, active regions that grow over time, eventually overlapping other regions, are merged into a single definitive HARP.
A near-real-time HARP is similar, but does not begin until the feature can be identified (there is no one-day pad at the beginning). Moreover, the heliographic size of the region may change during its life. NRT HARPs may also merge, but the merger is not seamless because it results in termination of one or more NRT HARPs and continuation of the larger, merged object. Flags are provided to identify mergers in the NRT product, because the sudden amalgamation of an NRT HARP with another region is an artifact of the grouping and not of physical origin. In the definitive product, regions do not merge because the entire history of the HARP is known before the bounding box is determined. Note that definitive and NRT HARP numbers are not the same.
HARPs are available in the data series hmi.Mharp_720s_nrt and hmi.Mharp_720s. More information about HARPs is available online at jsoc.stanford.edu/jsocwiki/HARPDataSeries (see Table 2) and in Turmon et al. (2014).
4 Milne–Eddington Inversion
Spectral line inversion codes are tools used to interpret spectro-polarimetric data. Given a set of observed Stokes spectral profiles, the purpose of an inversion code is to infer the physical properties of the atmosphere where they were generated.
To interpret HMI data, a relatively simple spectral line synthesis model, based on a Milne–Eddington (ME) atmosphere, is used. The ME model assumes that all of the physical properties of the atmosphere are constant with height, except for the source function, which varies linearly with optical depth. The generation of polarized radiation is described by the classical Zeeman effect. Under these assumptions, the polarized radiative transfer equation has an analytical solution, known as the Unno–Rachkovsky solution (Unno 1956; Rachkovsky, 1962, 1967). In the ME context, the forward model for spectral line synthesis traditionally has 11 free parameters: three magnetic-related quantities (magnetic field strength, its inclination with respect to the line of sight, and its azimuth with respect to an arbitrarily chosen direction in the plane perpendicular to the LoS), five thermodynamical ones (Doppler width, line core-to-continuum opacity ratio, Lorentz-wing damping, and the source function and its gradient), two kinematic variables (Doppler velocity and macroturbulent velocity), and a geometrical parameter, the filling factor, which quantifies the fraction of the pixel that is occupied by a magnetic structure.
The Very Fast Inversion of the Stokes Vector (VFISV) is a ME spectral line inversion code specifically designed to infer the vector magnetic field of the solar photosphere from HMI Stokes measurements (Borrero et al.2011; Centeno et al.2013). VFISV uses a Levenberg–Marquardt least-squares minimization (Press et al.1992) of a χ2 function. χ2 is a metric of the difference between the observed and synthetic Stokes profiles (i.e. the goodness of the fit). Given an initial guess for the model atmosphere, the algorithm produces synthetic Stokes profiles and compares them with the observations. The model parameters are then modified in an iterative manner until the synthetic data are deemed to be a good-enough fit to the observations. ‘Good enough’ is defined by the convergence criteria that determine when to exit the iteration loop.
Several limitations arise as a consequence of using the ME approximation. The thermodynamical parameters are complicated, nonlinear combinations of actual physical properties (density, temperature, pressure, etc.), so one cannot extract the corresponding real thermodynamical information using only the ME assumption. In addition, due to the lack of gradients in the model, asymmetries present in the Stokes profiles cannot be properly fit by the inversion code. However, the retrieved values of magnetic field and LoS velocity are representative of the average conditions throughout the spectral region of formation and averaged over temporal and spatial resolution (Westendorp Plaza et al.1998; Leka and Barnes 2012). HMI does not have an absolute wavelength reference. The zero point of the derived velocity depends on filter profile calibrations determined relative to the full-disk line center at the nominal wavelength of 6173.3433 (Norton et al.2006); no correction is made for the effect of convective blueshift on the observations. See Figure 16 in Section 7.2.3 for information about the daily variation of the velocity. Welsch, Fisher, and Sun (2013) have developed a scheme to determine the velocity zero point in active regions.
Despite being a general ME code with customizable settings, VFISV has been optimized to work within the HMI data processing pipeline. The inversions are typically applied to the hmi.S_720s series (full Stokes vector, averaged over 720 seconds, for the full disk of the Sun, with 4096×4096 pixels), which requires being able to invert more than 20 000 pixels per second. To meet the speed requirements, certain aspects of VFISV have been hard-coded for performance purposes; for instance, VFISV uses the HMI transmission filter profiles for each pixel in the computation of the synthetic spectral line. One important facet of this inversion code is that it forces the filling factor, α, to be unity. This constraint, enforced because of the sparse spectral sampling and moderate spatial resolution of the HMI data, assumes that the plasma is uniformly magnetized in each pixel. In the weak-field regime, there is a strong degeneracy between the filling factor and the magnetic field strength. However, the product of the two (αB) is very well constrained by the observed Stokes profiles. Therefore, assuming α=1 means that the quantity B should be interpreted as the average magnetic field of the pixel. The stray light, i.e. light scattered from other parts of the Sun that contaminates any given pixel, is currently not being considered either. This generally leads to lower values of the inferred magnetic field strength, especially in strong-field regions (LaBonte 2004a).
Several changes and optimizations have been introduced in VFISV since its release (Borrero et al.2011). The HMI team has derived optimal settings for the pipeline processing to improve the speed and general performance of the code. These changes to the original VFISV code are described in detail in Centeno et al. (2013). Some of the significant changes include a) a regularization term added to the χ2 minimization merit function to bias the solution towards the more physical solution when encountering two nearly degenerate minima, b) an adjustment to the relative weighting applied to the Stokes parameters I Q U V, c) implementation of tailored iteration and exit criteria that results in an average of ∼30 iterations per pixel, d) use of a spectral line synthesis module that computes the full radiative transfer solution only for the inner wavelength range of the HMI spectral line, and e) a simpler initial-guess scheme that does not use a neural net. In the HMI pipeline context, the inversions produced with these settings are referred to as fd10.
Two keywords indicate the version of the fd10 code: invcodev and codever4. A significant improvement was incorporated on 30 April 2013, when the code was enabled to use time-dependent information about the HMI filter profiles. The differences are spatially dependent and systematic. Over the full disk, a typical difference map between the two versions shows a mean of 0.1 G and an rms of 4 G, with a distinct East/West asymmetry and greater bias in strong-field regions. The filter profiles must be updated when the instrument tuning is adjusted, as indicated by the invphmap keyword. Inversions of data collected between 1 August 2011 and 23 May 2013 use earlier, less accurate filter phase maps. Notable changes to the pipeline modules and processing notes are documented at jsoc.stanford.edu/jsocwiki/PipelineCode as listed in Table 2.
For each pixel in the field of view, VFISV returns its best estimate of the atmospheric model together with the standard deviation associated with each model parameter and the normalized covariances in the errors of selected pairs of parameters. Appendix B describes differences between fd10 and a previous version of the inversion associated with an earlier data release.
5 The Disambiguation Algorithm
Inversion of the Zeeman splitting to infer the magnetic-field component transverse to the line of sight results in an ambiguity of 180∘ in its direction (Harvey 1969); some additional assumption(s) or approximation must be made to completely determine the magnetic-field vector. A plethora of methods have been proposed to resolve this ambiguity (for an overview, see Metcalf et al.2006). For disambiguation of HMI data, a variant on the “Minimum Energy” method (Metcalf 1994) called ME0 has been implemented.
The original Minimum Energy algorithm minimizes the sum of the squares of the magnitude of the field divergence and the total electric-current density, where the vertical derivatives in each term are approximated by the derivatives of a linear force-free field. Minimizing |∇⋅B| gives a physically meaningful solution, and minimizing J provides a smoothness constraint. For computational efficiency, the algorithm applied to HMI data uses a potential field to approximate the vertical derivative in |∇⋅B| and minimizes only the magnitude of the normal component of the current density. Note that now we minimize ∑|∇⋅B|+|Jz| in place of ∑|∇⋅B|2+|J|2 as in the original Minimum Energy method.
This method has been shown to be among the best performing on a wide range of tests on synthetic data for which the answer is known (Metcalf et al.2006; Leka et al.2009). However, Leka et al. (2009) showed that the minimum energy state is not always the correct ambiguity resolution in the presence of noise. Furthermore, convergence of the optimization routine is slow in pixels where the signal is dominated by noise, particularly noise in the transverse component of the field. Therefore, the final disambiguation for those pixels that fall below a specified noise threshold is made with several simpler and quicker methods in the pipeline.
Determine spatially dependent noise mask;
Compute potential field derivative;
Determine confidence in result;
Minimize energy function;
Disambiguate noisy pixels.
5.1 The Noise Mask
The HMI noise level varies with location on the disk and with relative velocity between the spacecraft and Sun (see Section 7.1 for a discussion of the temporal and large-scale spatial variations found in the data). A constant is added to the derived noise value, and pixels with a transverse field strength above this noise estimate are assigned to the disambiguation mask. The mask is then eroded to eliminate isolated pixels above the noise, and this defines the high-confidence pixels. Intermediate confidence is assigned to a buffer zone surrounding the clusters of pixels with a well-determined field. All pixels within that grown mask are included in minimizing the energy.
When only patches are disambiguated all pixels outside the high-confidence region are considered to be intermediate. Currently, all SHARPs observed before 15 January 2014 rely on such patch-wise disambiguation; consequently, all pixels within the HARP bounding box have been annealed, and those outside strong-field high-confidence areas have also been smoothed. This changed when the definitive pipeline switched over to computing the full disk disambiguation at each time step. The type of solution returned is recorded in the conf_disambig segment; see Section A.4 for more information.
5.2 The Potential Field
To determine the vertical derivative used in approximating ∇⋅B, the potential field that matches the observed LoS component of the field is computed in planar geometry (Alissandrakis 1981). By matching the line-of-sight component, the potential field only needs to be computed once, and by using planar geometry, fast Fourier transforms can be used. When planar geometry is used for the energy calculation, a single plane is used in the potential field calculation. For spherical geometry, the observed disk is divided into tiles by taking a regular grid in an area-preserving Mollweide projection and mapping it back to the spherical surface of the Sun. Each tile is treated as a separate plane for computing the potential field, although neighboring tiles are overlapped, and a windowing function is applied to reduce edge effects.
5.3 Minimum Energy Methods
5.4 Treatment of Areas Dominated by Noise
The utility of minimizing the energy given by Equation (1) depends on being able to reliably estimate the divergence and the vertical current density. Where noise dominates the retrieved field, alternate approaches are used.
A neighboring-pixel acute-angle algorithm based on the University of Hawai’i Iterative method (UHIM; Canfield et al.1993; Metcalf et al.2006) that locally maximizes the sum of the dot product of the field at one pixel with the field at its neighbors is used. In areas close to pixels with well-determined fields, the method performs well, as it quickly produces a smooth transition to noisy pixels. While the result is always a smooth solution, the algorithm can become trapped in a smooth but incorrect result, which tends to be propagated outwards from the well-measured field (Leka et al.2009). Therefore this method is currently used for SHARPs, and in small intermediate areas around well-determined fields for the full-disk.
Farther away from the well-measured field in full-disk mode, where the annealing method is not applied, the pipeline module disambiguates the azimuth in three ways, each with its own strengths and weaknesses. Method 1 selects the azimuth that is most closely aligned with the potential field whose derivative is used in approximating ∇⋅B. Method 2 assigns a random disambiguation for the azimuth. Method 3 selects the azimuth that results in the field vector being closest to radial. Methods 1 and 3 include information from the inversion, but can produce large-scale patterns in azimuth. Method 2 does not take advantage of any information available from the polarization, but does not exhibit any large-scale patterns and reflects the true uncertainty when the inversion returns purely noise. The results of all three methods are recorded in disambig; see Section A.4 for specifics.
6 Space-Weather HARPs – SHARPs
The Space-weather HARP (SHARP) data series collects most of the relevant observables in HMI active-region patches and computes from them a variety of summary active-region parameters that evolve in time. The SHARP data series, hmi.sharp_720s, is quite complete, comprising 31 maps of the active patch at each time step with all of the disambiguated field and thermodynamic parameters determined in the inversion, along with uncertainties and error cross-correlation coefficients, as well as the continuum intensity, Doppler velocity, and line-of-sight magnetic field (Bobra et al.2014).
There is an extensive literature describing potentially useful active-region indices (e.g. Leka and Barnes, 2003a, 2003b, 2007; Barnes and Leka, 2006, 2008; Falconer, Moore, and Gary 2008; Schrijver 2007; Mason and Hoeksema 2010; Georgoulis and Rust 2007). The SHARP series computes many of these quantities that are averaged or summed over the entire region. A list of computed indices can be found in Appendix C and includes total unsigned flux, mean inclination angle (relative to vertical), mean values of the horizontal gradients of the total, horizontal, and vertical field, means of the vertical current density, current helicity, twist parameter, and excess magnetic energy density, the total excess energy, the mean shear angle, and others. See Bobra et al. (2014) for details.
The alternate SHARP series hmi.sharp_cea_720s includes a smaller number of maps (eleven) remapped to cylindrical equal area (CEA) heliographic coordinates centered on the HARP center point. The coordinate remapping and vector transformation are decribed in Section 6.1. The CEA series includes maps of the three vector magnetic field components and the expected standard deviation of each component, along with the LoS magnetic field, Dopplergram, continuum intensity, disambiguation confidence, and HARP bitmap (see Appendix C for details).
6.1 Coordinate Remapping and Vector Transformation
Two coordinate systems are involved in the representation of the vector magnetograms. The first refers to the observation’s physical location on the Sun or in the sky, for which HMI uses World Coordinate System (WCS) standards for solar images (Thompson 2006). The second refers to the direction of the three-dimensional field vector components at a particular location. In this article, we call the conversion from one WCS format to another “remapping” in the first geometrical case and “vector transformation” in the second.
Currently, SHARP data are available in CCD image coordinates or in a cylindrical equal-area projection centered on the patch with the WCS projection type specified in ctype1 and ctype2. When data are requested from the JSOC, users will eventually have the option to customize the data using various remapping and vector transformation schemes.1 For a more detailed account of different map projections, we refer to Calabretta and Greisen (2002) and Thompson (2006).
Care must be taken with image coordinates. The standard SHARP image segment cut-outs, like most HMI image data series, are stored in helioprojective CCD image coordinates, registered and corrected for distortion, but without any remapping. Each pixel represents the same projected area on the plane of the sky, but corresponds to a different area on the solar surface. We note that the +y direction of the HMI CCD array in the data series does not generally correspond to solar North. The counterclockwise (CCW) angle needed to rotate the image to the “North-up” format is recorded in the keyword crota2. For most standard HMI images crota2 is close to 180∘, i.e. raw HMI CCD images appear upside down.
The vector magnetic field in SHARPs is also provided in a cylindrical equal-area projection data series, hmi.sharp_cea_720s. A thorough discussion is available as a technical note (Sun 2013). Each pixel in the remapped CEA image represents the same surface area on the photosphere. For the CEA remapping, the vector magnetogram is first converted into three images, each frame representing one component of the three-dimensional field vector (see next section). A target coordinate grid is defined for a CEA coordinate system in which the origin of the map projection is the center of the HARP. The CEA grid is centered on the region of interest to minimize geometric distortion in the result. The remapping is made individually for each vector component, as well as on the scalar observables. The uncertainties, bitmap, and confidence maps are derived a little differently: first, the center of each pixel in the remapped coordinate system is located in the original image; then the nearest neighboring pixel in that original image is identified and the value for that nearest original pixel is reported.
6.1.2 Vector Transformation
In the “native format” the field vector at each pixel is represented by three values derived from the inversion (Section 4): the total field strength (B), the inclination (γ), and the azimuth (ψ). Inclination is defined with respect to the HMI line of sight, so the longitudinal (Bl) and transverse field (Bt) components can be easily separated as Bl=Bcosγ and Bt=Bsinγ.
As mentioned in the previous section, we decompose the vector magnetogram into three component images before remapping using the following basis vector: (eξ, eη, eζ), where eξ refers to the +x direction of the native-format image, eη to +y, and eζ to +z out of the image. Note that eζ coincides with the LoS direction. Remapping is performed subsequently on the three component images.
The vector transformation is performed as the last step, following Equation (1) of Gary and Hagyard (1990) after determining the heliographic latitude and longitude at each pixel. For the CEA map-projected data we transform the vector into standard heliographic spherical coordinates with a basis vector (er, eθ, eϕ), where er is the radial direction normal to the solar surface, eθ points southward along the meridian at the point of interest, and eϕ points westward in the direction of solar rotation along a constant latitude line. The r component corresponds to the vertical component, θ and ϕ to the horizontal components.
6.2 A Comparison of Definitive and Quick-look SHARP Data
As described in Section 2.2, a preliminary flat-field is used, gap-filling is less sophisticated, cosmic-ray correction is not performed, and calibrations are based on default or preliminary instrument parameters. All of the NRT 720 s observables (vector and scalar) are calculated from the hmi.S_720s_nrt Stokes series.
The NRT HARP bounding box is based on the data available at that point in time, therefore the heliographic size may change and regions may even be merged by the time the definitive data are created. Obviously, no NRT HARP data are available before the region emerges, and no association with a NOAA AR can be made until NOAA assigns a number. The NRT and definitive HARP numbers may be different.
The NRT fd10 VFISV inversion is computed only for identified NRT HARPs. The inverted region extends beyond the NRT HARP bounding box by 50 pixels in each direction. Consequently, for NRT the size of the padding region outside the HARP used to compute the initial field parameters is reduced from 500 to 50 (or 20 in some intervals, check keyword ambnpad). NRT disambiguation parameters are adjusted to speed up the calculation by increasing the effective temperature scale factor, ambtfctr, and decreasing the number of reconfigurations, ambneq (see Barnes et al.2014 for details). The results for particularly small and (until September 2013) particularly large NRT SHARPs are not computed to limit the computing load. All NRT SHARPs are disambiguated using planar geometry rather than spherical. The same noise-threshold map is used in both pipelines, subject to some delays in updating. The SHARP parameters are computed using only pixels both within the HARP (the colored blobs in Figure 3) and above the noise threshold (see Section 7.1.1); the number of pixels is given in the keyword cmask.
The number of high-confidence pixels is shown by the yellow (definitive) and red (NRT) points in the upper panel of Figure 5. The number reflects both the size of the evolving active region and systematic variations. The clear 12-hour periodicity is associated with the spacecraft orbital velocity, Vr, relative to the Sun and is discussed in Section 7.1.2. The broad, roughly symmetric peaks centered ∼ 60∘ from central meridian are due to the spatially dependent sensitivity of the instrument (see Section 7.1.1). The noise level in low and moderate field strength regions changes as a function of center-to-limb angle and Vr, and consequently the number of pixels contributing to the usflux index changes. Histograms of two representative active regions show a shift in the peak of the distribution of low-to-moderate field pixels toward higher values as the regions move away from central meridian; the width of the distribution also broadens. An increase of a few tens of Gauss in the field strength distribution at 60∘ increases the number of pixels in the 250 – 750 G range by a few tens of percent. The field strength in higher field regions is more stable, but because the area covered by the strong field is much smaller, the variation in usflux is significantly affected.
The lower panel shows the percentage difference in the definitive and NRT usflux index as a function of time. The two match within a few percent except during the 2 – 4 July interval when there were two NRT SHARP regions. In the upper panel we have excluded all images where the quality keyword exceeded 0x010000. Bits in the quality keyword identify potential problems with the measurements (in this case typically missing filtergrams because of calibration sequences). For comparison, the lower panel includes all of the points, and the isolated points lying well away from the line warn of the consequences of using less-than-ideal measurements.
7 Uncertainties, Limitations, Systematics, and Sensitivities
The HMI vector field data are of high quality and more than meet their original performance specifications. Nevertheless, the measurements are far from perfect and proper care must be taken when using the data. This section discusses various uncertainties, limitations, and known systematic issues with the data produced in the HMI vector field pipeline. Sources of error include imperfections and limitations of the instrument and observing scheme, as well as imperfections and limitations of the analysis methods. Variances of the inverted variables and covariances between their errors are obtained during the VFISV inversion (see Section 4). These are recorded as estimated errors (square roots of the variances) for these quantities and their correlation coefficients (related to the covariances). We characterize the known uncertainties and errors as best we can; the user must take this information into account when performing research.
7.1 Temporal and Spatial Variations of the Inverted Magnetic Field
The dominant driver of time-varying errors in the magnetic field is the Doppler shift of the spectral line. By far the largest contributor is the daily period due to the geosynchronous orbit of SDO. On longer time-scales there are other orbital and environmental variations, along with changes in the instrument itself, changes in the way the instrument is tuned or operated, and variations in the calibration. Most of the short-term variation from solar oscillations is eliminated by the 12-minute averaging. This section concentrates primarily on the daily variability.
7.1.1 Time-Varying Noise Mask
The noise level of the inverted magnetic field shows large-scale spatial variations over the entire disk caused by effects of irregularities in the HMI instrument and viewing angle. This pattern changes with the orbital velocity of the geosynchronous satellite relative to the Sun, Vr (keyword obs_vr). Vr ranges ±3 km s−1 from local dusk (∼ 1 UT) to dawn (∼ 13 UT). The corresponding Doppler shift moves the spectral line back and forth by about one tuning step every 12 hours. Combined with the fixed velocity pattern of solar rotation, this leads to the temporal and spatial variations of the inverted magnetic field over the Sun’s disk every 24 hours.
The noise pattern changes somewhat with instrument parameters, for example when the front window temperature is adjusted. Such instrument changes have occurred at a few known times: 13 December 2010, 13 July 2011, 18 January 2012, and 15 January 2014. See references in jsoc.stanford.edu/jsocwiki/PipelineCode, Table 2. Reference noise mask coefficients are generated specifically for each time interval.
7.1.2 Periodicity in the Inverted Magnetic-Field Strength
Variability of the mean field strength in the quiet Sun is as much as 5 % of the typical weak-field magnitude and is dominated by daily variations and a reproducible twice-daily excursion centered near 0 km s−1. That excursion appears only in the transverse field, i.e. Stokes Q and U, and is attributed to sensitivity that depends on the line position relative to the HMI tuning wavelengths. The linear trend is just 2.3 G/km s−1. When the range −1.0 to +0.5 km s−1 is excluded, a linear fit gives 2.6 G/km s−1 (dashed line). Note that the velocity range does not extend to as highly negative velocity values in the strong-field regions because of the suppression of the convective blue shift. Power spectrum analysis shows a peak at 24 hours in all three region classes (see right panels of Figure 11). The 24-hour peak is strongest in the umbra and less so in weaker field regions, which also have a significant 12-hour periodicity caused by the 0 km s−1 excursion.
7.2 Known Issues
7.2.1 Bad Pixels
Occasionally, poor inversion results are obvious in the inverted magnetic-field data. They are particularly noticeable in sunspots, where pixels with abnormal values differ significantly from those adjacent to them or at nearby time steps. This usually happens when the inversion code fails to converge.
A number of reasons can lead the inversion code to fail to converge. Inside very dark sunspots, where the magnetic field is very strong, the Zeeman splitting of the spectral line can be strong enough to push one (or both) of the Stokes V (Q and U) lobes outside of the measured spectral range observed by HMI. This problem is exacerbated by the Doppler shift that arises as a combination of the orbital velocity of SDO, the solar rotation, and the intrinsic plasma motions at the photosphere. In areas with strong gradients of the magnetic field or the LoS velocity (such as the penumbra of a sunspot, an emerging region, or a flaring region) the Stokes profiles tend to show large asymmetries. The inversion code often fails to converge in these cases because the ME approximation is strongly violated.
7.2.2 Reliability of the Disambiguation
There are two main failure modes for the simulated annealing part of the disambiguation: 1) the minimization algorithm fails to find the global minimum of the energy, or 2) the global minimum does not correspond to the correct disambiguation. In the first case, the result can be improved by changing the cooling schedule used for the annealing, but it is computationally impractical to use a cooling schedule in the pipeline that will find the global minimum. Typically, however, the pixels that differ from the global minimum configuration occur in areas where the noise in the transverse field is high. The second case can occur for several reasons. As in the first case, when the transverse field is dominated by noise or is not spatially resolved, then finite differences do not accurately represent the derivatives of the field. Alternatively, if the field is sufficiently far from potential, then the approximation to the divergence of the magnetic field will not be accurate.
7.2.3 Comparing HMI Velocity and Magnetic Field Using VFISV and the MDI-Like Algorithms
7.3 Limits and Validation
The inference of solar photospheric magnetic-field vector maps is at best an estimate that represents the average field over height, time, and space, as deduced using a record of photons averaged in the spectral domain as well. In practice, vector magnetogram maps are the result of inverting data that only poorly constrain an optimization method based on physical assumptions known to be incorrect. There are additional instrumental artifacts that may or may not be mitigated fully. In this section, some rudimentary evaluation of the evolution of AR #11158 features are discussed in light of the limitations of the data, and a brief qualitative comparison is presented with simultaneous observations from the Hinode/SpectroPolarimeter (Kosugi et al.2007; Tsuneta et al.2008; Lites et al.2013). Comparisons beyond the qualitative presentations made here are beyond the scope of this paper.
7.3.1 Validation and Limitations of HMI Processing and Data
Characteristics of both the HMI instrument and the processing can lead to systematic and possibly subtle effects of which users need to at least be aware.
First, there is no treatment of scattered light, either as part of the data reduction or the inversion procedure. This can lead to systematically lower inferred field strengths and incorrect inferred angles of the magnetic vector (LaBonte 2004b). It will also provide simply incorrect relative photometry between different solar structures. In the future a treatment of scattered light may be performed; this is a feature available in the original VFISV scheme.
Second, the sparse and limited spectral sampling precludes a clean continuum point from being sampled consistently in the same part of the spectrum. For segments of the daily orbit, either the first or the last filter position should sample near the spectral continuum, but rarely far enough from the spectral line to be uncontaminated, and never for more than a few hours at a time. Again, this can impact the interpretation of relative photometry especially for analysis of temporally varying features.
Third, as summarized in Section 2.2, there is overlap in the contribution of filtergrams to each 12-minute average, such that a single magnetogram is not a completely independent measurement from its temporal neighbors. The effects of this may be subtle, but may be detectable in the velocity-tracking codes during times of strong temporal evolution (e.g. flares or emergence), and may contradict some assumptions made by statistical analysis.
7.3.2 HMI Vector Magnetograms in Context
Every instrument and observing scheme makes compromises to balance the limitations imposed by a finite number of photons and the performance of real optics. HMI’s vector magnetogram capability, as with data from other vector-spectropolarimetric instruments, enables a broader spectrum of physical interpretation than instruments such as MDI that provide solely LoS measurements. Compared with other vector magnetogram data, HMI observations have much better spatial and temporal coverage than Hinode/SP, whereas the spatial and spectral resolution, sampling, and polarization sensitivity of Hinode/SP are significantly better. HMI data have much better spatial and temporal coverage than the Imaging Vector Magnetograph (IVM) archive, but poorer spectral sampling, in addition to the advantages and disadvantages of space-based vs. ground-based observing. HMI’s full-disk imaging capability makes its global spatial coverage superior to any data except the SOLIS/SPM and Huairou/HSOS. The HMI spatial resolution of 1′′ is similar to that of the IVM and the optical potential of SOLIS/SPM, but significantly poorer than that of Hinode/SP and certain high-resolution ground-based instruments. HMI’s combination of cadence, coverage, and continuity are unmatched.
7.3.3 HMI Vector Magnetograms vs.Hinode/SP Vector Magnetograms
The distribution plots demonstrate that the data are qualitatively very similar, but there are quantitative and systematic differences. The HMI flux density generally falls short of that reported by Hinode/SP, as does the contrast and its variation. Both of these effects are expected with lower spatial resolution (Leka and Barnes 2012) and the presence of scattered light (LaBonte 2004a). In these plots the flux-density effects are clearest in the sunspot umbrae, whereas the contraction of the contrast distribution is easiest to see in the quiet-Sun or plage areas. The lack of a scattered light correction may also contribute to both the field strength and continuum-intensity differences. The inclination angles display the same morphology in the distribution plots, but the HMI data generally fail to achieve the extreme inclination angles at all flux densities and tend to lie closer to the plane of the sky. This again may be a consequence of scattered light (LaBonte 2004b) or noise (Borrero and Kobel 2011), or it may be attributable to the better wavelength sampling of Hinode/SP, which effectively leads to an enhanced signal-to-noise ratio.
HMI vector magnetic field observations have been collected continuously since 1 May 2010. Examples have been shown to demonstrate the capabilities of the HMI instrument and explain how the observables are generated routinely in the vector field pipeline analysis. HARP 377, AR #11158 was highlighted in part because it produced the first X-class flare of Cycle 24 and in part because an earlier version of the HMI vector field data were released for this region.
A sequence of full-disk, polarized, narrow-passband filtergrams are collected every 135 seconds. A Level 1 data analysis pipeline corrects the filtergrams for a variety of instrumental and observational effects, co-aligns them, and averages data from ten sequences together on a 720 s cadence (Schou and Couvidat 2013). The basic magnetic observables, Stokes [I Q U V], are determined at six wavelengths. Other scalar quantities provided at the same cadence include Doppler velocity, line-of-sight magnetic field, continuum intensity, line depth, and line width. The data series are listed in Table 1.
HMI active region patches are identified automatically and tracked during their entire disk passage (Turmon et al.2014) based on analysis of the HMI LoS magnetic field and continuum intensity. Each HARP is assigned a number and may in many cases be associated with one or more NOAA active regions. There are also many HARPs that contain no sunspot and therefore have no NOAA AR number. The geometric information in the HARP data series is used to select regions for further processing.
VFISV, a very fast Milne–Eddington inversion code, is applied to determine the magnetic field and other plasma parameters. The fd10 version of the code described in this article and in more detail in Centeno et al. (2013) has been run on all HMI full-disk vector field data since 1 May 2010.
The inverted fd10 data require disambiguation to resolve the 180∘ azimuthal uncertainty in the transverse field direction. We have applied the method described by Barnes et al. (2014) to a growing selection of active region patches. The disambiguation minimizes a quantity proportional to the sum of the absolute values of the field divergence and the electric current density. The pipeline disambiguation code is being run routinely on active-region patches observed before 15 January 2014. Full-disk disambiguated vector magnetograms are being used for more recent observations.
The SHARP (Space-weather HARP) data series gathers together for each HMI active-region patch at each time step the disambiguated vector field, other inversion outputs, and most of the HMI scalar observables. The SHARP data series also provides a number of active-region quantities computed at each time step for each patch, such as total flux, mean current helicity, and weighted measures of the field gradient (Bobra et al.2014). Maps of select inversion outputs are remapped into heliographic coordinates using a cylindrical equal area projection centered on the HARP.
The pipeline is applied to definitive HMI data that become available several days after the observations are collected. The definitive HARP analysis is not completed until after the region has rotated off the visible solar disk, introducing delays as long as several weeks. For most scientific purposes these high-quality data are the most useful. However, for space-weather forecasting and evaluative purposes, quick-look near-real-time data for many observables are generally available within minutes or at most a few hours of observation. These data include the full-disk scalar quantities and everything required to make SHARPs.
In Section 7 and elsewhere many of the known limitations, uncertainties, and issues associated with the vector field data were described. Prudence must be exercised when using the data quantitatively. HMI vector field measurements compare favorably with other observations, but of course have been optimized for the capabilities and constraints of the instrument, satellite, and processing.
Table 2 provides links to additional documentation relevant to the HMI magnetic field data.
We thank the numerous team members who have contributed to the success of the SDO mission and particularly to the HMI instrument. This work was supported by NASA Contract NAS5-02139 (HMI) to Stanford University. Some of the research described here was carried out by staff of the Jet Propulsion Laboratory, California Institute of Technology. HAO/NCAR is supported by the National Science Foundation. Efforts at NWRA were also supported through NASA Contract NNH09CF22C and by PO#NNG12PP28D/C#GS-23F-0197P from NASA/Goddard Space Flight Center. J. Schou acknowledges support from EU FP7 Collaborative Project Exploitation of Space Data for Innovative Helio- and Asteroseismology (SPACEINN).
Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.