1 Introduction

Exclusive vector meson (VM) photoproduction, \({\upgamma _{}^{}} \mathrm{p}\rightarrow \mathrm {VM}\mathrm{p}\), has received renewed interest following recent studies of ultraperipheral collisions involving ions and protons at the CERN LHC [1, 2]. In such collisions, photon-induced interactions predominantly occur when the colliding hadrons are separated by a distance larger than the sum of their radii. In this case, one of the hadrons may emit a quasi-real photon that fluctuates into a quark-antiquark pair with the quantum numbers of the photon, which can then turn into a VM upon interacting with the other hadron. The interaction of the VM with the hadron proceeds via the exchange of the vacuum quantum numbers, the so-called pomeron exchange. Proton–lead (pPb) collisions are particularly interesting for studying photon–proton interactions [3, 4] because the large electric charge of the Pb nucleus strongly enhances photon emission. Also, in these events, one can determine the photon direction and hence the photon–proton centre-of-mass energy \(W_{{\upgamma _{}^{}} \mathrm{p}}\) unambiguously. This advantage is not present in symmetric colliding systems such as pp interactions. Exclusive VM photoproduction is interesting because the Fourier transform of the t distribution, with t being the squared four-momentum transfer at the proton vertex, is related to the two-dimensional spatial distribution of the struck partons in the plane transverse to the beam direction. Furthermore, some models suggest that the energy dependence of the integrated cross section and that of the t distribution may provide evidence of gluon saturation, as discussed in Refs. [5,6,7,8,9,10].

By using ultraperipheral pPb collisions at \(\sqrt{\smash [b]{s_{_{\mathrm {NN}}}}} = 5.02\,\text {Te}\text {V} \) at the LHC, the ALICE Collaboration has measured the exclusive photoproduction of \({{J/\uppsi _{}^{}}}{{\left( {1S}\right) }{}_{}^{}}\) mesons in the centre-of-mass energy interval \(20< W_{{\upgamma _{}^{}} \mathrm{p}} < 700\,\text {Ge}\text {V} \) [11, 12]. The LHCb Collaboration has studied exclusive \({{J/\uppsi _{}^{}}}{{\left( {1S}\right) }{}_{}^{}}\), \({{\uppsi _{}^{}}}{{\left( {2S}\right) }{}_{}^{}}\), and \(\Upsilon _{}^{}\) (nS) photoproduction in pp collisions at \(\sqrt{s} = 7\) and \(8\,\text {Te}\text {V} \) [13, 14]. Exclusive photoproduction of \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) mesons was first studied in fixed-target experiments at \(W_{{\upgamma _{}^{}} \mathrm{p}}\) values up to 20\(\,\text {Ge}\text {V}\) [15, 16]. Experiments at the HERA electron–proton collider at DESY have studied this process at \(W_{{\upgamma _{}^{}} \mathrm{p}}\) values ranging from 50 to 187\(\,\text {Ge}\text {V}\), both with quasi-real photons and for photons with larger virtualities [17, 18]. The HERA data have provided clear experimental evidence for the transition from the soft to the hard diffractive regime [19, 20]. More recently, exclusive photoproduction of \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) mesons has been studied by the STAR Collaboration in ultraperipheral AuAu collisions at the BNL RHIC collider [21,22,23], and by the ALICE Collaboration in PbPb collisions [24]. The cross sections measured by the ALICE and STAR Collaborations in photon-nucleus interactions are 40% lower than both the prediction from the Glauber approach and the corresponding measurements in photon–proton interactions [24, 25]. However, the Glauber approach reproduces the measured cross sections well at lower energies. This is an indication that nuclei do not behave as a collection of independent nucleons at high energies. In the present analysis, exclusive photoproduction of \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) mesons in the \({\uppi _{}^{}} _{}^{+}\) \({\uppi _{}^{}} _{}^{-}\) decay channel in ultraperipheral pPb collisions at \(\sqrt{\smash [b]{s_{_{\mathrm {NN}}}}} = 5.02\) \(\,\text {Te}\text {V}\) is measured. The cross section is measured as a function of \(W_{{\upgamma _{}^{}} \mathrm{p}}\) and t. In this paper \(|t |\) is defined as the squared transverse momentum of the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^0\) meson, \(|t | \approx p_{\mathrm {T}} ^{2}\).

This paper is organized as follows. Section 2 describes the experimental apparatus and Sect. 3 the data and simulated Monte Carlo samples. The event selection procedure is illustrated in Sect. 4. Section 5 discusses the background contributions and Sect. 6 the strategy used to extract the signal; the systematic uncertainties are summarized in Sect. 7. The total and differential cross sections are presented in Sect. 8. The results are summarized in Sect. 9.

2 The CMS detector

The central feature of the CMS apparatus is a superconducting solenoid of 6\(\,\text {m}\) internal diameter, providing a magnetic field of 3.8\(\,\text {T}\). Within the solenoid volume are a silicon pixel and strip tracker, a lead tungsten crystal electromagnetic calorimeter (ECAL), and a brass and scintillator hadron calorimeter (HCAL), each composed of a barrel and two endcap sections. The silicon tracker measures charged particles within the range \(|\eta |< 2.5\). It consists of 1440 silicon pixel and 15,148 silicon-strip detector modules and is located in the field of the superconducting solenoid. For nonisolated particles of \(1< p_{\mathrm {T}} < 10\,\text {Ge}\text {V} \) and \(|\eta | < 1.4\), the track resolutions are typically 1.5% in \(p_{\mathrm {T}}\) and 25–90 (45–150)\(\,\mu \text {m}\) in the transverse (longitudinal) direction [26].

The pseudorapidity coverage for the ECAL and HCAL detectors is \(|\eta |<3.0\). The ECAL provides coverage in the pseudorapidity range \(|\eta |<1.5\) in the barrel (EB) region and \(1.5<|\eta |<3.0\) in the two endcap (EE) regions. The HCAL provides coverage for \(|\eta |<1.3\) in the barrel (HB) region and \(1.3<|\eta |< 3.0\) in the two endcap (HE) regions. The hadron forward (HF) calorimeters (\(3.0<|\eta | < 5.2 \)) complement the coverage provided by the barrel and endcap detectors. The zero-degree calorimeters (ZDCs) are two Čerenkov calorimeters composed of alternating layers of tungsten and quartz fibers that cover the region \(|\eta |>8.3\). Both the HF and ZDC detectors are divided into two halves, one covering positive pseudorapidities, the other negative, and referred to as HF+ and ZDC+ (and HF- and ZDC-), respectively. Another calorimeter, CASTOR, also a Čerenkov sampling calorimeter, consists of quartz and tungsten plates and is located only at negative pseudorapidities with coverage of \(-6.6<\eta <-5.2\).

A more detailed description of the CMS detector, together with the definition of the coordinate system used and the relevant kinematic variables, can be found in Ref. [27].

3 Data and Monte Carlo simulation

This analysis uses data from pPb collisions at \(\sqrt{\smash [b]{s_{_{\mathrm {NN}}}}} = 5.02\,\text {Te}\text {V} \) collected with the CMS detector in February 2013. The beam energies are 4\(\,\text {Te}\text {V}\) for the protons and 1.58\(\,\text {Te}\text {V}\) per nucleon for the lead nuclei. The integrated luminosity is \({\mathcal {L}} = 7.4\,\mu \text {b}^{-1} \) for the pPb data set (protons circulating in the negative z direction) and \({\mathcal {L}} = 9.6\,\mu \text {b}^{-1} \) for the Pbp data set (protons circulating in the positive z direction). Since the events are asymmetric in rapidity, the pPb and Pbp samples are merged after changing the sign of the rapidity in the Pbp sample.

The starlight (version 2.2.0) Monte Carlo (MC) event generator [28] is used to simulate exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction followed by the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) decay. The starlight generator models two-photon and photon-hadron interactions at ultrarelativistic energies. Two processes contribute to the exclusive \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) channel: resonant \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\rightarrow {\uppi _{}^{}} ^{+}{\uppi _{}^{}} ^{-}\) production, and nonresonant \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) production, including the interference term. Both processes are generated in order to calculate the signal acceptance and efficiency, and to extract the corrected signal yield. starlight is also used to generate exclusive \({{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}\) events. The pPb and Pbp samples are produced separately. The events are passed through a detailed Geant4 [29] simulation of the CMS detector in order to model the detector response, and are reconstructed with the same software used for the data.

4 Event selection

Table 1 presents the number of events after each selection requirement is applied. Events were selected online [30] by requiring the simultaneous presence of the two beams at the interaction point, as measured by the beam monitor timing system, in conjunction with at least one track in the pixel tracker. Offline, events are discarded if they have an energy deposit in any of the HF towers above the noise threshold of 3\(\,\text {Ge}\text {V}\). Events are also required to have exactly two tracks that pass the selection criteria defined in Ref. [31], and to be associated with a single vertex located within 15\(\,\text {cm}\) of the nominal interaction point along the beam direction. The pion mass is assigned to each track. In order to minimize the effect of the uncertainty in the low-\(p_{\mathrm {T}}\) track efficiency, one of the tracks should have a \(p_{\mathrm {T}}\) larger than 0.4\(\,\text {Ge}\text {V}\), and the other larger than 0.2\(\,\text {Ge}\text {V}\). Both tracks are selected in the interval \(|\eta | < 2.0\). The rapidity of the \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) system is required to be in the interval \(|y_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}} |<2.0\). To reject the photoproduction of \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) mesons from \({\upgamma _{}^{}} \mathrm {Pb}\) interactions where the proton radiates a quasi-real photon, the \(p_{\mathrm {T}}\) of the \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) system is required to be larger than 0.15\(\,\text {Ge}\text {V}\) (as discussed in Sect. 5).

A sizable background contribution comes from proton dissociative events, \({\upgamma _{}^{}} \mathrm{p}\rightarrow {{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\mathrm{p}^{*}\), where \(\mathrm{p}^{*}\) indicates a low-mass hadronic state. In these events the scattered proton is excited and then dissociates. The \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) is measured in the central region, whereas the low-mass state usually escapes undetected. To suppress this contribution, events with activity above noise thresholds in the CASTOR, HE, HF, and ZDC detectors are rejected. The signal-to-noise ratio in \(\hbox {ZDC}^{+}\) is better than in \(\hbox {ZDC}^{-}\) because of differences in radiation damage to the two detectors. For this reason, the ZDC energy thresholds shown in Table 1 are asymmetric. CASTOR is used for only the pPb sample because of its location, as discussed in Sect. 2. The final selection requires the two tracks to have opposite charges. A total of 20,060 opposite-sign pair events and 1514 same-sign pair events are selected in this analysis.

Table 1 Integrated luminosity and number of events after each of the selection requirements for the two data samples. The leading tower is the tower with the largest energy deposition in the calorimeter

5 Background

The main background sources are listed below.

  • Nonresonant \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) production. This contributes mainly through an interference term. It is included when fitting the invariant mass distribution, as discussed in Sect. 6.

  • Exclusive photoproduction of \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \) and \({{{\upphi _{}^{}}}{{\left( {1020}\right) }{}_{}^{}}} \) mesons. Contamination from the decay \({{{\upphi _{}^{}}}{{\left( {1020}\right) }{}_{}^{}}} \rightarrow \hbox {K}^{+}\hbox {K}^{-}\) is removed by assigning the kaon mass to the tracks and rejecting events with invariant mass values of the \(\hbox {K}^{+}\hbox {K}^{-}\) system larger than 1.04\(\,\text {Ge}\text {V}\). In addition, contamination is expected from the \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} {{\uppi _{}^{}} _{}^{0}} \) and \({{{\upphi _{}^{}}}{{\left( {1020}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} {{\uppi _{}^{}} _{}^{0}} \) decays when the photons from the \({\uppi _{}^{}} _{}^{0}\)  decay are undetected. Although the \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) invariant mass in these cases is mostly below the \({{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}\)  mass, the rate of \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \) and \({{{\upphi _{}^{}}}{{\left( {1020}\right) }{}_{}^{}}} \) meson production increases with \(|t |\). As observed in this analysis and at HERA [32], undetected photons lead to an overestimate of the \(p_{\mathrm {T}}\) imbalance in the event, mimicking large \(|t |\) events. Since these processes cannot be modeled by starlight, their contribution is estimated from the fits of the unfolded invariant mass distributions described in Sect. 6. The \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) amplitude is small, but is clearly visible through its interference with the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\), which produces the small kink in the invariant mass spectrum near 800\(\,\text {Me}\text {V}\). This contribution is included in the invariant mass fit, as discussed in Sect. 6.

  • Exclusive photoproduction of \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) mesons.Footnote 1 The \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) decays mostly into a \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) meson and a pion pair, leading to final states with four charged pions, or with two charged pions and two neutral pions. The \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) decay may also result in opposite-sign events when only two opposite-sign pions are detected because of the limited rapidity coverage of the detector. Such events will appear to have a \(p_{\mathrm {T}}\) imbalance, causing them to be incorrectly identified as large \(|t |~{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^0\) events, thereby resulting in a distortion of the \(|t |\) distribution. To validate the use of starlight for \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) photoproduction, exclusive \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) events are selected in the data. The data sample and the starlight simulation for \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) exclusive photoproduction are studied by applying the same selection criteria as for the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\), except that on the number of tracks. Figure 1 shows a comparison of the \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) distributions of the reconstructed \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) mesons in the four pion event samples obtained from the data and the starlight simulation. All combinations of two oppositely charged pions are plotted in Fig. 1 if they have an invariant mass \(0.5< M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}} < 1.2\,\text {Ge}\text {V} \). In addition, the distribution of the same-sign events in the data is shown; they come mostly from \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) decays with two missing pions. Figure 1 shows that the data and the starlight results are in agreement, lending confidence to the performance of this generator. These distributions provide a template for the \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) distribution of the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) background used to estimate its contribution, as described in Sect. 6.

  • Proton dissociative \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction. This contribution is suppressed by rejecting events with activity in the CASTOR, HE, HF, and ZDC detectors. In order to determine the residual contribution, a sample of dissociative events is selected by requiring activity in at least one of the forward detectors (CASTOR, HF, or ZDC). This sample provides a template for the \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) distribution of the dissociative events, under the assumption that the \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) distribution is independent of the mass of the dissociative system (the more forward the detector, the smaller the masses to which it is sensitive). Finally, this template is used to estimate the remaining dissociative background contributions, as discussed in Sect. 6.

  • Double pomeron exchange processes and photoproduction processes from \({\upgamma _{}^{}} \mathrm {Pb}\) interactions. Since the strong force has short range, only the nucleons on the surface of the nucleus may contribute to double pomeron exchange interactions; the corresponding cross section is therefore negligible [35]. For coherent processes in \({\upgamma _{}^{}} \mathrm {Pb}\) interactions, the size of the lead ion restricts the mean \(p_{\mathrm {T}}\) of the VM to be about \(60\,\text {Me}\text {V} \), corresponding to a de Broglie wavelength of the order of the nucleus size. Taking into account the detector resolution, all coherent \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) events have \(p_{\mathrm {T}}\) less than \(0.15\,\text {Ge}\text {V} \). Thus, events from \({\upgamma _{}^{}} \mathrm {Pb}\) interactions contribute to the lowest \(|t |\) region, which is not included in this analysis.

Fig. 1
figure 1

Comparison between the \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) distributions of the reconstructed \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) mesons in the data (full symbols) and the starlight simulation (histogram) when only two oppositely charged pions are selected. The triangles correspond to same-sign two-track events (either \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{+}} \) or \({{\uppi _{}^{}} _{}^{-}} {{\uppi _{}^{}} _{}^{-}} \)) in the data; they mostly come from \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) decays with two undetected pions. The integrals of all three distributions are normalized to unity. Vertical bars correspond to the statistical uncertainties. The region to the left of the dashed vertical line is not included in the analysis (see Sect. 5 for details)

6 Signal extraction

The extraction of the signal is carried out in two steps. First, the proton dissociative and the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) contributions are estimated by performing a fit to the data as a function of \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\). This method relies on the fact that exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) events contribute mainly to the low-\(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) region (\(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}<0.7\,\text {Ge}\text {V} \)), whereas nonexclusive events dominate the high-\(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) region (\(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}>1.2\,\text {Ge}\text {V} \)), and the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) contribution is mostly at intermediate \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) values (\(0.7<p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}<1.2\,\text {Ge}\text {V} \)). This makes the identification of the proton dissociative and the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) contributions robust. Second, the yield of exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) candidates is extracted by performing a fit to the unfolded invariant mass distribution. Since the events from exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) production have a different invariant mass distribution from the signal events, they are subtracted before correcting the data for acceptance and efficiency. Conversely, the proton dissociative background has the same invariant mass and angular distributions as the signal, and its effect is corrected after unfolding by scaling the observed yields according to the fit performed in the first step.

To extract the normalizations of the proton dissociative and the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) backgrounds, an unbinned maximum likelihood fit is performed to the data as a function of \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) in the rapidity interval \(|y_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}} | < 2\). The sum of the following distributions is fitted to the data at the reconstructed level: the signal distribution and the \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) continuum, as simulated by starlight, the distribution of the proton dissociative background, which is extracted from the data control sample, and the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) fitting template, which is simulated using starlight. The normalization of each of these components is determined from the fit. The signal \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) distribution generated by starlight is reweighted to describe the data using the theory-inspired expression \(\mathrm {e}^{- b|t |}\) [15]. The initial b value of starlight is \(12\,\text {Ge}\text {V} ^{-2}\) and the reweighted b is \(13.1^{+0.4}_{-0.3}\,\text {(stat)} \,\text {Ge}\text {V} ^{-2}\).

The result of the fit of the \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) distributions is shown in Fig. 2, including the systematic uncertainties associated with the fitting procedure that are discussed in Sect. 7. The resulting residual proton-dissociative and \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) contributions, over the whole rapidity interval, are \(18\pm 2\%\) \(\,\text {(stat)}\) and \(20\pm 2\%\,\text {(stat)} \), respectively. Similar fractions of proton dissociative and \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) contributions are obtained in the four rapidity intervals used in the differential cross section measurement as a function of rapidity. This is consistent with the small energy dependence of these processes in the energy range of this analysis. As seen in Fig. 2, the signal and both background contributions are of the same order of magnitude around \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}=1\,\text {Ge}\text {V} \), corresponding to a signal-to-background ratio of about 30%. For this reason, only the region \(|t | < 1\) \(\text {Ge}\text {V} ^{2}\) is used in this measurement.

Fig. 2
figure 2

The measured distribution of the reconstructed \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) transverse momentum (full circles) together with the fitted sum of signal and backgrounds described in the text (red solid histogram). The starlight direct \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) contribution (pink dotted histogram), the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) background (blue dotted-short-dashed histogram), and the proton-dissociative contribution (green dotted-long-dashed histogram) are also shown. The shaded areas represent the systematic uncertainties. The region to the left of the dashed vertical line is not included in the analysis (see Sect. 5 for details)

The \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) background is subtracted in bins of invariant mass using the normalization obtained from the \(p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) fitting templates. The invariant mass distribution is then unfolded using the iterative D’Agostini method [36], which is regularized by four iterations. In particular, the Bayesian iterative unfolding technique is used, as implemented in the roounfold package [37]. This procedure leads to corrections for experimental effects including possible data migration between bins. The response matrix is obtained from starlight. The average of the combined acceptance and efficiency is 0.13 and is almost independent of both \(p_{\mathrm {T}}\) and \(\eta \), whereas it is sensitive to the invariant mass.

The invariant mass shape of the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) in photoproduction deviates from that of a pure Breit–Wigner resonance [38]. Several parameterizations of the shape exist. One of the most often used is the Söding formula [39], where a continuum amplitude B is added to a Breit–Wigner distribution. Following the recent results by the STAR Collaboration [23] and the earlier ones by the DESY-MIT Collaboration [40], a further relativistic Breit–Wigner component is added to account for \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \) photoproduction, followed by the decay \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \). This leads to the following fitting function:

$$\begin{aligned}&\frac{\mathrm {d}N_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}}{\mathrm {d}M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}} = \left| A\frac{\sqrt{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}}}\varGamma _{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}}}}}{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}^{2} - M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}^{2} + iM_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}\varGamma _{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}}}}\right. \\&\left. \quad + B + C\mathrm {e}^{i\phi _\omega }\frac{\sqrt{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}\varGamma _{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {\uppi _{}^{}} {\uppi _{}^{}}}}}{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}^{2} - M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}^{2} + iM_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} ^{0}}\varGamma _{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}} \right| ^{2}. \end{aligned}$$

Here A is the amplitude of the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) Breit–Wigner function, B is the amplitude of the direct nonresonant \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) production, C is the amplitude of the \({{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}\) contribution, and the mass-dependent widths are given by

$$\begin{aligned} \varGamma _{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}}} = \varGamma _{0}\frac{M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}}{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}} \left[ \frac{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}^{2} - 4m_{{{\uppi _{}^{}} _{}^{\pm }}}^{2}}{M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}^{2} - 4m_{{{\uppi _{}^{}} _{}^{\pm }}}^{2}} \right] ^{\frac{3}{2}}, \end{aligned}$$

and

$$\begin{aligned} \varGamma _{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}} = \varGamma _{0}\frac{M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}}{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}} \left[ \frac{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}^{2} - 9m_{{{\uppi _{}^{}} _{}^{\pm }}}^{2}}{M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}^{2} - 9m_{{{\uppi _{}^{}} _{}^{\pm }}}^{2}} \right] ^{\frac{3}{2}}, \end{aligned}$$

where \(\varGamma _{0}\) is the pole width for each meson and \(m_{{{\uppi _{}^{}} _{}^{\pm }}}\) is the charged pion mass. Since the branching fraction (\({\mathcal {B}}\)) for \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) is small, only the first order term in the \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}-{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) mass mixing theory is considered [40], leading to

$$\begin{aligned}&\varGamma _{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {\uppi _{}^{}} {\uppi _{}^{}}} \\&\quad ={\mathcal {B}}({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {\uppi _{}^{}} {\uppi _{}^{}})\varGamma _{0}\frac{M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}}{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}} \left[ \frac{M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}^{2} - 4m_{{{\uppi _{}^{}} _{}^{\pm }}}^{2}}{M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}^{2} - 4m_{{{\uppi _{}^{}} _{}^{\pm }}}^{2}} \right] ^{\frac{3}{2}}, \end{aligned}$$

with \({\mathcal {B}}({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {\uppi _{}^{}} {\uppi _{}^{}})=0.0153^{+0.0011}_{-0.0013}\) [33]. The H1 and ZEUS measurements did not include the \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}-{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) interference component, although the ZEUS data seem to indicate its effect in the mass spectrum near 800\(\,\text {Me}\text {V}\) [17].

Fig. 3
figure 3

Unfolded \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) invariant mass distribution in the pion pair rapidity interval \(|y_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}} | < 2.0\) (full circles) fitted with the modified Söding model. The results of the fit are also given (see text for details). The green dashed line indicates resonant \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) production, the red dotted line the interference term, the black dash-dotted line the non-resonant contribution, the dark blue dashed line the interference between \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) and \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \), and the blue solid line represents the sum of all these contributions

Figure 3 shows the fit of the unfolded distribution with the modifed Söding model. A least squares fit is performed for the interval \(0.6< M_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}} < 1.1\,\text {Ge}\text {V} \), with the quantities \(M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}\), \(M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}\), \(\varGamma _{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}\), \(\varGamma _{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}\), A, B, C, and \(\phi _{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \) treated as free parameters. This model includes the interference between resonant \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) and direct \({\uppi _{}^{}} ^{+}{\uppi _{}^{}} ^{-}\) production, as well as between \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) and \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \) production. To correct for the \({{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}\)  reflection in the \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) mass spectrum, a Gaussian function peaking around 500\(\,\text {Me}\text {V}\) [18] is added as a further component of the invariant mass fit. This is only visible at high \(|t |\) values, as shown in Fig. 4. The fit yields \(M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}} = 773\pm 1\) \(\,\text {(stat)}\) \(\,\text {Me}\text {V}\) and \(\varGamma _{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}} = 148\pm 3\,\text {(stat)} \,\text {Me}\text {V} \), and \(M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}} = 776\pm 2\) \(\,\text {(stat)}\) \(\,\text {Me}\text {V}\), consistent with the world average values [33]. The fitted value of the \({{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}\) width, \(\varGamma _{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}} = 30\pm 5\) \(\,\text {(stat)}\) \(\,\text {Me}\text {V}\), is instead larger than the world average because of the detector resolution.

The \(|B/A |\) and C / A fractions are also determined; they measure the ratios of the nonresonant and \({{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}\) contributions to the resonant \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) production, respectively. Since the ZEUS Collaboration found that \(|B/A |\) decreases as \(|t |\) increases, the fit is repeated for \(|t |<0.5\) \(\text {Ge}\text {V} ^{2}\) resulting in \(0.50 \pm 0.06\) \(\,\text {(stat)}\) \(\text {Ge}\text {V} ^{-1/2}\). For this kinematic region H1 measured \(|B/A |=0.57 \pm 0.09\) \(\,\text {(stat)}\) \(\text {Ge}\text {V} ^{-1/2}\) and ZEUS \(|B/A |=0.70 \pm 0.04\) \(\,\text {(stat)}\) \(\text {Ge}\text {V} ^{-1/2}\). If the fit is repeated without the \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}-{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) interference component, the result for \(|B/A |\) changes by less than its statistical uncertainty. The measured ratio of the \({{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}\) to \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) amplitudes is \(C/A=0.40\pm 0.06\) \(\,\text {(stat)}\), consistent with the prediction of starlight, \(C/A=0.32\), and the measurements of the STAR [23] and the DESY-MIT [40] experiments, which report \(C/A=0.36\pm 0.03\) \(\,\text {(stat)}\) and \(C/A=0.36\pm 0.04\) \(\,\text {(stat)}\), respectively. The present fit gives a nonzero \({{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}\) phase angle, \(\phi _{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} =1.8\pm 0.3\) \(\,\text {(stat)}\), also in agreement with the previous measurements [23, 40].

Additionally, the fit is performed in \(|t |\) and y bins as shown in Fig. 4. To ensure fit stability, the \(M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}\), \(M_{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}\), \(\varGamma _{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}\), \(\varGamma _{{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}}}\), \(\phi _{{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \) and \(|C/A |\) parameters are fixed to the values obtained for the full rapidity interval. The \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} {{\uppi _{}^{}} _{}^{0}} \) contribution increases with \(|t |\), as reported by the H1 Collaboration [18] and as seen in Fig. 4. The \(|B/A |\) ratio is found to be independent of \(W_{{\upgamma _{}^{}} \mathrm{p}}\) and decreases with \(|t |\), in agreement with results reported by ZEUS [17].

Fig. 4
figure 4

Unfolded \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) invariant mass distributions in the pion pair rapidity interval \(|y_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}} | < 2.0\) (full circles) fitted with the Söding model in different \(|t |\) bins. The green dashed lines indicate resonant \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) production, the red dotted lines the interference term, the magenta dash-dotted lines correspond to the background from \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \rightarrow {{\uppi _{}^{}} _{}^{0}} {{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \), the black dash-dotted lines to the nonresonant contribution, the dark blue dashed line to the interference between \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) and \({{{\upomega _{}^{}}}{{\left( {783}\right) }{}_{}^{}}} \), and the blue solid lines represent the sum of all these contributions

7 Systematic uncertainties

The following sources of systematic uncertainty are considered.

Integrated luminosity determination: The uncertainty in the integrated luminosity is 4% for both the pPb and Pbp samples [41].

Track reconstruction: The contribution of the tracking efficiency to the systematic uncertainty is studied with the method described in Ref. [26], where the ratio of yields of neutral charm mesons decaying to two-body and four-body final states is compared with data and simulation for pion momenta above 300\(\,\text {Me}\text {V}\). The accuracy of the detector simulation to reproduce the single-pion tracking efficiency is 3.9%. For the present measurement, this yields a 7.8% uncertainty.

Unfolding: The uncertainty associated with the unfolding procedure is determined by modifying the number of iterations used for the Bayesian unfolding from the nominal value of 4 to 3 and 5. The resulting uncertainty is smaller than that found when changing the model for building the response matrix. The latter is estimated by comparing two different starlight samples: resonant \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) meson production, and combined resonant and nonresonant \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) production. The resulting effect on the integrated cross section is 3%.

Uncertainty in the photon flux: The uncertainty in the photon flux is 9% for the high-\(W_{{\upgamma _{}^{}} \mathrm{p}}\) data point and 2% at low \(W_{{\upgamma _{}^{}} \mathrm{p}}\), as discussed in Ref. [11]. The flux is computed in impact parameter space, convolved with the probability of no hadronic interactions. The radius of the lead nucleus is varied by the nuclear skin thickness (\(\pm 0.5\,\text {fm} \)). In addition, in the calculation of the photon flux, the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) pole mass in Eq. (1) is replaced by the reconstructed \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) mass on an event-by-event basis. The effect of this variation is negligible.

Calorimeter exclusivity: The uncertainty related to the exclusivity requirements is evaluated by varying the calorimeter energy thresholds. Increasing (or decreasing) the energy scale of the HF calorimeter towers by 5% results in a 1.0% variation of the exclusive \({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}} \) yields. The CASTOR energy scale is varied by \(17\%\) [42], resulting in a difference of 1% in the extracted \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) yield. The variations of the energy thresholds for HE and ZDC within their respective energy scale uncertainties have a negligible effect.

Background estimation: The uncertainty in the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) subtraction is evaluated by varying the normalization of the \({{{\uprho _{}^{}} _{}^{}}{{\left( {1700}\right) }{}_{}^{}}} \) contribution by 20% with respect to that obtained from the fit shown in Fig. 2. As mentioned in Sect. 5, the proton dissociative background template is obtained by requiring a signal in at least one of the forward detectors: HF, CASTOR, or ZDC. To calculate the systematic uncertainty related to the estimation of this background, the analysis is repeated five times and each time alternative combinations of forward detectors are used to obtain the proton dissociative template. The following variations are studied: (i) HF alone; (ii) CASTOR alone; (iii) ZDC alone; (iv) HF or CASTOR; (v) HF or ZDC. For each of these combinations the proton dissociative contributions are obtained in each \(|t |\) and rapidity bin. The maximum deviations from the nominal results are taken as conservative estimates of the systematic uncertainty. The resulting effect on the integrated exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction cross section is smaller than 10%.

Model dependence: In order to assess the uncertainty due to the model used to fit the invariant mass distribution, the Ross–Stodolsky model [43] is used instead of the Söding model. The resulting cross section changes by up to 8%, depending on the rapidity and \(|t |\) interval studied. Another contribution to the model dependence uncertainty comes from the reweighting procedure of the starlight MC described in Sect. 6. This uncertainty is evaluated by varying the reweighting parameter b within its uncertainty; it is found to increase as a function of \(|t |\), and reaches 32% for the highest \(|t |\) bin. The second contribution turns out to be dominant for all the rapidity and \(|t |\) intervals studied. The uncertainty in the extrapolation to the region \(|t | < 0.025\,\text {Ge}\text {V} ^{2}\) is model dependent. We estimated this uncertainty by studying different fitting functions to the differential cross section measurements. In particular, we studied a dipole form [28], a pure exponential \(\mathrm {e}^{-bt}\), and a modified exponential \(\mathrm {e}^{-bt+ct^2}\). The difference between the two most extreme extrapolated values is used as an estimate of the model dependence uncertainty.

The values of the systematic uncertainties for all \(y_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}}\) and \(|t |\) intervals are summarized in Table 2. The systematic uncertainties are added in quadrature for the integrated photoproduction cross section. For the differential cross section results, the systematic uncertainties in Table 2 are treated as correlated between bins.

Table 2 Summary of the systematic uncertainties in the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction cross section. The numbers are given in percent. The total uncertainty is calculated by adding the individual uncertainties in quadrature

8 Results

The differential cross section for exclusive photoproduction of \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) mesons is given by

$$\begin{aligned} \frac{\mathrm {d}\sigma }{\mathrm {d}y} = \frac{N^{\text {exc}}_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}}{{\mathcal {B}}({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\rightarrow {\uppi _{}^{}} ^{+}{\uppi _{}^{}} ^{-}) L \varDelta y}, \end{aligned}$$

where \(N^{\text {exc}}_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}\) is the corrected number of exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) events obtained from the fits described in Sect. 6 by integrating the resonant component in the interval \(0.28< M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}<1.50\,\text {Ge}\text {V} \) (\(2M_{{{\uppi _{}^{}} _{}^{\pm }}}< M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}} < M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}} + 5\varGamma _{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}}\)); \({\mathcal {B}}\) is the branching fraction, which equals about 0.99 for the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\rightarrow {\uppi _{}^{}} ^{+}{\uppi _{}^{}} ^{-}\) decay [33], \(\varDelta y\) is the rapidity interval, and L is the integrated luminosity of the data sample. The cross section \(\mathrm {d}\sigma /\mathrm {d}y(\mathrm{p}\mathrm {Pb}\rightarrow \mathrm{p}\mathrm {Pb}{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0})\) is related to the photon–proton cross section, \(\sigma ({\upgamma _{}^{}} \mathrm{p}\rightarrow {{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\mathrm{p}) \equiv \sigma (W_{{\upgamma _{}^{}} \mathrm{p}})\), through the photon flux, \(\mathrm {d}n/\mathrm {d}k\):

$$\begin{aligned} \frac{\mathrm {d}\sigma }{\mathrm {d}y}(\mathrm{p}\mathrm {Pb}\rightarrow \mathrm{p}\mathrm {Pb}{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}) = k \frac{\mathrm {d}n}{\mathrm {d}k} \sigma ({\upgamma _{}^{}} \mathrm{p}\rightarrow {{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\mathrm{p}). \end{aligned}$$

Here, k is the photon energy, which is determined from the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) mass and rapidity, according to the formula

$$\begin{aligned} k = (1/2) M_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}} \exp {(-y_{{{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}})}. \end{aligned}$$
(1)

The average photon flux and the average centre-of-mass energy (\(\langle W_{{\upgamma _{}^{}} \mathrm{p}} \rangle \)) values in each rapidity interval are calculated using starlight.

Table 3 Differential cross section for exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction, \(\sigma ({\upgamma _{}^{}} \mathrm{p}\rightarrow {{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\mathrm{p})\), with statistical and systematic uncertainties, for \(|t |<0.5\) \(\text {Ge}\text {V} ^{2}\). The differential cross section \(\mathrm {d}\sigma /\mathrm {d}|t |\) is also shown, along with the rapidity range, the average value of \(W_{{\upgamma _{}^{}} \mathrm{p}}\), \(\langle W_{{\upgamma _{}^{}} \mathrm{p}}\rangle \), and \( k \frac{\mathrm {d}n}{\mathrm {d}k}\)
Fig. 5
figure 5

Differential cross section \(\mathrm {d}\sigma /\mathrm {d}|t |\) (full circles) in four different rapidity bins. The error bars show the statistical uncertainty, whereas the shaded areas represent the statistical and systematic uncertainties added in quadrature. The dashed lines show the unweighted starlight predictions

The unfolded invariant mass distribution is studied in different \(|t |\) bins, and the extraction of the \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction cross section is performed in each bin. In order to compare with the HERA results, the \(p_{\mathrm {T}}\)-related measurements are presented in terms of \(|t |\), which is approximated as \(|t | \approx (p_{\mathrm {T}} ^{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}})^{2}\). Figure 5 shows the differential cross sections as a function of \(|t |\), together with the unweighted starlight prediction, whose slope parameter is independent of \(W_{{\upgamma _{}^{}} \mathrm{p}}\). The starlight prediction is systematically higher than the data in the high-\(|t |\) region. This trend becomes more significant as \(W_{{\upgamma _{}^{}} \mathrm{p}}\) increases.

Fig. 6
figure 6

Differential cross section \(\mathrm {d}\sigma /\mathrm {d}|t |\) (full circles) for exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction in the rapidity interval \(-1.2< y_{{{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}} < 0\). The square symbols indicate the H1 results, and the triangles the ZEUS results. The error bars show the statistical uncertainty, while the shaded areas represent the statistical and systematic uncertainties added in quadrature. For the H1 data [18], the error bars represent the statistical and systematic uncertainties added in quadrature, and for the ZEUS data [17] the reported uncertainties are negligible

Figure 6 shows the differential cross section \(\mathrm {d}\sigma /\mathrm {d}|t |\) in the rapidity interval \(-1.2< y({{\uppi _{}^{}} _{}^{+}} {{\uppi _{}^{}} _{}^{-}}) < 0\) compared with the H1 and ZEUS results [17, 18] in a similar \(W_{{\upgamma _{}^{}} \mathrm{p}}\) range.

Fig. 7
figure 7

The slope parameter b extracted from the exponential fits of the differential cross sections \(\mathrm {d}\sigma /\mathrm {d}|t |\) shown as a function of \(W_{{\upgamma _{}^{}} \mathrm{p}}\). The inner error bars show the statistical uncertainty, while the outer error bars indicate the statistical and systematic uncertainties added in quadrature. The dashed line shows the result of the Regge fit discussed in the text

The differential cross section as a function of \(|t |\) is fitted with the form \(A\mathrm {e}^{-bt+ct{^2}}\) in the region \(0.025<|t |<0.5\) \(\text {Ge}\text {V} ^{2}\). For the integrated rapidity bin the fit gives \(b=9.2\pm 0.7\) \(\,\text {(stat)}\) \(\text {Ge}\text {V} ^{-2}\) and \(c=4.6\pm 1.6\) \(\,\text {(stat)}\) \(\text {Ge}\text {V} ^{-4}\). The resulting values of the slope b are shown in Fig. 7 as a function of \(W_{{\upgamma _{}^{}} \mathrm{p}}\), together with those measured by H1 and ZEUS [17, 18]. The values of the parameter c are found to be constant within the fit uncertainties. The Regge formula [44] \(b = b_{0} + 2\alpha '\ln (W_{{\upgamma _{}^{}} \mathrm{p}}/W_{0})^{2}\), which parametrizes the dependence of b on the collision energy, is fitted to the data using \(W_{0} = 92.6\) \(\,\text {Ge}\text {V}\), the average centre-of-mass energy of the present data. The fit to the CMS data alone gives a pomeron slope of \(\alpha ' = 0.28 \pm 0.11\,\text {(stat)} \pm 0.12\) \(\,\text {(syst)}\) \(\text {Ge}\text {V} ^{-2}\), consistent with the ZEUS [17] value and the Regge expectation of \(0.25~\text {Ge}\text {V} ^{-2}\).

The resulting photon–proton cross section, obtained for \(W_{{\upgamma _{}^{}} \mathrm{p}}\) between 29 and 213\(\,\text {Ge}\text {V}\) (\(\langle W_{{\upgamma _{}^{}} \mathrm{p}} \rangle = 92.6\) \(\,\text {Ge}\text {V}\)) is extrapolated to the range \(0<|t |<0.5~\text {Ge}\text {V} ^{2}\) using the exponential fits just discussed and the starlight predictions in order to allow direct comparison with previous experiments. The resulting value is \(\sigma = 11.0 \pm 1.4\) \(\,\text {(stat)}\) \(\pm 1.0\) \(\,\text {(syst)}\) \(\mu \)b. The photon–proton cross section values, \(\sigma ({\upgamma _{}^{}} \mathrm{p}\rightarrow {{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\mathrm{p})\), for all rapidity bins are presented in Table 3 and Fig. 8. Figure 8 also shows a compilation of fixed-target [45,46,47,48] and HERA results [17, 18]. The results of two fits are shown in Fig. 8. The dashed line indicates the result of a fit to all the plotted data with the formula \(\sigma = \alpha _{1} W^{\delta _{1}}_{{\upgamma _{}^{}} \mathrm{p}} + \alpha _{2} W^{\delta _{2}}_{{\upgamma _{}^{}} \mathrm{p}}\) (see e.g. [19, 20]). The fit describes the data well and yields the values \(\delta _{1} = -0.81 \pm 0.04\) \(\,\text {(stat)}\) \(\pm 0.09\) \(\,\text {(syst)}\), \(\delta _{2} = 0.36 \pm 0.07\) \(\,\text {(stat)}\) \(\pm 0.05\) \(\,\text {(syst)}\). The CMS and HERA data are also fitted with the function \(\sigma = \alpha W^{\delta }_{{\upgamma _{}^{}} \mathrm{p}}\) as shown in Fig. 8. The fit yields \(\delta = 0.24 \pm 0.13\) \(\,\text {(stat)}\) \(\pm 0.04\) \(\,\text {(syst)}\). Only statistical and uncorrelated systematic uncertainties are considered in these fits.

Fig. 8
figure 8

Exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction cross section as a function of \(W_{{\upgamma _{}^{}} \mathrm{p}}\). The inner bars show the statistical uncertainty, while the outer bars represent the statistical and systematic uncertainties added in quadrature. Fixed-target [45,46,47,48] and HERA [17, 18] data are also shown. The dashed lines indicate the results of the fits described in the text

9 Summary

The CMS Collaboration has made the first measurement of exclusive \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction off protons in ultraperipheral pPb collisions at \(\sqrt{\smash [b]{s_{_{\mathrm {NN}}}}} = 5.02\,\text {Te}\text {V} \). The cross section for this process is measured in the photon–proton centre-of-mass energy interval \(29< W_{{\upgamma _{}^{}} \mathrm{p}} < 213\,\text {Ge}\text {V} \). The results are consistent with those of the H1 and ZEUS Collaborations at HERA, indicating that ion–proton collisions can be used in the same way as electron–proton ones, with ions acting as a source of quasi-real photons. The combination of the present data and the earlier, lower energy results agrees with theory-inspired fits. The differential cross section \(\mathrm {d}\sigma /\mathrm {d}|t |\) for \({{{\uprho _{}^{}} _{}^{}}{{\left( {770}\right) }{}_{}^{}}} ^{0}\) photoproduction is measured as a function of \(W_{{\upgamma _{}^{}} \mathrm{p}}\). The starlight prediction is systematically higher than the data in the high-\(|t |\) region. This trend becomes more significant as \(W_{{\upgamma _{}^{}} \mathrm{p}}\) increases.