1 Introduction

Recently, the LHCb Collaboration confirmed the \(\Xi _{cc}\) baryon [1] which was predicted in the quark model (QM) decades ago [2] and first measured by the SELEX Collaboration in 2002 [3]. Excited conventional heavy hadrons are also observed in recent years [4]. We are still on the way to confirm the conventional structure with three heavy quarks. However, the most exciting thing in hadron physics is that more and more unexpected hadrons are detected [5,6,7,8,9,10,11,12,13,14,15,16] and thus hadrons beyond the conventional quark model should exist. This indicates that we may identify the existence of multiquark states before the confirmation of all the QM states. For example, the \(P_c(4380)\) and \(P_c(4450)\) states observed in the \(J/\psi N\) channel by the LHCb Collaboration [17] can be interpreted as pentaquark states since their high masses are not natural for conventional 3q baryons [18]. If a pentaquark can be confirmed, the existence of other multiquark states should also be possible. It is interesting to investigate theoretically which multiquark systems allow bound states.

Table 1 Flavor contents of the pentaquarks we consider

Since the pentaquark-like states \(P_c(4380)\) and \(P_c(4450)\) are much higher than the \(J/\psi N\) threshold and the \(J/\psi N\) interaction is not strong (a lattice simulation gives a value around 0.7 fm for the scattering length [19]), the interpretation with \(J/\psi N\) scattering states seem not to be appropriate. In the literature, various interpretations, such as \(\Sigma _c^{(*)}\bar{D}^*\) molecules, diquark-diquark-antiquark pentaquarks or diquark-triquark pentaquarks, have been used to understand their nature [9,10,11,12,13,14,15,16]. Assigning them as \(qqqc\bar{c}\) compact pentaquarks is another possible interpretation, where the \(c\bar{c}\) is a color-octet state. In Refs. [20,21,22], investigations along this line were performed. It was found that interpreting the \(P_c(4380)\) state as such a pentaquark can be accepted. Further investigations on this type configuration of pentaquarks showed that a stable \(\Lambda \)-type hidden-charm state is also possible [21, 23]. In the present study, we are going to consider a mirror-type structure by changing heavy (light) quarks to light (heavy) quarks, pentquarks with the \(QQQq\bar{q}\) configuration where QQQ is always a color-octet triply heavy state. In the following discussions, we use QQQ to denote ccc, bbb, ccb, or bbc. When one needs to distinguish the quark contents, we will also use QQQ to denote ccc or bbb and \(QQQ'\) to denote ccb or bbc.

In the study of the \(udsQ\bar{Q}\) states with a colored uds, one found that the quark-quark and quark-antiquark color-spin interactions can all be attractive [21]. Mixing effects among different color-spin structures further lowered the pentaquark masses and finally resulted in a \(\Lambda \)-type state which has a rather low mass. The mass is not far from the value obtained in Ref. [18] where molecule configuration was adopted and hidden-charm pentaquarks were proposed first. In the present work, we try to understand whether colored QQQ is also helpful to the formation of pentqaurks or not. If the answer is yes, a problem to distinguish the pentaquarks from conventional QQQ baryons may arise. If no, one expects that conventional triply heavy baryons rather than pentaquarks would be found experimentally first.

Up to now, theoretical studies have given the masses of the conventional QQQ baryons in various approaches, although there is still no experimental evidence about them. According to these calculations, the mass of the ground \(\Omega _{ccc}\) baryon, for example, is in the range of 4.6\(\sim \)5.0 GeV [4, 24,25,26,27]. If an additional quark-antiquark pair surrounds the heavy color source, there is a possibility that the system has a little higher mass and it looks like an excited \(\Omega _{ccc}\) state. This possibility would be excluded if the \(QQQq\bar{q}\) state has a much higher mass. We would like to extract some information about this problem from the following investigations.

In this article, we consider the mass splittings of the compact triply heavy pentaquarks \(QQQq\bar{q}\) \((Q=b,c;q=u,d,s)\)Footnote 1 and estimate their rough masses in the framework of a simple quark model. In the following Sect. 2, the wave functions will be constructed. In Sect. 3, we give the chromomagnetic interaction (CMI) matrices for different types of pentaquarks. In Sect. 4, we show our choice of relevant parameters and analyse the numerical results for the spectrum. The last section is a short summary.

2 Construction of the wave functions

Before the calculation of CMI matrices for the considered ground pentaquark states, we need to construct all the spin-color wave functions. The configuration we consider contains three heavy quarks (ccc, ccb, bbc, or bbb) and a light quark-antiquark pair (\(n\bar{n}\), \(n\bar{s}\), \(s\bar{n}\), or \(s\bar{s}\), \(n=u\) or d), which is simply denoted as \(1234\bar{5}\). Table 1 lists the flavor contents of these 16 systems.

Here, we use \(|S_{12},S_{123},S_{4\bar{5}},J~=~S_{1234\bar{5}}\rangle \) to denote the possible spin wave functions. There are five states with \(J~=~1/2\),

$$\begin{aligned} X_1= & {} |1,\frac{1}{2},0,\frac{1}{2}\rangle , \quad X_2=|1,\frac{1}{2},1,\frac{1}{2}\rangle , \nonumber \\ X_3= & {} |1,\frac{3}{2},1,\frac{1}{2}\rangle ,\quad X_4=|0,\frac{1}{2},1,\frac{1}{2}\rangle , \nonumber \\ X_5= & {} |0,\frac{1}{2},0,\frac{1}{2}\rangle , \end{aligned}$$
(1)

four states with \(J~=~3/2\),

$$\begin{aligned} X_6= & {} |1,\frac{1}{2},1,\frac{3}{2}\rangle ,\quad X_7=|1,\frac{3}{2},0,\frac{3}{2}\rangle ,\nonumber \\ X_8= & {} |1,\frac{3}{2},1,\frac{3}{2}\rangle ,\quad X_9=|0,\frac{1}{2},1,\frac{3}{2}\rangle , \end{aligned}$$
(2)

and one state with \(J~=~5/2\)

$$\begin{aligned} X_{10}=|1,\frac{3}{2},1,\frac{5}{2}\rangle . \end{aligned}$$
(3)

Their explicit expressions are easy to get by using the SU(2) C.G. coefficients.

In color space, one uses \(|R_{12},R_{123},R_{4\bar{5}},R_{1234\bar{5}}=1_c\rangle \) to denote the wave functions. Then, we find two bases

$$\begin{aligned} C_1= & {} |6,8^{MS},8,1^{MS}\rangle ,\quad C_2=|\bar{3},8^{MA},8,1^{MA}\rangle \end{aligned}$$
(4)

for the present investigation, where the superscripts MS and MA mean that the first two quarks are symmetric and antisymmetric, respectively. Their explicit expressions are the same as those presented in Eq. (2) of Ref. [21].

Taking the Pauli principle into account when we combine the bases in different spaces, one may obtain five types of total wave functions.

  • Type A [\(\mathrm{Flavor}=QQQq\bar{q}\), \(\mathrm{J}=1/2\)]:

    $$\begin{aligned} \Phi _1^A= & {} \frac{1}{\sqrt{2}}\left\{ [(QQ)_6^0Q]_8^{\frac{1}{2}}(q\bar{q})_8^0\right\} _1^{\frac{1}{2}}\nonumber \\&-\frac{1}{\sqrt{2}}\left\{ [(QQ)_{\bar{3}}^1Q]_8^{\frac{1}{2}}(q\bar{q})_8^0\right\} _1^{\frac{1}{2}}\nonumber \\= & {} \frac{1}{\sqrt{2}}QQQq\bar{q}\otimes (C_1\otimes X_5-C_2\otimes X_1),\nonumber \\ \Phi _2^A= & {} \frac{1}{\sqrt{2}}\left\{ [(QQ)_6^0Q]_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{1}{2}}\nonumber \\&- \frac{1}{\sqrt{2}}\left\{ [(QQ)_{\bar{3}}^1Q]_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{1}{2}}\nonumber \\= & {} \frac{1}{\sqrt{2}}QQQq\bar{q}\otimes (C_1\otimes X_4-C_2\otimes X_2); \end{aligned}$$
    (5)
  • Type B [\(\mathrm{Flavor}\,=\,QQQq\bar{q}\), \(\mathrm{J}~=~3/2\)]:

    $$\begin{aligned} \Phi _1^B= & {} \frac{1}{\sqrt{2}}\left\{ [(QQ)_6^0Q]_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{3}{2}}\nonumber \\&- \frac{1}{\sqrt{2}}\left\{ [(QQ)_{\bar{3}}^1Q]_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{3}{2}}\nonumber \\= & {} \frac{1}{\sqrt{2}}QQQq\bar{q}\otimes (C_1\otimes X_9-C_2\otimes X_6); \end{aligned}$$
    (6)
  • Type C [\(\mathrm{Flavor}=QQQ'q\bar{q}\), \(J~=~1/2\)]:

    $$\begin{aligned} \Phi _1^C= & {} \left\{ [(QQ)_6^0Q']_8^{\frac{1}{2}}(q\bar{q})_8^0\right\} _1^{\frac{1}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_1\otimes X_5,\nonumber \\ \Phi _2^C= & {} \left\{ [(QQ)_6^0Q']_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{1}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_1\otimes X_4,\nonumber \\ \Phi _3^C= & {} \left\{ [(QQ)_{\bar{3}}^1Q']_8^{\frac{1}{2}}(q\bar{q})_8^0\right\} _1^{\frac{1}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_2\otimes X_1,\nonumber \\ \Phi _4^C= & {} \left\{ [(QQ)_{\bar{3}}^1Q']_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{1}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_2\otimes X_2,\nonumber \\ \Phi _5^C= & {} \left\{ [(QQ)_{\bar{3}}^1Q']_8^{\frac{3}{2}}(q\bar{q})_8^1\right\} _1^{\frac{1}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_2\otimes X_3; \end{aligned}$$
    (7)
  • Type D [Flavor \(=QQQ'q\bar{q}\), J = 3/2]:

    $$\begin{aligned} \Phi _1^D= & {} \left\{ [(QQ)_6^0Q']_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{3}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_1\otimes X_9,\nonumber \\ \Phi _2^D= & {} \left\{ [(QQ)_{\bar{3}}^1Q']_8^{\frac{1}{2}}(q\bar{q})_8^1\right\} _1^{\frac{3}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_2\otimes X_6,\nonumber \\ \Phi _3^D= & {} \left\{ [(QQ)_{\bar{3}}^1Q']_8^{\frac{3}{2}}(q\bar{q})_8^0\right\} _1^{\frac{3}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_2\otimes X_7,\nonumber \\ \Phi _4^D= & {} \left\{ [(QQ)_{\bar{3}}^1Q']_8^{\frac{3}{2}}(q\bar{q})_8^1\right\} _1^{\frac{3}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_2\otimes X_8; \end{aligned}$$
    (8)
  • Type E [Flavor \(=QQQ'q\bar{q}\), J = 5/2]:

    $$\begin{aligned} \Phi _1^E= & {} \left\{ [(QQ)_{\bar{3}}^1Q']_8^{\frac{3}{2}}(q\bar{q})_8^1\right\} _1^{\frac{5}{2}}\nonumber \\= & {} (QQQ'q\bar{q})\otimes C_2\otimes X_{10}. \end{aligned}$$
    (9)

Here, QQQ means ccc or bbb and \(QQQ'\) means ccb or bbc. The superscripts (subscripts) for quarks indicate spins (representations in color space). In each type of pentaquark systems, configuration mixing induced by the chromomagnetc interaction occurs. If we use \(\Psi ^X\) to denote a mixed wave function for the type-X state, it can be written as a superposition of different configurations,

$$\begin{aligned} \Psi ^X=\sum _{i=1}^{N_X}C_i^X\Phi _i^X, \end{aligned}$$
(10)

where the coefficients \(C_i^X\) satisfy the normalization condition \(\sum _{i=1}^{N_X}|C_i^X|^2=1\) and \(N_X=2, 1, 5, 4,\) and 1 correspond to \(X=A\), B, C, D, and E, respectively. There are \(N_X\) independent \(\Psi ^X\).

3 Chromomagnetic interaction

The Hamiltonian for the mass calculation in the model reads

$$\begin{aligned} \widehat{H}= & {} \sum _{i=1}^nm_i-\sum _{i<j}\sum _{\alpha =1}^{3}\sum _{\beta =1}^{8} C_{ij} \left( \sigma _i^{\alpha }\sigma _j^{\alpha }\right) \left( \widetilde{\lambda }_i^{\beta }\widetilde{\lambda }_j^{\beta } \right) \nonumber \\= & {} \sum _{i=1}^nm_i+\widehat{H}_{CMI}. \end{aligned}$$
(11)

Here, n is the number of (anti)quarks in the hadron and \(m_i\) is the effective quark mass for the ith quark by taking account of effects from kinetic energy, color confinement, and so on. The coefficient \(C_{ij}\) reflects the strength of the chromomagnetic interaction between the ith and jth quark components and is influenced by their masses. The Pauli matrix \(\sigma _i^{\alpha }\) and Gell-Mann matrix \(\widetilde{\lambda }_i^{\beta }\)=\(\lambda _i^{\beta }\) (\(-{{\lambda }^*}_i^{\beta }\)) act on the spin and color wave functions of the ith quark (antiquark), respectively.

With the constructed bases of wave functions for the type-X pentaquarks, one can easily obtain the matrix element \(\mathbf [ H_{CMI}^X\mathbf ] _{kl}=\langle \Phi _k^X|{\widehat{H}}_{CMI}|\Phi _l^X\rangle \), where k, \(l=1,2,\ldots N_X\). The calculation of all matrix elements gives five CMI matrices.

  • Type A [\(\mathrm{Flavor}\,=\,QQQq\bar{q}\), \(J\,=\,1/2\)]:

    $$\begin{aligned} {{H}}_{CMI}^A= \left( \begin{matrix} 10C_{12}+2C_{45} &{} \frac{10}{\sqrt{3}}(C_{14}+C_{15}) \\ &{} 10C_{12}-\frac{2}{3} C_{45}-\frac{20}{3}(C_{14}-C_{15}) \end{matrix}\right) .\nonumber \\ \end{aligned}$$
    (12)

    Here, the base vector is (\(\Phi _1^A\), \(\Phi _2^A\)).

  • Type B [\(\mathrm{Flavor}\, =\, QQQq\bar{q}\), \(\mathrm{J}\,=\,3/2\)]:

    $$\begin{aligned} {{H}}_{CMI}^B= 10C_{12}-\frac{2}{3} C_{45}+\frac{10}{3}(C_{14}-C_{15}), \end{aligned}$$
    (13)

    where the only base is \(\Phi _1^B\).

  • Type C [\(\mathrm{Flavor}\,=\,QQQ'q\bar{q}\), \(\mathrm{J}\,=\,1/2\)]:

    $$\begin{aligned} {{H}}_{CMI}^C= \begin{matrix} \left( \begin{array}{ccccc} 2(2C_{12}+C_{45})&{}\frac{\sqrt{3}}{21}(15\gamma +13\delta )&{}2(\mu -\nu )&{}-\frac{\sqrt{3}}{21}(15\alpha -13\beta )&{}-\frac{\sqrt{6}}{21}(15\alpha -13\beta )\\ &{}\frac{2(7\lambda -13\gamma -15\delta )}{21}&{}-\frac{\sqrt{3}}{21}(15\alpha -13\beta )&{}\frac{42(\mu -\nu )-2(13\alpha -15\beta )}{21}&{}\frac{\sqrt{2}}{21}(13\alpha -15\beta )\\ &{}&{}\frac{2}{3}(8\lambda -8\mu -3\nu )&{}\frac{2\sqrt{3}}{9}(2\beta -\delta )&{}-\frac{2\sqrt{6}}{9}(\beta -2\delta )\\ &{}&{}&{}\frac{2}{9}(3\nu -4\alpha +2\gamma )&{}-\frac{2\sqrt{2}}{9}(\alpha -2\gamma )\\ &{}&{}&{}&{}\frac{2}{9}(3\mu -5\alpha -5\gamma ) \end{array}\right) ,\qquad \qquad \qquad \quad \qquad \end{matrix} \end{aligned}$$
    (14)

    where the base vector is (\(\Phi _1^C\), \(\Phi _2^C\), \(\Phi _3^C\), \(\Phi _4^C\), \(\Phi _5^C\)). The defined variables are \(\alpha =7C_{14}+2C_{15}\), \(\beta =7C_{14}-2C_{15}\), \(\gamma =2C_{34}+7C_{35}\), \(\delta =2C_{34}-7C_{35}\), \(\mu =4C_{12}-C_{13}-C_{45}\), \(\nu =4C_{12}+2C_{13}-C_{45}\), and \(\lambda =6C_{12}-C_{45}\).

  • Type D [Flavor \(=QQQ'q\bar{q}\), J = 3/2]:

    $$\begin{aligned} {{H}}_{CMI}^D= \begin{matrix} \left( \begin{array}{cccc} \frac{1}{21}(14\lambda +13\gamma +15\delta )&{}\frac{42(\mu -\nu )+(13\alpha -15\beta )}{21}&{}\frac{\sqrt{3}}{21}(15\alpha -13\beta )&{}\frac{\sqrt{5}}{21}(13\alpha -15\beta )\\ &{}\frac{2}{9}(3\nu +2\alpha -\gamma )&{} \frac{2\sqrt{3}}{9}(\beta -2\delta ) &{} -\frac{2\sqrt{5}}{9}(\alpha -2\gamma )\\ &{}&{} \frac{2}{3}(8\lambda -4\nu -7\mu )&{} \frac{2\sqrt{15}}{9}(\beta +\delta )\\ &{}&{}&{}\frac{2}{9}(3\mu -2\alpha -2\gamma ) \end{array}\right) ,\qquad \qquad \qquad \qquad \qquad \quad \quad \quad \end{matrix} \end{aligned}$$
    (15)

    where the base vector is (\(\Phi _1^D\), \(\Phi _2^D\), \(\Phi _3^D\), \(\Phi _4^D\)).

  • Type E [Flavor \(=QQQ'q\bar{q}\), J = 5/2]:

    $$\begin{aligned} {{H}}_{CMI}^E= & {} \frac{2}{3}(4C_{12}-C_{45}-C_{13}+7C_{14}\nonumber \\&+2C_{15}+2C_{34}+7C_{35}). \end{aligned}$$
    (16)

    Here the only base is \(\Phi _1^E\).

Comparing the present CMI matrices with those in Ref. [21], one finds that the above expressions form a subset of those for the \(qqqQ\bar{Q}\) case. The reason is that the flavor wave function of two identical heavy quarks must be symmetric while that of light quarks can also be antisymmetric. We will get the eigenvalues and eigenvectors of these matrices in the numerical evaluation. For the type-X pentaquarks, their mass splittings are the differences between the \(N_X\) eigenvalues.

We use masses of conventional hadrons to determine relevant parameters. For convenience, here we also present CMI expressions for them [29],

$$\begin{aligned} H_{CMI}(q_1\bar{q}_2)^{J~=~1}= & {} \frac{16}{3}C_{12},\nonumber \\ H_{CMI}(q_1\bar{q}_2)^{J~=~0}= & {} -16C_{12}, \nonumber \\ H_{CMI}(q_1q_2q_3)^{J~=~3/2}= & {} \frac{8}{3}(C_{12}+C_{23}+C_{13}), \nonumber \\ H_{CMI}(q_1q_2q_3)^{J~=~1/2}= & {} \frac{8}{3}\left[ \begin{array}{cc}(C_{12}-2C_{23}-2C_{13})&{}\sqrt{3}(C_{23}-C_{13})\\ \sqrt{3}(C_{23}-C_{13})&{}-3C_{12}\end{array}\right] ,\nonumber \\ \end{aligned}$$
(17)

where the two bases for the last matrix correspond to the case of \(J_{q_1q_2}=1\) and that of \(J_{q_1q_2}=0\).

Table 2 Relevant coupling parameters in units of MeV
Table 3 Used masses of the conventional hadrons in units of MeV [38]. Since the spin of the \(\Xi _{cc}\) observed by LHCb may be 1/2 or 3/2, we show results in both cases. The adopted masses of other doubly heavy baryons are taken from Refs. [39,40,41,42] (\(\Omega _{cc}^*\) is from Ref. [27]). The values in parentheses are obtained with the parameters in Table 2

4 Numerical analysis

4.1 Parameter selection and estimation strategy

In order to estimate the masses of the possible pentaquark states, one needs to know the values of relevant mass parameters and coupling strengths. We extract the values of \(C_{ij}\)’s from the mass splittings of conventional hadrons. For example, \(C_{nn}=1/16(m_{\Delta }-m_N)\) and \(C_{n\bar{n}}=3/64(m_{\rho }-m_{\pi })\) may be determined with Eq. (17). However, several effective coupling constants, \(C_{s\bar{s}}\), \(C_{cc}\), \(C_{bb}\), \(C_{bc}\), and \(C_{b\bar{c}}\), need to be assigned by models or assumptions. Although the \(\Xi _{cc}\) state has been observed, the extraction of \(C_{cc}\) needs more measured baryon masses. We here simply adopt the assumption \(C_{cc}\)=\(C_{c\bar{c}}\) for our evaluations. Similarly, we use \(C_{s\bar{s}}\)=\(C_{ss}\), \(C_{bb}\)=\(C_{b\bar{b}}\), and \(C_{bc}\)=\(C_{b\bar{c}}\), where \(C_{b\bar{c}}\) is obtained with the mass difference between \(B_c^*\) and \(B_c\) [30]. A variation of the values related with heavy quarks does not induce significant differences [31,32,33]. Table 2 lists all the coupling strengths we will use. At present, we further assume that these parameters can be applied to different systems so that we may estimate the masses of the studied pentaquark states. In the last part of this section, we will check the effects caused by the adoption of other values of coupling parameters.

According to Eq. (11), the mass of a pentquark state in the chromomagnetic model is

$$\begin{aligned} M=\sum _{i=1}^5 m_i+\langle \widehat{H}_{CMI}\rangle , \end{aligned}$$
(18)

where M and \(\langle \widehat{H}_{CMI}\rangle \) are the mass of a pentaquark and the corresponding eigenvalue of the choromomagnetic interaction, respectively. By introducing a reference system, the mass of the pentaquark state can be written as

$$\begin{aligned} M=(M_{ref}-\langle \widehat{H}_{CMI}\rangle _{ref})+\langle \widehat{H}_{CMI}\rangle . \end{aligned}$$
(19)

Here, \(M_{ref}\) and \(\langle \widehat{H}_{CMI}\rangle _{ref}\) are the mass of the reference system and the corresponding chromomagnetic interaction, respectively. Because none of \(QQQq\bar{q}\) pentaquark states is observed, we choose the threshold of a baryon-meson state with the same quark content as \(M_{ref}\). If the simple model could give correct masses for all the hadron states, the above two formulas should be equivalent. In fact, the model does not involve dynamics and the two approaches result in different multiquark masses. One may consult Refs. [21, 34] for some discussions on the difference.

Table 4 The masses of triply heavy baryons in units of MeV in the literature. One may consult Refs. [26, 44] for more results about the \(\Omega _{ccc}\) and \(\Omega _{bbb}\)

If we adopt Eq. (18), one needs to know the effective quark masses. Their values extracted from lowest conventional hadrons are \(m_n = 361.7\) MeV, \(m_s = 540.3\) MeV, \(m_c = 1724.6\) MeV, and \(m_b = 5052.8\) MeV. From Eq. (18) and the coupling parameters in Table 2, the masses of conventional hadrons may be evaluated. By comparing them with the experimental measurements, one finds overestimated theoretical results [34, 35]. The multiquark masses are also generally overestimated [21, 33, 34, 36, 37]. Thus we may treat the masses obtained in this method as theoretical upper limits. This fact indicates that attractions inside hadrons cannot be taken into account sufficiently in the simple chromomagnetic model. A more reasonable approach is to adopt Eq. (19), where the necessary attractions for conventional hadrons have been implicitly included in their physical masses. In this approach, probably there are two choices on the reference threshold. In this case, we present results with both thresholds. To calculate the baryon-meson thresholds, we use the hadron masses shown in Table 3. The extraction of the above effective quark masses and coupling parameters also relies on these numbers. Here, we assume that the spin of \(\Xi _{cc}\) is 1/2, which is presumed in Ref. [43]. If the spin of \(\Xi _{cc}\) is 3/2 (consistent with the prediction in Refs. [39,40,41,42]), the multiquark masses estimated with the threshold relating to \(\Xi _{cc}\) would be shifted downward by 64 MeV. When determining thresholds relating to other doubly heavy baryons, we adopt the values obtained in Refs. [39,40,41,42]. However, the mass of \(\Omega _{cc}^*\) in that reference was obtained by adding \(\sim \)100 MeV to the mass of \(\Xi ^*_{cc}\). Consider the fact that the quantum numbers of the observed \(\Xi _{cc}\) by LHCb have not been determined, we prefer to use another value obtained in Ref. [27]. A different mass of the doubly heavy baryon (see Refs. [26, 44] for a collection) will lead to a different mass of the pentaquark. One may compare the adopted mass with the value in Table 3 to estimate the mass difference. For example, if we got a pentaquark mass \(M_1\) with \(M_{\Omega _{bc}}=6920\) MeV while one wants to adopt \(M_{\Omega _{bc}^*}=7065.7\) MeV [27], then one would obtain the mass of that pentaquark by adding \((7065.7-6983.4)\) MeV to \(M_1\), where 6983.4 MeV is the mass of \(\Omega _{bc}^*\) in Table 3. In order for further discussions, we also present a summary for the theoretical investigations in the literature on the masses of triply heavy conventional baryons in Table 4.

4.2 Numerical results and global features

Based on the content of heavy quarks, one may classify the pentaquarks into four groups: \(cccq\bar{q}\), \(bbbq\bar{q}\), \(ccbq\bar{q}\), and \(bbcq\bar{q}\) or two types: \(QQQq\bar{q}\) and \(QQQ'q\bar{q}\). With all the parameters given above, we get the spectra of these pentaquark systems which are shown in Tables 5, 6, 7 and 8. In these tables, the columns labeled with the title “Mass” list masses estimated with Eq. (18). The last one or two columns show results estimated with relevant baryon-meson thresholds. For the \(QQQ'q\bar{q}\) states, one may use (QQq)-\((Q'\bar{q})\) or \((QQ'q)\)-\((Q\bar{q})\) type threshold for our purpose. The resulting masses may have an uncertainty about 100 MeV, which is not a very large value if compared to the mass around 10 GeV. We present results with both type thresholds.

Table 5 Numerical results for the \(cccq\bar{q}\) systems in units of MeV. The masses in the sixth column are estimated with Eq. (18) and those in the last column with the (ccq)-\((c\bar{q})\) type threshold
Table 6 Numerical results for the \(bbbq\bar{q}\) systems in units of MeV. The masses in the sixth column are estimated with Eq. (18) and those in the last column with the (bbq)-\((b\bar{q})\) type threshold
Table 7 Numerical results for the \(ccbq\bar{q}\) systems in units of MeV. The masses in the sixth column are estimated with Eq. (18) and those in the last two columns with the (ccq)-\((b\bar{q})\) type and (bcq)-\((c\bar{q})\) type thresholds, respectively
Table 8 Numerical results for the \(bbcq\bar{q}\) systems in units of MeV. The masses in the sixth column are estimated with Eq. (18) and those in the last two columns with the (bcq)-\((b\bar{q})\) type and (bbq)-\((c\bar{q})\) type thresholds, respectively

For the \(QQQn\bar{n}\) states, we do not present the isospin indices in the results because the isoscalar and isovector cases are degenerate. If the isoscalar \(QQQn\bar{n}\) and \(QQQs\bar{s}\) can mix, the resulting states would have different masses with the isovector \(QQQn\bar{n}\). Here, we do not consider this possibility.

Fig. 1
figure 1

Rough positions for the obtained triply heavy pentaquarks

In fact, one may also use the \(H_Q\)-\(H_q\) type threshold to estimate the pentaquark masses, where the hadron \(H_q\) contains only light quarks and \(H_Q\) contains heavy quarks. From previous investigations [21, 34, 35], we have seen that the multiquark masses estimated with such thresholds can be treated as theoretical lower limits. This feature should be related with the attractions inside conventional hadrons that cannot be taken into account in the present model. Since no evidence for triply heavy baryons is reported, with this feature, we may conversely set upper limits for the masses of the conventional triply heavy baryons. The formula is

$$\begin{aligned} M_{H_{QQQ}}\le & {} \Big [M_{ref}-\langle \widehat{H}_{CMI}\rangle _{ref}\Big ]-\Big [M_{H_{q\bar{q}}}-\langle \widehat{H}_{CMI}\rangle _{H_{q\bar{q}}}\Big ]\nonumber \\&+\langle \widehat{H}_{CMI}\rangle _{H_{QQQ}}, \end{aligned}$$
(20)

where the value of \([M_{ref}-\langle \widehat{H}_{CMI}\rangle _{ref}]=[M-\langle \hat{H}_{CMI}\rangle ]\) may be calculated with definition or read out from Tables 5, 6, 7 and 8. The obtained upper limits can be different if one considers different systems, but they do not rely on the angular momentum if a system is given. Of course, the correctness of this conjecture needs to be confirmed by further measurements. From Eq. (17) and the masses in above tables, we may set \(M_{\Omega _{ccc}}\le (M_{\Xi _{cc}^*}+M_D-M_\omega )+\frac{16}{3}(C_{cc}-C_{cn}+C_{n\bar{n}}+3C_{c\bar{n}})\approx 5044\) MeV if we consider the \(cccn\bar{n}\) system. If the \(cccs\bar{s}\) system is used, we have \(M_{\Omega _{ccc}}\le (M_{\Omega _{cc}^*}+M_{D_s}-M_\phi )+\frac{16}{3}(C_{cc}-C_{cs}+C_{s\bar{s}}+3C_{c\bar{s}})\approx 4897\) MeV. The upper limits extracted with the \(cccn\bar{s}\) and \(cccs\bar{n}\) are 4975 MeV and 4989 MeV, respectively. One should adopt the smallest value 4897 MeV as the final limit. Similarly, from our parameters, we have

$$\begin{aligned} M_{\Omega _{bbb}}\le & {} (M_{\Omega _{bb}^*}+M_{B_s}-M_\phi )\nonumber \\&+\frac{16}{3}(C_{bb}-C_{bs}+C_{s\bar{s}}+3C_{b\bar{s}})\approx 14640\text { MeV},\nonumber \\ M_{\Omega _{ccb}^*}\le & {} (M_{\Omega _{bc}^*}+M_{D_s}-M_\phi )\nonumber \\&+\frac{8}{3}(C_{bc}+C_{cc}-C_{cs}-C_{bs}\nonumber \\&+2C_{s\bar{s}}+6C_{c\bar{s}})\approx 8082\text { MeV},\nonumber \\ M_{\Omega _{bbc}^*}\le & {} (M_{\Omega _{bb}^*}+M_{D_s}-M_\phi )\nonumber \\&+\frac{16}{3}(C_{bc}-C_{bs}+C_{s\bar{s}}+3C_{c\bar{s}})\approx 11314\text { MeV},\nonumber \\ \end{aligned}$$
(21)

and further \(M_{\Omega _{ccb}}\le 8029\) MeV and \(M_{\Omega _{bbc}}\le 11261\) MeV. These limits are much lower than the baryon masses obtained with Eq. (18). Most of the masses obtained in the literature (Table 4) are consistent with such constraints. Of course, these upper limits rely on the input masses of the doubly heavy baryons, but are irrelevant with the pentaquark masses. In this sense, the masses of conventional triply heavy baryons are constrained by those of conventional doubly heavy baryons. On the other hand, if the experimentally observed triply heavy baryons have masses larger than such values, one may conclude that they probably are not ground QQQ states.

In Fig. 1, we show the rough positions of the studied pentaquark states and the thresholds of relevant \((QQq)-(Q\bar{q})\), \((QQq)-(Q'\bar{q})\), or \((QQ'q)-(Q\bar{q})\) type decay patterns. Each diagram corresponds to a group of pentaquarks. We have adopted the masses listed in the seventh columns of Tables 5, 6, 7 and 8. From a study of dibaryon states [72], the additional kinetic energy may be a possible effect in understanding why the predition of the H-dibaryon [73] is inconsistent with experimental results. If quark dynamics are considered, probably reasonable pentaquarks have higher masses than those obtained here. That is why we do not use the masses in the eighth columns of Tables 7 and 8 for the \(QQQ^\prime q\bar{q}\) systems when plotting the diagrams. In Fig. 1, the spectrum relies on the input masses of the doubly heavy baryons, but the relative positions comparing to the thresholds relating to the mass estimation is fixed in the present method. For example, the masses of the \(J~=~5/2\) \(ccbn\bar{n}\) states (\(I=1\) and \(I=0\)) may be changed if one uses a different input mass of \(\Xi _{bb}\) but the distance between the threshold of \(\Xi _{bb}\bar{B}\) and them is fixed by the CMI matrices. Of course, the mass splittings between the pentaquark states are also fixed only by the CMI matrices.

From Tables 5, 6, 7 and 8 and Fig. 1, one may understand some features for the spectra we study: (i). There is a hierarchy around 3200 MeV between the four groups of pentaquarks, which is from the mass difference between the bottom and charm quarks. Within each group, the hierarchy caused by the mass difference \(m_s-m_n\) is about 100 MeV; (ii). For each system, the states with highest and lowest masses usually have the lowest spin \(J~=~1/2\); (iii). The \(QQQs\bar{n}\) states generally have higher masses than the \(QQQn\bar{s}\) states, which is a result of the difference in coupling strengths, \(C_{Qn}\ne C_{Qs}\) and \(C_{Q\bar{n}}\ne C_{Q\bar{s}}\).

If the considered compact pentaquarks exist, they will decay into lower hadron states. The easiest decay mode, \((QQq)+(Q\bar{q})\), \((QQq)+(Q'\bar{q})\), or \((QQ'q)+(Q\bar{q})\), would be due to quark rearrangements. Figure 1 shows relevant thresholds for such a mode. When 2J (J is the spin of a pentaquark) is equal to a subscript of the label for the baryon-meson channel, the decay into that channel through S-wave is allowed. The other decay mode is \((QQQ)+(q\bar{q})\) or \((QQQ')+(q\bar{q})\). Now, the color of the three heavy quarks is changed by emitting a gluon. Because of the possible constraints from the Pauli principle and/or angular momentum, the spin-flip of QQQ may happen and this decay mode is suppressed for some cases where the spin-flip of QQQ is forbidden in the heavy quark limit. We check this feature in the following analyses.

4.3 Stability of various states

We explore the possible compact structure \(QQQq\bar{q}\) in this article, where QQQ is always a color octet state. Since the mass estimation for the pentaquark states depends on effective quark masses or the masses of the unobserved doubly heavy baryons, what we obtain here are only the rough positions of such states. More accurate values need further dynamical calculations. Before those studies, it is beneficial to discuss preliminarily the stability of such pentaquark states and to find out possible interesting exotic states.

The basic idea is to consider the allowed two-body strong decays and the size of the phase space for decay. From the above results, all the pentaquark states seem to have rearrangement decays and are probably not stable. Since hadrons are composed of quarks, the masses and decay properties are finally determined by the quark-quark interactions. It is helpful to understand the hadron-level features from the inner interactions. If heavy quark spin symmetry plays a role in the decay processes [74,75,76], probably narrow pentaquarks are still possible. We will check this possibility. In the study of the \(QQ\bar{Q}\bar{Q}\) systems [33], we checked the effective interaction between two heavy quarks in the mixing case by varying the effective coupling strengths, through which we may roughly guess whether the tetraquark states are stable or not. Here, we also perform a similar study.

4.3.1 The \(cccq\bar{q}\) and \(bbbq\bar{q}\) states

For these states, the spin of ccc or bbb (QQQ) is always 1/2 from the symmetry consideration, irrespective of the total spin of the system, 1/2 or 3/2. Since the spin of the color-singlet \(\Omega _{ccc}\) or \(\Omega _{bbb}\) is 3/2, the decay of such pentaquarks into a triply heavy baryon plus a light meson involves an emission of a chromomagnetic gluon and the spin-flip of QQQ. In the heavy quark limit, such a decay process is suppressed. In principle, no symmetry principle suppresses the decay into a doubly heavy baryon plus a heavy-light meson and one expects that narrow \(QQQq\bar{q}\) states would not exist if the pentaquark masses are high enough. To check this point, one may calculate overlapping factor between the initial state wave function and the final state wave function. From the recoupling formula in the spin space, for the \(cccn\bar{n}\) case (other \(QQQq\bar{q}\) cases are similar), one has

$$\begin{aligned} (\Xi _{cc}D)^{J~=~\frac{1}{2}}= & {} \frac{1}{2}(ccc)^{\frac{1}{2}}(n\bar{n})^{0}-\frac{1}{2\sqrt{3}}(ccc)^{\frac{1}{2}}(n\bar{n})^1\nonumber \\&+\sqrt{\frac{2}{3}}(ccc)^{\frac{3}{2}}(n\bar{n})^{1},\nonumber \\ (\Xi _{cc}D^*)^{J~=~\frac{1}{2}}= & {} -\frac{1}{2\sqrt{3}}(ccc)^{\frac{1}{2}}(n\bar{n})^{0}+\frac{5}{6}(ccc)^{\frac{1}{2}}(n\bar{n})^1\nonumber \\&+\frac{\sqrt{2}}{3}(ccc)^{\frac{3}{2}}(n\bar{n})^{1},\nonumber \\ (\Xi _{cc}^*D^*)^{J~=~\frac{1}{2}}= & {} \sqrt{\frac{2}{3}}(ccc)^{\frac{1}{2}}(n\bar{n})^{0}+\frac{\sqrt{2}}{3}(ccc)^{\frac{1}{2}}(n\bar{n})^1\nonumber \\&-\frac{1}{3}(ccc)^{\frac{3}{2}}(n\bar{n})^{1};\nonumber \\ (\Xi _{cc}^*D)^{J~=~\frac{3}{2}}= & {} -\frac{1}{\sqrt{3}}(ccc)^{\frac{1}{2}}(n\bar{n})^{1}\nonumber \\&+\frac{1}{2}(ccc)^{\frac{3}{2}}(n\bar{n})^0+\frac{\sqrt{15}}{6}(ccc)^{\frac{3}{2}}(n\bar{n})^{1},\nonumber \\ (\Xi _{cc}D^*)^{J~=~\frac{3}{2}}= & {} \frac{1}{3}(ccc)^{\frac{1}{2}}(n\bar{n})^{1}-\frac{1}{\sqrt{3}}(ccc)^{\frac{3}{2}}(n\bar{n})^0\nonumber \\&+\frac{\sqrt{5}}{3}(ccc)^{\frac{3}{2}}(n\bar{n})^{1},\nonumber \\ (\Xi _{cc}^*D^*)^{J~=~\frac{3}{2}}= & {} \frac{\sqrt{5}}{3}(ccc)^{\frac{1}{2}}(n\bar{n})^{1}+\frac{\sqrt{15}}{6}(ccc)^{\frac{3}{2}}(n\bar{n})^0\nonumber \\&+\frac{1}{6}(ccc)^{\frac{3}{2}}(n\bar{n})^{1}; \end{aligned}$$
(22)

where the superscripts indicate the spins. Obviously, there is no suppressed coupling from the comparison between these wave functions and those in Eqs. (5) and (6). One may roughly get relative coupling amplitudes between different channels with these wave functions, but could not derive the absolute partial widths without knowing the coupling strength. Therefore, the possible nature that the \(QQQq\bar{q}\) states have generally broad widths cannot be excluded from this coupling analysis.

In a multiquark state, the interactions between each pair of quark components together affect the final mass which determines the phase space of decay. After the complicated coupling among different color-spin structures, the property of the interaction between two quark components becomes unclear. It is helpful to understand whether the effective interaction is attractive or repulsive by introducing a measure. To find it, we may study the effects induced by the artificial change of coupling strengths in the Hamiltonian. When a coupling strength is reduced, the resulting mass may be increased or decreased. If the effective interaction between the considered components is attractive (repulsive), the mass would be shifted upward (downward) and vice versa. For the purpose to see the effects, we may define a dimensionless variable

$$\begin{aligned} K_{ij}=\frac{\Delta M}{\Delta C_{ij}}, \end{aligned}$$
(23)

where \(\Delta C_{ij}\) is the variation of a coupling strength in Eq. (11) and \(\Delta M=\Delta \langle \hat{H}_{CMI}\rangle \) is the corresponding variation of a pentaquark mass. Then the positive (negative) \(K_{ij}\) corresponds to a repulsive (attractive) effective interaction between the ith and jth components. When \(\Delta C_{ij}\) is small enough, \(K_{ij}\) tends to be a constant \((\partial M)/(\partial C_{ij})\). With these constants, we may write an equivalent expression for the pentaquark mass as

$$\begin{aligned} M=M_0+\langle \hat{H}_{CMI}\rangle = M_0+\sum _{i<j}K_{ij}C_{ij}, \end{aligned}$$
(24)

where \(M_0\) is a constant for a given pentaquark system and its value can be obtained based on the estimation approach, Eq. (18) or (19). One should note that this formula does not mean that M is linearly related with \(C_{ij}\).

Table 9 Values of \(K_{ij}\) when reducing the coupling strength \(C_{ij}\) between the ith and jth quark components by 0.01%. The orders of states are the same as those in Tables 5 and 6

Now we apply this definition of \(K_{ij}\) to the \(cccn\bar{n}\) states. By reducing one relevant coupling strength to 99.99% of its original value, we get a \(K_{ij}\). Each time we change only one \(C_{ij}\) while others remain unchanged. The results are collected in Table 9 where the order of states is the same as that in Table 5. A positive (negative) number indicates that the corresponding color-spin interaction is effectively repulsive (attractive). In the \(bc\bar{b}\bar{c}\) or \(bb\bar{b}\bar{b}\) case, for example, one may understand that a relatively stable tetraquark is favored if the effective bc or bb interaction is attractive. In the present case, not only one quark-quark interaction exists. Usually, it is hard to guess whether a pentaquark state is stable or not just from the signs of \(K_{ij}\). The sum of their contributions gives the final mass shift. From Table 9, it is obvious that the effective color-spin interactions between each pair of components in the high mass \(J~=~1/2\) \(cccn\bar{n}\) states (\(I=1\) and \(I=0\)) are repulsive and the states should not be stable. By checking the CMI matrix in Eq. (12) where the interaction between quark components can be attractive, one understands that the mixing effect may change the nature of each interaction. In addition to judge the stability of a pentaquark with Fig. 1, one may equivalently use Eq. (24) to judge whether the decay into a \((ccn)-(c\bar{n})\) channel happens or not. Since \(K_{cc}C_{cc}+K_{cn}C_{cn}>8/3C_{cc}+16/3C_{cn}\) (CMI of \(\Xi _{cc}^*\)) and \(K_{c\bar{n}}C_{c\bar{n}}>16/3C_{c\bar{n}}\) (CMI of \(D^*\)), the decay into \(\Xi _{cc}^*D^*\) (and thus \(\Xi _{cc}D^*\) and \(\Xi _{cc}D\)) through S-wave is allowed. If this state exists, its width should not be narrow. For a \(J~=~3/2\) state (\(I=1\) or \(I=0\)), the \(n\bar{n}\) and \(c\bar{n}\) interactions are both attractive, which is obvious from Eq. (13) or (24), and the width of this state should be relatively narrower. From masses or effective interactions, S-wave \(\Xi _{cc}D^*\) and \(\Xi _{cc}^*D\) decay channels are both opened. For the remaining \(J~=~1/2\) states, the attraction appears mainly between a charm quark and a light quark. Now, the allowed S-wave decay channels are \(\Xi _{cc}D\) and possibly \(\Xi _{cc}D^*\). The same \(K_{cc}\) for different states reflects the fact that the spin of ccc is always 3/2. From these discussions, it seems that all these \(cccn\bar{n}\) pentaquarks are not narrow states even if they do exist.

For the other \(cccq\bar{q}\) states, only one isospin is allowed, either 1/2 or 0. The higher \(J~=~1/2\) \(cccn\bar{s}\) state has three S-wave channels \(\Xi _{cc}^*D_s^*\), \(\Xi _{cc}D_s^*\), and \(\Xi _{cc}D_s\) and the \(J~=~3/2\) state has two S-wave channels \(\Xi _{cc}D_s^*\) and \(\Xi _{cc}^*D_s\). The allowed S-wave decay channels for the remaining \(J~=~1/2\) \(cccn\bar{s}\) state are \(\Xi _{cc}D_s\) and possibly \(\Xi _{cc}D_s^*\). Effective contributions from each pair of quark components can also be obtained from the values shown in Table 9. In principle, these \(cccn\bar{s}\) states should not be narrow. The \(cccs\bar{n}\) states have similar decay properties, but \(D_s\) (\(D_s^*\)) is replaced by D (\(D^*\)) and \(\Xi _{cc}\) (\(\Xi _{cc}^*\)) is replaced by \(\Omega _{cc}\) (\(\Omega _{cc}^*\)). If one replaces only \(\Xi _{cc}\) (\(\Xi _{cc}^*\)) by \(\Omega _{cc}\) (\(\Omega _{cc}^*\)) in the decay products of the \(cccn\bar{s}\) states, the decay patterns of the \(cccs\bar{s}\) states are obtained. From the above discussions, the widths of all the \(cccq\bar{q}\) should not be narrow.

Similarly, one gets rough decay properties of the \(bbbq\bar{q}\) states. It is easy to understand that their widths should not be narrow either, since all of them have S-wave rearrangement decay patterns and no suppressed channels are found.

If the interactions between light quark components have large contributions to the pentaquark mass, the state may be low enough and probably stable, because the coupling constant in the CMI model is proportional to \(1/(m_im_j)\). Two examples are the \(udsc\bar{c}\) state proposed in Refs. [21, 23] and the \(QQqq\bar{q}\) states studied in Ref. [34]. In the present \(QQQq\bar{q}\) case, it is easy to read out contributions from each pair of interaction from Table 9. Obviously, the \(q\bar{q}\) effective interactions are not attractive enough (even repulsive). The effective interactions for heavy-heavy and heavy-light components do not provide enough attraction, either. Thus, the masses of \(QQQq\bar{q}\) states are not low enough, which results in the conclusion that such pentaquark states are probably not narrow even if they exist. Of course, further conclusion needs accurate hadron masses and the determination of decay amplitudes.

4.3.2 The \(ccbq\bar{q}\) and \(bbcq\bar{q}\) states

Without the constraint from the Pauli principle, the spin of ccb or bbc (\(QQQ'\)) can be both 3/2 and 1/2. The resulting spectrum is more complicated. When the angular momentum of the pentaquark is 5/2, the spin of \(QQQ'\) must be 3/2. The decay of the pentaquark into \(\Omega _{QQQ'}\) plus a light meson is forbidden or suppressed, but the decay into \(\Omega _{QQQ'}^*\) plus a light vector meson not. The latter decay is forbidden only by kinematics. When the angular momentum of the pentaquark is 1/2 or 3/2, the spin of the inside \(QQQ'\) can be both 1/2 and 3/2. From the eigenvectors in Tables 7 and 8, the spin of \(QQQ'\) in some states is dominantly 1/2. The decays of the 1/2 or 3/2 pentaquarks into \(\Omega _{QQQ'}\) and a \(q\bar{q}\) meson are not suppressed, either. For the \((QQq)+(Q'\bar{q})\) decay mode, it is easy to understand that each overlapping factor does not vanish from Eqs. (7), (8), and (22). (The nonvanishing overlapping factor for the decay of a \(J~=~5/2\) pentaquark is obvious.) For the \((QQ'q)+(Q\bar{q})\) decay mode, the nonvanishing overlapping factor can be understood similarly since the spin of \(QQ'\) in a physical \((QQ'q)\) state can be both 1 and 0. Even if the spin of \(QQ'\) in \((QQ'q)\) is only zero, the factor still does not vanish. Therefore, no symmetry requirement can suppress the decay of the \(QQQ'q\bar{q}\) states. Whether such a state can decay or not depends only on kinematics.

Table 10 Values of \(K_{ij}\) when reducing the coupling strength \(C_{ij}\) between the ith and jth quark components by 0.001%. The orders of states are the same as those in Tables 7 and 8

To understand the effective quark-quark or quark-antiquark color-spin interactions, we list \(K_{ij}\) of each pair of interactions in Table 10 where \(\Delta C_{ij}=0.00001 C_{ij}\). Contributions to the pentaquark mass from each pair of components are easy to obtain. For example, the effective cc or bb interaction is always repulsive. From the table, the interactions in all the highest states (\(J~=~1/2\)) are repulsive and such states are certainly not stable. For the lowest states (\(J~=~1/2\)) in each system, the chromomagnetic interactions except for cc or bb are all attractive. To understand whether the interactions result in low enough and thus possible narrow pentaquarks, what we need is to check whether the lowest states with various spins can decay.

First, we focus on the lowest \(ccbn\bar{n}\) states. The thresholds of the decay mode containing a (bcn) baryon are generally lower than those of the mode containing a (ccn) baryon. For the case \(J~=~5/2\), the states (\(I=1\) and 0) probably do not have the S-wave decay pattern \(\Xi _{cc}^*B^*\), but they may decay into \(\Xi _{bc}^*D^*\) and \(\Omega _{ccb}^*\rho \) or \(\Omega _{ccb}^*\omega \) through S-wave. Their widths should not be narrow. For the lowest \(J~=~3/2\) states (\(I=1\) and 0), the channels \(\Xi _{bc}D^*\), \(\Xi _{bc}^*D\), and \(\Xi _{bc}^\prime D^*\) are all opened. They can also decay into \(\Omega _{ccb}^*\pi \), \(\Omega _{ccb}\rho \), or \(\Omega _{ccb}\omega \) through S-wave. Their widths should not be narrow, either. For the lowest \(J~=~1/2\) states, the decay patterns \(\Xi _{bc}D^*\), \(\Xi _{bc}D\), \(\Xi _{bc}^\prime D\), \(\Omega _{ccb}\pi \), \(\Omega _{ccb}\omega \), etc. are all allowed, which should result in broad pentaquark states if they exist. Therefore, narrow \(ccbn\bar{n}\) pentaquarks are not expected. However, this conclusion depends on the pentaquark masses. If the masses estimated with the \(\Xi _{bc}D\) are more reasonable, one may conclude that relatively narrow \(J~=~5/2\) or \(J~=~3/2\) pentaquark states are still possible.

Next, one may analyse similarly the cases \(ccbn\bar{s}\), \(ccbs\bar{n}\), and \(ccbs\bar{s}\). The basic conclusion is that relatively narrow \(J~=~5/2\) pentaquarks are possible only when their masses are low enough.

Finally, the \(bbcq\bar{q}\) systems have similar spectra to the \(ccbq\bar{q}\) systems, but the thresholds of the decay mode containing a bbq baryon are lower than those of the mode containing a bcq baryon. If pentaquark masses shown in Fig. 1 are reasonable, no narrow or stable \(bbcq\bar{q}\) states should exist.

From the above results, one basically finds that all the \(QQQ^\prime q\bar{q}\) pentaquark states are probably not stable, although relatively narrow states cannot be excluded completely. The color-spin interaction itself does not lead to enough attraction. Further theoretical and experimental investigations on doubly heavy and triply heavy states may provide more information.

4.4 Discussions

In obtaining the rough masses of the studied pentaquark states, we have several uncertainties. First, the values of coupling constants \(C_{ij}\) in the model Hamiltonian are determined from the conventional hadrons. Whether they can be used to multiquark states is still an open question, as noticed in Refs. [77, 78]. Secondly, the mass shifts from CMI energies for a system and thus the pentaquark masses are not well determined. If one uses the effective quark masses determined from conventional hadrons, one obtains hadron masses with overestimated values. To reduce the uncertainty, we phenomenologically adopt a reference hadron-hadron system for our purpose. Whether the selected system is appropriate or not is also a question to be answered. At present, we tend to use a system with high threshold in order to include possible additional effects like the additional kinetic energy [72]. The uncertainty for the obtained pentaquark masses in this method will be checked by the future experimental measurements. Thirdly, the adopted model does not involve dynamics and much information is hidden in constant parameters. The parameters should be different from system to system. However, as a preliminary work for multiquark system where the few-body problem is difficult to deal with, the present investigation on basic features of multiquark spectra is still helpful for further theoretical and experimental studies on multiquark properties. We want to emphasize that the estimated masses do not indicate that all of these states should be bound. Whether such states exist or not needs the experimental measurements to confirm. On the other side, if one compact pentaquark state could be observed, the masses of its partner states may be predicted with our results.

If the pentaquark masses shown in Fig. 1 are all reasonable, a question arises to distinguish a compact multiquark state from a molecule state. In understanding the nature of the \(P_c(4380)\) state, both the \((cqq)(\bar{c}q)\) molecule configuration and the \((c\bar{c})_{8_c}(qqq)_{8_c}\) pentaquark configuration are not contradicted with experimental measurements. The masses of the proposed \(udsc\bar{c}\) in these two configurations are also consistent [18, 21]. For the present \(QQQq\bar{q}\) case, the situation is different. Our study does not favor low mass \(cccq\bar{q}\) or \(bbbq\bar{q}\) pentaquarks while the investigations at the hadron level [79, 80] indicate that the molecule states such as \(\Xi _{cc}D\) and \(\Xi _{cc}D^*\) are possible. A study with the QCD sume rule method also favors the existence of such molecules [81]. If a low-lying pentaquark-like state around such thresholds were observed, the molecule interpretation would be preferred. However, for the possible states around the thresholds of \(\Xi _{cc}\bar{B}\) and \(\Xi _{cc}\bar{B}^*\), one needs to use other information like branching ratios to understand whether it is a compact pentaquark or a molecule, which can be studied in future works.

As mentioned in the beginning of this section, we have used the assumptions that \(C_{cc}=C_{c\bar{c}}\), \(C_{s\bar{s}}=C_{ss}\), \(C_{bb}=C_{b\bar{b}}\), and \(C_{bc}=C_{b\bar{c}}\) because of lack of experimental data. This assumption certainly leads to uncertainties for the estimated masses. To see the differences caused by assumption selection, one may try other methods in determining the coupling parameters and compare the resulting masses. First, we check the extraction of \(C_{cc}\), \(C_{bb}\), and \(C_{bc}\) from baryon masses. Based on the formulas given in Eq. (17), one cannot determine \(C_{cc}\) just from the mass difference between \(\Xi _{cc}\) and \(\Xi _{cc}^*\), but may get a number from \((M_{\Xi _{cc}}+2M_{\Xi _{cc}^*}-M_N-3M_{\eta _c}-8C_{nn}-48C_{c\bar{c}})/8\), \(3/8(M_{\Sigma }+M_{\Omega _{cc}}-M_{\Sigma _c}-M_{\Omega _c})+C_{ss}+4(C_{ns}-C_{cn})\), or \(3/8(M_\Sigma +M_{\Omega _{cc}}-M_{\Xi _c^\prime }-M_{\Xi _c^*})+6C_{ns}+3C_{cs}-C_{nn}-C_{cn}\) once the mass of another doubly charmed baryon is known. However, the obtained \(C_{cc}\) is either negative or unreasonably large if \(M_{\Xi _{cc}^*}>M_{\Xi _{cc}}=3621.4\) MeV or \(M_{\Omega _{cc}}<3850\) MeV (see Ref. [26] for the rough value of \(M_{\Omega _{cc}}\) in theoretical investigations). One may also use \((M_\Delta +2M_{\Omega _{ccc}}-2M_{\Xi _{cc}^*}-M_{\Xi _{cc}}-8C_{nn})/8\) to extract \(C_{cc}\), but the reasonable (positive, not large) value is sensitive to the assignment for the spin of \(\Xi _{cc}\) and the masses of the involved baryons. To extract \(C_{bb}\), the masses of two doubly bottom baryons are at least needed, but similar situation to \(C_{cc}\) is found once quark model predictions are used. For the value of \(C_{bc}\), one may extract it with \((M_{\Omega _{ccb}^*}-M_{\Omega _{ccb}})/16=(M_{\Omega _{bbc}^*}-M_{\Omega _{bbc}})/16\) or from \(M_{\Xi _{bc}^*}-M_{\Xi _{bc}^\prime }\). If the mass difference \(M_{\Omega _{ccb}^*}-M_{\Omega _{ccb}}\) is around tens of MeV, the obtained \(C_{bc}\) is not far from the adopted 3.3 MeV. However, \(C_{bc}\) is sensitive to the mass difference \(M_{\Xi _{bc}^*}-M_{\Xi _{bc}^\prime }\). One may also extract \(m_c\), \(m_b\), \(C_{cc}\), \(C_{bb}\), and \(C_{bc}\) simultaneously by using a set of masses for the triply heavy baryons shown in Table 4, but results sensitive to baryon masses or unreasonable results are obtained. The above considerations indicate that the determination of \(C_{cc}\), \(C_{bc}\), and \(C_{bb}\) with baryon masses still has some problems. Secondly, we check the method \(C_{ij}=C_H/(m_im_j)\) usually used in the literature, e.g. Refs. [31, 32, 82]. This method allows us to estimate \(C_{s\bar{s}}\) from \(C_{n\bar{n}}\). According to Ref. [31], we have \(C_{s\bar{s}}=9/25C_{n\bar{n}}=10.7\) MeV. This value is comparable to that from Ref. [83], \(3/8\kappa _{s\bar{s}}=11.3\) MeV, but larger than that we have used. However, for \(C_{cc}\), \(C_{bb}\), and \(C_{bc}\), the parameter \(C_H\) is different from those for quark-antiquark pairs and light diquarks [31]. The determination of \(C_H\) in this case needs more baryon masses and the above problems are probably also be there. Thirdly, we check the estimation method \(C_{ij}=C_{i\bar{j}}C_{nn}/C_{n\bar{n}}\approx 2/3C_{i\bar{j}}\) where \(C_{i\bar{j}}\) means \(C_{ij}\) for a quark-antiquark pair. By inspecting values we haved adopted, those we can determine from experimental data are consistent with this method. Then one gets \(C_{s\bar{s}}=10.5\) MeV, \(C_{cc}=3.3\) MeV, \(C_{bb}=1.8\) MeV, and \(C_{bc}=2.0\) MeV. The obtained \(C_{s\bar{s}}\) in this method is also consistent with that in the second method. We will compare estimated \(QQQq\bar{q}\) masses using these parameters with those using our assumptions.

By changing \(C_{cc}=C_{c\bar{c}}=5.3\) MeV, \(C_{bb}=C_{b\bar{b}}=2.9\) MeV, \(C_{bc}=C_{b\bar{c}}=3.3\) MeV, and \(C_{s\bar{s}}=C_{ss}=6.5\) MeV to 3.3 MeV, 1.8 MeV, 2.0 MeV, and 10.5 MeV, respectively, and re-calculating pentaquark masses, one finds that this does not affect the results significantly: (1) the reduction of \(C_{cc}\) or \(C_{bb}\) results in \(\sim \)10 MeV lower masses for relevant systems and the effects caused by the change of \(C_{bc}\) or \(C_{s\bar{s}}\) are just around several MeV’s; and (2) the change of all the coupling parameters simultaneously induces mass shifts around 0\(\sim \)20 MeV. In fact, the effects due to the changes of \(C_{ij}\) can be roughly seen from the obtained \(K_{ij}\)’s although the value of \(K_{ij}\) is also affected by the coupling parameters. From Tables 9 and 10, the largest numbers are \(K_{cc}=K_{bb}=10\). Since the variations of \(C_{cc}\), \(C_{bb}\), and \(C_{bc}\) cannot be large, the mass uncertainties because of them are at most tens of MeV. For \(C_{s\bar{s}}\), the effects from its uncertainty are not large, either, because the largest \(K_{s\bar{s}}\) is only around 1. Therefore, from the above discussions, the approximations we have adopted do not cause significant effects on the results.

Now we move on to the question how to distinguish an orbitally excited QQQ structure from an isoscalar pentaquark structure if a high mass QQQ-like state was observed. Since the conventional P-wave states and the pentaquark states may have similar decay patterns, the theoretical mass gaps between these two structures are useful. We can check the gaps between the upper limits for the masses of ground QQQ baryons and the lowest \((QQn)(Q\bar{n})\) thresholds (\(\Xi _{cc}D\sim \)5490 MeV, \(\Xi _{bb}\bar{B}\sim \)15370 MeV, \(\Xi _{bc}D\sim \)8690 MeV, and \(\Xi _{bb}D\sim \)11960 MeV) above which pentaquarks probably exist. They are around 590 MeV for the ccc case, 730 MeV for the bbb case, 600 MeV for the ccb case, and 650 MeV for the bbc case. According to the calculations in the literature, the P-wave excitation energy for the ccc case is around 120\(\sim \)360 MeV [25, 53, 62, 84], that for the bbb case is around 120\(\sim \)600 MeV [25, 53, 60, 62], that for the ccb case is around 130\(\sim \)280 MeV [25, 53, 62], and that for the bbc case is around 120\(\sim \)250 MeV [25, 39,40,41,42, 53, 62, 71]. Therefore, the P-wave QQQ states are expected to be below the \((QQn)(Q\bar{n})\) thresholds and thus below the pentaquarks. Alternatively, in theoretical studies, the maximum masses of P-wave states are [53]: \((ccc)\sim 5160\) MeV, \((bbb)\sim 14976\) MeV, \((ccb)\sim 8432\) MeV, and \((bbc)\sim 11762\) MeV. It seems that one does not need to worry about the exotic nature of the observed QQQ baryon once it is below relevant \((QQn)(Q\bar{n})\) thresholds. However, this argument is only applicable to the lowest P-wave QQQ states. If the P-wave QQQ states (e.g. radially excited states studied in Ref. [71]) are heavier, the coupled channel effects due to the \((QQn)(Q\bar{n})\) thresholds probably result in states with exotic properties. In this case, the situation would be similar to the X(3872). If our pentaquark masses are overestimated and they are close to the masses of the P-wave QQQ states, the configuration mixing is also possible. In this case, relatively lower QQQ-like states might exist. To identify the nature of such states needs information from production or decay properties. We have to wait for future experimental searches for possible interesting phenomena in triply heavy baryon systems.

5 Summary

In this paper, we have investigated the mass splittings for the pentaquark states with the configuration \(QQQq\bar{q}\) in a chromomagnetic model, where QQQ can be color-octet ccc, bbb, ccb, or bbc. The values of their masses cannot be determined accurately since the model does not involve dynamics. We estimate roughly the masses with two methods. Since no symmetry constraints suppress the S-wave rearrangement decays into \((QQq)+(Q\bar{q})\), whether the decays happen or not depends only on kinematics. Although the obtained results have uncertainties, it seems that all the studied pentaquarks are above the respective lowest (QQq)-\((Q\bar{q})\) type thresholds and thus do not have low masses and narrow widths. On the other hand, the proposed molecules around the thresholds of \(\Xi _{cc}D\), \(\Xi _{cc}D^*\), \(\Xi _{cc}\bar{B}\), and \(\Xi _{cc}\bar{B}^*\) are still possible [79]. Based on our results, once a state around the threshold of \(\Xi _{cc}D\) were observed, its molecular nature other than compact multiquark nature is favored.

To see the important mixing effects from different color-spin structures, we express the mass of an obtained pentaquark state with effective chromomagnetic interactions by varying coupling constants in the model Hamiltonian. The relevant coefficients \(K_{ij}\)’s are tabulated in Tables 9 and 10. From these tables, it is easy to understand the contributions to the pentaquark mass from each pair of quark interactions. When comparing with the CMI matrices in Sect. 3, one finds that the mixing may change the interaction strengths significantly (even signs). Actually, the value of \(K_{ij}\) can also be obtained with the eigenvectors in Tables 5, 6, 7 and 8 and the CMI matrices in Sect. 3. With the explicit expressions, one can see how the mixing effects contribute to a state. For example, the effective cn interaction in the lower \(J~=~1/2\) \(cccn\bar{n}\) state (\(I=1\) or 0) reads

$$\begin{aligned} K_{cn}C_{cn}= & {} 0.52^2\times 0+(-0.85)^2\times \left( -\frac{20}{3}\right) C_{cn}+0.52\nonumber \\&\times (-0.85)\times \frac{10}{\sqrt{3}}C_{cn}\times 2=-9.92C_{cn}, \end{aligned}$$
(25)

which equals to \(-9.99C_{cn}\) if the error bars in the eigenvector are included.

As a byproduct of the pentaquark study, we have obtained a conjecture for the mass inequalities for conventional doubly heavy baryons and conventional triply heavy baryons. Such relations may be tested in the future experimental results.

We hope the present study may stimulate further investigations about properties of conventional doubly or triply heavy baryons and multiquark states on both the theoretical side and the experimental side. Search for the exotic triply heavy baryons can be performed at LHC.