1 Introduction

The triply heavy baryons, comprising the three heaviest quarks within the standard model, serves as a valuable way for unraveling the intricate structure and dynamics of baryons. The complications of light-quark interaction are absent in the triply heavy baryons, thus, they provide an ideal place for our better understanding the heavy quark dynamics [1]. It also can provide information about the quark confinement mechanism as well as elucidating our knowledge about the nature of the strong force by providing a clean probe of the interplay between perturbative and nonperturbative QCD [2, 3].

The three-quark potential is one of the most important inputs of the potential models [4,5,6]. However, despite the progress made in studying the triply heavy baryons, there is currently no precise formula available to three-quark potential. The best known phenomenological models are ansatze which are a kind of the Cornell model for a three-quark system [4,5,6]. The short-range part of the potential energy in system can be approximated by the Coulomb potential, which represents the impact of single gluon exchange within the framework of perturbative QCD [7]. However, in the long-distance part, this potential energy exhibits a linear behavior. Therefore, the potential energy of three quarks can be considered as the sum of the Coulomb potential resulting from interactions between two quarks, and a linear potential arising from the string tension [8,9,10,11].

The QQQ potential is a key quantity to understanding the quark confinement mechanism in baryons [4]. The difficulty in studing quark confinement is due to the non-perturbative features [5]. The non-perturbative nature of this problem can be effectively addressed by the AdS/CFT correspondence [12,13,14]. Subsequently, this correspondence method has been widely utilized for studying heavy quarks. For example, in Ref. [15], the authors studied the potential energy of heavy quarks in a magnetic field background. Reference [16] studied free energy of a heavy quark–antiquark pair in a thermal medium. Recently, charmed pentaquarks and tetraquarks have been studied in [17]. It was found that the presence of angular velocity can facilitate the transition of quark pairs from confinement to deconfinement in a rotating background [18]. In addition, there are some studies on quark pairs under other conditions [19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. The above research only focuses on two-quark systems and hasn’t involved the QQQ system. Recently, with the proposal of Andreev’s series of works, it has become possible for us to study three quark systems from a holographic model [4, 35, 36].

Previous studies of QQQ with isotropic background concentrated on three facets: spectroscopy, production and decay [37,38,39,40,41,42,43,44,45,46,47,48,49,50]. While less attention has been paid to the anisotropic background. The anisotropy is a consequence of distinct pressure gradients, leading to the rapid expansion of QGP predominantly in the longitudinal direction. Additionally, the isotropic model is unable to replicate the observed energy-dependent behavior of experimental multiplicity, while the anisotropic model effectively captures this dependence [51, 52]. Several works have been initiated to study anisotropic backgrounds. For instance, in Ref. [53], the authors examine the behavior of light quarks within anisotropic backgrounds, while in Ref. [54], the focus is on investigating heavy quark radiation within an anisotropic hot QCD medium. Additionally, Refs. [55,56,57,58,59,60,61,62,63,64,65,66,67] contains other notable works addressing anisotropic backgrounds. Motivated by this, we mainly study the three quark potential energy in anisotropic backgrounds. Specifically, it is necessary to know how the potential energy of three quarks varies with the anisotropic background.

The work is organized as follows: in Sect. 2, the primary focus is on the potential energy of A configuration. It begins with an examination of the action of three quarks, from which we derive the separation distance and potential energy by establishing the balance equation. Similarly, Sect. 3 extends this discussion to the potential energy in the B configuration. In Sect. 4, the primary emphasis is on studying the quark potential energy and separation distance under the same entropy density. The final section serves as a summary of the preceding discussions.

2 Three-quark potential of A configuration

Based on Refs. [4,5,6], our study investigates baryons comprised of three fully heavy quarks (QQQ) in anisotropic background. We have identified two distinct quark configurations for this system: the A configuration and the B configuration. In this section, we concentrate on the A configuration, where two heavy quarks are symmetrically positioned on opposite sides of the x-axis, with the third quark located along the y-axis, as shown in Fig. 1.

Using the AdS/CFT correspondence, the anisotropic backgrounds have been studied in [55, 56]. By deforming the gauge theory with \(\theta \) term which depends on one of the boundary field theory coordinates, the anisotropic supergravity solution has been found in [55]. Here, \(\theta = 2 \pi n x_3\), where n signifies the density of D7 brane distributed in the anisotropic direction, and the D7 brane is wrapped on the five dimensional sphere and the xy plane [61]. Let’s start with the string framework of this anisotropic background

$$\begin{aligned} d s^{2}= & {} \frac{1}{u^{2}}\left( -{\mathcal {F}} {\mathcal {B}}\, d t^{2}+d x^{2}+d y^{2}+{\mathcal {H}} d x_{3}^{2}+\frac{d u^{2}}{{\mathcal {F}}}\right) \nonumber \\ {}{} & {} \quad + e^{\frac{1}{2}\phi } d \Omega _{S^{5}}^{2}, \end{aligned}$$
(1)
$$\begin{aligned} \chi= & {} a\, x_{3}, \quad \phi = \phi (u). \end{aligned}$$
(2)

Here a is the anisotropic parameter with units of inverse length, \(\phi \) is the dilaton field, \(\chi \) is axion which linearly dependents on the coordinates of \(x_{3}\), and \(\Omega _{S^{5}}\) represents the volume of a five-dimensional unit sphere. Following Ref. [61], \(\frac{a}{T}\) changes from zero to a small value like 4.4 with \(T=0.33\) GeV. In the context of this work, where the temperature is set to 0.1 GeV, we find that the maximum effective value of a remains below 1.452. The orientation along the \(x_{3}\) axis signifies the anisotropic direction. The anisotropy is attributed to the hydrodynamic dynamics expansion of QGP. Meanwhile, the two directions(x and y) exhibiting rotational symmetry within the transverse plane are indicative of the transverse direction [58]. Typically, the pressure along the \(x_{3}\) direction is less than that in the transverse direction. The functions \({\mathcal {F}}(u)\), \({\mathcal {B}}(u)\), and \({\mathcal {H}}(u)\) depend on the anisotropy parameter a. One finds the isotropic background at \(a=0\) so that \({\mathcal {F}}(u)= {\mathcal {B}}(u)={\mathcal {H}}(u)=1\) and \(\phi (u)=0\). Then the temperature can be expressed as

$$\begin{aligned} T= & {} -\left. \frac{\partial _{u} {\mathcal {F}} \sqrt{{\mathcal {B}}}}{4 \pi }\right| _{u = u_{h}}\nonumber \\ {}= & {} \frac{1}{\pi u_{h}}+a^{2} u_{h} \frac{5 \log 2-2}{48 \pi }+{\mathcal {O}}\left( a^{4}\right) . \end{aligned}$$
(3)

The entropy density is given by [55]

$$\begin{aligned} s= & {} \left( \frac{\pi ^{2} N_{c}^{2}}{2}\right) \frac{e^{\frac{-5}{4}} \phi _{h}}{\pi ^{3} u_{h}^{3}}. \end{aligned}$$
(4)
Fig. 1
figure 1

The schematic diagram of A configuration. Red dots are employed to represent heavy quarks, black dot is used to denote verter, and solid blue lines are utilized to illustrate strings

To compare results with the isotropic case, we can fix either temperature or entropy in the system. For small a/T, the functions \({\mathcal {F}}(u)\), \({\mathcal {B}}(u)\), and \({\mathcal {H}}(u)\) are given by [55]

$$\begin{aligned} {\mathcal {F}}(u)= & {} 1-\frac{u^{4}}{u_{h}^{4}}+a^{2}{\mathcal {F}}_{2}(u)+{\mathcal {O}}\left( a^{4}\right) , \end{aligned}$$
(5)
$$\begin{aligned} {\mathcal {B}}(u)= & {} 1+a^{2} {\mathcal {B}}_{2}(u)+{\mathcal {O}}\left( a^{4}\right) , \end{aligned}$$
(6)
$$\begin{aligned} {\mathcal {H}}(u)= & {} e^{-\phi (u)}, \quad \text{ with } \quad \phi (u) = a^{2} \phi _{2}(u)+{\mathcal {O}}\left( a^{4}\right) . \end{aligned}$$
(7)

given the asymptotic AdS boundary conditions and horizon conditions \(u=u_{h}\), one obtains

$$\begin{aligned} {\mathcal {F}}_{2}(u)= & {} \frac{1}{24 u_{h}^{2}}\left[ 8 u^{2}\left( u_{h}^{2}-u^{2}\right) -10 u^{4} \log 2\right. \nonumber \\{} & {} \quad \left. +\left( 3 u_{h}^{4}+7 u^{4}\right) \log \left( 1+\frac{u^{2}}{u_{h}^{2}}\right) \right] , \end{aligned}$$
(8)
$$\begin{aligned} B_{2}(u)= & {} -\frac{u_{h}^{2}}{24}\left[ \frac{10 u^{2}}{u_{h}^{2}+u^{2}}+\log \left( 1+\frac{u^{2}}{u_{h}^{2}}\right) \right] , \end{aligned}$$
(9)
$$\begin{aligned} \phi _{2}(u)= & {} -\frac{u_{h}^{2}}{4} \log \left( 1+\frac{u^{2}}{u_{h}^{2}}\right) . \end{aligned}$$
(10)

Anisotropy in plasma is known to induce instabilities. While these should indeed be investigated in the context of strongly coupled plasma, the gravity background presented in Ref. [55] already demonstrates such instabilities. However, as our work is conducted within the probe limit,

we do not anticipate the introduction of a new source of instability into the system. In the context of AdS/CFT, once the metric is obtained, we can study the potential energy of three quarks. The total action for this potential energy comprises three components: the Nambu-Goto action of three quarks, the vertex action and the boundary action(\(S_{A}\)), namely

$$\begin{aligned} S=\sum _{i=1}^{3} S_{N G}^{(i)}+S_{\textrm{vert}}+3 S_{A}. \end{aligned}$$
(11)

Here the baryon vertex action is

$$\begin{aligned} S_{\textrm{vert}}=\tau _{v} \int \textrm{d} t \sqrt{\frac{{\mathcal {F}}{\mathcal {B}} e^{\frac{5}{2} \phi }}{u^2}}. \end{aligned}$$
(12)

Here \(\tau _{v}\) is a dimensionless parameter. The boundary action is defined as

$$\begin{aligned} S_{A}=\mp \frac{1}{3} \int \textrm{d} t {\mathcal {F}}_{2}(0). \end{aligned}$$
(13)

Thus, the total action can be written as

$$\begin{aligned} S{} & {} =\frac{3 g}{T} \int \textrm{d} x \frac{\sqrt{{\mathcal {B}}}}{u^{2}} \sqrt{{\mathcal {F}} {\mathcal {H}}+\left( \partial _{x} u\right) ^{2}}+\frac{3 \mathrm {~kg}}{T} \sqrt{\frac{{\mathcal {F}}{\mathcal {B}} e^{\frac{5}{2} \phi }}{u_{v}^2}}\nonumber \\ {}{} & {} \quad -\frac{{\mathcal {F}}_{2}(0)}{T}. \end{aligned}$$
(14)

Following Refs. [4,5,6], we adopt the model-dependent parameters as follows: g=0.176 and k=\(-\)0.102. Therefore, the Lagrange of the first term in Eq. (14) is

$$\begin{aligned} {\mathcal {L}}=\frac{\sqrt{{\mathcal {B}}}}{u^{2}} \sqrt{{\mathcal {F}} {\mathcal {H}}+\left( \partial _{x} u\right) ^{2}}. \end{aligned}$$
(15)

The conservation current equation is

$$\begin{aligned} {\mathcal {L}}-u^{\prime } \frac{\partial {\mathcal {L}}}{\partial u^{\prime }} = \frac{\frac{\sqrt{{\mathcal {B}}}}{u^{2}} {\mathcal {F}} {\mathcal {H}}}{\sqrt{{\mathcal {F}} {\mathcal {H}}+\left( \partial _{x} u\right) ^{2}}} = \text{ C }. \end{aligned}$$
(16)

So, for coordinates \(u_{0}\) and vertex \(u_{v}\), we have

$$\begin{aligned} \frac{\frac{\sqrt{{\mathcal {B}}(u)}}{u^{2}} {\mathcal {F}}(u) {\mathcal {H}}(u)}{\sqrt{{\mathcal {F}}(u){\mathcal {H}}(u)+\left( \partial _{x} u\right) ^{2}}}= & {} \frac{\sqrt{{\mathcal {B}}(u_0)}}{u_0^{2}} {\mathcal {F}}(u_0) {\mathcal {H}}(u_0), \end{aligned}$$
(17)
$$\begin{aligned} \frac{\frac{\sqrt{{\mathcal {B}}(u_v)}}{u_v^{2}} {\mathcal {F}}(u_v){\mathcal {H}}(u_v)}{\sqrt{{\mathcal {F}}(u_v){\mathcal {H}}(u_v)+\tan ^{2} \alpha }}= & {} \frac{\sqrt{{\mathcal {B}}(u_0)}}{u_0^{2}} {\mathcal {F}}(u_0) {\mathcal {H}}(u_0). \end{aligned}$$
(18)

Note that \(\partial _{x} u= \tan \alpha \) at \(u=u_{v}\). Sort out the square shift terms on both sides of Eq. (17) and obtain

$$\begin{aligned}{} & {} \partial _{u} x = \sqrt{\frac{\frac{{\mathcal {B}}(u_{0})}{u_{0}^{4}} {\mathcal {F}}^2(u_0){\mathcal {H}}^2(u_0)}{\frac{{\mathcal {B}}(u)}{u^{4}} {\mathcal {F}}^2(u){\mathcal {H}}^2(u), {\mathcal {F}}(u_0){\mathcal {H}}(u_0)-\frac{{\mathcal {B}}(u_{0})}{u_{0}^{4}} {\mathcal {F}}^2(u_0){\mathcal {H}}^2(u_0) {\mathcal {F}}(u){\mathcal {H}}(u)}}. \end{aligned}$$
(19)

Then multiply the denominator on both sides of the Eq. (18) to obtain

$$\begin{aligned}{} & {} \frac{\sqrt{{\mathcal {B}}(u_v)}}{u_{v}^{2}} {\mathcal {F}}(u_v){\mathcal {H}}(u_v)-\frac{\sqrt{{\mathcal {B}}(u_0)}}{u_{0}^{2}} \sqrt{{\mathcal {F}}(u_0){\mathcal {H}}(u_0)},\nonumber \\{} & {} \quad \sqrt{{\mathcal {F}}(u_v){\mathcal {H}}(u_v)+\tan ^{2} \alpha }=0. \end{aligned}$$
(20)

From Fig. 1, the force balance equation at \(u = u_{v}\) is

$$\begin{aligned} {\varvec{e}}_{1}+{\varvec{e}}_{2}+{\varvec{e}}_{3}+{\varvec{f}}_{v}= & {} 0. \end{aligned}$$
(21)

Here \({\varvec{e}}_{1}\), \({\varvec{e}}_{2}\) and \({\varvec{e}}_{3}\) are string tensions. \({\varvec{f}}_{v}\) is gravitational force at the vertex, which is given by \(f_{v}=-\delta E_{\textrm{vert}} / \delta u\) with \(E_{\textrm{vert}} =TS_{vert}\). Where \(S_{vert}\) is the action of the vertex, which can be given by Eq. 12. Therefore each force and its component is

$$\begin{aligned} f_{v}= & {} \left( 0,0,-3 g \textrm{k} \partial _{u_{v}} \sqrt{ \frac{ {\mathcal {F}}(u_v) {\mathcal {B}}(u_v) e^{ \frac{5}{2} \phi }}{u^2} }\right) ,\nonumber \\ {\varvec{e}}_{\textbf{1}}= & {} -g \frac{\sqrt{{\mathcal {B}}(u_v)}}{u_{v}^{2}}\left( \cos \beta \frac{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)}{\sqrt{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)+\tan ^{2} \alpha }},\right. \nonumber \\{} & {} \times \left. \sin \beta \frac{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)}{\sqrt{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)+\tan ^{2} \alpha }}\right. ,\nonumber \\{} & {} - \left. \frac{1}{\sqrt{1+{\mathcal {F}}(u_v) {\mathcal {H}}(u_v) \cot ^{2} \alpha }}\right) \nonumber \\ {\varvec{e}}_{2}= & {} -g \frac{\sqrt{{\mathcal {B}}(u_v)}}{u_{v}^{2}}\left( -\cos \beta \frac{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)}{\sqrt{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)+\tan ^{2} \alpha }},\right. \nonumber \\{} & {} \times \left. \sin \beta \frac{ {\mathcal {F}}(u_v) {\mathcal {H}}(u_v) }{\sqrt{ {\mathcal {F}}(u_v) {\mathcal {H}}(u_v)+\tan ^{2} \alpha }}\right. ,\nonumber \\{} & {} - \left. \frac{1}{\sqrt{1+{\mathcal {F}}(u_v) {\mathcal {H}}(u_v) \cot ^{2} \alpha }}\right) ,\nonumber \\ {\varvec{e}}_{3}= & {} -g \frac{\sqrt{{\mathcal {B}}(u_v)}}{u_{v}^{2}}\left( 0,-\frac{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)}{\sqrt{{\mathcal {F}}(u_v) {\mathcal {H}}(u_v)+\tan ^{2} \alpha }},\right. \nonumber \\{} & {} \left. -\frac{1}{\sqrt{1+{\mathcal {F}}(u_v) {\mathcal {H}}(u_v) \cot ^{2} \alpha }}\right) \text{. } \nonumber \\ \end{aligned}$$
(22)

Due to the fact that the forces acting in the x and y directions are equal in magnitude and opposite in direction, the combined external force acting is directly equal to zero. Then, according to the force balance equation, we have

$$\begin{aligned}{} & {} \frac{\sqrt{{\mathcal {B}}(u_v)}}{u_{v}^{2}} \frac{1}{\sqrt{1+{\mathcal {F}}(u_v) {\mathcal {H}}(u_v) \cot ^{2} \alpha }}\nonumber \\ {}{} & {} -k \partial _{u_{v}} \sqrt{ \frac{ {\mathcal {F}}(u_v) {\mathcal {B}}(u_v) e^{ \frac{5}{2} \phi }}{u_v^2} } = 0. \end{aligned}$$
(23)

According to Refs. [4, 5], in the A configuration (B configuration), quarks are symmetrically arrayed across the u-axis, therefore, in the force balance equation, a single angle suffices to ascertain the force acting on the vertices. By solving Eq. (23), \(u_{v}\) can be directly obtained. In the A configuration, the length of the strings connecting the three quarks can be viewed as an integral from 0 to \(u_{0}\) and then to \(u_{v}\). Therefore, we have the following expression [4, 5]

$$\begin{aligned} L= & {} \sqrt{3}\left( \int _{0}^{u_{0}} \partial _{u} x \mathrm {~d} u+\int _{u_{v}}^{u_{0}} \partial _{u} x \mathrm {~d} u\right) \nonumber \\ {}= & {} \sqrt{3} \int _{0}^{u_{0}} \sqrt{\frac{\frac{{\mathcal {B}}(u_0)}{u_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0)}{\frac{{\mathcal {B}}(u)}{u^{4}} {\mathcal {F}}^2(u) {\mathcal {H}}^2(u) {\mathcal {F}}(u_0) {\mathcal {H}}(u_0))-\frac{{\mathcal {B}}(u_0)}{u_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0) {\mathcal {F}}(u) {\mathcal {H}}(u)}} d u \nonumber \\{} & {} + \sqrt{3} \int _{u_{v}}^{v_{0}} \sqrt{\frac{\frac{{\mathcal {B}}(u)}{r_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0)}{\frac{{\mathcal {B}}(u)}{u^{4}} {\mathcal {F}}^2(u) {\mathcal {H}}^2(u) {\mathcal {F}}(u_0) {\mathcal {H}}(u_0)-\frac{{\mathcal {B}}(u_0)}{u_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0) {\mathcal {F}}(u) {\mathcal {H}}(u)}} \textrm{d} u.\nonumber \\ \end{aligned}$$
(24)

Thus the potential energy is

$$\begin{aligned} E= & {} 3 g\left( \int _{0}^{u_{0}} \frac{\sqrt{{\mathcal {B}}(u)}}{u^{2}} \sqrt{1+{\mathcal {F}}(u) {\mathcal {H}}(u)\left( \partial _{u} x\right) ^{2}}-\frac{1}{u^{2}} \mathrm {~d} u\right. \nonumber \\{} & {} + \left. \int _{u_{v}}^{u_{0}} \frac{\sqrt{{\mathcal {B}}(u)}}{u^{2}} \sqrt{1+{\mathcal {F}}(u) {\mathcal {H}}(u)\left( \partial _{u} x\right) ^{2}} \mathrm {~d} u\right) -\frac{3 g}{u_{0}}\nonumber \\{} & {} +3 g \textrm{k} \sqrt{ \frac{ {\mathcal {F}}(u_v) {\mathcal {B}}(u_v) e^{ \frac{5}{2} \phi }}{u_v^2} }+3 c \nonumber \\{} & {} -{\mathcal {F}}_{2}(0). \end{aligned}$$
(25)

Here we take \(c=0.623\) GeV. According to the definition of binding energy and Refs. [16, 68], the binding energy of the QQQ system can be defined as

$$\begin{aligned} E_{bind}= & {} E-3E_{Q}\nonumber \\= & {} 3 g\left( \int _{0}^{u_{0}} \frac{\sqrt{{\mathcal {B}}(u)}}{u^{2}} \sqrt{1+{\mathcal {F}}(u) {\mathcal {H}}(u)\left( \partial _{u} x\right) ^{2}}-\frac{1}{u^{2}} \mathrm {~d} u\right. \nonumber \\{} & {} + \left. \int _{u_{v}}^{u_{0}} \frac{\sqrt{{\mathcal {B}}(u)}}{u^{2}} \sqrt{1+{\mathcal {F}}(u) {\mathcal {H}}(u)\left( \partial _{u} x\right) ^{2}} \mathrm {~d} u\right) -\frac{3 g}{u_{0}}\nonumber \\{} & {} +3 g \textrm{k} \sqrt{ \frac{ {\mathcal {F}}(u_v) {\mathcal {B}}(u_v) e^{ \frac{5}{2} \phi }}{u_v^2} }+3 c \nonumber \\{} & {} - {\mathcal {F}}_{2}(0)-\frac{3}{2}g\left( \int _{0}^{u_{h}} \frac{\sqrt{{\mathcal {B}}(u)}}{u^{2}} \sqrt{{\mathcal {F}}(u) {\mathcal {H}}(u)}\right. \nonumber \\ {}{} & {} \left. -\frac{1}{u^{2}} \mathrm {~d}u-\frac{1}{u_h} \right) . \end{aligned}$$
(26)

Here \(E_{Q}\) represents the free energy of a single quark, which is [16]

$$\begin{aligned} E_{Q}= & {} \frac{1}{2}\left( \int _{0}^{u_{h}} \frac{\sqrt{{\mathcal {B}}(u)}}{u^{2}} \sqrt{{\mathcal {F}}(u) {\mathcal {H}}(u)}-\frac{1}{u^{2}} \mathrm {~d}u-\frac{1}{u_h}\right) .\nonumber \\ \end{aligned}$$
(27)

Based on the theoretical derivation and discussion above, we turn to analyzing its calculation results. Firstly, let’s focus on vertex coordinate. The relationship between angle \(\alpha \) and the vertex coordinate \(u_{v}\) can be described by the balance equation, as shown in Fig. 2. It is found that this relationship represents a monotonic function. Specifically, when \(u_{v}\) has a very small magnitude, the change in angle \(\alpha \) is relatively gradual. This implies that \(\alpha \) exhibits low sensitivity to variations in \(u_{v}\) under such conditions. However, when \(u_{v}\) takes on larger values, the angle \(\alpha \) undergoes rapid and significant changes in response to the fluctuations in \(u_{v}\).

In order to further investigate the forces \(F_{v}\) affecting the vertex, we plot Fig. 3. It reveals a consistent trend where the magnitude of the force acting on the vertex decreases gradually as the \(u_{v}\) increases. In this model, the three quarks are interconnected by strings, and we are aware that the separation distance of heavy quarkonium varies in response to changes in the anisotropic background. This leads us to investigate how the separation distance among the three quarks is affected.

Fig. 2
figure 2

The dependence of \(\alpha \) on \(u_{v}\) at \(T =0.1\,\textrm{GeV}\) with \(a=0\)

Fig. 3
figure 3

The dependence of \(F_{v}\) on \(u_{v}\) at \(T =0.1\,\textrm{GeV}\)

Fig. 4
figure 4

The dependence of separation distance of triply heavy baryon on \(u_{v}\) at \(T =0.1\,\textrm{GeV}\) with a. The blue dashed line is \(a=0\), the black line is \(a=0.5\) and the red line is \(a=0.7\)

In Fig. 4, we present the variations in separation distance and the parameter \(u_{v}\) for the three quarks. It is found that the separation distance between the three quarks steadily increases as \(u_{v}\) increases, reaching its maximum value before gradually decreasing. This observed behavior closely resembles the response of heavy quarkonium. Furthermore, it’s worth noting that as the anisotropy parameter a progressively increases, the maximum screening distance consistently decreases. This indicates that a has a diminishing effect on the screening distance.

Fig. 5
figure 5

The dependence of potential of triply heavy baryon on separation distance at \(T =0.1\,\textrm{GeV}\) with a. The blue dashed line is \(a=0\), the black line is \(a=0.5\) and the red line is \(a=0.7\)

Fig. 6
figure 6

The dependence of \(E_{bind}\) on L at \(T =0.1\,\textrm{GeV}\) with a. The black dashed line is \(a=0.5\), the red line is \(a=0.7\) and the green line is \(a=0.8\)

Fig. 7
figure 7

The schematic diagram of B configuration. Red dots are employed to represent heavy quarks, black dot is used to denote verter, and solid blue lines are utilized to illustrate strings. The system is anisotropic in the transverse direction

To investigate the dependency of the potential energy of the three quarks on the separation distance L, we plot Fig. 5. The results show that the potential energy of the three quarks exhibits a continuous increase with the separation distance, ultimately reaching a point where the three quark systems undergo dissolution. Besides, the results also indicate that with an increase in anisotropy, the potential energy of the three quarks gradually diminishes. This signifies that the anisotropic parameters exert a suppressing effect on the potential energy. In particular, the impact of the anisotropy parameter a is most pronounced in the linear region of the potential energy.

It’s know that bound states are closely linked with binding energy. Specifically, when a system is in a bound state, its binding energy tends to be negative. Besides, the larger the absolute value of the binding energy, the stronger the binding, leading to increased stability within the system. Thus we can determine whether a system is in a bound state by examining the sign of its binding energy. To comprehend the effect of the anisotropic parameter a on the bound state, let’s study the results illustrated in Fig. 6. The presence of a negative range of binding energy \(E_{bind}\) suggests the existence of bound states within the QQQ system. Moreover, we find a gradual increase in the absolute value of this negative energy as the anisotropy a decreases. This indicates that with an increase in a, the QQQ system becomes less tightly bound, resulting in greater instability.

3 Three-quark potential of B configuration

In the preceding section, we focus on the separation distance and potential energy of three quarks within the A configuration. Now, let’s turn our attention to B configuration, where one quark is positioned at the coordinate origin, and the other two quarks are symmetrically distributed on both sides of the x-axis, as shown in Fig. 7. The system is anisotropic in the transverse direction. Thus, the force balance equation for the B configuration is

$$\begin{aligned}{} & {} -2 \frac{ \sqrt{{\mathcal {B}}(u_v)} }{u_{v}^{2}} \frac{1}{\sqrt{1+{\mathcal {F}}(u_v) {\mathcal {H}}(u_v) \cot ^{2} \alpha }}+\frac{ \sqrt{{\mathcal {B}}(u_v)} }{u_{v}^{2}}\nonumber \\{} & {} \quad +3 k \partial _{u_{v}} \sqrt{ \frac{ {\mathcal {F}}(u_v) {\mathcal {B}}(u_v) e^{ \frac{5}{2} \phi }}{u^2} } = 0. \end{aligned}$$
(28)

Then, the vertex coordinate \(u_{v}\) can be obtained by applying Eq. 28. Additionally, the value of \(u_{0}\) can be determined through Eq. 18 as well. By utilizing these obtained values, we can calculate the separation distance of B configuration

$$\begin{aligned}{} & {} L = \int _{0}^{u_{0}} \partial _{u} x \mathrm {~d} u+\int _{u_{v}}^{u_{0}} \partial _{u} x \mathrm {~d} u = \int _{0}^{u_{0}} \sqrt{\frac{\frac{{\mathcal {B}}(u_0)}{u_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0) }{\frac{\textrm{e}^{2 s r^{2}}}{u^{4}} {\mathcal {F}}^2(u) {\mathcal {H}}^2(u) {\mathcal {F}}(u_0) {\mathcal {H}}(u_0)-\frac{{\mathcal {B}}(u_0)}{u_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0) {\mathcal {F}}^2(u) {\mathcal {H}}^2(u)}} \textrm{d} u\nonumber \\{} & {} \quad +\int _{u_{v}}^{u_{0}} \sqrt{\frac{\frac{{\mathcal {B}}(u_0)}{u_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0)}{\frac{{\mathcal {B}}(u)}{u^{4}} {\mathcal {F}}^2(u) {\mathcal {H}}^2(u){\mathcal {F}}(u_0) {\mathcal {H}}(u_0)-\frac{{\mathcal {B}}(u_0)}{u_{0}^{4}} {\mathcal {F}}^2(u_0) {\mathcal {H}}^2(u_0) {\mathcal {F}}(u) {\mathcal {H}}(u)}} \textrm{d} u. \nonumber \\ \end{aligned}$$
(29)

Thus, the potential energy is given by

$$\begin{aligned} E= & {} 2 g\left( \int _{0}^{u_{0}} \frac{{\mathcal {B}}(u)}{u^{2}} \sqrt{1+{\mathcal {F}}(u) {\mathcal {H}}(u)\left( \partial _{u} x\right) ^{2}} \mathrm {~d} u\right. \nonumber \\{} & {} + \left. \int _{u_{v}}^{u_{0}} \frac{{\mathcal {B}}(u)}{u^{2}} \sqrt{1+{\mathcal {F}}(u) {\mathcal {H}}(u)\left( \partial _{u} x\right) ^{2}} \mathrm {~d} u\right) -\frac{2 g}{u_{0}}\nonumber \\{} & {} +g \int _{0}^{u_{v}} \left( \frac{{\mathcal {B}}(u)}{u^{2}}-\frac{1}{u^{2}}\right) \mathrm {~d} u-\frac{g}{u_{v}}\nonumber \\{} & {} + 3 g k \sqrt{\frac{{\mathcal {F}}(u) {\mathcal {B}}(u) e^{\frac{5}{2} \phi }}{u^2}}+3 c-{\mathcal {F}}_{2}(0). \end{aligned}$$
(30)

The physical significance of the screening distance is its capability to provide insights into the stability and dissolution characteristics of three-quark systems within strongly interacting media. In particular, when the screening distance is substantial, it signifies that the quarkonium remains relatively stable within the surrounding medium and can maintain its original state. Thus, to investigate the stability of the three-quark system, we plot Fig. 8. The result of this analysis reveal that, as the parameter a increases, the maximum screening distance gradually diminishes, indicating that the three-quark system becomes more susceptible to dissolution under these conditions.

Fig. 8
figure 8

The dependence of screening distance on a at \(T =0.1\,\textrm{GeV}\)

Fig. 9
figure 9

The dependence of \(F_{v}\) on a at \(T =0.1\,\textrm{GeV}\)

Fig. 10
figure 10

The dependence of E on L at \(T =0.1\,\textrm{GeV}\) with a. The blue line is \(a=0\), the black line is \(a=0.5\) and the red line is \(a=0.7\)

Fig. 11
figure 11

Comparing the potential energy in A configuration and B configuration at \(T=0.1\) GeV and \(a=0\). The blue dashed line is A configuration and the blue line is B configuration

Fig. 12
figure 12

a The dependence of L on \(u_{v}\) at \(s =2\) with a for A configuration. The blue dashed line is \(a=0\), the black line is \(a=1\) and the red line is \(a=1.2\). b The dependence of E on L at \(s =2\) with a. The blue dashed line is \(a=0\), the black line is \(a=1\) and the red line is \(a=1.2\)

To further investigate the force acting on vertex, we plot Fig. 9. The results indicate that as the anisotropy parameter increases, the force acting on the vertex can change from negative to positive. A detailed explanation of this behavior can be provided as follows: As shown in Fig. 7, the force acting on the vertex is clearly directed downward. Thus, a positive force value typically corresponds to an upward force direction. However, considering the force acting on the vertex to be positive in this particular context would imply a direction contrary to that depicted in Fig. 7. This discrepancy clearly lacks physical significance and contradicts the established force direction. Therefore, we can conclude that when the anisotropic parameter a exceeds a certain critical value \(a_{0}\) (\(a > a_{0}\), where \(a_{0}\) represents the root of equation \(F_{v}(a)=0\)), the three quark system will become unstable.

Fig. 13
figure 13

a The dependence of E on L at \(s =2\) with a for B configuration. The blue line is \(a=0\), the black line is \(a=1\) and the red line is \(a=1.2\). b Comparing the potential energy in A configuration and B configuration at \(s =2\) and \(a=1.2\). The red dashed line is A configuration and the red line is B configuration

The Fig. 10 illustrates the correlation between potential energy (E) and separation distance (L). In general, the potential energy consistently rises as the separation distance increases. Additionally, as the parameter a increases, there is a gradual decrease in potential energy. These two observations closely parallel the findings in A configuration. However, the energy of the three quarks in A configuration is slightly lower than that in B configuration, shown in Fig. 11. This difference in potential energy implies that the three quarks in A configuration have relatively greater stability compared to those in B configuration, which is consistent with the results of Ref. [5]

4 Three-quark potential with the same entropy density

As it was expressed, to compare the results with the isotropic case one can fix temperature and change entropy density. In Ref. [69], it was found that the behavior of a jet at a specific temperature is distinct from its behavior at the same entropy density. In the preceding section, we studied the potential energy of three quarks under identical temperature conditions. Now, our focus shifts to investigating the potential energy of three quarks subjected to an equivalent energy density. Here, the entropy density can be determined using Eq. (4), and the method for calculating the L and E of the three-quark system under same entropy density conditions is analogous to the previous calculations.

Based on the results presented in Fig. 12, it is found that in A configuration, where the entropy density remains constant, the maximum screening distance steadily decreases as the anisotropy parameter a increases. This means that the presence of anisotropic parameters is beneficial for the dissolution of three-quark systems when the entropy density or degree of system disorder is equivalent. The potential energy at fixed entropy density also exhibits a continuous decline with increasing a, which is very similar to the behavior of fixed temperature, as shown in Fig. 13a. However, the distinction emerges in terms of the potential energy between A configuration and B configuration under fixed entropy density, with the former exhibiting significantly lower values than the latter (Fig. 13b). This also means that the three quark system in A configuration is more stable than in B configuration.

5 Summary and conclusions

In this work, we mainly study triply heavy baryon in anisotropic backgrounds. The total action of the three quark system mainly includes the Nambu-Goto action, vertex action, and boundary term of the three quarks. The vertex positions can be obtained by solving the force balance equation. After determining the vertex position, we further calculate the separation distance and potential energy of the three quarks. The results show that as the anisotropic background a increases, the maximum screening distance gradually decreases. Next, we also study the three quark potential energy in A configuration and B configuration. The results indicate that in both A configuration and B configuration, the potential energy gradually decreases with the increase of anisotropic parameter a. This shows that the presence of an anisotropic background promotes the dissolution of the three quark system. The difference is that the potential energy in A configuration is smaller than that in B configuration, which means that the three quark system in A configuration is more stable. That would be interesting to add chemical potential and study holographic A and B configuration of heavy baryons in the presence of anisotropy [70].

However, triple heavy baryons have not been directly observed in experiments. Therefore, our work can be seen as a prediction of experimental. Over the past decade, many exotic hadron states have been found through experiments. These exotic hadron states offer a new perspective for understanding the dynamics of strong interactions and multi-quark systems. Specifically, X(6900) has been observed on the LHC and is assumed to be composed of four fully heavy quarks [71]. But so far, its properties are not entirely clear. Therefore, it is necessary for us to study the potential energy of fully heavy tetraquark in anisotropic backgrounds, in order to broaden our understanding of exotic hadron states. We will further investigate it in the future work.