1 Introduction and main result

In this paper we are devoted to the following Schrödinger–Poisson system

$$ \textstyle\begin{cases} -\Delta u+u+K(x)\phi u=a(x)u^{3},& x\in \mathbb{R}^{3}, \\ -\Delta \phi =K(x)u^{2}, & x\in \mathbb{R}^{3}, \end{cases}\displaystyle {\mathrm{(SP)}} $$

where the potentials K and a satisfy:

(\(\mathrm{a}_{1}\)):

\(a\in L^{\infty }(\mathbb{R}^{3})\), \(\lim_{|x|\rightarrow \infty }a(x)=a_{\infty }>0\).

(K):

\(K\in L^{2}(\mathbb{R}^{3})\), \(\lim_{|x|\rightarrow \infty }K(x)=0\), \(K(x)\geq 0\), for all \(x\in \mathbb{R}^{3}\), \(K\not \equiv 0\).

(\(\mathrm{a}_{2}\)):

\(a(x)\geq a_{\infty }\), \(\forall x\in \mathbb{R}^{3}\), \(a(x)-a_{\infty }>0\) on a positive measure set.

(\(\mathrm{a}_{3}\)):

\(a(x)\leq a_{\infty }\), \(\forall x\in \mathbb{R}^{3}\), \(\inf_{x\in \mathbb{R}^{3}}a(x)>0\).

System (SP) is a special form of the Schrödinger–Poisson system

$$ \textstyle\begin{cases} -\Delta u+V(x)u+K(x)\phi u=f(x,u),& x\in \mathbb{R}^{3}, \\ -\Delta \phi =K(x)u^{2}, & x\in \mathbb{R}^{3}, \end{cases} $$
(1.1)

which has been first introduced in [5] as a physical model describing a charged wave, interacting with its own electrostatic field in quantum mechanics. The unknowns u and ϕ represent the wave functions associated to the particle and electric potential, the functions V and K are external potentials, and the nonlinearity \(f(x,u)\) simulates the interaction between many particles or external nonlinear perturbations. For more information on the physical aspects, we refer the reader to [5].

There have been many works dealing with (1.1) and the existence of bound and ground states, radial and nonradial solutions, sign-changing solutions, and semiclassical states. Here we mainly are interested in the existence results of bound and ground states. It is well known that the main difficulty of problem (1.1) is the lack of compactness for Sobolev’s embedding theorem on the whole space \(\mathbb{R}^{3}\). To recover the compactness, many studies were focused on the autonomous case (see [4, 9,10,11, 14, 17], for example) or on the radially symmetric function space which possesses compact embedding (see [3, 15, 17], for instance). When the potentials are neither constants nor radially symmetric, system (1.1) has also been increasingly receiving interest in recent years, for example, see [1,2,3, 13]. Azzollini and Pomponio [4] considered the existence of ground states of (1.1) when V is nonconstant and possibly unbounded below, \(K=1\), \(f(x,u)=|u|^{p-1}u\) and \(f(x,u)=u^{5}+|u|^{p-1}u\) with \(3< p<5\). In [23], Zhao and Zhao established the existence of ground states of (1.1) with pure power nonlinearity \(f(u)\) and V being weakly differentiable, \(K=1\). Later, Cerami and Vaira [8] considered the system

$$ \textstyle\begin{cases} -\Delta u+u+K(x)\phi u=a(x) \vert u \vert ^{p-1}u,& x\in \mathbb{R}^{3}, \\ -\Delta \phi =K(x)u^{2}, & x\in \mathbb{R}^{3}, \end{cases} $$
(1.2)

where \(3< p<5\). Assume that the potential \(K(x)\) satisfies condition (K) and \(a(x)\) satisfies

(\(\mathrm{a}_{1}'\)):

\(\lim_{|x|\rightarrow \infty }a(x)=a_{\infty }>0\), \(\alpha (x):=a(x)-a_{\infty }\in L^{\frac{6}{5-p}}(\mathbb{R}^{3})\);

they discussed the existence of ground and bound states. More precisely, when (\(\mathrm{a}_{1}'\)), (\(\mathrm{a}_{2}\)), (K) and other suitable restrictions on \(K(x)\) and \(a(x)\) are satisfied, they showed that problem (1.2) has a ground state by the standard method of Nehari manifold and compactness lemma. Moreover, when (\(\mathrm{a}_{1}'\)), (\(\mathrm{a}_{3}\)), (K), and certain restrictions on \(K(x)\) and \(a(x)\) are satisfied, they proved that system (1.2) possesses a bound state via the linking theorem. After that some researchers focused on problem (1.2). Sun et al. in [19] generalized the existence results of ground states to the asymptotically linear case. In [13], the authors dealt with the equation system

$$ \textstyle\begin{cases} -\Delta u+V(x)u+K(x)\phi u=a(x) \vert u \vert ^{p-1}u,& x\in \mathbb{R}^{3}, \\ -\Delta \phi =K(x)u^{2}, & x\in \mathbb{R}^{3}, \end{cases} $$
(1.3)

where \(3< p<5\), and they obtained a ground state of (1.3) by imposing some conditions on the decay rate of the potentials. On the other hand, under suitable assumptions on the decay rate of the potentials, Cerami and Molle [6] proved the existence of bound states of (1.3). Zhang et al. [22] considered system (1.3) with critical growth, namely

$$ \textstyle\begin{cases} -\Delta u+V(x)u+K(x)\phi u=u^{5},& x\in \mathbb{R}^{3}, \\ -\Delta \phi =K(x)u^{2}, & x\in \mathbb{R}^{3}. \end{cases} $$
(1.4)

When \(V\in L^{\frac{3}{2}}(\mathbb{R}^{3})\), \(K\in L^{2}(\mathbb{R} ^{3})\) are nonnegative functions, and \(|V|_{\frac{3}{2}}+|K|_{2}\) is suitably small, they showed that (1.4) has a bound state via a linking theorem.

It seems that the existence of bound and ground states for problem (1.2) with \(p=3\), namely system (SP), has not been studied. So in this paper we will fill this gap. Compared with [8], the main difficulty is the lack of the higher-order term and the competing effect of the nonlocal term with three times growth term. On the one hand, due to the lack of the higher-order term, the standard method of Nehari manifold is invalid. Inspired by [12], by restricting the functional in a set, this functional has a unique maximum point along the nontrivial direction u in \(H^{1}(\mathbb{R}^{3})\). Then we use the one-to-one correspondence of the functionals on the manifold and an open set of the unit sphere to establish the new method of Nehari manifold. On the other hand, the competing effect of the nonlocal term \(K(x)\phi u\) and three times growth term \(a(x)u^{3}\) makes some estimations and verifications more complex.

Since we have no symmetry assumptions, similar to [8] we shall recover the compactness of PS sequences by the problem at infinity:

$$-\Delta u+u=a_{\infty }u^{3}. \mathrm{{(NSE)}_{\infty }} $$

In order to state the main results, we give some notations as follows. Denote by w the unique radial solution of \((\mathrm{NSE})_{\infty }\), and set \(m_{\infty }=\frac{1}{4}\|w\|^{2}\), where \(\|\cdot \|\) is the standard norm of \(H^{1}(\mathbb{R}^{3})\).

In addition, when (\(\mathrm{a}_{2}\)) holds, the problem \(-\Delta u+u=a(x) u ^{3}\) possesses a ground state \(w_{a}\), whose energy is \(m_{a}= \frac{1}{4}\|w_{a}\|^{2}< m_{\infty }\). We denote by S and the best constants for the embeddings of \(H^{1}(\mathbb{R} ^{3})\) and \(D^{1,2}(\mathbb{R}^{3})\) in \(L^{6}(\mathbb{R}^{3})\), respectively. Our results are as follows:

Theorem 1.1

Let (\(\mathrm{a}_{1}\)), (\(\mathrm{a}_{2}\)) and (K) hold. Furthermore, assume either

$$ \vert K \vert ^{2}_{2}< \frac{(m_{\infty }-m_{a})\bar{S}^{2}{S}^{4}}{4m_{a}m_{ \infty }} $$
(1.5)

or

$$ \int _{\mathbb{R}^{3}} K(x)\phi _{w}w^{2}\,dx< \int _{\mathbb{R}^{3}} \bigl(a(x)-a _{\infty }\bigr)w^{4} \,dx, $$
(1.6)

then system (SP) has a ground state.

Theorem 1.2

Let (\(\mathrm{a}_{1}\)), (\(\mathrm{a}_{3}\)) and (K) hold. In addition, assume

$$ \vert K \vert ^{2}_{2}< \biggl(\frac{\inf_{x\in \mathbb{R}^{3}} a(x)}{a_{\infty }}- \frac{1}{2} \biggr)\frac{\bar{S}^{2}{S}^{4}}{4m_{\infty }}, $$
(1.7)

then the system (SP) has a bound state.

The paper is organized as follows. In Sect. 2, we give some preliminaries. In Sect. 3, we introduce the variational setting. In Sects. 4 and 5, we prove Theorems 1.1 and 1.2, respectively.

2 Notations and preliminaries

In this paper we use the following notations:

\(H^{1}(\mathbb{R}^{3})\) is the Sobolev space with standard norm

$$ \Vert u \Vert ^{2}= \int _{\mathbb{R}^{3}}\bigl( \vert \nabla u \vert ^{2}+u^{2}\bigr)\,dx; $$

\(S_{1}=\{u\in H^{1}(\mathbb{R}^{3}):\|u\|^{2}=1\}\); \(D^{1,2}( \mathbb{R}^{3})\) is the Sobolev space endowed with the scalar product and norm

$$ (u,v)_{D^{1,2}}= \int _{\mathbb{R}^{3}} \nabla u\cdot \nabla v\,dx, \qquad \Vert u \Vert ^{2}_{D^{1,2}}= \int _{\mathbb{R}^{3}} \vert \nabla u \vert ^{2}\,dx. $$

The norm in \(L^{r}(\mathbb{R}^{3})\) (\(1\leq r\leq \infty \)) is denoted by \(|\cdot |_{r}\); S and are the best Sobolev constants for the embeddings of \(H^{1}(\mathbb{R}^{3})\) and \(D^{1,2}(\mathbb{R}^{3})\) in \(L^{6}(\mathbb{R}^{3})\), respectively, namely

$$ S=\inf_{u\in H^{1}(\mathbb{R}^{3})\setminus \{0\}} \frac{ \Vert u \Vert }{ \vert u \vert _{6}}, \qquad \bar{S}=\inf _{u\in D^{1,2}(\mathbb{R}^{3})\setminus \{0\}}\frac{ \Vert u \Vert _{D^{1,2}}}{ \vert u \vert _{6}}. $$

Without loss of generality, in the sequel, we assume that \(a_{\infty }=1\).

System (SP) can be easily transformed into a Schrödinger equation with a nonlocal term. Actually, for all \(u\in H^{1}(\mathbb{R}^{3})\), consider the linear functional \(L_{u}\) defined in \(D^{1,2}(\mathbb{R} ^{3})\) by

$$ L_{u}(v)= \int _{\mathbb{R}^{3}} K(x)u^{2}v\,dx. $$

By Hölder and Sobolev inequalities, we have

$$ \bigl\vert L_{u}(v) \bigr\vert \leq \vert K \vert _{2} \vert u \vert ^{2}_{6} \vert v \vert _{6}\leq {\bar{S}}^{-1} \vert K \vert _{2} \vert u \vert ^{2} _{6} \Vert v \Vert _{D^{1,2}}. $$
(2.1)

Hence, the Lax–Milgram theorem implies that there exists a unique \(\phi _{u}\in D^{1,2}(\mathbb{R}^{3})\) such that

$$ (\phi _{u},v)_{D^{1,2}}=L_{u}(v)= \int _{\mathbb{R}^{3}} K(x)u^{2}v\,dx, \quad \forall v\in D^{1,2}\bigl(\mathbb{R}^{3}\bigr). $$
(2.2)

Namely, \(\phi _{u}\) is the unique solution of \(-\Delta \phi =K(x)u^{2}\), and

$$ \phi _{u}(x)=\frac{1}{4\pi } \int _{\mathbb{R}^{3}}\frac{K(y)}{ \vert x-y \vert }u ^{2}(y)\,dy. $$

Substituting \(\phi _{u}\) into the first equation of (SP), we get

$$-\Delta u+u+K(x)\phi _{u}u=a(x)u^{3}. \mathrm{(SP)}' $$

By (2.1) and (2.2), we obtain

$$ \Vert \phi _{u} \Vert _{D^{1,2}}= \Vert L_{u} \Vert _{\mathcal{L}(D^{1,2}(\mathbb{R}^{3}), \mathbb{R})}\leq \bar{S}^{-1}{S}^{-2} \vert K \vert _{2} \Vert u \Vert ^{2}. $$

Then

$$ \begin{aligned} \biggl\vert \int _{\mathbb{R}^{3}} K(x)\phi _{u}u^{2}\,dx \biggr\vert &\leq \bar{S} ^{-2}{S}^{-4} \vert K \vert ^{2}_{2} \Vert u \Vert ^{4}. \end{aligned} $$
(2.3)

In addition, one easily has that the functional

$$ I(u)=\frac{1}{2} \Vert u \Vert ^{2}+ \frac{1}{4} \int _{\mathbb{R}^{3}} K(x)\phi _{u}u^{2}\,dx- \frac{1}{4} \int _{\mathbb{R}^{3}} a(x)u^{4}\,dx $$

is of class \(C^{1}\) and its critical points are solutions of (SP)′.

Define the operator \(\varPhi : H^{1}(\mathbb{R}^{3})\rightarrow D^{1,2}( \mathbb{R}^{3})\) as

$$ \varPhi (u)=\phi _{u}. $$

Below we summarize some properties of Φ, which were proved in [6, 8].

Lemma 2.1

  1. (1)

    Φ is continuous;

  2. (2)

    Φ maps bounded sets into bounded sets;

  3. (3)

    \(\varPhi (tu)=t^{2}\varPhi (u)\) for all \(t\in \mathbb{R}\);

  4. (4)

    If \(u_{n}\rightharpoonup u\) in \(H^{1}(\mathbb{R}^{3})\), then \(\varPhi (u_{n})\rightarrow \varPhi (u)\) in \(D^{1,2}(\mathbb{R}^{3})\), and

    $$\begin{aligned}& \int _{\mathbb{R}^{3}} K(x)\phi _{u_{n}}u^{2}_{n} \,dx\rightarrow \int _{\mathbb{R}^{3}} K(x)\phi _{u}u^{2}\,dx,\\& \int _{\mathbb{R}^{3}} K(x) \phi _{u_{n}}u_{n}\psi \,dx\rightarrow \int _{\mathbb{R}^{3}} K(x)\phi _{u}u\psi \,dx, \end{aligned}$$

    for any \(\psi \in H^{1}(\mathbb{R}^{3})\).

3 Variational setting

In this section we describe the variational framework for our problem. Firstly we give the Nehari manifold M corresponding to I:

$$ M=\bigl\{ u\in H^{1}\bigl(\mathbb{R}^{3}\bigr)\backslash \{0\}:\bigl\langle I'(u),u\bigr\rangle =0\bigr\} , $$

where

$$ \bigl\langle I'(u),u\bigr\rangle = \Vert u \Vert ^{2}+ \int _{\mathbb{R}^{3}} K(x)\phi _{u} u ^{2}\,dx- \int _{\mathbb{R}^{3}} a(x)u^{4}\,dx, $$

and the least energy on M is defined by \(c:=\inf_{M}I\).

Lemma 3.1

Let (K), (\(\mathrm{a}_{1}\)), and either (\(\mathrm{a}_{2}\)) or (\(\mathrm{a}_{3}\)) hold. Then I is coercive on M.

Proof

For all \(u\in M\), we have

$$ I(u)=I(u)-\frac{1}{4}\bigl\langle I'(u),u\bigr\rangle =\frac{1}{4} \Vert u \Vert ^{2}. $$
(3.1)

Hence \(I|_{M}\) is coercive. □

Next we introduce a set to construct the new method of Nehari manifold as in [21]. Define

$$ \varTheta :=\biggl\{ u\in H^{1}\bigl(\mathbb{R}^{3} \bigr): \int _{\mathbb{R}^{3}} K(x)\phi _{u}u^{2}\,dx< \int _{\mathbb{R}^{3}} a(x)u^{4}\,dx\biggr\} . $$

We claim that

$$ \varTheta \neq \varnothing . $$
(3.2)

We shall argue as in [21] to show (3.2), but we need some modifications since \(K\in L^{2}(\mathbb{R}^{3})\) in this paper, which is different than \(L^{\infty }(\mathbb{R}^{3})\) considered in [21]. Firstly, we need the following inequality:

Proposition 3.1

(Hardy–Littlewood–Sobolev inequality; see [16])

Let \(s,r>1\), \(0<\mu <3\) with \(\frac{1}{s}+\frac{\mu }{3}+\frac{1}{r}=2\), \(f\in L^{s}(\mathbb{R}^{3})\), and \(h\in L^{r}(\mathbb{R}^{3})\). There exists a sharp constant \(C(s,\mu ,r)\), independent of f and h, such that

$$ \int _{\mathbb{R}^{3}} \int _{\mathbb{R}^{3}}\frac{f(x)h(y)}{ \vert x-y \vert ^{ \mu }}\,dy\,dx\leq C(s,\mu ,r) \vert f \vert _{s} \vert h \vert _{r}. $$

Now we prove (3.2). In fact, let \(u_{0}\in C^{\infty }_{0}( \mathbb{R}^{3},[0,1])\) be such that \(u_{0}\equiv 1\) in \(B_{r}(0)\), \(u_{0}\equiv 0\) in \(\mathbb{R}^{3}\setminus B_{2r}(0)\), where r is to be determined. Then

$$ \int _{\mathbb{R}^{3}}K(x)\phi _{u_{0}}u^{2}_{0} \,dx =\frac{1}{4\pi } \int _{\mathbb{R}^{3}} \int _{\mathbb{R}^{3}}\frac{K(x)K(y)u^{2}_{0}(x)u ^{2}_{0}(y)}{ \vert x-y \vert }\,dy\,dx\leq C \vert K \vert ^{2}_{2} \vert u_{0} \vert ^{4}_{6}. $$

Then

$$ \int _{\mathbb{R}^{3}}K(x)\phi _{u_{0}}u^{2}_{0} \,dx\leq C_{1}r^{2}. $$

Moreover,

$$ \int _{\mathbb{R}^{3}} a(x)u^{4}_{0}\,dx\geq \inf_{\mathbb{R}^{3}}a \int _{|x|\leq r}\,dx=C_{2} r^{3}. $$

Hence we can choose r be so large that \(u_{0}\in \varTheta \). Then (3.2) follows.

Set

$$ h(t):=I(tu)=\frac{t^{2}}{2} \Vert u \Vert ^{2}+ \frac{t^{4}}{4} \biggl[ \int _{\mathbb{R}^{3}} K(x)\phi _{u} u^{2}\,dx- \int _{\mathbb{R}^{3}} a(x)u ^{4}\,dx \biggr]. $$

Lemma 3.2

Under the assumptions of Lemma 3.1, we have that:

  1. (i)

    For all \(u\in \varTheta \), there exists a unique \(t_{u}>0\) such that \(h'(t)>0\) for \(0< t< t_{u}\), and \(h'(t)<0\) for \(t>t_{u}\). Moreover, \(t_{u}u\in M\) and \(I(t_{u}u)=\max_{t>0}I(tu)\).

  2. (ii)

    If \(u\notin \varTheta \), then \(tu\notin M\) for any \(t>0\).

  3. (iii)

    For each compact subset W of \(\varTheta \cap S_{1}\), there exists \(C_{W}>0\) such that \(t_{w}\leq C_{W}\) for all \(w\in W\).

  4. (iv)

    There exists \(\rho >0\) such that \(\inf_{S_{\rho }}I>0\) and then \(c=\inf_{M}I\geq \inf_{S_{\rho }}I>0\), where \(S_{\rho }=\{u\in H^{1}( \mathbb{R}^{3}):\|u\|^{2}=\rho \}\).

  5. (v)

    \(\|u\|^{2}\geq 4c\) for all \(u\in M\).

Proof

The proof is similar to that given in [21], and we state it for the reader’s convenience.

(i) For each \(u\in \varTheta \), one easily has that \(h(t)>0\) when t is sufficiently small, and \(h(t)<0\) when t is large enough. Then h has a positive maximum point in \((0,\infty )\). Moreover, the maximum point t satisfies

$$ \Vert u \Vert ^{2}=t^{2} \biggl[ \int _{\mathbb{R}^{3}} a(x)u^{4}\,dx- \int _{\mathbb{R}^{3}} K(x)\phi _{u} u^{2}\,dx \biggr]. $$
(3.3)

Then the maximum point is unique, and denoted by \(t_{u}\). Therefore, conclusion (i) follows.

(ii) We argue by contradiction. Assume that there exists \(t>0\) such that \(tu\in M\). Then \(\langle I'(tu),tu\rangle =0\). So (3.3) holds. Then \(u\in \varTheta \). This contradicts the fact that \(u\notin \varTheta \).

(iii) Suppose that there exist a compact subset \(W\subset \varTheta \cap S_{1}\) and a sequence \(\{w_{n}\}\subset W\) such that \(t_{w_{n}} \rightarrow \infty \). Assume \(w\in W\) is such that \(w_{n}\rightarrow w\) in \(H^{1}(\mathbb{R}^{3})\). Then one easily has that

$$ \int _{\mathbb{R}^{3}} K(x)\phi _{w_{n}}w^{2}_{n}- \int _{\mathbb{R}^{3}} a(x)w^{4}_{n}\rightarrow \int _{\mathbb{R}^{3}} K(x)\phi _{w}w^{2}- \int _{\mathbb{R}^{3}} a(x)w^{4}< 0. $$

So

$$ \frac{I(t_{w_{n}}w_{n})}{t^{2}_{w_{n}}}=\frac{1}{2}+\frac{t^{2}_{w _{n}}}{4} \biggl[ \int _{\mathbb{R}^{3}} K(x)\phi _{w_{n}}w^{2}_{n}- \int _{\mathbb{R}^{3}} a(x)w^{4}_{n} \biggr] \rightarrow -\infty . $$

However, by (3.1), we know that \(I(t_{w_{n}}w_{n})\geq 0\). This is a contradiction.

(iv) By (2.3), one easily has that there exists \(\rho >0\) such that \(\inf_{S_{\rho }}I>0\). For any \(u\in M\), there is \(t>0\) such that \(tu\in S_{\rho }\). Note that \(I(u)\geq I(tu)\), then \(\inf_{S_{\rho }}I \leq \inf_{M}I=c\). Hence \(c>0\).

In addition, (v) easily follows from (3.1). This ends the proof. □

From Lemma 3.2(i), we define the mapping \(\hat{m}:\varTheta \rightarrow M\) by \(\hat{m}(u)=t_{u}u\). In addition, \(\forall v\in \mathbb{R}^{+}u\), we have \(\hat{m}(v)=\hat{m}(u)\). Let \(U:=\varTheta \cap S_{1}\). Now we easily infer that U is an open subset of \(S_{1}\). Define \(m:=\hat{m}|_{U}\). Then m is a bijection from U to M. Moreover, as in the proof of [20, Proposition 3.1], Lemma 3.2 implies

Lemma 3.3

Under the assumptions of Lemma 3.1, the mapping m is a homeomorphism between U and M, and the inverse of m is given by \(m^{-1}(u)=\frac{u}{\|u\|}\).

By Lemma 3.3, the least energy c has the following minimax characterization:

$$ c:=\inf_{u\in M}I(u)=\inf _{u\in U}\max_{t\geq 0}I(tu). $$
(3.4)

Considering the functional \(\varPsi :U\rightarrow \mathbb{R}\) given by

$$ \varPsi (u):=I\bigl(m(u)\bigr), $$

and as in [20, Corollary 3.3], we deduce

Lemma 3.4

Under the assumptions of Lemma 3.1, the following results hold:

  1. (1)

    If \(\{w_{n}\}\) is a PS sequence for Ψ, then \(\{m(w_{n})\}\) is a PS sequence for I. If \(\{u_{n}\}\subset M\) is a bounded PS sequence for I, then \(\{m^{-1}(u_{n})\}\) is a PS sequence for Ψ.

  2. (2)

    u is a critical point of Ψ if and only if \(m(u)\) is a nontrivial critical point of I. Moreover, \(\inf_{M}I=\inf_{U}\varPsi \).

In order to restore the compactness for the PS sequence of (SP)′, we introduce two equations. If \(K(x)=0\), then (SP)′ turns out to be

$$-\Delta u+u=a(x) u^{3}, \mathrm{{(NSE)}} $$

whose functional is

$$ I_{a}(u)=\frac{1}{2} \Vert u \Vert ^{2}- \frac{1}{4} \int _{\mathbb{R}^{3}}a(x)u ^{4}\,dx, $$

and the Nehari manifold is

$$ M_{a}=\bigl\{ u\in H^{1}\bigl(\mathbb{R}^{3} \bigr)\backslash \{0\}:\bigl\langle I'_{a}(u),u \bigr\rangle =0\bigr\} . $$

When \(a(x)=a_{\infty }=1\), \(\mathrm{{(NSE)}}\) becomes

$$-\Delta u+u= u^{3}. \mathrm{{(NSE)}_{1}} $$

The functional of \(\mathrm{{(NSE)}_{1}}\) is

$$ I_{\infty}(u)=I_{1}(u)=\frac{1}{2} \Vert u \Vert ^{2}- \frac{1}{4} \int _{\mathbb{R}^{3}}u^{4}\,dx, $$

and the Nehari manifold is

$$ M_{\infty}=M_{1}=\bigl\{ u\in H^{1}\bigl(\mathbb{R}^{3} \bigr)\backslash \{0\}:\bigl\langle I'_{1}(u),u \bigr\rangle =0\bigr\} . $$

Moreover, we define the least energy of \(\mathrm{{(NSE)}}\) and \(\mathrm{{(NSE)}_{1}}\) by \(m_{a}:=\inf_{M_{a}}I_{a}\) and \(m_{\infty}=m_{1}:= \inf_{M_{1}}I_{1}\), respectively. We recall some known results about \(\mathrm{{(NSE)}}\) and \(\mathrm{{(NSE)}_{1};}\) see [8].

Proposition 3.2

Equation \(\mathrm{{(NSE)}_{1}}\) has a positive ground state \(w\in H^{1}(\mathbb{R}^{3})\), radially symmetric about the origin, unique up to translations, decaying exponentially, together its derivatives, as \(|x|\rightarrow \infty \).

Proposition 3.3

Let (\(\mathrm{a}_{2}\)) hold. Equation \(\mathrm{{(NSE)}}\) has a positive ground state \(w_{a}\in H^{1}(\mathbb{R}^{3})\).

From the above two propositions, we know that

$$ m_{a}=I_{a}(w_{a})= \frac{1}{4} \Vert w_{a} \Vert ^{2}, \qquad m_{1}=I_{1}(w)=\frac{1}{4} \Vert w \Vert ^{2}=\frac{1}{4} \vert w \vert ^{4}_{4}. $$
(3.5)

Next we give a compactness lemma, which can be deduced by the argument in [8, Lemma 4.1] and Lemma 2.1.

Lemma 3.5

Let \(\{u_{n}\}\) be a bounded \((\mathrm{PS})_{d}\) sequence for I with \(d>0\), then replacing \(u_{n}\), if necessary, with a subsequence, there exist \(u\in H^{1}(\mathbb{R}^{3})\) with \(I'(u)=0\), a number \(k\in \mathbb{N}\cup \{0\}\), functions \(w_{1}, w_{2},\dots , w_{k}\), and k sequences of points \(\{y^{j}_{n}\}\subset \mathbb{R}^{3}\), \(1\leq j\leq k\), such that

  1. (i)

    \(|y^{j}_{n}|\rightarrow \infty \), \(|y^{j}_{n}-y^{i}_{n}|\rightarrow \infty \) as \(n\rightarrow \infty \) if \(i\neq j\);

  2. (ii)

    \(w_{j}\neq 0\), and \(I'_{\infty }(w_{j})=0\);

  3. (iii)

    \(\|u_{n}-u-\sum^{k}_{j=1}w_{j}(\cdot -y^{j}_{n})\|\rightarrow 0\) as \(n\rightarrow \infty \);

  4. (iv)

    \(I(u_{n})=I(u)+\sum^{k}_{j=1}I_{\infty }(w_{j})+o_{n}(1)\).

Moreover, we agree that in the case \(k=0\) the above holds without \(w_{j}\).

As in the proof of Lemma 3.1, any \((\mathrm{PS})_{d}\) sequence of I is bounded in \(H^{1}(\mathbb{R}^{3})\). Then from Lemma 3.5 we easily infer the following two propositions.

Proposition 3.4

Functional I satisfies the PS condition at any level \(d< m_{1}\).

Proposition 3.5

Let \(\{u_{n}\}\) be a \((\mathrm{PS})_{m_{1}}\) sequence. Then either \(\{u_{n}\}\) is relatively compact or the statement of Lemma 3.5 holds with \(k=1\), \(u=0\), and \(w_{1}=w\), where w is the ground state of \((\mathrm{NSE}) _{1}\).

4 Existence of a ground state

In this section, we suppose that (\(\mathrm{a}_{2}\)) holds.

Lemma 4.1

Let (1.5) or (1.6) hold. Then \(c< m_{\infty }\).

Proof

First we assume that (1.5) holds.

Let \(w_{a}\) be a ground state of (NSE). Then \(w_{a}\in M_{a}\) and \(I_{a}(w_{a})=m_{a}\). By (1.5) and (2.3), we have that

$$ \begin{aligned} \int _{\mathbb{R}^{3}} K(x)\phi _{w_{a}}w^{2}_{a} \,dx &\leq \bar{S}^{-2} {S}^{-4} \vert K \vert ^{2}_{2} \Vert w_{a} \Vert ^{4} \\ &=4m_{a}\bar{S}^{-2}{S}^{-4} \vert K \vert ^{2} _{2} \Vert w_{a} \Vert ^{2}< \Vert w_{a} \Vert ^{2}= \int _{\mathbb{R}^{3}} a(x)w^{4}_{a}\,dx. \end{aligned} $$

Then \(w_{a}\in \varTheta \), and so there exists \(t>0\) such that \(tw_{a}\in M\). Note that

$$ \begin{aligned} t^{2} &=\frac{ \Vert w_{a} \Vert ^{2}}{\int _{\mathbb{R}^{3}} a(x)w^{4}_{a}\,dx- \int _{\mathbb{R}^{3}} K(x)\phi _{w_{a}}w^{2}_{a}\,dx} \\ &\leq \frac{ \Vert w _{a} \Vert ^{2}}{ \Vert w_{a} \Vert ^{2}-\bar{S}^{-2}{S}^{-4} \vert K \vert ^{2}_{2} \Vert w_{a} \Vert ^{4} }=\frac{1}{1-\bar{S}^{-2}{S}^{-4} \vert K \vert ^{2}_{2}4m_{a} }< \frac{m_{1}}{m _{a}}. \end{aligned} $$

Hence,

$$ c\leq I(tw_{a})=\frac{1}{4}t^{2} \Vert w_{a} \Vert ^{2}=t^{2}m_{a}< m_{1}. $$

Next we assume (1.6) holds.

Let w be the ground state of \((\mathrm{NSE})_{1}\). By (1.6), we get \(w\in \varTheta \). Then there exists \(t>0\) such that \(tw\in M\). First we show that \(t<1\). Indeed, if \(t\geq 1\), using \(\|w\|^{2}=|w|^{4}_{4}\) we infer that

$$ \begin{aligned} 0 &=t^{2} \Vert w \Vert ^{2}+t^{4} \int _{\mathbb{R}^{3}} K(x)\phi _{w}w^{2}\,dx-t ^{4} \int _{\mathbb{R}^{3}} a(x) \vert w \vert ^{4}\,dx \\ &\leq t^{4} \int _{\mathbb{R} ^{3}} K(x)\phi _{w}w^{2} \,dx-t^{4} \int _{\mathbb{R}^{3}} \bigl(a(x)-1\bigr) \vert w \vert ^{4}\,dx. \end{aligned} $$

This contradicts (1.6). So \(t<1\). Then

$$ c\leq I(tw)=I(tw)-\frac{1}{4}\bigl\langle I'(tw),tw \bigr\rangle =\frac{1}{4}t ^{2} \Vert w \Vert ^{2}=t^{2}m_{1}< m_{1}, $$

completing the proof. □

Proof of Theorem 1.1

Assume that \(w_{n}\in U\) satisfies that \(\varPsi (w_{n})\rightarrow \inf_{U}\varPsi \). By the Ekeland variational principle, we may suppose that \(\varPsi '(w_{n})\rightarrow 0\). From Lemma 3.4 it follows that \(I'(u_{n})\rightarrow 0\) and \(I(u_{n}) \rightarrow c\), where \(u_{n}=m(w_{n})\in M\). Then by Lemma 4.1 and Proposition 3.4, there exists \(u\in H^{1}(\mathbb{R}^{3})\) such that \(u_{n}\rightarrow u\) in \(H^{1}(\mathbb{R}^{3})\). Then \(I(u)=c\) and \(I'(u)=0\). This ends the proof. □

5 Existence of a bound state

Throughout this section we suppose that (\(\mathrm{a}_{3}\)) holds. First we show that, under (\(\mathrm{a}_{3}\)), problem (SP)′ cannot be solved by minimization.

Lemma 5.1

\(c= m_{1}\) and c is not attained.

Proof

First we show that \(c\geq m_{1}\). For all \(u\in U\), by the standard argument, there exists \(t_{0}>0\) such that \(t_{0}u\in M_{1}\). By \(K\geq 0\) and \(a(x)\leq 1\), we have

$$ \begin{aligned} m_{1}\leq I_{1}(t_{0}u) \leq I(t_{0}u)\leq \max_{t>0}I(tu). \end{aligned} $$

Using (3.4), we get \(m_{1}\leq \inf_{u\in U}\max_{t>0}I(tu)=c\).

Below we shall show that \(c\leq m_{\infty }\). Indeed, set \(w_{n}(x)=w(x-z _{n})\), where w the positive solution centered at zero of \((\mathrm{NSE}) _{1}\), and \(|z_{n}|\rightarrow \infty \) as \(n\rightarrow \infty \).

In fact, since \(w_{n}\rightharpoonup 0\) in \(H^{1}(\mathbb{R}^{3})\), by Lemma 2.1(4) we have that

$$ \int _{\mathbb{R}^{3}} K(x)\phi _{w_{n}}w^{2}_{n} \,dx\rightarrow 0,\qquad \int _{\mathbb{R}^{3}} a(x)w^{4}_{n}\,dx \rightarrow \int _{\mathbb{R}^{3}} w^{4}\,dx, $$
(5.1)

so for n large enough, we have

$$ \int _{\mathbb{R}^{3}} K(x)\phi _{w_{n}}w^{2}_{n} \,dx< \int _{\mathbb{R} ^{3}} a(x)w^{4}_{n}\,dx, $$

and then

$$ w_{n}\in \varTheta . $$
(5.2)

Considering \(u_{n}=t_{n}w_{n}\in M\), we claim that

$$ I(u_{n})\rightarrow m_{1} \quad \text{as } n\rightarrow \infty . $$
(5.3)

Since \(t_{n}w_{n}\in M\), we get

$$ \frac{1}{t^{2}_{n}} \Vert w_{n} \Vert ^{2}+ \int _{\mathbb{R}^{3}} K(x)\phi _{w _{n}}w^{2}_{n} \,dx= \int _{\mathbb{R}^{3}} a(x)w^{4}_{n}\,dx. $$

By (5.1), we have

$$ \frac{1}{t^{2}_{n}} \Vert w \Vert ^{2}= \int _{\mathbb{R}^{3}} w^{4}\,dx+o_{n}(1). $$

Observe that

$$ \Vert w \Vert ^{2}= \int _{\mathbb{R}^{3}} w^{4}\,dx, $$

then we have \(t_{n}=1+o_{n}(1)\), and, using (5.1) again, infer

$$ I(u_{n})=I(t_{n}w_{n})\rightarrow \frac{1}{4} \Vert w \Vert ^{2}=m_{1}. $$

Then (5.3) follows and so \(c\leq m_{1}\). Hence, \(c=m_{1}\).

Finally, arguing by contradiction, we assume that there exists \(\bar{u}\in M\) such that \(I(\bar{u})=c=m_{1}\). By a standard argument, there exists \(\xi >0\) such that \(\xi \bar{u}\in M_{1}\), and it is easy to see that \(\xi \leq 1\). Then

$$ m_{1}\leq I_{1}(\xi \bar{u})=\frac{1}{4} \Vert \xi \bar{u} \Vert ^{2}\leq \frac{1}{4} \Vert \bar{u} \Vert ^{2}=I(\bar{u})-\frac{1}{4}\bigl\langle I'(\bar{u}), \bar{u}\bigr\rangle =c=m_{1}. $$

Therefore, \(\xi =1\), \(\bar{u}\in M_{1}\) and \(I_{1}(\bar{u})=I(\bar{u})=m _{1}\). Then

$$ \frac{1}{2} \Vert \bar{u} \Vert ^{2}- \frac{1}{4} \int _{\mathbb{R}^{3}} \vert \bar{u} \vert ^{4}\,dx= \frac{1}{2} \Vert \bar{u} \Vert ^{2}+ \frac{1}{4} \int _{\mathbb{R}^{3}} K(x) \phi _{\bar{u}}{\bar{u}}^{2} \,dx-\frac{1}{4} \int _{\mathbb{R}^{3}} a(x) \vert \bar{u} \vert ^{4} \,dx. $$

Since \(K\geq 0\) and \(a(x)\leq 1\), we get

$$ \int _{\mathbb{R}^{3}} K(x)\phi _{\bar{u}}{\bar{u}}^{2} \,dx=0. $$
(5.4)

Hence, by the uniqueness of the family realizing \(m_{1}\), we have

$$ \bar{u}(\cdot )=w_{z}:=w(\cdot -z)>0, $$

for some \(z\in \mathbb{R}^{3}\). Therefore,

$$ \int _{\mathbb{R}^{3}} K(x)\phi _{\bar{u}}{\bar{u}}^{2} \,dx= \int _{\mathbb{R}^{3}} K(x)\phi _{w_{z}}{w}^{2}_{z} \,dx>0, $$

which contradicts (5.4). □

By the previous lemma, we can only hope to find critical points of I at a level higher than \(m_{1}\). Similar to [8, Lemma 6.2], we have

Lemma 5.2

Functional I satisfies the \((\mathrm{PS})_{d}\) condition for all \(d\in (m _{1}, 2m_{1})\).

Below we shall use the notion of a barycenter to build a suitable min–max level which belongs to \((m_{1}, 2m_{1})\). Firstly we recall the definition of the barycenter of a function \(u\in H^{1}(\mathbb{R}^{3}) \backslash \{0\}\) given in [7]. Setting

$$\begin{aligned}& \mu (u) (x)=\frac{1}{ \vert B_{1}(0) \vert } \int _{B_{1}(x)} \bigl\vert u(y) \bigr\vert dy,\quad \mu (u) \in L^{\infty }\bigl(\mathbb{R}^{3}\bigr)\text{ and is continuous}, \\& \hat{u}(x)= \biggl[\mu (u) (x)-\frac{1}{2}\max \mu (u) (x) \biggr]^{+}, \quad \hat{u}\in C_{0}\bigl( \mathbb{R}^{3}\bigr), \end{aligned}$$

we define the barycenter \(\beta : H^{1}(\mathbb{R}^{3})\backslash \{0 \}\rightarrow \mathbb{R}^{3}\) by

$$ \beta (u)=\frac{1}{ \vert \hat{u} \vert _{1}} \int _{\mathbb{R}^{3}}x\hat{u}(x)\,dx \in \mathbb{R}^{3}. $$

Since û has a compact support, β is well defined. Moreover, the following properties hold:

Lemma 5.3

  1. (1)

    β is continuous in \(H^{1}(\mathbb{R}^{3})\backslash \{0\}\).

  2. (2)

    If u is a radial function, \(\beta (u)=0\).

  3. (3)

    For all \(t\neq 0\) and for all \(u\in H^{1}(\mathbb{R}^{3})\backslash \{0\}\), \(\beta (tu)=\beta (u)\).

  4. (4)

    Given \(z\in \mathbb{R}^{3}\) and setting \(u_{z}(x)=u(x-z)\), \(\beta (u_{z})=\beta (u)+z\).

Let us define

$$ b_{0}:=\inf \bigl\{ I(u):u\in M,\beta (u)=0\bigr\} . $$

By Lemmas 3.3 and 5.3(3), it is easy to see that

$$ b_{0}:=\inf \bigl\{ \varPsi (v):v\in U, \beta (v)=0\bigr\} . $$
(5.5)

Lemma 5.4

\(b_{0}>c\).

Proof

Clearly, \(b_{0}\geq c\). Assume that \(b_{0}=c\). By (5.5), there exists \(v_{n}\in U\) such that \(\beta (v_{n})=0\), and \(\varPsi (v_{n})\rightarrow b_{0}=c=m_{\infty }\). By Lemma 3.4(2), \(\varPsi (v_{n})\rightarrow \inf_{U}\varPsi \). By the Ekeland variational principle, we may assume that \(\varPsi '(v_{n})\rightarrow 0\). Set \(u_{n}=m(v_{n})=t_{v_{n}}v_{n}\). Then \(I(u_{n})\rightarrow c=m_{ \infty }\), \(I'(u_{n})\rightarrow 0\) and \(\beta (u_{n})=0\) by Lemma 5.3(3). Then Proposition 3.5 and Lemma 5.1 yield

$$ u_{n}(x)=w(x-z_{n})+o_{n}(1), $$

where \(|z_{n}|\rightarrow +\infty \) and w is the positive solution of \((\mathrm{NSE})_{1}\). Then

$$ \beta \bigl(u_{n}(x+z_{n})\bigr)=\beta (u_{n})-z_{n}=-z_{n}. $$

However,

$$ \beta \bigl(u_{n}(x+z_{n})\bigr)=\beta \bigl(w(x)+o_{n}(1)\bigr)=\beta \bigl(w(x)\bigr)=0. $$

This is a contradiction since \(|z_{n}|\rightarrow +\infty \). □

Now let us define the operator \(\varGamma :\mathbb{R}^{3}\rightarrow M\) as \(\varGamma [z](x)=t_{z}w(x-z)\), where w is the positive solution of \((\mathrm{NSE}) _{\infty }\) and \(t_{z}\) is chosen such that \(\varGamma [z]\in M\). As (5.2), \(w(x-z)\in \varTheta \) for any \(z\in \mathbb{R}^{3}\). Then Γ is well defined. From Lemma 5.3 it follows that

$$ \beta \bigl(\varGamma [z]\bigr)=\beta \bigl(t_{z}w(x-z) \bigr)=\beta \bigl(w(x-z)\bigr)=z. $$
(5.6)

Lemma 5.5

Assume that (1.7) holds. Then \(I(\varGamma [z])<2m_{1}\).

Proof

Since \(\varGamma [z]\in M\), we have

$$ I\bigl(\varGamma [z]\bigr)=\frac{1}{4} \bigl\Vert \varGamma [z] \bigr\Vert ^{2}=\frac{1}{4}t^{2}_{z} \Vert w _{z} \Vert ^{2}=\frac{1}{4}t^{2}_{z} \Vert w \Vert ^{2}=t^{2}_{z}m_{1}. $$

It suffices to show \(t^{2}_{z}<2\). Note that

$$ t^{2}_{z} \Vert w_{z} \Vert ^{2}+t^{4}_{z} \int _{\mathbb{R}^{3}} K(x)\phi _{w_{z}}w ^{2}_{z} \,dx=t^{4}_{z} \int _{\mathbb{R}^{3}} a(x)w^{4}_{z}\,dx. $$

Then

$$ \begin{aligned} t^{2}_{z} &= \frac{ \Vert w_{z} \Vert ^{2}}{\int _{\mathbb{R}^{3}} a(x)w^{4}_{z}\,dx- \int _{\mathbb{R}^{3}} K(x)\phi _{w_{z}}w^{2}_{z}\,dx} \\ &< \frac{ \Vert w_{z} \Vert ^{2}}{\inf_{x\in \mathbb{R}^{3}} a(x) \Vert w_{z} \Vert ^{2}-\bar{S}^{-2}{S} ^{-4} \vert K \vert ^{2}_{2} \Vert w_{z} \Vert ^{4}} \\ &=\frac{1}{\inf_{x\in \mathbb{R}^{3}} a(x)-\bar{S}^{-2}{S}^{-4} \vert K \vert ^{2}_{2}4m_{1}}< 2. \end{aligned} $$

This completes the proof. □

Now we are ready to prove Theorem 1.2.

Proof of Theorem 1.2

Arguing as when deriving (5.3), we obtain \(\lim_{|z|\rightarrow +\infty }I(\varGamma [z])=m_{1}\). Combining with Lemmas 5.4 and 5.1, there exists \(\rho >0\) such that

$$ \max_{|z|=\rho }I\bigl(\varGamma [z] \bigr)< b_{0}. $$
(5.7)

Set

$$ Q=\varGamma \bigl(\bar{B}_{\rho }(0)\bigr),\qquad S=\bigl\{ u\in M:\beta (u)=0 \bigr\} . $$

We claim that S and ∂Q link, that is,

$$ \begin{aligned} &\mathrm{(i)} \quad \partial Q\cap S=\varnothing ; \\ &\mathrm{(ii)} \quad h(Q)\cap S\neq \varnothing ,\quad \forall h\in \mathcal{H}=\bigl\{ h\in C(Q,M):h|_{ \partial Q}=\mathit{id}\bigr\} . \end{aligned} $$
(5.8)

Firstly, we show (5.8)(i). Indeed, if \(u\in \partial Q\), then \(u=\varGamma [{z}]\), \(|{z}|=\rho \). By (5.6), we get \(\beta (u)= \beta (\varGamma [{z}])={z}\), and so \(u\notin S\). Next we show (5.8)(ii). Consider \(h\in \mathcal{H}\) and define

$$ T:\bar{B}_{\rho }(0)\rightarrow \mathbb{R}^{3}, \qquad T(z)=\beta \circ h\circ \varGamma [z]. $$

This T is a continuous function. Moreover, for all \(|z|=\rho \), \(\varGamma [{z}]\in \partial Q\), we have \(h\circ \varGamma [z]=\varGamma [z]\). Then \(T(z)=z\). Brouwer fixed point theorem implies that there exists \(z\in B_{\rho }(0)\) such that \(T(z)=0\), and then \(h(\varGamma [z])\in S\). Thus \(h(Q)\cap S\neq \varnothing \).

By (5.7), we get \(b_{0}=\inf_{S}I>\max_{\partial Q}I\). Define

$$ d:=\inf_{h\in \mathcal{H}}\max_{u\in Q}I\bigl(h(u) \bigr). $$

By (5.8)(ii), \(d\geq b_{0}>c=m_{1}\). Moreover, taking \(h=\mathit{id}\) and using Lemma 5.5, we have that \(d<2m_{1}\). By Lemma 5.2, the PS condition holds in \((m_{1},2m_{1})\). Then the linking theorem [18, Theorem 8.4] implies that d is a critical value of I. This ends the proof. □