1 Introduction

In this paper, we studied the following fractional Kirchhoff-type problem:

$$ \biggl(a+b \int_{\mathbb{R}^{N}} \bigl\vert (-\triangle)^{\frac{\alpha }{2}}u \bigr\vert ^{2}\,\mathrm{d}x \biggr) (-\triangle)^{\alpha }u+V(x)u=f(x,u), \quad x\in{\mathbb{R}}^{N}, $$
(1.1)

where \(\alpha \in (0,1]\), a, b are positive constants. The fractional Laplacian operator \((-\triangle)^{\alpha}\) is defined as:

$$(-\triangle)^{\alpha}u(x)=\frac{1}{C(\alpha)} \int_{\mathbb {R}^{N}}\frac{u(x)-u(y)}{ \vert x-y \vert ^{N+2\alpha }}\,\mathrm{d}x, \quad x\in \mathbb{R}^{N}, $$

which can be viewed as the infinitesimal generators of a Lévy stable diffusion processes [1]. In order to reduce our statements, we first assume that the potential V and nonlinearity f satisfy the following basic assumptions:

(V):

\(V \in \mathcal{C}(\mathbb{R}^{N})\cap L^{\infty}(\mathbb {R}^{N})\) and \(\inf_{\mathbb{R}^{N}}V(x)>0\);

(F1):

\(f \in \mathcal{C}(\mathbb{R}^{N}\times\mathbb {R},\mathbb{R})\) and there exist constants \(C>0\) and \(2< p<2^{\ast }_{\alpha}:=\frac{2N}{N-2\alpha}\) such that

$$\begin{aligned} \bigl\vert f(x,t) \bigr\vert \leq C\bigl(1+ \vert t \vert ^{p-1}\bigr),\quad\forall(x,t) \in \mathbb{R}^{N}\times\mathbb {R}; \end{aligned}$$
(F2):

\(f(x,t)=o( \vert t \vert )\) as \(t\rightarrow0\) uniformly in \(x\in\mathbb{R}^{N}\);

(F3):

\(\lim_{ \vert t \vert \rightarrow\infty }\frac{\int_{0}^{t}f(x,s)\,\mathrm{d}s}{ \vert t \vert ^{4+N-4\alpha}}=\infty\) uniformly in \(x \in \mathbb{R}^{N}\);

(F4):

there exists a constant \(\theta_{0} \in (0,1)\) such that for any \(x \in \mathbb{R}^{N}\), \(t>0\) and \(\tau\neq0\)

$$\begin{aligned} \biggl[\frac{f(x,\tau)}{\tau^{3}}-\frac{f(x,t\tau)}{(t\tau )^{3}} \biggr] \operatorname{sign}(1-t)+\theta_{0}V(x)\frac{ \vert 1-t^{2} \vert }{(t\tau)^{2}}\geq0. \end{aligned}$$

In the recent years, fractional and nonlocal operators arise in the description of various phenomena in the pure mathematical research and concrete real-world applications, such as fractional quantum mechanics [2, 3], physics and chemistry [4], obstacle problems [5], optimization and finance [6], conformal geometry and minimal surfaces [7] and so on.

If \(\alpha=1\), Problem (1.1) formally reduces to the well-known Kirchhoff Dirichlet equation:

$$ -\biggl(a+b \int_{\Omega} \vert \nabla u \vert ^{2}\,\mathrm{d}x \biggr)\triangle u+V(x)u=f(x,u),\quad x\in\mathbb{R}^{N}, $$
(1.2)

which is related to the stationary analog of the equations

$$ u_{tt}- \biggl(a+b \int_{\Omega} \vert \nabla u \vert ^{2}\,\mathrm{d}x \biggr)\triangle u=f(x,u). $$
(1.3)

Equations of this type were first proposed by Kirchhoff [8] to describe the transversal oscillations of a stretched string. For more details in physical aspects, we refer the reader to [7, 9, 10]. Particularly, after Lions [11] introduced an abstract functional analysis framework to (1.2), the Kirchhoff-type problems received increasingly more attention by various authors. There are many existence and multiplicity results for (1.2), for example, Zhang and Zhang [12] proved the existence of Nehari-type ground state solutions for asymptotically periodic Kirchhoff-type problem when f satisfies (F1), (F2) and the following conditions:

(F3′):

\(\lim_{ \vert t \vert \rightarrow\infty }\frac{\int_{0}^{t}f(x,s)\,\mathrm{d}s}{ \vert t \vert ^{4}}=\infty\) uniformly in \(x\in\Omega\);

(F4′):

\(\frac{f(x,t)}{ \vert t \vert ^{3}}\) is nondecreasing in t on \(\mathbb{R}\setminus\{0\}\) for every \(x \in \mathbb{R}^{N}\).

For more recent results concerning Kirchhoff-type problems, see e.g. [1322].

When \(a=1\) and \(b=0\), then (1.1) reduces to the following fractional Schrödinger problem:

$$ (-\triangle)^{\alpha}u+V(x)u=f(x,u), \quad x\in \mathbb{R}^{N}. $$
(1.4)

Since \((-\triangle)^{\alpha}\) is a nonlocal operator, the usual analysis tools for elliptic PDEs are invalid for (1.4). This causes some mathematical difficulties which make the study of such a problem particularly interesting. After Caffarelli and Silvestrein transformed the nonlocal problem into a local problem by the extension theorem in [23], there have been a large number of works focused on the study of fractional Schrödinger equations. Recently, Secchi [24] obtained the existence of positive solutions by using the Nehari manifold method. Chang [25] proved the existence of a positive ground state solution of (1.4) when \(f(x,t)\) is asymptotically linear with respect to t at infinity. Zhang, Zhang and Mi [26] established the existence of solutions for (1.4) in periodic case and asymptotically periodic case via variational methods. We refer the reader to [2732] and the references therein.

Although the fractional Schrödinger equations have been widely studied, to the best of our knowledge, there are few papers concerning on the fractional Kirchhoff-type problems like (1.1) in the literature. Recently, under decay assumptions on V, Liu, Marco and Zhang [33] considered (1.1) where \(N=2\) with \(\alpha\in (\frac{1}{2},1)\) or \(N=3\) with \(\alpha\in(\frac{3}{4},1)\) and \(f(x,t)=f(t)\) satisfies:

(H1):

\(f\in\mathcal{C}^{1}(\mathbb{R}^{+},\mathbb{R})\) and \(\lim_{t\rightarrow0}\frac{f(t)}{t}=0\);

(H2):

there are \(D>0\) and \(2< q<2^{*}_{\alpha}\) such that \(f(t)\geq t^{t^{2^{*}_{\alpha}}-1}+Dt^{q-1}\) for any \(t\geq0\).

We point out that they obtained the existence of ground state solutions for (1.1) when D large enough in (H2). Note that \(2^{*}_{\alpha }>4\) when \(N=2\) with \(\alpha\in(\frac{1}{2},1)\) or \(N=3\) with \(\alpha\in(\frac{3}{4},1)\), which means f satisfies super-cubic condition (F3′). In fact, under (F1) and (F3′), it is easy to verify the Mountain Pass geometry for energy functional. Different from their work, we assume that f is non-autonomous and satisfies (F3) which implies (F3′). Evidently, (F1) and (F3) suggest that \(N\in (2\alpha,4\alpha)\) with \(\alpha\in(0,1)\) and that is what we are concerned about in this paper. Our results can be regarded as the complementary work of [33]. We also cite [3441] for related results.

In this paper, we are concerned with the existence of ground state solutions for the asymptotically periodic fractional Kirchhoff-type problems (1.1) involving asymptotically cubic or super-cubic nonlinearities. To this end, we must overcome three main difficulties: (I) when f is asymptotically cubic (i.e. \(\lim_{ \vert t \vert \rightarrow\infty}\frac{ \vert f(x,t) \vert }{ \vert t \vert ^{3}}=V_{\infty}\geq\ (\not\equiv )\ 0\)), there is no Mountain-Pass structure for (1.1) and the standard variational methods cannot be used on Nehari manifold; (II) when \(V (x)\) and \(f(x,u)\) are asymptotically periodic in x, many effective methods for periodic problems are invalid for asymptotically periodic ones; (III) when f is not differentiable, Nehari manifold may not be a \(\mathcal{C}^{1}\) manifold, so it is difficult to prove the minimizer of the variational functional over Nehari manifold is a critical point. To overcome these difficulties, we will introduce some new methods and analytical techniques in this paper.

In order to precisely state our result we denote by \(\mathcal{H}\) the class of functions \(h\in\mathcal{C}(\mathbb{R}^{N},\mathbb{R})\cap L^{\infty}(\mathbb{R}^{N},\mathbb{R})\) such that, for every \(\epsilon>0\), the set \(\{x\in\mathbb{R}^{N}: \vert h(x) \vert \geq\epsilon\}\) has finite Lebesgue measure. Moreover, for the potential V and the nonlinear term f, we suppose that:

(V0):

\(V \in\mathcal{C}(\mathbb{R}^{N}, (0,\infty))\) and \(V(x)\) is 1-periodic in x;

(F0):

\(f(x,t)\) is 1-periodic in x;

(V0′):

\(V(x)=V_{0}(x)+V_{1}(x)\), \(V_{0},V_{1} \in\mathcal {C}(\mathbb{R}^{N}, \mathbb{R}^{N})\), and \(V_{0}(x)\) is 1-periodic in x, \(V_{1}(x)\leq0\) for \(x \in\mathbb{R}^{N}\), and \(V_{1}\in\mathcal{H}\);

(F0′):

\(f(x,t) = f_{0}(x,t) + f_{1}(x,t)\), \(f_{0}\in\mathcal {C}(\mathbb{R}^{N}\times\mathbb{R}^{N}, \mathbb{R})\), \(f_{0}(x,t)\) is 1-periodic in x, and for any \(x \in\mathbb{R}^{N}\), \(t>0\) and \(\tau\neq0\),

$$\begin{aligned} \biggl[\frac{f_{0}(x,\tau)}{\tau^{3}}-\frac{f_{0}(x,t\tau)}{(t\tau )^{3}} \biggr] \operatorname{sign}(1-t)+ V_{0}(x)\frac{ \vert 1-t^{2} \vert }{(t\tau)^{2}}\geq0; \end{aligned}$$
(1.5)

\(f_{1}\in\mathcal{C}(\mathbb{R}^{N}\times\mathbb{R}, \mathbb{R})\), satisfies

$$\begin{aligned} \bigl\vert f_{1}(x,t) \bigr\vert \leq h(x) \bigl( \vert t \vert + \vert t \vert ^{q-1}\bigr), \quad f_{1}(x,t)t\geq0, \end{aligned}$$
(1.6)

where \(F_{1}(x,t)=\int_{0}^{t}f_{1}(x,s)\,\mathrm{d}s\), \(q\in (2,2^{\ast}_{\alpha})\) and \(h\in\mathcal{H}\).

Inspired by the previously mentioned work, especially [21, 42, 43], we seek definite answers to overcome the above three difficulties. Firstly, we use a new trick to show the following set:

$$\begin{aligned} \mathcal{E}= \biggl\{ u \in E : b \bigl\Vert (-\triangle)^{\frac {\alpha}{2}}u \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}} \bigl[V(x)u^{2} -f(x,u)u \bigr] \,\mathrm{d}x< 0 \biggr\} , \end{aligned}$$

is not empty (see Lemma 2.4), and construct a new minimax characterization (see Lemma 2.6) under (F3). Secondly, for the asymptotically periodic case, we adopt a technique introducing in [21] by combining the quantitative deformation lemma and degree theory, to overcome the difficulties caused by the dropping of periodicity of \(V(x)\) and \(f(x,u)\) in x (see Section 4). Thirdly, because the argument based on Nehari manifold approach (see Szulkin and Weth [44]) becomes invalid under condition (F4) instead of (F4′), we will use the non-Nehari manifold approach developed in [42, 43]. It relies on finding a minimizing Cerami sequence for variational functional related to (1.1) outside the Nehari manifold by using the diagonal method (see Lemma 2.8). Note that (F3) implies (F3′), which covers the asymptotically cubic and super-cubic nonlinearities due to \(N\in (2\alpha,4\alpha)\).

Now, we state the main results of this paper. In the periodic case, we establish the following theorem.

Theorem 1.1

Assume that V and f satisfy (V0) and (F0)-(F4). Then Problem (1.1) has a ground state solution \(u_{0} \in E\) such that \(\Phi(u_{0})=\inf_{\mathcal{N}}\Phi>0\). Moreover,

$$b \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u_{0} \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}} \bigl[V(x)u_{0}^{2}-f(x,u_{0})u_{0} \bigr]\,\mathrm{d}x< 0. $$

In the asymptotically periodic case, we establish the following theorem.

Theorem 1.2

Assume that V and f satisfy (V0′), (F0′) and (F1)-(F4). Then Problem (1.1) has a ground state solution \(u_{0} \in E\) such that \(\Phi(u_{0})=\inf_{\mathcal{N}}\Phi>0\). Moreover,

$$b \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u_{0} \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}} \bigl[V(x)u_{0}^{2}-f(x,u_{0})u_{0} \bigr]\,\mathrm{d}x< 0. $$

Remark 1.3

Since the term \(\Vert (-\triangle)^{\frac{\alpha}{2}}u \Vert ^{4}_{2}\) is homogeneous of degree 4, the greatest part of the literature focuses on the study of (1.1) with f satisfying the super-cubic condition (F3′). However, there are few papers consider f satisfies asymptotically cubic. In order to treat asymptotically cubic or super-cubic nonlinearities in a unified way, we use a weaker condition (F3) instead of (F3′) where \(N\in(2\alpha,4\alpha)\) with \(\alpha\in(0,1)\). Our results strongly improve the previous results on the existence of ground state solutions for (1.1), which are new even for \(\alpha=1\). Furthermore, we reduce the usual Nehari-type monotonic condition to a weaker condition (F4). In fact, there are many functions satisfying (F1)-(F4), but not satisfying (F3′) and (F4′), and some typical examples are introduced in [21].

Throughout this paper, we denote the norm of \(L^{s}(\mathbb{R}^{N})\) by \(\Vert u \Vert _{s}\) for \(s\geq2\), \(B_{r}(x)=\{y \in \mathbb{R}^{N} : \vert y-x \vert < r\}\), and C are various positive constants.

2 Preliminaries

First, we give some notations. A complete introduction to fractional Sobolev spaces can be found in [45]; we offer in the succeeding discussion a short review. We define the homogeneous fractional Sobolev space \(\mathcal{D}^{\alpha,2}(\mathbb{R}^{N})\) as follows:

$$\mathcal{D}^{\alpha,2}\bigl(\mathbb{R}^{N}\bigr) = \biggl\{ u \in L^{2^{\ast }_{\alpha}}\bigl(\mathbb{R}^{N}\bigr): \frac{ \vert u(x)-u(y) \vert }{ \vert x-y \vert ^{\frac{N}{2}+\alpha}} \in L^{2}\bigl(\mathbb{R}^{N}\times\mathbb {R}^{N} \bigr) \biggr\} , $$

which is the completion of \(\mathcal{C}^{\infty}_{0}(\mathbb {R}^{N})\) under the norm

$$\Vert u \Vert _{\mathcal{D}^{\alpha,2}(\mathbb {R}^{N})} = \biggl( \int_{\mathbb{R}^{N}} \bigl\vert (-\triangle)^{\frac {\alpha}{2}}u \bigr\vert ^{2}\,\mathrm{d}x \biggr)^{1/2} = \biggl( \int_{\mathbb{R}^{N}} \int_{\mathbb{R}^{N}}\frac{ \vert u(x)-u(y) \vert ^{2}}{ \vert x-y \vert ^{N+2\alpha }}\,\mathrm{d}x\,\mathrm{d}y \biggr)^{1/2}. $$

Moreover, the embedding \(\mathcal{D}^{\alpha,2}(\mathbb {R}^{N})\hookrightarrow L^{2^{\ast}_{\alpha}}(\mathbb{R}^{N})\) is continuous and for any \(\alpha \in (0,1)\), there exists a best constant \(S_{\alpha}\) such that

$$S_{\alpha} = \inf_{u\in\mathcal{D}^{\alpha,2}(\mathbb {R}^{N})}\frac{\int_{\mathbb{R}^{N}} \vert (-\triangle)^{\frac {\alpha}{2}}u \vert ^{2}\,\mathrm{d}x}{ (\int_{\mathbb{R}^{N}} \vert u^{2_{\alpha}^{\ast }} \vert \,\mathrm{d}x )^{\frac{2}{2_{\alpha}^{\ast}}}}. $$

The fractional Sobolev space \(H^{\alpha}(\mathbb{R}^{N})\) can be described by

$$H^{\alpha}\bigl(\mathbb{R}^{N}\bigr) = \biggl\{ u \in L^{2}\bigl(\mathbb{R}^{N}\bigr): \frac{ \vert u(x)-u(y) \vert }{ \vert x-y \vert ^{\frac{N}{2}+\alpha}} \in L^{2}\bigl(\mathbb{R}^{N}\times\mathbb {R}^{N} \bigr) \biggr\} , $$

endowed with the natural norm

$$\Vert u \Vert _{H^{\alpha}(\mathbb{R}^{N})} = \biggl( \int _{\mathbb{R}^{N}} \vert u \vert ^{2}\,\mathrm{d}x + \int_{\mathbb{R}^{N}} \int_{\mathbb{R}^{N}}\frac{ \vert u(x)-u(y) \vert ^{2}}{ \vert x-y \vert ^{N+2\alpha }}\,\mathrm{d}x\,\mathrm{d}y \biggr)^{1/2}. $$

It is well known that \(H^{\alpha}(\mathbb{R}^{N})\) is continuously embedded into \(L^{q}(\mathbb{R}^{N})\), and compactly embedded into \(L^{q}_{\mathrm{loc}}(\mathbb{R}^{N})\) for \(2\leq q \leq2_{\alpha }^{\ast} :=\frac{2N}{N-2\alpha}\).

Under assumption (V), we see that

$$E= \biggl\{ u\in H^{\alpha}\bigl(\mathbb{R}^{N}\bigr): \int_{\mathbb{R}^{N}} \bigl(a \bigl\vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\vert ^{2}+V(x)u^{2} \bigr)\,\mathrm{d}x< +\infty \biggr\} $$

is a Hilbert space equipped with the norm

$$\Vert u \Vert = \biggl( \int_{\mathbb{R}^{N}}\bigl(a \bigl\vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\vert ^{2}+V(x)u^{2} \bigr)\,\mathrm{d}x \biggr)^{1/2} . $$

Let

$$ \begin{aligned}[b]\Phi(u)&=\frac{1}{2} \int_{\mathbb{R}^{N}} \bigl(a \bigl\vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\vert ^{2}+V(x)u^{2} \bigr)\,\mathrm{d}x\\ &\quad {} + \frac{b}{4} \biggl( \int_{\mathbb{R}^{N}} \bigl\vert (-\triangle )^{\frac{\alpha}{2}}u \bigr\vert ^{2}\,\mathrm{d}x \biggr)^{2} - \int_{\mathbb{R}^{N}}F(x,u)\,\mathrm{d}x,\quad\forall u\in E. \end{aligned} $$
(2.1)

From (F1) and (F2), it is easy to see that \(\Phi \in \mathcal {C}^{1}(E,\mathbb{R})\) as a functional, and that

$$\begin{aligned} \bigl\langle \Phi'(u),v \bigr\rangle =& \int_{\mathbb{R}^{N}} \bigl(a(-\triangle)^{\frac{\alpha }{2}}u(- \triangle)^{\frac{\alpha}{2}}v +V(x)uv \bigr)\,\mathrm{d}x \\ &{} +b \int_{\mathbb{R}^{N}} \bigl\vert (-\triangle)^{\frac{\alpha }{2}}u \bigr\vert ^{2}\,\mathrm{d}x \int_{\mathbb{R}^{N}}(-\triangle)^{\frac{\alpha}{2}}u(-\triangle )^{\frac{\alpha}{2}}v\,\mathrm{d}x \\ &{}- \int_{\mathbb{R}^{N}}f(x,u)v\,\mathrm{d}x,\quad\forall u,v \in E. \end{aligned}$$
(2.2)

Clearly, any critical point of Φ is a weak solution of (1.1). Set

$$\begin{aligned} \mathcal{N} := \bigl\{ u \in E : \bigl\langle \Phi'(u),u \bigr\rangle =0, u\neq0\bigr\} . \end{aligned}$$
(2.3)

Lemma 2.1

Assume that (V), (F1), (F2) and (F4) hold. Then

$$\begin{aligned} \Phi(u) \geq & \Phi(tu)+\frac{1-t^{4}}{4}\bigl\langle \Phi^{'}(u),u \bigr\rangle +\frac{(1-\theta_{0})(1-t^{2})^{2}}{4} \Vert u \Vert ^{2}, \quad\forall u \in E, t\geq0. \end{aligned}$$
(2.4)

Proof

For any \(x \in \mathbb{R}^{N}\), \(t\geq0\), \(\tau \in \mathbb{R}\setminus\{0\}\), (F4) yields

$$ \begin{aligned}[b] &\frac{1-t^{4}}{4}\tau f(x,\tau)+F(x,t\tau)-F(x,\tau)+ \frac {\theta_{0}V(x)}{4}\bigl(1-t^{2}\bigr)^{2}\tau^{2} \\ &\quad = \int^{1}_{t} \biggl[ \frac{f(x,\tau)}{\tau^{3}}- \frac{f(x,\xi \tau)}{(\xi\tau)^{3}} +\theta_{0}V(x)\frac{1-\xi^{2}}{(\xi\tau)^{2}} \biggr] \xi^{3}\tau ^{4}\,\mathrm{d}\xi\geq0. \end{aligned} $$
(2.5)

By (2.1), (2.2) and (2.5), we have

$$\begin{aligned} \Phi(u)-\Phi(tu) =& \frac{1-t^{2}}{2} \Vert u \Vert ^{2}+\frac{1-t^{4}}{4}b \bigl\Vert (-\triangle)^{\frac{ \alpha}{2}} \bigr\Vert ^{4}_{2}+ \int_{\mathbb {R}^{N}}\bigl[F(x,tu)-F(x,u)\bigr]\,\mathrm{d}x \\ =& \frac{1-t^{4}}{4}\bigl\langle \Phi^{'}(u),u \bigr\rangle + \frac {(1-t^{2})^{2}}{2} \Vert u \Vert ^{2} \\ &{}+ \int_{\mathbb{R}^{N}} \biggl[\frac {1-t^{4}}{4}f(x,u)u+F(x,tu)-F(x,u) \biggr]\,\mathrm{d}x \\ \geq&\frac{1-t^{4}}{4}\bigl\langle \Phi^{'}(u),u \bigr\rangle + \frac{(1-\theta _{0})(1-t^{2})^{2}}{4} \Vert u \Vert ^{2} \\ &{}+ \int_{\mathbb{R}^{N}} \biggl[\frac {1-t^{4}}{4}f(x,u)u+F(x,tu)-F(x,u)+ \frac{\theta _{0}V(x)}{4}\bigl(1-t^{2}\bigr)^{2}u^{2} \biggr]\,\mathrm{d}x \\ \geq&\frac{1-t^{4}}{4}\bigl\langle \Phi^{'}(u),u \bigr\rangle + \frac{(1-\theta _{0})(1-t^{2})^{2}}{4} \Vert u \Vert ^{2}. \end{aligned}$$

This shows that (2.4) holds. □

Corollary 2.2

Assume that (V), (F1), (F2) and (F4) hold. Then, for an \(u\in\mathcal{N}\),

$$\begin{aligned} \Phi(u) \geq & \Phi(tu)+\frac{(1-\theta_{0})(1-t^{2})^{2}}{4} \Vert u \Vert ^{2}, \quad\forall t\geq0. \end{aligned}$$
(2.6)

Corollary 2.3

Assume that (V), (F1), (F2) and (F4) hold. Then, for any \(u\in\mathcal{N}\),

$$\begin{aligned} \Phi(u)=\max_{t\geq0}\Phi(tu). \end{aligned}$$
(2.7)

Under (F3), to show \(\mathcal{N}\neq\emptyset\) in our situation, we have to overcome the competing effect of \(\int_{\mathbb{R}^{N}} \vert (-\triangle)^{\frac{\alpha}{2}}u \vert ^{2}\,\mathrm{d}x\). To this end, we define a set \(\mathcal{E}\) as follows:

$$\begin{aligned} \mathcal{E}= \biggl\{ u \in E : b \bigl\Vert (- \triangle)^{\frac {\alpha}{2}}u \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}} \bigl[V(x)u^{2} -f(x,u)u \bigr] \,\mathrm{d}x< 0 \biggr\} . \end{aligned}$$
(2.8)

Lemma 2.4

Assume that (V) and (F1)-(F4) hold. Then \(\mathcal{E}\neq\emptyset\). Moreover, \(\mathcal{N} \subset \mathcal{E}\).

Proof

For any fixed \(u \in E\) with \(u\neq0\), set \(u_{t}(x)=tu(t^{-1} x)\) for \(t>0\). By (V), one has

$$ \begin{aligned}[b] &b \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u_{t} \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}} \bigl[V(x)u_{t}^{2}-f(x,u_{t})u_{t} \bigr]\,\mathrm{d}x \\ &\quad = t^{4+2N-4\alpha}b \bigl\Vert (-\triangle)^{\frac{\alpha }{2}}u \bigr\Vert ^{4}_{2} +t^{2+N} \int_{\mathbb{R}^{N}}V(tx)u^{2}\,\mathrm{d}x -t^{N} \int_{\mathbb{R}^{N}}f(tx,tu)tu\,\mathrm{d}x \\ &\quad \leq t^{2+N} \biggl[t^{2+N-4\alpha}b \bigl\Vert (- \triangle)^{\frac {\alpha}{2}}u \bigr\Vert ^{4}_{2} + \Vert V \Vert _{\infty} \Vert u \Vert ^{2}_{2} - \int_{\mathbb{R}^{N}}\frac{f(tx,tu)tu}{t^{2}}\,\mathrm{d}x \biggr] \\ &\quad =t^{2+N} \biggl\{ t^{2+N-4\alpha} \biggl[b \bigl\Vert (-\triangle )^{\frac{\alpha}{2}}u \bigr\Vert ^{4}_{2} - \int_{\mathbb{R}^{N}}\frac{f(tx,tu)tu}{t^{4+N-4\alpha}}\,\mathrm{d}x \biggr] + \Vert V \Vert _{\infty} \Vert u \Vert ^{2}_{2} \biggr\} . \end{aligned} $$
(2.9)

Note that, for \(u\neq0\), \(F(tx,tu)/ \vert tu \vert ^{4+N-4\alpha}\rightarrow+\infty\) as \(t\rightarrow+\infty\) by (F3), where \(F(x,t)=\int_{0}^{t}f(x,s)\,\mathrm{d}s\). From (2.5) with \(t=0\), one has

$$\begin{aligned} \frac{1}{4}\tau f(x,\tau)-F(x,\tau)+\frac{\theta_{0}V(x)}{4}\tau ^{2}\geq0, \quad\forall x \in \mathbb{R}^{N}, \tau \in \mathbb{R}, \end{aligned}$$
(2.10)

then we have

$$\begin{aligned} \frac{f(tx,tu)tu}{ \vert tu \vert ^{4+N-4\alpha }}\rightarrow+\infty, \quad\mbox{as } t \rightarrow+\infty\mbox{ uniformly in } x \in \mathbb{R}^{N}. \end{aligned}$$
(2.11)

For \(N\in(2\alpha,4\alpha)\), thus from (2.9) and (2.11), one has

$$\begin{aligned} b \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u_{t} \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{3}} \bigl[V(x)u_{t}^{2}-f(x,u_{t})u_{t} \bigr]\,\mathrm{d}x\rightarrow-\infty, \quad\mbox{as } t\rightarrow+\infty. \end{aligned}$$

Thus, taking \(v=u_{T}\) for T large, we have \(v \in \mathcal{E}\). From (2.2), it is easy to see that and \(\mathcal{N}\subset \mathcal{E}\). □

Lemma 2.5

Assume that (V) and (F1)-(F4) hold. If \(u \in \mathcal{E}\), then there exists a unique \(t(u)>0\) such that \(t(u) \in \mathcal{N}\).

Proof

First, we prove the existence of \(t(u)\). In view of Lemma 2.4, let \(u\in\mathcal{E}\) be fixed and define a function \(g(t)=\langle\Phi'(tu), tu \rangle\) on \([0,+\infty)\). By (F4), one has

$$\begin{aligned} \theta_{0}V(x) (t\tau)^{2}-f(x,t\tau)t\tau \leq\bigl[\theta_{0}V(x)\tau ^{2}-f(x,\tau)\tau \bigr]t^{4},\quad\forall x \in \mathbb{R}^{N}, t \geq 1, \tau \in \mathbb{R}, \end{aligned}$$
(2.12)

Since \(u \in \mathcal{E}\), (2.12) yields

$$ \begin{aligned}[b] &bt^{4} \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}}\bigl[\theta_{0}V(x) (tu)^{2}-f(x,tu)tu \bigr]\,\mathrm{d}x \\ &\quad \leq t^{4} \biggl(b \bigl\Vert (-\triangle)^{\frac{\alpha }{2}}u \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}}\bigl[\theta _{0}V(x)u^{2}-f(x,u)u \bigr]\,\mathrm{d}x \biggr)< 0,\quad\forall t \geq 1. \end{aligned} $$
(2.13)

It follows from (2.1) and (2.13) that

$$\begin{aligned} g(t) =&t^{2} \biggl[a \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}u \bigr\Vert ^{2}_{2}+(1- \theta_{0}) \int_{\mathbb{R}^{N}}V(x)u^{2}\,\mathrm{d}x \biggr] +bt^{4} \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\Vert ^{4}_{2} \\ &{}+ \int_{\mathbb{R}^{N}}\bigl[\theta_{0}V(x) (tu)^{2}-f(x,tu)tu \bigr]\,\mathrm{d}x \\ \leq&t^{2} \biggl[a \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\Vert ^{2}_{2}+(1-\theta_{0}) \int_{\mathbb{R}^{N}}V(x)u^{2}\,\mathrm{d}x \biggr] \\ &{}+t^{4} \biggl(b \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}}\bigl[\theta_{0}V(x)u^{2}-f(x,u)u \bigr]\,\mathrm{d}x \biggr). \end{aligned}$$
(2.14)

For (F1), (F2) and (2.14), it is easy to verify that \(g(0)=0\), \(g(t)>0\) for \(t>0\) small and \(g(t)<0\) for t large because of \(u\in \mathcal{E}\). Therefore, there exists \(t_{0}=t(u)>0\) so that \(g(t_{0})=0\) and \(t(u)u \in \mathcal{N}\).

Next, we prove the uniqueness. For any given \(u \in \mathcal{E}\), let \(t_{1}, t_{2}>0\) such that \(g(t_{1})={g(t_{2})=0}\). Jointly with (2.6), one has

$$\begin{aligned} \Phi(t_{1}u) \geq\Phi(t_{2}u)+ \frac{(1-\theta _{0})(t_{1}^{2}-t_{2}^{2})^{2}}{4t_{1}^{2}} \Vert u \Vert ^{2} \end{aligned}$$
(2.15)

and

$$\begin{aligned} \Phi(t_{2}u) \geq\Phi(t_{1}u)+ \frac{(1-\theta _{0})(t_{2}^{2}-t_{1}^{2})^{2}}{4t_{2}^{2}} \Vert u \Vert ^{2}. \end{aligned}$$
(2.16)

Both (2.15) and (2.16) imply \(t_{1}=t_{2}\). Hence, \(t(u)>0\) is unique for any \(u \in \mathcal{E}\). □

Lemma 2.6

Assume that (V) and (F1)-(F4) hold. Then

$$\inf_{u\in\mathcal{N}}\Phi(u) = c = \inf_{u\in\mathcal{E},u\neq0} \max _{t\geq0}\Phi(t u)>0. $$

Proof

Corollary 2.3 and Lemma 2.5 imply that \(c = \inf_{u\in\mathcal{E},u\neq0} \max_{t\geq0}\Phi(t u)\). From Lemma 2.1, it is easy to see that \(c> 0\). □

Lemma 2.7

Assume that (V) and (F1)-(F4) hold. Then there exist a constant \(c_{\ast} \in (0,c]\) and a sequence \({u_{n}}\subset E\) satisfying

$$\begin{aligned} \Phi(u_{n}) \rightarrow c_{\ast},\quad \bigl\Vert \Phi'(u_{n}) \bigr\Vert \bigl(1+ \Vert u_{n} \Vert \bigr)\rightarrow0. \end{aligned}$$
(2.17)

Proof

We use the non-Nehari manifold approach developed in [42, 43] to show (2.17). From (F1), (F2) and (2.1), we know that there exist \(\delta_{0}>0\) and \(\rho_{0}>0\) such that

$$\begin{aligned} \Phi(u)\geq\rho_{0},\quad \Vert u \Vert = \delta_{0}. \end{aligned}$$
(2.18)

Choose \(v_{k}\in\mathcal{N}\subset\mathcal{E}\) such that

$$\begin{aligned} c\leq\Phi(v_{k})< c+\frac{1}{k},\quad k \in \mathbb{N}. \end{aligned}$$
(2.19)

For Lemma 2.1, it is easy to see that \(\Phi(tv_{k})<0\) for large \(t>0\). In fact, if \(\Phi(tv_{k})\geq0\) for large \(t>0\). By (2.4) and \(v_{k} \in \mathcal{N}\), we have

$$\begin{aligned} \Phi(v_{k})\geq\Phi(tv_{k})+ \frac{(1-\theta_{0})(1-t^{2})^{2}}{4} \Vert v_{k} \Vert ^{2}, \end{aligned}$$
(2.20)

which contradicts (2.19). From the mountain pass lemma, there exists a sequence \(\{u_{k,n}\}_{n\in\mathbb{N}}\subset E\) satisfying

$$\begin{aligned} \Phi(u_{k,n}) \rightarrow c_{k},\qquad \bigl\Vert \Phi '(u_{k,n}) \bigr\Vert \bigl(1+ \Vert u_{k,n} \Vert \bigr)\rightarrow 0,\quad k \in \mathbb{N}, \end{aligned}$$
(2.21)

where \(c_{k} \in [\rho_{0},\sup_{t\geq0}\Phi(tv_{k})]\). By (2.7) and (2.19), one has

$$\begin{aligned} \rho_{0}\leq c_{k}\leq\sup _{t\geq0}\Phi(tv_{k})=\Phi(v_{k})< c+ \frac {1}{k},\quad k \in \mathbb{N}. \end{aligned}$$
(2.22)

Therefore, by (2.21) and (2.22), for \(k \in \mathbb{N}\), one has

$$\begin{aligned} \Phi(u_{k,n}) \rightarrow c_{k} \in \biggl[ \rho_{0},c+\frac {1}{k} \biggr),\qquad \bigl\Vert \Phi'(u_{k,n}) \bigr\Vert \bigl(1+ \Vert u_{k,n} \Vert \bigr)\rightarrow0,\quad\mbox{as }n\rightarrow \infty. \end{aligned}$$
(2.23)

In view of (2.23), for \(k=1\), there exists \(n_{1}>0\) large enough such that

$$\begin{aligned} \rho_{0}\leq\Phi(u_{1,n_{1}})< c_{1}+1, \qquad \bigl\Vert \Phi '(u_{1,n_{1}}) \bigr\Vert \bigl(1+ \Vert u_{1,n_{1}} \Vert \bigr)< 1; \end{aligned}$$
(2.24)

for \(k=2\), there exists \(n_{2}>n_{1}>0\) large enough such that

$$\begin{aligned} \rho_{0}\leq\Phi(u_{2,n_{2}})< c_{2}+1/2, \qquad \bigl\Vert \Phi '(u_{2,n_{2}}) \bigr\Vert \bigl(1+ \Vert u_{2,n_{2}} \Vert \bigr)< 1/2. \end{aligned}$$
(2.25)

In this way, we can choose a sequence \(\{n_{k}\}\subset\mathbb{N}\) with \(n_{k}\rightarrow\infty\) as \(k\rightarrow\infty\) such that

$$\begin{aligned} \Phi(u_{k,n_{k}}) \in \biggl[\rho_{0},c+ \frac{1}{k} \biggr),\qquad \bigl\Vert \Phi'(u_{k,n_{k}}) \bigr\Vert \bigl(1+ \Vert u_{k,n_{k}} \Vert \bigr)< \frac{1}{k}, \quad k\in\mathbb{N}. \end{aligned}$$
(2.26)

Let \(u_{k}=u_{k,n_{k}}\), \(k \in \mathbb{N}\). Then, going if necessary to a subsequence, we conclude from (2.26) that

$$\begin{aligned} \Phi(u_{n}) \rightarrow c_{\ast},\qquad \bigl\Vert \Phi'(u_{n}) \bigr\Vert \bigl(1+ \Vert u_{n} \Vert \bigr)\rightarrow0. \end{aligned}$$
(2.27)

 □

Lemma 2.8

Assume that (V) and (F1)-(F4) hold. Then any sequence \(\{u_{n}\}\subset E\) satisfying (2.17) is bounded in E.

Proof

By (2.2), (2.10) and (2.17), one has

$$ \begin{aligned}[b] c_{\ast}+o(1) &=\Phi(u_{n})-\frac{1}{4}\bigl\langle \Phi'(u_{n}), u_{n} \bigr\rangle \\ &\geq\frac{1-\theta_{0}}{4} \Vert u_{n} \Vert ^{2} + \int_{\mathbb{R}^{N}} \biggl(\frac{1}{4}f(x,u)u-F(x,u)+ \frac{\theta _{0}V(x)}{4}u^{2} \biggr)\,\mathrm{d}x \\ &\geq\frac{1-\theta_{0}}{4} \Vert u_{n} \Vert ^{2}. \end{aligned} $$
(2.28)

This shows that the sequence \(\{u_{n}\}\) is bounded in E. □

Next, we prove the minimizer of the constrained problem is a critical point, which plays a crucial role in the asymptotically periodic case.

Lemma 2.9

Assume that (V) and (F1)-(F4) hold. If \(u_{0}\in \mathcal{N}\) and \(\Phi(u_{0})=c\), then \(u_{0}\) is a critical point of Φ.

Proof

Analogous to the proof of [21], it is easy to show this lemma by combining the quantitative deformation lemma and degree theory. □

3 The periodic case

Proof of Theorem 1.1

Lemma 2.7 implies the existence of a sequence \(\{u_{n}\}\subset E\) satisfying (2.17), then

$$\begin{aligned} \Phi(u_{n}) \rightarrow c_{\ast},\qquad \bigl\Vert \Phi'(u_{n}) \bigr\Vert \bigl(1+ \Vert u_{n} \Vert \bigr)\rightarrow0. \end{aligned}$$
(3.1)

By Lemma 2.8, \(\{u_{n}\}\) is bounded in E. Thus, there exists \(C>0\) such that \(\Vert u_{n} \Vert _{2}\leq C\). If

$$\begin{aligned} \delta:=\limsup_{n\rightarrow\infty}\sup_{y\in\mathbb{R}^{N}} \int _{B_{1}(y)} \vert u_{n} \vert ^{2} \,\mathrm{d}x=0, \end{aligned}$$
(3.2)

then by Lion’s concentration compactness principle [46], we have \(u_{n}\rightarrow0\) in \(L^{q}(\mathbb{R}^{N})\) for \(2< q<2^{\ast}_{\alpha }\). By (F1) and (F2), for \(\varepsilon=c_{*}/2C^{2}\), there exists \(C_{\varepsilon}>0\) such that

$$\begin{aligned} \limsup_{n\rightarrow\infty} \int_{\mathbb{R}^{N}} \biggl\vert \frac {1}{2}f(x,u_{n})u_{n}-F(x,u_{n}) \biggr\vert \,\mathrm{d}x \leq\frac{3}{2}\varepsilon C^{2}+C_{\varepsilon}\lim_{n\rightarrow \infty} \Vert u_{n} \Vert ^{p}_{p}= \frac{3c_{*}}{4}. \end{aligned}$$
(3.3)

From (2.1), (2.2), (3.1) and (3.3), one has

$$\begin{aligned} c_{*} =&\Phi(u_{n})-\frac{1}{2}\bigl\langle \Phi'(u_{n}), u_{n}\bigr\rangle +o(1) \\ =&-\frac{b}{4} \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}u_{n} \bigr\Vert + \int_{\mathbb{R}^{N}} \biggl[\frac{1}{2}f(x,u_{n})u_{n}-F(x,u_{n}) \biggr]\,\mathrm{d}x \\ \leq&\frac{3c_{*}}{4}. \end{aligned}$$

This contradiction shows \(\delta>0\).

Going if necessary to a subsequence, we may assume the existence of \(k_{n} \in \mathbb{Z}^{N}\) such that

$$\begin{aligned} \int_{B_{2}(k_{n})} \vert u_{n} \vert ^{2} \,\mathrm{d}x>\frac {\delta}{2}. \end{aligned}$$
(3.4)

Let \(v_{n}(x)=u_{n}(x+k_{n})\), then

$$\begin{aligned} \int_{B_{2}(0)} \vert v_{n} \vert ^{2} \,\mathrm{d}x>\frac{\delta}{2}. \end{aligned}$$
(3.5)

Since \(V(x)\) and \(f(x,u)\) are periodic on x, we have

$$\begin{aligned} \Phi(v_{n}) \rightarrow c_{\ast},\qquad \bigl\Vert \Phi'(v_{n}) \bigr\Vert \bigl(1+ \Vert v_{n} \Vert \bigr)\rightarrow0. \end{aligned}$$
(3.6)

Passing to a subsequence, we have \(v_{n}\rightharpoonup\bar{v}\) in E, \(v_{n}\rightarrow\bar{v}\) in \(L^{q}_{\mathrm{loc}}(\mathbb{R}^{N})\) for \(2< q<2^{*}_{\alpha}\) and \(v_{n}\rightarrow\bar{v}\) a.e. on \(\mathbb {R}^{N}\). Thus, (3.5) implies that \(\bar{v}\neq0\). Let \(l:=\lim_{n\rightarrow\infty} \Vert (-\triangle)^{\frac{\alpha}{2}}\bar {v}_{n} \Vert _{2}\), then the weakly lower semi-continuous of the norm implies that \(\Vert (-\triangle)^{\frac{\alpha}{2}}\bar {v} \Vert _{2}\leq l\). It is easy to check that

$$ \begin{aligned}[b] &\bigl\langle \Phi'(\bar{v}), \varphi\bigr\rangle + \bigl(l^{2}- \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}\bar{v} \bigr\Vert ^{2}_{2}\bigr) \int_{\mathbb{R}^{N}}(-\triangle)^{\frac{\alpha}{2}}\bar {v}(- \triangle)^{\frac{\alpha}{2}}\varphi\,\mathrm{d}x\\ &\quad =\lim_{n\rightarrow\infty} \bigl\langle \Phi'(\bar{v}_{n}), \varphi \bigr\rangle =0, \quad\forall\varphi \in \mathcal{C}_{0}^{\infty }\bigl( \mathbb{R}^{N}\bigr). \end{aligned} $$
(3.7)

Since \(\mathcal{C}_{0}^{\infty}(\mathbb{R}^{N})\) is dense in E, (3.7) implies \(\langle\Phi'(\bar{v}), \varphi\rangle\leq0\). We claim that \(\langle\Phi'(\bar{v}), \bar{v}\rangle=0\). In fact, if \(\langle\Phi'(\bar{v}), \bar{v}\rangle<0\), together with \(\langle \Phi'(t\bar{v}), t\bar{v}\rangle>0\) for small \(t>0\), then there exists \(t_{1} \in (0,1)\) such that \(\langle\Phi'(t_{1}\bar{v}), t_{1}\bar {v}\rangle=0\) and \(\Phi(t_{1}\overline{v})\geq c\). Using (F4), we have

$$\begin{aligned} f(x,t\tau)t\tau\leq f(x,\tau)\tau t^{4}+ \theta_{0}V(x) \bigl(1-t^{2}\bigr) (t\tau )^{2}, \quad\forall x\in \mathbb{R}^{N}, 0\leq t \leq1, \tau\in\mathbb{R}. \end{aligned}$$
(3.8)

Note that (2.5) implies

$$ \begin{aligned}[b] F(x,t\tau)&\geq\frac{t^{4}-1}{4}f(x,\tau)\tau+F(x,\tau)\\ &\quad {}- \frac {1-2t+t^{4}}{4}\theta_{0}V(x)\tau^{2},\quad\forall x\in \mathbb {R}^{N}, 0\leq t \leq1, \tau\in\mathbb{R}. \end{aligned} $$
(3.9)

Combining (3.8) and (3.9), we have

$$ \begin{aligned}[b] &\frac{1}{4}f(x,t\tau)t\tau-F(x,t\tau)+ \frac{\theta _{0}V(x)}{4}(t\tau)^{2} \\ &\quad \leq\frac{1}{4}f(x,\tau)\tau-F(x,\tau)+\frac{\theta _{0}V(x)}{4} \tau^{2},\quad\forall x\in \mathbb{R}^{N}, 0\leq t \leq 1, \tau\in\mathbb{R}. \end{aligned} $$
(3.10)

Then by (2.1), (2.2), (3.6) and (3.10), the weakly lower semi-continuity of the norm and Fatou’s lemma, we have

$$\begin{aligned} c \leq&\Phi(t_{1}\bar{v})-\frac{1}{4}\bigl\langle \Phi'(t_{1}\bar{v}), t_{1}\bar{v}\bigr\rangle \\ =&\frac{a\theta_{0}}{4}t_{1}^{2} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}\bar{v} \bigr\Vert _{2}^{2}+ \frac{1-\theta_{0}}{4}t_{1}^{2} \Vert \bar{v} \Vert ^{2} \\ &{}+ \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f(x,t_{1} \bar{v})t_{1}\bar {v}-F(x,t_{1}\bar{v})+\frac{\theta_{0}V(x)}{4}(t_{1} \bar{v})^{2} \biggr]\,\mathrm{d}x \\ < &\frac{a\theta_{0}}{4} \bigl\Vert (-\triangle)^{\frac{\alpha}{2}} \bar{v} \bigr\Vert _{2}^{2}+ \frac{1-\theta_{0}}{4} \Vert \bar{v} \Vert ^{2} + \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f(x,\bar{v})\bar{v}-F(x,\bar {v})+\frac{\theta_{0}V(x)}{4}(\bar{v})^{2} \biggr]\,\mathrm{d}x \\ \leq&\lim_{n\rightarrow\infty} \biggl\{ \frac{a\theta_{0}}{4} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}v_{n} \bigr\Vert _{2}^{2}+ \frac{1-\theta_{0}}{4} \Vert v_{n} \Vert ^{2} \\ & {} + \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f(x,v_{n})v_{n}-F(x,v_{n})+ \frac {\theta_{0}V(x)}{4}v_{n}^{2} \biggr]\,\mathrm{d}x \biggr\} \\ =&\lim_{n\rightarrow\infty} \biggl\{ \Phi(v_{n})- \frac{1}{4}\bigl\langle \Phi'(v_{n}), v_{n} \bigr\rangle \biggr\} \leq c, \end{aligned}$$
(3.11)

which is impossible. Thus, we get \(\bar{v} \in \mathcal{N}\) and \(\Phi(\bar{v})\geq c\). Jointly with (3.7), we have \(\lim_{n\rightarrow\infty} \Vert (-\triangle)^{\frac{\alpha}{2}}v_{n} \Vert _{2}= \Vert (-\triangle)^{\frac{\alpha}{2}}\bar {v} \Vert _{2}\) and \(\Phi'(\bar{v})=0\). On the other hand, from (2.10), (3.6), the weakly lower semi-continuous of norm and Fatou’s lemma, one has

$$\begin{aligned} c \geq&c_{*}=\Phi(v_{n})-\frac{1}{4} \bigl\langle \Phi'(v_{n}),v_{n}\bigr\rangle \\ =&\lim_{n\rightarrow\infty} \biggl\{ \frac{a\theta_{0}}{4} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}v_{n} \bigr\Vert _{2}^{2}+ \frac{1-\theta_{0}}{4} \Vert v_{n} \Vert ^{2} \\ &{} + \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f(x,v_{n})v_{n}-F(x,v_{n})+ \frac {\theta_{0}V(x)}{4}v_{n}^{2} \biggr]\,\mathrm{d}x \biggr\} \\ \geq&\liminf_{n\rightarrow\infty} \biggl[ \frac{a\theta_{0}}{4} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}v_{n} \bigr\Vert _{2}^{2}+ \frac{1-\theta_{0}}{4} \Vert v_{n} \Vert ^{2} \biggr] \\ & {} +\liminf_{n\rightarrow\infty} \int_{\mathbb{R}^{N}} \biggl[\frac {1}{4}f(x,v_{n})v_{n}-F(x,v_{n})+ \frac{\theta_{0}V(x)}{4}v_{n}^{2} \biggr]\,\mathrm{d}x \\ \geq&\frac{1}{4} \Vert \bar{v} \Vert ^{2}+ \int_{\mathbb {R}^{N}} \biggl[\frac{1}{4}f(x,\bar{v})v-F(x,\bar{v}) \biggr]\,\mathrm{d}x \\ =&\Phi(\bar{v})-\frac{1}{4}\bigl\langle \Phi'(\bar{v}), \bar{v} \bigr\rangle =\Phi(\bar{v}). \end{aligned}$$
(3.12)

This shows that \(\Phi(\bar{v})\leq c\) and so \(\Phi(\bar{v})= c=\inf_{\mathcal{N}}\Phi>0\). □

4 The asymptotically periodic case

In this section, we have \(V(x)=V_{0}(x)+V_{1}(x)\) and \(f(x,u)=f_{0}(x,u)+f_{1}(x,u)\). Define the functional \(\Phi_{0}\) as follows:

$$ \begin{aligned}[b] \Phi_{0}(u)&=\frac{1}{2} \int_{\mathbb{R}^{N}} \bigl(a \bigl\vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\vert ^{2}+V_{0}(x)u^{2} \bigr)\,\mathrm{d}x \\ &\quad {}+ \frac{b}{4} \biggl( \int_{\mathbb{R}^{N}} \bigl\vert (-\triangle )^{\frac{\alpha}{2}}u \bigr\vert ^{2}\,\mathrm{d}x \biggr)^{2} - \int_{\mathbb{R}^{N}}F_{0}(x,u)\,\mathrm{d}x,\quad\forall u\in E, \end{aligned} $$
(4.1)

where \(F_{0}(x,u):=\int_{\mathbb{R}^{N}}f_{0}(x,s)\,ds\). By (V0′), (F0′), (F1) and (F2), we have \(\Phi_{0} \in \mathcal{C}^{1}(E,\mathbb{R})\) and

$$ \begin{aligned}[b] \bigl\langle \Phi_{0}'(u),v \bigr\rangle &= \int_{\mathbb{R}^{N}} \bigl(a(-\triangle)^{\frac{\alpha }{2}}u(- \triangle)^{\frac{\alpha}{2}}v +V_{0}(x)uv \bigr)\,\mathrm{d}x\\ &\quad {} +b \int_{\mathbb{R}^{N}} \bigl\vert (-\triangle)^{\frac{\alpha }{2}}u \bigr\vert ^{2}\,\mathrm{d}x \int_{\mathbb{R}^{N}}(-\triangle)^{\frac{\alpha}{2}}u(-\triangle )^{\frac{\alpha}{2}}v\,\mathrm{d}x \\ &\quad {}- \int_{\mathbb{R}^{N}}f_{0}(x,u)v\,\mathrm{d}x,\quad\forall u,v \in E. \end{aligned} $$
(4.2)

By a standard argument, we have the following lemma.

Theorem 4.1

Assume that (V0′), (F0′), (F1) and (F2) hold. If \(u_{n}\rightharpoonup0\) in E, then

$$\begin{aligned}& \lim_{n\rightarrow\infty} \int_{\mathbb{R}^{N}}V_{1}(x)u^{2}_{n} \,\mathrm{d}x=0,\qquad\lim_{n\rightarrow\infty} \int_{\mathbb {R}^{N}}V_{1}(x)u_{n}v\,\mathrm{d}x=0,\quad \forall v \in E; \end{aligned}$$
(4.3)
$$\begin{aligned}& \lim_{n\rightarrow\infty} \int_{\mathbb{R}^{N}}F_{1}(x,u_{n})\,\mathrm{d}x=0, \qquad\lim_{n\rightarrow\infty} \int_{\mathbb {R}^{N}}f_{1}(x,u_{n})v\,\mathrm{d}x=0, \quad\forall v \in E. \end{aligned}$$
(4.4)

Proof of Theorem 1.2

Lemma 2.7 implies the existence of a sequence \(\{u_{n}\}\subset E\) satisfying (2.17), then

$$\begin{aligned} \Phi(u_{n}) \rightarrow c_{\ast},\qquad \bigl\Vert \Phi'(u_{n}) \bigr\Vert \bigl(1+ \Vert u_{n} \Vert \bigr)\rightarrow0. \end{aligned}$$
(4.5)

By Lemma 2.8, \(\{u_{n}\}\) is bounded in E. Thus, there exists \(C>0\) such that \(\Vert u_{n} \Vert _{2}\leq C\). Passing to a subsequence, we have \(u_{n}\rightharpoonup\bar{u}\) in E, \(u_{n}\rightarrow\bar{u}\) in \(L^{q}_{\mathrm{loc}}(\mathbb{R}^{N})\) for \(2\leq q<2^{*}_{\alpha}\) and \(u_{n}\rightarrow\bar{u}\) a.e. on \(\mathbb{R}^{N}\). There are two possible cases: (i) \(\bar{u}=0\); (ii) \(\bar{u}\neq0\).

Case i). \(\bar{u}=0\). Then \(u_{n}\rightharpoonup0\) in E, \(u_{n}\rightarrow0\) in \(L^{q}_{\mathrm{loc}}(\mathbb{R}^{N})\) for \(2\leq q<2^{*}_{\alpha}\) and \(u_{n}\rightarrow0\) a.e. on \(\mathbb{R}^{N}\). Note that

$$\begin{aligned}& \Vert u \Vert ^{2}= \int_{\mathbb{R}^{N}} \bigl(a \bigl\vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\vert ^{2}+V_{0}(x)u^{2} \bigr)\,\mathrm{d}x + \int_{\mathbb{R}^{N}}V_{1}(x)u^{2}\,\mathrm{d}x,\quad \forall u\in E, \end{aligned}$$
(4.6)
$$\begin{aligned}& \Phi_{0}(u)=\Phi(u)-\frac{1}{2} \int_{\mathbb{R}^{N}}V_{1}(x)u^{2}\,\mathrm{d}x + \int_{\mathbb{R}^{N}}F_{1}(x,u)\,\mathrm{d}x,\quad\forall u\in E, \end{aligned}$$
(4.7)

and

$$\begin{aligned} \bigl\langle \Phi'_{0}(u), v \bigr\rangle = \bigl\langle \Phi'(u), v \bigr\rangle - \int _{\mathbb{R}^{N}}V_{1}(x)uv\,\mathrm{d}x + \int_{\mathbb{R}^{N}}f_{1}(x,u)v\,\mathrm{d}x,\quad\forall u,v \in E. \end{aligned}$$
(4.8)

By (2.17), (4.3), (4.4), (4.6)-(4.8), one has

$$\begin{aligned} \Phi_{0}(u_{n}) \rightarrow c_{\ast},\qquad \bigl\Vert \Phi '_{0}(u_{n}) \bigr\Vert \bigl(1+ \Vert u_{n} \Vert \bigr)\rightarrow0. \end{aligned}$$
(4.9)

Analogous to the proof of (3.4), there exists \(k_{n} \in \mathbb {Z}^{N}\), going if necessary to a subsequence, such that

$$\begin{aligned} \int_{B_{2}(k_{n})} \vert u_{n} \vert ^{2} \,\mathrm{d}x>\frac {\delta}{2}. \end{aligned}$$
(4.10)

Let us define \(v_{n}(x)=u_{n}(x+k_{n})\). Then

$$\begin{aligned} \int_{B_{2}(0)} \vert v_{n} \vert ^{2} \,\mathrm{d}x>\frac{\delta}{2}. \end{aligned}$$
(4.11)

Since \(V(x)\) and \(f(x,u)\) are periodic on x, we have

$$\begin{aligned} \Phi_{0}(v_{n}) \rightarrow c_{\ast} \in (0,c],\qquad \bigl\Vert \Phi '_{0}(v_{n}) \bigr\Vert \bigl(1+ \Vert v_{n} \Vert \bigr)\rightarrow0. \end{aligned}$$
(4.12)

Passing to a subsequence, we have \(v_{n}\rightharpoonup\bar{v}\) in E, \(v_{n}\rightarrow\bar{v}\) in \(L^{q}_{\mathrm{loc}}(\mathbb{R}^{N})\) for \(2\leq q <2^{*}_{\alpha}\) and \(v_{n}\rightarrow\bar{v}\) a.e. on \(\mathbb{R}^{N}\). Thus, (4.10) implies that \(\bar{v}\neq0\). Similar to Corollary 2.3 and Lemma 2.6, by (2.4), (4.7) and (4.8), we can deduce that

$$\begin{aligned} \Phi_{0}(u)=\max_{t\geq0} \Phi_{0}(tu),\quad\forall u \in \mathcal {N}_{0},\qquad\inf _{u\in\mathcal{N}}\Phi_{0}(u) = c_{0} = \inf _{u\in\mathcal{E}_{0}} \max_{t\geq0}\Phi_{0}(t u)>0, \end{aligned}$$
(4.13)

where

$$\begin{gathered} \mathcal{N}_{0} := \bigl\{ u \in E : \bigl\langle \Phi'_{0}(u),u \bigr\rangle =0, u\neq 0\bigr\} , \\ \mathcal{E}_{0}= \biggl\{ u \in E : b \bigl\Vert (- \triangle)^{\frac {\alpha}{2}}u \bigr\Vert ^{4}_{2}+ \int_{\mathbb{R}^{N}} \bigl[V_{0}(x)u^{2} -f_{0}(x,u)u \bigr]\,\mathrm{d}x< 0 \biggr\} . \end{gathered} $$

In view of Theorem 1.1, there exists \(v_{0} \in \mathcal {N}_{0} \subset\mathcal{E}_{0}\) such that \(c_{0}=\Phi(v_{0})\). Then, from (F0′), (4.7) and (4.13), we get

$$\begin{aligned} c= \inf_{u\in\mathcal{E}} \max_{t\geq0}\Phi(t v)\leq\max_{t\geq 0}\Phi(t v_{0})\leq\max _{t\geq0}\Phi_{0}(t v_{0})\leq \Phi_{0}(v_{0})=c_{0}. \end{aligned}$$
(4.14)

Similar to (3.7), we have \(\langle\Phi'_{0}(\bar{v}), \bar {v}\rangle\leq0\). If \(\langle\Phi'_{0}(\bar{v}), \bar{v}\rangle <0\), together with \(\langle\Phi'_{0}(t\bar{v}), t\bar{v}\rangle>0\) for small \(t>0\), we see that there exists \(t_{2} \in (0,1)\) such that \(\langle\Phi'_{0}(t_{2}\bar{v}), t_{2}\bar{v}\rangle=0\) and \(\Phi (t_{2}\overline{v})\geq c_{0}\). By (F0′), we have

$$\begin{aligned} f_{0}(x,t\tau)t\tau\leq f_{0}(x,\tau)\tau t^{4}+V_{0}(x) \bigl(1-t^{2}\bigr) (t\tau )^{2},\quad\forall x\in \mathbb{R}^{N}, 0\leq t \leq1, \tau \in\mathbb{R} , \end{aligned}$$
(4.15)

and

$$ \begin{aligned}[b] &\frac{1-t^{4}}{4}\tau f_{0}(x,\tau)+F_{0}(x,t \tau)-F_{0}(x,\tau)+\frac {V_{0}(x)}{4}\bigl(1-t^{2} \bigr)^{2}\tau^{2} \\ &\quad = \int^{1}_{t} \biggl[ \frac{f_{0}(x,\tau)}{\tau^{3}}- \frac {f_{0}(x,\xi\tau)}{(\xi\tau)^{3}} +V_{0}(x)\frac{1-\xi^{2}}{(\xi\tau)^{2}} \biggr]\xi^{3} \tau^{4}\,\mathrm{d}\xi\\ &\quad \geq0,\quad\forall x\in \mathbb{R}^{N}, t\geq0, \tau\in \mathbb{R}\backslash\{0\}. \end{aligned} $$
(4.16)

Combining (4.15) and (4.16), we have

$$ \begin{aligned}[b] &\frac{1}{4}f_{0}(x,t\tau)t \tau-F_{0}(x,t\tau)+\frac{V(x)}{4}(t\tau )^{2} \\ &\quad \leq\frac{1}{4}f_{0}(x,\tau)\tau-F_{0}(x,\tau)+ \frac{V_{0}(x)}{4}\tau ^{2},\quad\forall x\in \mathbb{R}^{N}, 0\leq t \leq1, \tau\in\mathbb{R}. \end{aligned} $$
(4.17)

It follows from (4.16) with \(t=0\) that

$$\begin{aligned} \frac{1}{4}f_{0}(x,\tau)\tau-F_{0}(x, \tau)+\frac{V_{0}(x)}{4}\tau^{2}\geq 0,\quad\forall x\in \mathbb{R}^{N}, \tau\in\mathbb{R}. \end{aligned}$$
(4.18)

Since \(t_{2} \in (0,1)\), from (4.1), (4.2), (4.12), (4.14), (4.17) and (4.18), the weakly lower semi-continuity of the norm and Fatou’s lemma, we have

$$\begin{aligned} c_{0} \leq&\Phi_{0}(t_{2} \bar{v})-\frac{1}{4}\bigl\langle \Phi_{0}'(t_{2} \bar{v}), t_{2}\bar{v}\bigr\rangle \\ =&\frac{a}{4}t_{2}^{2} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}\bar {v} \bigr\Vert _{2}^{2} + \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f_{0}(x,t_{2} \bar{v})t_{2}\bar {v}-F_{0}(x,t_{2}\bar{v})+ \frac{V_{0}(x)}{4}(t_{2}\bar{v})^{2} \biggr]\,\mathrm{d}x \\ < &\frac{a}{4} \bigl\Vert (-\triangle)^{\frac{\alpha}{2}}\bar {v} \bigr\Vert _{2}^{2} + \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f_{0}(x,\bar{v}) \bar {v}-F_{0}(x,\bar{v})+\frac{V_{0}(x)}{4}(\bar{v})^{2} \biggr]\,\mathrm{d}x \\ \leq&\lim_{n\rightarrow\infty} \biggl\{ \frac{a}{4} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}v_{n} \bigr\Vert _{2}^{2}+ \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f_{0}(x,v_{n})v_{n}-F_{0}(x,v_{n})+ \frac {V_{0}(x)}{4}v_{n}^{2} \biggr]\,\mathrm{d}x \biggr\} \\ =&\lim_{n\rightarrow\infty} \biggl\{ \Phi_{0}(v_{n})- \frac{1}{4}\bigl\langle \Phi_{0}'(v_{n}), v_{n} \bigr\rangle \biggr\} \leq c\leq c_{0}, \end{aligned}$$
(4.19)

which is impossible. Thus, we get \(\langle\Phi_{0}'(\bar{v}), \bar{v} \rangle=0\) and \(\Phi_{0}(\bar{v})\geq c_{0}\). By a standard argument, we have \(\Phi'_{0}(\bar{v})=0\). On the other hand, from (4.1), (4.2), (4.12) and (4.18), the weakly lower semi-continuity of the norm and Fatou’s lemma, we obtain

$$\begin{aligned} c \geq&c_{*}=\lim_{n\rightarrow\infty} \biggl[ \Phi_{0}(v_{n})-\frac {1}{4}\bigl\langle \Phi'_{0}(v_{n}),v_{n}\bigr\rangle \biggr] \\ =&\lim_{n\rightarrow\infty} \biggl\{ \frac{a}{4} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}v_{n} \bigr\Vert _{2}^{2} + \int_{\mathbb{R}^{N}} \biggl[\frac{1}{4}f_{0}(x,v_{n})v_{n}-F_{0}(x,v_{n})+ \frac {V_{0}(x)}{4}v_{n}^{2} \biggr]\,\mathrm{d}x \biggr\} \\ \geq&\liminf_{n\rightarrow\infty} \frac{a}{4} \bigl\Vert (- \triangle)^{\frac{\alpha}{2}}v_{n} \bigr\Vert _{2}^{2} +\liminf_{n\rightarrow\infty} \int_{\mathbb{R}^{N}} \biggl[\frac {1}{4}f_{0}(x,v_{n})v_{n}-F_{0}(x,v_{n})+ \frac{V_{0}(x)}{4}v_{n}^{2} \biggr]\,\mathrm{d}x \\ \geq&\frac{1}{4} \Vert \bar{v} \Vert ^{2}+ \int_{\mathbb {R}^{N}} \biggl[\frac{1}{4}f_{0}(x, \bar{v})v-F_{0}(x,\bar{v}) \biggr]\,\mathrm{d}x \\ =&\Phi_{0}(\bar{v})-\frac{1}{4}\bigl\langle \Phi'_{0}(\bar{v}), \bar{v} \bigr\rangle = \Phi_{0}(\bar{v}). \end{aligned}$$
(4.20)

This implies that \(\Phi_{0}(\bar{v})\leq c\). By (F0′), we have \(\langle\Phi'(\bar{v}),\bar{v}\rangle\leq \langle\Phi'_{0}(\bar{v}),\bar{v}\rangle=0\), which implies \(\bar {v} \in \mathcal{E}\). Then, by Lemma 2.5, there exists \(t_{0}=t(\bar{v})\) such that \(t_{0}\bar{v}\in\mathcal{N}\geq c\), and so \(\Phi(t_{0}\bar{v})\geq c\). Now we prove that \(\Phi(t_{0}\bar{v})=c\). Arguing indirectly, we assume that \(\Phi(t_{0}\bar{v})>c\). Then by (V0′), (F0′), (4.1), (4.2) and (4.16), we have

$$\begin{aligned} c \geq&\Phi_{0}(\bar{v}) \\ =&\Phi_{0}(t_{0} \bar{v})+\frac{1-t_{0}^{4}}{4}\bigl\langle \Phi'_{0}( \bar{v}), \bar{v}\bigr\rangle +\frac{a(1-t_{0})^{2}}{4} \int _{\mathbb{R}^{N}} \bigl\vert (-\triangle)^{\frac{\alpha}{2}}u \bigr\vert ^{2}\,\mathrm{d}x \\ &{}+ \int_{\mathbb{R}^{N}} \biggl[\frac{1-t_{0}^{4}}{4}\tau f_{0}(x,\bar {v})+F_{0}(x,t_{0}\bar{v})-F_{0}(x,\bar{v})+ \frac {V_{0}(x)}{4}\bigl(1-t_{0}^{2}\bigr)^{2}( \bar{v})^{2} \biggr]\,\mathrm{d}x \\ \geq&\Phi_{0}(t_{0}\bar{v})=\Phi(t_{0} \bar{v})-\frac{1}{2} \int _{\mathbb{R}^{N}}V_{1}(x) (t_{0} \bar{v})^{2}\,\mathrm{d}x + \int_{\mathbb{R}^{N}}F_{1}(x,t_{0}\bar{v})\,\mathrm{d}x \\ \geq&\Phi(t_{0}\bar{v})>c. \end{aligned}$$
(4.21)

This contradiction shows that \(\Phi(t_{0}\bar{v})=c\).

Let \(u_{0}=t_{0}\bar{v}\). Then \(u_{0}\in\mathcal{N}\) and \(\Phi(u_{0})=c\). In view of Lemma 2.9, we have \(\Phi'(u_{0})=0\). This shows that \(u_{0}\in E\) is a solution for (1.1) with \(\Phi(u_{0})=\inf_{\mathcal{N}}\Phi>0\).

Case ii). \(\bar{u}\neq0\). By the same fashion as the last part of the proof of Theorem 1.1, we can prove that \(\Phi'(\bar{u})=0\) and \(\Phi(\bar{u})=c=\inf_{\mathcal{N}}\Phi\). This shows that \(\bar{u} \in E\) is a solution for (1.1) with \(\Phi(\bar {u})=\inf_{\mathcal{N}}\Phi\). □

5 Conclusion

In this paper, by using the variational methods and some weaker conditions, the existence of Nehari-type solutions to equation (1.1) is established. We consider periodic or asymptotically periodic fractional Kirchhoff problems with more general nonlinearity f in \(\mathbb{R}^{N}\), where \(2\alpha< N<4\alpha\) and \(\alpha\in(0,1)\), especially f unifies asymptotically cubic and super-cubic nonlinearity, which generalizes and improves the previous results. Meanwhile, (1.1) is a nonlocal problem, so we need to overcome some new difficulties, which involves some new approaches and analytical techniques in our paper.