Asymptotic behavior for a class of population dynamics

1.   Introduction

In this paper, we are interested in establishing the existence and nonexistence results of nontrivial solutions for the coupled fractional Schrödinger systems of Choquard type

where $s\in(0, 1), \ N\geq 3, \ \alpha\in(0, N), \ p > 1$, $\lambda_{i} > 0$ are constants for $i = 1, \ 2$, $\beta > 0$ is a parameter, and $I_{\alpha}(x)$ is the Riesz Potential defined as

where $\Gamma$ is the Gamma function.

Here, the nonlocal Laplacian operator $(-\Delta)^{s}$ with $s\in (0, 1)$ of a function $u : \mathbb{R}^{N}\to R$ is expressed by the formula

where P.V. stand for the Cauchy principal value on the integral, and $C(N, s)$ is some positive normalization constant (see ^[1] for details).

It can also be defined as a pseudo-differential operator

where $\mathcal{F}$ is the Fourier transform.

The problem (1.1) presents nonlocal characteristics in the nonlinearity as well as in the (fractional) diffusion because of the appearance of the terms $(I_{\alpha}*|u|^{p})|u|^{p-2}u$ and $(I_{\alpha}*|v|^{p})|v|^{p-2}v$. This phenomenon raises some mathematical puzzles that make the study of such problems particularly interesting. We point out that when $s = 1$, $\lambda_{1} = 1$, $p = 2$, $N = 3$, $\alpha = 2$ and $\beta = 0$, (1.1) reduces to the Choquard-Pekar equation

which appeared in 1954 by Pekar ^[2] describing a polaron at rest in the quantum theory. In 1976, Choquard ^[3] used this equation to model an electron trapped in its own hole and considered it as an approximation to Hartree-Fock theory of one-component plasma. Subsequently, in 1996 Penrose ^[4] investigated it as a model for the self-gravitating collapse of a quantum mechanical wave function; see also ^[5]. The first investigations for existence and uniqueness of ground state solutions of (1.2) go back to the work of Lieb ^[6]. Lions ^[7] generalized the result in ^[6] and proved the existence and multiplicity of positive solutions of (1.2). In addition, the existence and qualitative results of solutions of power type nonlinearities $|u|^{p-2}u$ and for more generic values of $\alpha\in(0, N)$ are discussed by variational method, where $N\ge 3$, see ^{[8,9,10,11,12]}. Under almost necessary conditions on the nonlinearity $F$ in the spirit of H. Berestycki and P. L. Lions ^[13], Moroz and Schaftingen ^[14] considered the existence of a ground state solution $u\in H^{1}(\mathbb{R}^{N})$ to the nonlinear Choquard equation

When $s\in(0, 1)$, Laskin ^[15] introduced the fractional power of the Laplace operator in (1.1) as an extension of the classical local Laplace operator in the study of nonlinear Schrödinger equations, replacing the path integral over Brownian motions with Lévy flights ^[16]. This operator has concrete applications in a wide range of fields, see ^[1,17] and the references therein. Equations involving the fractional Laplacian together with local nonlinearities and the system of weakly coupled equations has been investigated extensively in recent years, and some research results can be found in ^{[18,19,20,21]}.

When $\beta = 0$, the system (1.1) can be reduced to two single Choquard equations

and

Equations (1.3) and (1.4) arise from the search for standing wave solutions of the following time-dependent fractional Choquard equation:

where $i$ denotes the imaginary unit.

In ^[22], by minimizing

on $H^{s}(\mathbb{R}^{N})\setminus\{0\}$, the authors obtained the existence of ground state solution of (1.3) with $p\in(1+\frac{\alpha}{N}, \frac{N+\alpha}{N-2s})$ (see [22, Theorem 4.2]).

Of course, scalar problems can be extended to systems. It is easy to see that the system (1.1) can be regarded as a counterpart of the following systems with standard Laplace operator

In ^[23], Chen and Liu studied the systems of Choquard type, when $p\in(1+\frac{\alpha}{N}, \frac{N+\alpha}{N-2})$, they obtained the existence of ground state solutions of the systems. Yang et al. ^[24] considered the corresponding critical case.

Motivated by the above mentioned works, in this paper, we aim to study the existence of positive ground state solutions of the systems (1.1). This class of systems has two new characteristics: One is the presence of the fractional Laplace and the Choquard type functions which are nonlocal, the other is its lack of compactness inherent to problems defined on unbounded domains. In order to overcome such difficulties, next we introduce a special space where we are able to recover some compactness.

First we use $\left \| \cdot \right \|_{p}$ denote the norm of $L^{p}(\mathbb{R}^{N})$ for any $1\leq p < \infty$. The Hilbert space $H^{s}(\mathbb{R}^{N})$ is defined by

with the scalar product and norm given by

where

The radial space $H^{s}_{r}(\mathbb{R}^{N})$ of $H^{s}(\mathbb{R}^{N})$ is defined as

with the $H^{s}(\mathbb{R}^{N})$ norm.

Let

for convenience. It is easy to obtain that $\|\cdot\|_{\lambda_{i}}$ and $\|\cdot\|$ are equivalent norms in $H^{s}(\mathbb{R}^{N})$. Denote $H: = H^{s}(\mathbb{R}^{N})\times H^{s}(\mathbb{R}^{N})$ and $H_{r}: = H^{s}_{r}(\mathbb{R}^{N})\times H^{s}_{r}(\mathbb{R}^{N})$. The norm of $H$ is given by

The energy functional $E_{\beta}$ associated to (1.1) is

It is easy to obtain that $E_{\beta}\in C^{1}(H, \mathbb{R})$ and

for all $(\varphi, \psi)\in H$.

$(u, v)$ is called a nontrivial solution of (1.1) if $u_{\beta}\not\equiv 0, \ v_{\beta}\not\equiv 0$ and $(u, v)\in H$ solves (1.1). A positive ground state solution $(u, v)$ of (1.1) is a nontrivial solution of (1.1) such that $u > 0$, $v > 0$ which has minimal energy among all nontrivial solutions. In order to find positive ground state solutions of (1.1), we need to investigate the existence of the minimum value of $E_{\beta}$, defined in (1.5) under the Nehari manifold constraint

Define

Furthermore, define $E_{0, i}:H^{s}(\mathbb{R}^{N})\to \mathbb{R}$ by

We introduce the Nehari manifolds

A ground state solution of (1.3) (or (1.4)) is a solution with minimal energy $E_{0, 1}$ (or $E_{0, 2}$) and can be characterized as

The main results of our paper are the following.

Theorem 1.1. Suppose $s\in(0, 1), \ N\geq 3, \ \alpha\in(0, N)$ and $p\in(1+\frac{\alpha}{N}, \frac{\alpha+N}{N-2s})$, then the system (1.1) possesses a positive radial ground state solution $(u_{\beta}, v_{\beta})\in \mathcal{N}_{\beta}$ with $E_{\beta}(u_{\beta}, v_{\beta}) = m_{\beta} > 0$ for any $0 < \beta < \sqrt{\lambda_{1}\lambda_{2}}$. Moreover, $(u_{\beta}, v_{\beta})\to(u_{0}, v_{0})$ in $H$ as $\beta\to 0^+$, where $(u_{0}, v_{0})$ is a positive radial ground state solution for the system (1.1) with $\beta = 0,$ namely, $u_{0}$ and $v_{0}$ are positive radial ground state solutions to problems (1.3) and (1.4), respectively.

Remark 1.1. In comparison with ^[19], this paper has several new features. Firstly, the system (1.1) contains the Choquard type terms which are more difficult to deal with. Secondly, Lemma 3.11 in ^[19] shows that $(u_{\beta}, v_{\beta})\to (u_{0}, v_{0})$ in $H$ as $\beta\to 0^+$, where either $v_{0}\equiv 0$ and $u_{0}$ is a ground state solution to one single equation, or $u_{0}\equiv 0$ and $v_{0}$ is a ground state solution to the other single equation. While we prove that $(u_{0}, v_{0})$ is a positive radial ground state solution for the system (1.1) with $\beta = 0.$ Finally, the difference in asymptotic behavior is that it is obtained in this paper that $u_{0} > 0$ and $v_{0} > 0$ are positive radial ground state solutions to problems (1.3) and (1.4), respectively (see Theorem 1.3 in ^[19]).

Finally, by using the Pohožaev identity (4.1) of the system (1.1), we have the following non-existence result.

Theorem 1.2. Suppose $p\ge\frac{\alpha+N}{N-2s}$ or $p\leq 1+\frac{\alpha}{N}$, then the system (1.1) does not admit non-trivial solutions.

Remark 1.2. According to Theorem 1.2, we can know that the range of $p\in(1+\frac{\alpha}{N}, \frac{\alpha+N}{N-2s})$ is optimal for the existence of nontrivial solutions to the system (1.1).

The rest of this paper is as following. In Section 2, we introduce some preliminary results and notions. In Section 3, we obtain the existence of ground state solutions of the system (1.1) and we also investigate their asymptotic behaviour. In Section 4, we get the nonexistence result.

Throughout this paper, we use "$\rightarrow$" and "$\rightharpoonup$" to denote the strong convergence and weak convergence in the correlation function space, respectively. $o_{n}(1)$ denotes a sequence which converges to $0$ as $n\to \infty$. $C$ will always denote a positive constants, which may vary from line to line.

2.   Preliminaries

It is well known that the following properties which follow from the fractional Sobolev embedding

If $1+\frac{\alpha}{N} < p < \frac{\alpha+N}{N-2s}$, we have that $2 < \frac{2Np}{N+\alpha} < 2^{*}_{s}$, the space $H^{s}_{r}(\mathbb{R}^{N})$ compactly embedded into $L^{\frac{2Np}{N+\alpha}}(\mathbb{R}^{N})$.

First of all, let us recall the Hardy-Littlewood-Sobolev inequality.

Lemma 2.1. (Hardy-Littlewood-Sobolev inequality ^[23]) Let $0 < \alpha < N$, $r, \ q > 1$ and $1\leq s < t < \infty$ be such that

(i) For any $u\in L^{r}(\mathbb{R}^{N})$ and $v\in L^{q}(\mathbb{R}^{N})$, we have

If $p\in(1+\frac{\alpha}{N}, \frac{\alpha+N}{N-2s})$ and $r = q = \frac{2N}{N+\alpha}$, then

where the sharp constant $C(N, \alpha, p)$ is

(ii) For any $u\in L^{s}(\mathbb{R}^{N})$, we have

Here, $C(N, \alpha, s)$ is a positive constant which depends only on $N$, $\alpha$ and $s$, and satisfies

where $\omega_{N-1}$ denotes the surface area of the $N-1$ dimensional unit sphere.

Next, the following result is crucial in the proof of the Theorem 1.1.

Lemma 2.2. Assumption $N\in \mathbb{N}$, $0 < \alpha < N$ and $p\in(1+\frac{\alpha}{N}, \frac{\alpha+N}{N-2s})$. Let $\{u_{n}\}\subset H^{s}(\mathbb{R}^{N})$ be a sequence satisfying that $u_{n}\rightharpoonup u$ weakly in $H^{s}(\mathbb{R}^{N})$ as $n\to\infty$, then

To show Lemma 2.2, we state the classical Brezis-Lieb lemma ^[25].

Lemma 2.3. Let $\Omega \subseteq \mathbb{R}^{N}$ be an open subset and $1\leq r < \infty$. If

(i) $\{u_{n}\}_{n\in\mathbb{N}}$ is bounded in $L^{r}(\Omega)$.

(ii) $u_{n}\rightarrow u$ almost everywhere on $\Omega$ as $n\to \infty$, then for every $q\in[1, r]$,

Here we also need to mention sufficient conditions for weak convergence (see for example [25, Proposition 4.7.12]).

Lemma 2.4. Assume $\Omega$ be an open subset of $\mathbb{R}^{N}$, $1 < q < \infty$ and the sequence $\{u_{n}\}_{n\in\mathbb{N}}$ is bounded in $L^{q}(\Omega)$. If $u_{n}\rightarrow u$ almost everywhere on $\Omega$ as $n\to \infty$, we have that $u_{n}\rightharpoonup u$ weakly in $L^{q}(\Omega)$.

In view of Lemmas 2.3 and 2.4 we have the following proof.

Proof of Lemma 2.2. For every $n\in \mathbb{N}$. We have that

Since $1+\frac{\alpha}{N} < p < \frac{\alpha+N}{N-2s}$, we have that $2 < \frac{2Np}{N+\alpha} < 2^{*}_{s}$, then the space $H^{s}(\mathbb{R}^{N})$ is embedded continuously in $L^{\frac{2Np}{N+\alpha}}(\mathbb{R}^{N})$. Moreover, $u_{n}\rightharpoonup u$ weakly in $H^{s}(\mathbb{R}^{N})$ as $n\to\infty$. Thus, the sequence $\{u_{n}\}_{n\in\mathbb{N}}$ is bounded in $L^{\frac{2Np}{N+\alpha}}(\mathbb{R}^{N})$. By (2.5) with $q = p$ and $r = \frac{2Np}{N+\alpha}$, we have that

strongly in $L^{\frac{2N}{N+\alpha}}(\mathbb{R}^{N})$ as $n\to\infty$. By (2.3), we have that $I_{\alpha}$ defines a linear continuous map from $L^{\frac{2N}{N+\alpha}}(\mathbb{R}^{N})$ to $L^{\frac{2N}{N-\alpha}}(\mathbb{R}^{N})$, then

in $L^{\frac{2N}{N-\alpha}}(\mathbb{R}^{N})$ as $n\to\infty$. By (2.2), we have

In view of Lemma 2.4, we get $|u_{n}-u|^{p}\rightharpoonup0$ weakly in $L^{\frac{2N}{N+\alpha}}(\mathbb{R}^{N})$ as $n\to\infty$. Thus,

The proof is thereby complete. □

Lemma 2.5. Let $0 < \alpha < N$, $p\in(1+\frac{\alpha}{N}, \frac{\alpha+N}{N-2s})$ and the sequence $\{u_{n}\}_{n\in\mathbb{N}}\subset H^{s}(\mathbb{R}^{N})$ be such that $u_{n}\rightharpoonup u\in H^{s}(\mathbb{R}^{N})$ weakly in $H^{s}(\mathbb{R}^{N})$ as $n\to\infty$. Let $\phi\in H^{s}(\mathbb{R}^{N})$, we have

Proof. Since $u_{n}\rightharpoonup u$ weakly in $H^{s}(\mathbb{R}^{N})$ as $n\to\infty$, then $u_{n}\rightarrow u$ a.e. in $\mathbb{R}^{N}$. By the fractional Sobolev embedding $H^{s}(\mathbb{R}^{N})\hookrightarrow L^{q}(\mathbb{R}^{N})$ with $q\in[2, 2^{*}_{s}]$, we see that $\{u_{n}\}_{n\in\mathbb{N}}$ is bounded in $L^{2}(\mathbb{R}^{N})\cap L^{2^{*}_{s}}(\mathbb{R}^{N})$. Since $2 < \frac{2Np}{N+\alpha} < 2^{*}_{s}$, then $\{|u_{n}|^{p}\}$ and $\{|u_{n}|^{q-2}u_{n}\}$ are bounded in $L^{\frac{2N}{N+\alpha}}(\mathbb{R}^{N})$ and $L^{\frac{q}{q-1}}(\mathbb{R}^{N})$ with $q\in [2, 2^{*}_{s}]$, respectively, up to a subsequence, we get

In view of the Rellich theorem, $u_{n}\rightarrow u$ in $L^{t}_{loc}(\mathbb{R}^{N})$ for $t\in [1, 2^{*}_{s})$ and $|u_{n}|^{p-2}u_{n}\rightarrow |u|^{p-2}u$ in $L^{\frac{2Np}{(p-1)(N+\alpha)}}_{loc}(\mathbb{R}^{N})$ (see [26, Theorem A.2]), then we have that $|u_{n}|^{p-2}u_{n}\phi\rightarrow |u|^{p-2}u\phi$ in $L^{\frac{2N}{N+\alpha}}(\mathbb{R}^{N})$ for any $\phi\in C^{\infty}_{0}(\mathbb{R}^{N})$, where $C^{\infty}_{0}(\mathbb{R}^{N})$ denotes the space of the functions infinitely differentiable with compact support in $\mathbb{R}^{N}$. By (2.3), we get

in $L^{\frac{2N}{N-\alpha}}(\mathbb{R}^{N})$. Therefore, by (2.7) and (2.8) we get

as $n\to \infty$. Since $C^{\infty}_{0}(\mathbb{R}^{N})$ is dense in $H^{s}(\mathbb{R}^{N})$, we reach the conclusion. □

Lemma 2.6. (see [27, Theorem 3.7]) Let $f$, $g$ and $h$ be three non-negative Lebesgue measurable functions on $\mathbb{R}^{N}$. Let

we get

where $f^{*}$, $g^{*}$ and $h^{*}$ denote the symmetric radial decreasing rearrangement of $f$, $g$ and $h$.

Lemma 2.7. (see [22, Theorem 1.1]) Under the assumptions of Theorem 1.1, there exists a ground state solution $u\in H^{s}(\mathbb{R}^{N})$ ($v\in H^{s}(\mathbb{R}^{N})$) to problem (1.3) (1.4) which is positive, radially symmetric. Moreover, the minima of the energy functional $E_{0, 1}$ ($E_{0, 2}$) on the Nehari manifold $\mathcal{N}_{0, 1}$ ($\mathcal{N}_{0, 2}$) defined in (1.9) satisfies $\min _{u\in \mathcal{N}_{0, 1}}E_{0, 1}(u) > 0$ ($\min _{u\in \mathcal{N}_{0, 2}}E_{0, 2}(u) > 0$).

3.   Proof of Theorem 1.1

For any $(u, v)\in \mathcal{N}_{\beta},$ we have

This shows that $E_{\beta}$ is coercive on $\mathcal{N}_{\beta}$. Next we show, through a series of lemmas, that $m_{\beta}$ is attained by some $(u, v)\in\mathcal{N}_{\beta}$ which is a critical point of $E_{\beta}$ considered on the whole space $H$, and therefore a ground state solution to (1.1).

We begin with some basic properties of $E_{\beta}$ and $\mathcal{N}_{\beta}$.

Lemma 3.1. For every $(u, v)\in H\setminus \{(0, 0)\}$, there exists some $t > 0$ such that $(tu, tv)\in\mathcal{N}_{\beta}$.

Proof. Indeed, $(tu, tv)\in\mathcal{N}_{\beta}$ is equivalent to

which is solved by

By inequality

we have that

Therefore we get $t > 0$. □

Lemma 3.2. The following assertions hold:

(i) There exists $c > 0$ such that $\|(u, v)\|_{H}\ge c$ for any $(u, v)\in\mathcal{N}_{\beta}$.

(ii) $m_{\beta} = \inf_{(u, v)\in \mathcal{N}_{\beta}}E_{\beta}(u, v) > 0$ for all fixed $0 < \beta < \sqrt{\lambda_{1}\lambda_{2}}$.

(iii) Let $u_{1}$, $v_{1}$ are positive solutions of (1.3) and (1.4) respectively, and let $t > 0$ be such that $(tu_{1}, tv_{1})\in \mathcal{N}_{\beta}$, then $0 < t < 1$.

Proof. (i) In view of the definition of $\mathcal{N}_{\beta}$, by the Hardy-Littlewood-Sobolev inequality (2.2), for any $(u, v)\in\mathcal{N}_{\beta}$, we have

where $C_{1} > 0$ denotes the fractional Sobolev embedding constant and $C_{1}$ does not depend on $u$ and $v$. This means that

Since $0 < \beta < \sqrt{\lambda_{1}\lambda_{2}}$, we have $\|(u, v)\|_{H}\ge c$, where

(ii) For any $(u, v)\in\mathcal{N}_{\beta}$, we have

Since $p > 1$, we obtain $m_{\beta}\ge (\frac{1}{2}-\frac{1}{2p})(1-\frac{\beta}{\sqrt{\lambda_{1}\lambda_{2}}})c^{2} > 0$.

(iii) Since $u_{1}$, $v_{1}$ are positive solutions of (1.3) and (1.4) respectively, and $(tu_{1}, tv_{1})\in \mathcal{N}_{\beta}$, we have

and

Combining (3.4) and (3.5), we have

The proof is complete. □

Proof of Theorem 1.1. Let $(u_{n}, v_{n})\in\mathcal{N}_{\beta}$ be a minimizing sequence for $E_{\beta}$, namely such that $E_{\beta}(u_{n}, v_{n})\to m_{\beta}$. By (3.3), we know that $\{(u_{n}, v_{n})\}_{n\in\mathbb{N}}$ is bounded in $H$. In view of Lemma 3.1, there exists $t_{n} > 0$ such that $(t_{n}|u_{n}|, t_{n}|v_{n}|)\in \mathcal{N}_{\beta}$. Then

Hence, we have that $0 < t_{n}\leq1$. Since

For this reason we can assume that $u_{n}\ge0$ and $v_{n}\ge0$. Let $u_{n}^{*}$ and $v_{n}^{*}$ denote the symmetric decreasing rearrangement of $u_{n}$, respectively $v_{n}$. By Lemma 2.6 with $f(x) = |u_{n}(x)|^{p}$, $g(y) = |u_{n}(y)|^{p}$, $h(x-y) = |x-y|^{\alpha-N}$, we have

In addition, it is well known that

(see [28, Theorem 3]). By Hardy-Littlewood inequality and Riesz rearrangement inequality (see ^[28]),

By (3.6)–(3.8) we have

Therefore, we can further assume that $(u_{n}, v_{n})\in H_{r}$. By (3.3), we have that $\{(u_{n}, v_{n})\}$ is bounded in $H$, there exists $(u_{\beta}, v_{\beta})\in H$ and $u_{\beta}\ge 0$, $v_{\beta}\ge 0$ such that up to subsequences, $(u_{n}, v_{n})\rightharpoonup(u_{\beta}, v_{\beta})$ weakly in $H$. Moreover, we also can assume that $u_{n}\to u_{\beta}$, $v_{n}\to v_{\beta}$ a.e. in $\mathbb{R}^{N}$ and $(u_{\beta}, v_{\beta})\in H_{r}$. Since $\{(u_{n}, v_{n})\}_{n\in\mathbb{N}}\subset\mathcal{N}_{\beta}$, we have

By (2.4), we obtain

which means $u_{\beta}\not\equiv 0$ or $v_{\beta}\not\equiv 0$.

By (2.4) and Fatou's lemma, we have

Let $t > 0$ such that $(tu_{\beta}, tv_{\beta})\in\mathcal{N}_{\beta}$, we have

Hence,

Thus, we can deduce that $t = 1$ and $m_{\beta}$ is achieved by $(u_{\beta}, v_{\beta})\in \mathcal{N}_{\beta}$ with $u_{\beta}\ge0$, $v_{\beta}\ge0$. Now we know that $(u_{\beta}, v_{\beta})$ be non-negative and radial ground state solution of (1.1). Since (1.1) has no semitrivial solution, namely $(u_{\beta}, 0)$ and $(0, v_{\beta})$ are no solutions of (1.1), we infer that $u_{\beta}\not\equiv 0$ and $v_{\beta}\not\equiv 0$. By the strong maximum principle, we get $u_{\beta} > 0$ and $v_{\beta} > 0$, then $(u_{\beta}, v_{\beta})$ be positive and radial ground state solution of (1.1).

Next we consider the asymptotic behavior of the ground state solution.

Suppose $\{\beta_{n}\}$ be a sequence which satisfies $\beta_{n}\in(0, \min\{\frac{1}{2}, \sqrt{\lambda_{1}\lambda_{2}}\})$ and $\beta_{n}\to 0$ as $n\to\infty$. Let $(u_{\beta_{n}}, v_{\beta_{n}})$ be the positive radial ground state solution of (1.1) obtained above, we claim $\{(u_{\beta_{n}}, v_{\beta_{n}})\}$ is bounded in $H$. Indeed, let $\phi$, $\psi$ are the positive solutions of (1.3) and (1.4) respectively. By (iii) of Lemma 3.2, we have that $(t_{n}\phi, t_{n}\psi)\in \mathcal{N}_{\beta_{n}}$, where $0 < t_{n} < 1$. Hence, by (1.5) and (1.6), we have

Therefore, let $c_{0} = \min\{\frac{1}{2}, \sqrt{\lambda_{1}\lambda_{2}}\}$, for $n$ large enough, we have

from which we deduce that $\{(u_{\beta_{n}}, v_{\beta_{n}})\}$ is bounded in $H$. Thus, there exists $(u_{0}, v_{0})\in H$ such that, up to a subsequences, $(u_{\beta_{n}}, v_{\beta_{n}})\rightharpoonup (u_{0}, v_{0})$ in $H$ as $n\to\infty$ and $u_{0}\geq 0, v_{0}\geq 0$. Moreover by (3.2) we have that

is an increasing sequence and $\|(u_{\beta_{n}}, v_{\beta_{n}})\|_{H}^{2} > c_{1} > 0$, hence we have that $u_{0}\not\equiv 0$ or $v_{0}\not\equiv0$. It is easy to observe that $E'_{0}(u_{0}, v_{0}) = 0$, thus $u_{0}$, $v_{0}$ are the solutions of (1.3) and (1.4), respectively. Since

by Lemmas 2.1, 2.2, 2.5 and above equality (3.9), we can conclude that $(u_{\beta_{n}}, v_{\beta_{n}})\to (u_{0}, v_{0})$ in $H$ as $n\to\infty$.

In view of Lemma 2.7, we can assume that $u_{1}$, $v_{1}$ are positive ground state solutions to (1.3) and (1.4) respectively, and let $t_{n} > 0$ such that $(t_{n}u_{1}, t_{n}v_{1})\in \mathcal{N}_{\beta_{n}}$. In view of (iii) of Lemma 3.2, we know that $0 < t_{n} < 1$. Furthermore, by (3.1) we have that

is an increasing sequence and $t_{n} > t_{1} > 0$, then we know that $t_{n}\to 1$. Consequently, we have

Obviously $E_{0}(u_{0}, v_{0})$ is the sum of the energy of $u_{0}$ and $v_{0}$ for the single equation (1.3) and (1.4) respectively, namely

where $E_{0, 2}:H^{s}(\mathbb{R}^{N})\to \mathbb{R}$ is the energy functional of (1.4), which is defined similarly to $E_{0, 1}$, and $E_{0}(u_{1}, v_{1})$ is the sum of the energy of $u_{1}$ and $v_{1}$ for the single equation (1.3) and (1.4), respectively, namely

Since $u_{1}$, $v_{1}$ are positive ground state solutions to (1.3) and (1.4) respectively, we have

By (3.10), we get $E_{0, 1}(u_{0}) = E_{0, 1}(u_{1})$ and $E_{0, 2}(v_{0}) = E_{0, 2}(v_{1})$. By Lemma 2.7, we know that $u_{0}$, $v_{0}$ are positive ground state solutions of (1.3) and (1.4) respectively.

Let $u_{0}^{*}$ and $v_{0}^{*}$ denote the symmetric decreasing rearrangement of $u_{0}$ and $v_{0}$ respectively. By Lemma 2.6 with $f(x) = |u_{0}(x)|^{p}$, $g(y) = |u_{0}(y)|^{p}$, $h(x-y) = |x-y|^{\alpha-N}$, we have

In addition, we know that

(see [28, Theorem 3]). By (3.11) and (3.12) we have

Therefore, we can further assume that $(u_{0}, v_{0})\in H_{r}$. This completes the proof of Theorem 1.1.□

4.   Nonexistence

In this section, in order to prove the nonexistence of nontrivial solutions, we need to use the following Pohožaev identity type:

Lemma 4.1. Let $N\ge 3$ and $(u, v)\in H$ be any solution of (1.1). Then, $(u, v)$ satisfies the Pohožaev identity

Proof. The proof is similar to the argument of Theorem 1.13 in ^[22]. □

Proof of Theorem 1.2. Let $\langle E_{\beta}'(u, v), (u, v)\rangle = 0$, by (1.6), we have

for all $(u, v)\in H$.

Combining the Pohožaev identity (4.1) and (4.2), we can see that

Since $\lambda_{1} > 0$, $\lambda_{2} > 0$ and $0 < \beta < \sqrt{\lambda_{1}\lambda_{2}}$, we have

Thus, if both the coefficients are non-positive, that is

then we get $p\leq1+\frac{\alpha}{N}$, which jointly with (4.3) leads us to a contradiction. Therefore, the solution of (1.1) is the trivial one. Similarly, if they are nonnegative, that is $p\ge \frac{N+\alpha}{N-2s}$, we get that nontrivial solutions of (1.1) cannot exist. Therefore, the range of $1+\frac{\alpha}{N} < p < \frac{N+\alpha}{N-2s}$ is optimal for the existence of nontrival solutions of the problem (1.1). This completes the proof.

5.   Conclusions

In this present paper, we combine the critical point theory and variational method to investigate a class of coupled fractional systems of Choquard type. By using constrained minimization method and Hardy-Littlewood-Sobolev inequality, we establish the existence and asymptotic behaviour of positive ground state solutions of the systems. Furthermore, nonexistence of nontrivial solutions is also obtained. In the next work, we will focus on the research of normalized solutions to fractional couple Choquard systems.

Acknowledgments

This research was funded by the National Natural Science Foundation of China (61803236) and Natural Science Foundation of Shandong Province (ZR2018MA022).

Conflicts of interest

The authors declare that they have no conflicts of interest.