New integral inequalities using exponential type convex functions with applications

1.   Introduction

Boundary value problems for fractional-order pseudodifferential operators $P$, in particular where $P$ is a generalization of the fractional Laplacian $(-\Delta)^a$ ($0 < a < 1$), have currently received much interest in applications, such as in financial theory and probability (but also in mathematical physics and differential geometry), and many methods have been used, most often probabilistic or potential-theoretic methods.

The author has studied such problems by pseudodifferential methods in ^{[8,9,10,11,12,13]}, under the assumption that the operators satisfy a $\mu$-transmission condition at the boundary of the domain $\Omega \subset {\mathbb R}^n$, which allows to show regularity results for solutions of the Dirichlet problem in elliptic cases, to show integration by parts formulas, and much else.

In the present paper we consider translation-invariant pseudodifferential operators ($\psi$do's) $P = \operatorname{Op}(p(\xi))$ of order $2a > 0$ with homogeneous symbol $p(\xi)$, which are only taken to satisfy the top-order equation in the $\mu$-transmission condition (relative to the domain $\Omega = {\mathbb R}^n_+$), we call this the principal $\mu$-transmission condition. It is shown that they retain some of the features: The solution spaces for the homogeneous Dirichlet problem in the elliptic case equal the $\mu$-transmission spaces from ^[8] (in a setting of low-order Sobolev spaces), having a factor $x_n^\mu$. The integration by parts formula holds (even when $P$ is not elliptic):

when $u$ and $u'$ are in $x_n^\mu C^\infty (\overline{\mathbb R}^n_+)$ resp. $x_n^{\bar\mu '}C^\infty (\overline{\mathbb R}^n_+)$ ($\mu ' = 2a-\mu$) and compactly supported.

We also treat nonhomogeneous local Dirichlet problems with Dirichlet trace $\gamma _0(u/x_n^{\mu -1})$, and show how the above formula implies a "halfways" Green's formula where one factor has nonzero Dirichlet trace. $P$ can be of any positive order, and $\mu$ can be complex.

The results apply in particular to the operator $L = \operatorname{Op}(\mathcal A(\xi)+i\mathcal B(\xi))$ with $\mathcal A$ real, positive and even in $\xi$, $\mathcal B$ real and odd in $\xi$, which satisfies the principal $\mu$-transmission equation for a suitable real $\mu$. Hereby we can compensate for an error made in the recent publication ^[13] (see also ^[14]), where it was overlooked that $L$ may not satisfy the full $\mu$-transmission condition when $\mathcal B\ne 0$ (it does so for $\mathcal B = 0$). The general $L$ are now covered by the present work. They were treated earlier by Dipierro, Ros-Oton, Serrra and Valdinoci ^[5] under some hypotheses on $a$ and $\mu$; they come up in applications as infinitesimal generators of $\alpha$-stable $n$-dimensional Lévy processes, see ^[5]. (The calculations in ^[13] are valid when applied to operators satisfying the full $\mu$-transmission condition.)

The study of $x$-independent $\psi$do's $P$ on the half-space ${\mathbb R}^n_+$ serves as a model case for operators on domains $\Omega \subset {\mathbb R}^n$ with curved boundary and possible $x$-dependence, and can be expected to be a useful ingredient in the general treatment, as carried out for the operator $L$ in ^[5].

Plan of the paper: In Section 2 we give an overview of the aims and results of the paper with only few technicalities. Section 3 introduces the principal transmission condition in detail for homogeneous $\psi$do symbols. In Section 4, the Wiener-Hopf method is applied to derive basic decomposition and factorization formulas for such symbols. This is used in Section 5 to establish mapping properties for the operators, and regularity properties for solutions of the homogeneous Dirichlet problem in strongly elliptic cases; here $\mu$-transmission spaces (known from ^[8]) defined in an $L_2$-framework play an important role. Section 6 gives the proof of the above-mentioned integration by parts formula on ${\mathbb R}^n_+$. Section 7 treats nonhomogeneous local Dirichlet conditions, and a halfways Green's formula is established.

2.   Presentation of the main results

The study is concerned with the so-called model case, where the pseudodifferential operators have $x$-independent symbols, hence act as simple multiplication operators in the Fourier transformed space (this frees us from using the deeper composition rules needed for $x$-dependent symbols), and the considered open subset $\Omega$ of ${\mathbb R}^n$ is simplest possible, namely $\Omega = {\mathbb R}^n_+ = \{x\in {\mathbb R}^n\mid x_n > 0\}$. We assume $n\ge 2$ and denote $x = (x_1, \dots, x_n) = (x', x_n)$, $x' = (x_1, \dots, x_{n-1})$. Recall the formulas for the Fourier transform $\mathcal F$ and the operator $P = \operatorname{Op}(p(\xi))$:

We work in $L_2({\mathbb R}^n)$ and $L_2({\mathbb R}^n_+)$ and their derived $L_2$-Sobolev spaces (the reader is urged to consult (5.1) below for notation). On $L_2({\mathbb R}^n)$, the Plancherel theorem

makes norm estimates of operators easy. (There is more on Fourier transforms and distribution theory e.g., in ^[7].) The model case serves both as a simplified special case, and as a proof ingredient for more general cases of domains with curved boundaries, and possibly $x$-dependent symbols.

The symbols $p(\xi)$ we shall consider are scalar and homogeneous of degree $m = 2a > 0$ in $\xi$, i.e., $p(t\xi) = t^mp(\xi)$ for $t > 0$, and are $C^1$ for $\xi \ne 0$, defining operators $P = \operatorname{Op}(p)$.

A typical example is the squareroot Laplacian with drift:

where $\pmb b = (b_1, \dots, b_n)$ is a real vector. Here $m = 1$, $a = \frac12$. It satisfies the condition for strong ellipticity, which is:

this is important in regularity discussions. Some results are obtained without the ellipticity hypothesis; as an example we can take the operator $L_2$ with symbol

whose real part is zero e.g., when $\xi = (1, -1, 0, \dots, 0)$.

The operators are well-defined on the Sobolev spaces over ${\mathbb R}^n$: When $p$ is homogeneous of degree $m\ge 0$, there is an inequality

(we say that $p$ is of order $m$); then

so $P$ maps $H^m({\mathbb R}^n)$ continuously into $L_2({\mathbb R}^n)$. Similarly, it maps $H^{s+m}({\mathbb R}^n)$ continuously into $H^s({\mathbb R}^n)$ for all $s\in\mathbb R$.

But for these pseudodifferential operators it is not obvious how to define them relative to the subset ${\mathbb R}^n_+$, since they are not defined pointwise like differential operators, but by integrals (they are nonlocal). The convention is here to let them act on suitable linear subsets of $L_2({\mathbb R}^n_+)$, where we identify $L_2({\mathbb R}^n_+)$ with the set of $u\in L_2({\mathbb R}^n)$ that are zero on $\mathbb R^n_-$, i.e., have their support $\operatorname{supp}u\subset \overline{\mathbb R}^n_+$. (The support $\operatorname{supp}u$ of a function or distribution $u$ is the complement of the largest open set where $u = 0$. The operator that extends functions on ${\mathbb R}^n_+$ by zero on $\mathbb R^n_-$ is denoted $e^+$.) Then we apply $P$ and restrict to ${\mathbb R}^n_+$ afterwards; this is the operator $r^+P$. ($r^+$ stands for restriction from ${\mathbb R}^n$ to ${\mathbb R}^n_+$.)

Aiming for the integration by parts formula mentioned in the start, we have to clarify for which functions $u, u'$ the integrals make sense. It can be expected from earlier studies (^[5,10,20]) that the integral will be meaningful for solutions of the so-called homogeneous Dirichlet problem on ${\mathbb R}^n_+$, namely the problem

(where the latter condition can also be written $\operatorname{supp} u\subset \overline{\mathbb R}^n_+$). This raises the question of where $r^+P$ lands; which $f$ can be prescribed? Or, if $f$ is given in certain space, where should $u$ lie in order to hit the space where $f$ lies?

Altogether, we address the following three questions on $P$:

$(1)$ Forward mapping properties. From which spaces does $r^+P$ map into an $H^s$-space for $f$?

$(2)$ Regularity properties. If $u$ solves (2.7) with $f$ in an $H^s$-space for a high $s$, will $u$ then belong to a space with a similar high regularity?

$(3)$ Integration by parts formula for functions in spaces where $r^+P$ is well-defined.

It turns out that the answers to all three points depend profoundly on the introduction of so-called $\mu$-transmission spaces. To explain their importance, we turn for a moment to the fractional Laplacian which has a well-established treatment:

For the case of $(-\Delta)^a$, $0 < a < 1$, it was shown in ^[8] that the following space is relevant:

It has the property that $(-\Delta)^a$ maps it to $C^\infty (\overline{\mathbb R}^n_+)$; more precisely,

Here $\mathcal E'({\mathbb R}^n)$ is the space of distributions with compact support, so the intersection with this space means that we consider functions in $\mathcal E_a$ that are zero outside a compact set.

For Sobolev spaces, it was found in ^[8] that the good space for $u$ is the so-called $a$-transmission space $H^{a(t)}(\overline{\mathbb R}^n_+)$; here

for all $t\ge a$ (say). $\mathcal E_a(\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ is a dense subset of $H^{a(t)}(\overline{\mathbb R}^n_+)$. The definition of the space $H^{a(t)}(\overline{\mathbb R}^n_+)$ is recalled below in (2.15) and in more detail in Section 5.3; let us for the moment just mention that it is the sum of the space $\dot H^t(\overline{\mathbb R}^n_+)$ and a certain subspace of $x_n^a \overline H^{t-a}({\mathbb R}^n_+)$. This also holds when $a$ is replaced by a more general $\mu$.

For $(-\Delta)^a$, the $a$-transmission spaces provide the right answers to question (1), and they are likewise right for question (2) (both facts established in ^[8]), and there are integration by parts formulas for $(-\Delta)^a$ applied to elements of these spaces, ^[10,11].

The key to the proofs is the so-called $a$-transmission condition that $(-\Delta)^a$ satisfies; it is an infinite list of equations for $p(\xi)$ and its derivatives, linking the values on the interior normal to ${\mathbb R}^n_+$ with the values on the exterior normal. We formulate it below with $a$ replaced by a general $\mu$.

Definition 2.1. Let $\mu \in\mathbb C$, and let $p(\xi)$ be homogeneous of degree $m$. Denote the interior resp. exterior normal to the boundary of ${\mathbb R}^n_+$ by $(0, \pm 1) = \{(\xi ', \xi _n)\mid \xi ' = 0, \xi _n = \pm 1\}$.

$1^\circ$ $p$ (and $P = \operatorname{Op}(p)$) is said to satisfy the principal $\mu$-transmission condition at ${\mathbb R}^n_+$ if

$2^\circ$ $p$ (and $P = \operatorname{Op}(p)$) is said to satisfy the $\mu$-transmission condition at ${\mathbb R}^n_+$ if

Note that $\mu$ is determined from $p$ in (2.11) up to addition of an integer, when $p(0, 1)\ne 0$.

The operators considered on smooth domains $\Omega$ in ^[8] were assumed to satisfy (2.12) (for the top-order term $p_0$ in the symbol) at all boundary points $x_0\in \partial\Omega$, with $(0, 1)$ replaced by the interior normal $\nu$ at $x_0$, and $(0, -1)$ replaced by $-\nu$. The lower-order terms $p_j$ in the symbol, homogeneous of degree $m-j$, should then satisfy analogous rules with $m-j$ instead of $m$.

The principal $\mu$-transmission condition (2.11) is of course much less demanding than the full $\mu$-transmission condition (2.12). What we show in the present paper is that when (2.11) holds, the $\mu$-transmission spaces are still relevant, and provide the appropriate answers to both questions (1) and (2), however just for $t$ (the regularity parameter) in a limited range. This range is large enough that integration by parts formulas can be established, answering (3).

By simple geometric considerations one finds:

Proposition 2.2. $1^\circ$ When $p(\xi)$ is homogeneous of degree $m$, there is a $\mu \in \mathbb C$, uniquely determined modulo $\mathbb Z$ if $p(0, 1)\ne 0$, such that $\rm(2.11)$ holds.

$2^\circ$ If moreover, $p$ is strongly elliptic $\rm(2.4)$ and $m = 2a > 0$, $\mu$ can be chosen uniquely to satisfy $\mu = a+\delta$ with $|\operatorname{Re}\delta | < \frac12$.

This is shown in Section 3. From here on we work under two slightly different assumptions. The symbol $p(\xi)$ is in both cases taken homogeneous of degree $m = 2a > 0$ and $C^1$ for $\xi \ne 0$. We pose Assumption 3.1 requiring that $p$ is strongly elliptic and $\mu$ is chosen as in Proposition 2.2 $2^\circ$. We pose Assumption 3.2 just requiring that $\mu$ is defined according to Proposition 2.2 $1^\circ$. In all cases we write $\mu = a+\delta$, and define $\mu ' = a-\delta = 2a-\mu$.

Example 2.3. Consider $\mathcal L_1 = |\xi |+i\pmb b\cdot \xi$ defined in (2.3). The order is $1 = m = 2a$, so $a = \frac12$. Here $\mathcal L_1(0, 1) = 1+ib_n$ and $\mathcal L_1(0, -1) = 1-ib_n$. The angle $\theta$ in $\mathbb C = \mathbb R^2$ between the positive real axis and $1+ib_n$ is $\theta = \operatorname{Arctan}b_n$. Set $\delta = \theta /\pi$, then

Moreover,

so (2.11) holds with $m = 2a = 1$, $\mu = \frac12+\delta$, where $\delta = \frac1\pi \operatorname{Arctan}b_n$, and Assumption 3.1 is satisfied. Note that $\delta \in \, ]-\frac12, \frac12[\,$.

For $\mathcal L_2$ in (2.5), the values at $(0, 1)$ and $(0, -1)$ are the same as the values for $\mathcal L_1$, so (2.11) holds with the same values, and Assumption 3.2 is satisfied. But not Assumption 3.1 since $\mathcal L_2$ is not strongly elliptic.

When $b_n\ne 0$, hence $\delta \ne 0$, neither of these symbols satisfy the full $\mu$-transmission condition Definition 2.1 $2^\circ$, since second derivatives remove the $(i\pmb b\cdot \xi)$-term so that the resulting symbol is even (with $\mu = a+\delta$ replaced by $\mu = a$). $

Our answer to (1) is now the following (achieved in Section 5.4):

Theorem 2.4. Let $P$ satisfy Assumption $3.2$. For $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$, $r^+P$ defines a continuous linear mapping

It is important to note that $r^+P$ then also makes good sense on subsets of $H^{\mu (t) }(\overline{\mathbb R}^n_+)$. In particular, since $\mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ is a subset of $H^{\mu (t)}(\overline{\mathbb R}^n_+)$ for all $t$, the operator $r^+P$ is well-defined on $\mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, mapping it into $\bigcap_{t < \operatorname{Re}\mu +\frac32} \overline H^{t-2a }({\mathbb R}^n_+)\subset \overline H^{\operatorname{Re}\delta +\frac32-a-\varepsilon }({\mathbb R}^n_+)$, any $\varepsilon > 0$, by (2.13). When $\operatorname{Re}\delta > -\frac12$ (always true under Assumption 3.1), this is assured to be contained in $\overline H^{1-a }({\mathbb R}^n_+)$.

Our answer to (2) is (cf. Section 5.4):

Theorem 2.5. Let $P$ satisfy Assumption $3.1$. Then $P = \widehat P+P'$, where $P'$ is of order $2a-1$, and $r^+\widehat P$ is a bijection from $H^{\mu (t) }(\overline{\mathbb R}^n_+)$ to $\overline H^{t -2a }({\mathbb R}^n_+)$ for $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$. In other words, there is unique solvability of $\rm(2.7)$ with $P$ replaced by $\widehat P$, in the mentioned spaces.

For $r^+P$ itself, there holds the regularity property: Let $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$, let $f\in \overline H^{t-2a}({\mathbb R}^n_+)$, and let $u\in \dot H^{\sigma }(\overline{\mathbb R}^n_+)$ (for some $\sigma > \operatorname{Re}\mu -\frac12$) solve the homogeneous Dirichlet problem $\rm(2.7).$ Then $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$.

The last statement shows a lifting of the regularity of $u$ in the elliptic case, namely if it solves (2.7) lying in a low-order space $\dot H^{\sigma }(\overline{\mathbb R}^n_+)$, then it is in the best possible $\mu$-transmission space according to Theorem 2.4, mapping into the given range space $\overline H^{t-2a}(\overline{\mathbb R}^n_+)$. In other words, the domain of the homogeneous Dirichlet problem with range in $\overline H^{t-2a}(\overline{\mathbb R}^n_+)$ equals $H^{\mu (t)}(\overline{\mathbb R}^n_+)$.

The strategy for both theorems is, briefly expressed, as follows: The first step is to replace $P = \operatorname{Op}(p(\xi))$ by $\widehat P = \operatorname{Op}(\widehat p(\xi))$, where $\widehat p(\xi)$ is better controlled at $\xi ' = 0$ and $p'(\xi) = p(\xi)-\widehat p(\xi)$ is $O(|\xi |^{2a-1})$ for $|\xi |\to \infty$. The second step is to reduce $\widehat P$ to order 0 by composition with "plus/minus order-reducing operators" $\Xi ^t_\pm = \operatorname{Op}((\langle {{\xi '}} \rangle\pm i\xi _n)^t)$ ((3.11), (5.2)) geared to the value $\mu$ (recall $\mu ' = 2a-\mu$):

Then the homogeneous symbol $q$ associated with $\widehat Q$ satisfies the principal $0$-transmission condition. The third step is to decompose $\widehat Q$ into a sum (when Assumption 3.2 holds) or a product (when Assumption 3.1 holds) of operators whose action relative to the usual Sobolev spaces $\dot H^s(\overline{\mathbb R}^n_+)$ and $\overline H^s({\mathbb R}^n_+)$ can be well understood, so that we can show forward mapping properties and (in the strongly elliptic case) bijectiveness properties for $\widehat Q$. The fourth step is to carry this over to forward mapping properties and (in the strongly elliptic case) bijectiveness properties for $\widehat P$. The fifth and last step is to take $P' = P-\widehat P$ back into the picture and deduce the forward mapping resp. regularity properties for the original operator $P$.

It is the right-hand factor $\Xi _+^{-\mu }$ in (2.14) that is the reason why the $\mu$-transmission spaces, defined by

enter. Here $e^+ \overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ has a jump at $x_n = 0$ when $t > \operatorname{Re}\mu +\frac12$, and then the coefficient $x_n^\mu$ appears.

The analysis of $\widehat Q$ is based on a Wiener-Hopf technique (cf. Section 4) explained in Eskin's book ^[6], instead of the involvement of the extensive Boutet de Monvel calculus used in ^[8].

An interesting feature of the results is that the $\mu$-transmission spaces have a universal role, depending only on $\mu$ and not on the exact form of $P$.

Finally, we answer (3) by showing an integration by parts formula, based just on Assumption 3.2.

Theorem 2.6. Let $P$ satisfy Assumption $3.2$, and assume moreover that $\operatorname{Re}\mu > -1$, $\operatorname{Re}\mu' > -1$. For $u\in \mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, $u'\in \mathcal E_{\bar\mu '} (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, there holds

where $s_0 = e^{-i\pi \delta }p(0, 1)$. The formula extends to $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$, $u'\in H^{\bar\mu '(t')}(\overline{\mathbb R}^n_+)$, for $t > \operatorname{Re}\mu +\frac12$, $t' > \operatorname{Re}\mu '+\frac12$.

The integrals over ${\mathbb R}^n_+$ in (2.16) are interpreted as dualities when needed. The basic step in the proof is the treatment of one order-reducing operator in Proposition 6.1, by an argument shown in detail in [10,Th. 3.1,Rem. 3.2], and recalled in [13,Th. 4.1].

In the proof of (2.16) in Section 6, the formula is first shown for the nicer operator $\widehat P$, and thereafter extended to $P$. (The formula (2.16) for $(-\Delta)^a$ in Ros-Oton and Serra [20,Th. 1.9] should have a minus sign on the boundary contribution; this has been corrected by Ros-Oton in the survey [19,p. 350].)

The theory will be carried further, to include "large" solutions of a nonhomogeneous local Dirichlet problem, and to show regularity results and a "halfways Green's formula", see Section 7, but we shall leave those aspects out of this preview.

The example $L_1$ in (2.3) is a special case of the operator $L = \operatorname{Op}(\mathcal L(\xi))$, where $\mathcal L(\xi) = \mathcal A(\xi)+i\mathcal B(\xi)$ with $\mathcal A(\xi)$ real, even in $\xi$ and positive, and $\mathcal B(\xi)$ real and odd in $\xi$. There are more details below in (3.5)ff. (this stands for (3.5) and the near following text) and Examples 5.9, 6.5, 7.4. $L$ was first studied in ^[5] (under certain restrictions on $a$ and $\mu$), and our results apply to it. Theorem 2.6 gives an alternative proof for the same integration by parts formula, established in [5,Prop. 1.4] by extensive real function-theoretic methods.

The result on the integral over ${\mathbb R}^n_+$ is combined in ^[5] with localization techniques to get an interesting result for curved domains, and it is our hope that the present results for more general strongly elliptic operators can be used in a similar way.

3.   The principal mu-transmission condition

3.1.   Analysis of homogeneous symbols

Let $p(\xi)$ be a complex function on ${\mathbb R}^n$ that is homogeneous of degree $m$ in $\xi$, and let $\nu \in {\mathbb R}^n$ be a unit vector. For a complex number $\mu$, we shall say that $p$ satisfies the principal $\mu$-transmission condition in the direction $\nu$, when

When $p(\nu)\ne 0$, we can rewrite (3.1) as

where $\log$ is a complex logaritm. This determines the possible $\mu$ up to addition of an integer.

The (full) $\mu$-transmission property defined in ^[8] demands much more, namely that

Besides assuming infinite differentiability, this is a stronger condition than (3.1) in particular because of the requirements it puts on derivatives of $p$ transversal to $\nu$.

To analyse this we observe that when a (sufficiently smooth) function $f(t)$ on $\mathbb R\setminus \{0\}$ is homogeneous of degree $m\in\mathbb R$, then it has the form, for some $c_1, c_2\in\mathbb C$,

and its derivative outside $t = 0$ is a function homogeneous of degree $m-1$ satisfying

In particular, if $c_1\ne 0$, $m\ne 0$,

In the case $m = 0$, $f$ is constant for $t > 0$ and $t < 0$, and the derivative is zero there.

Thus, when $p(\xi)$ is a (sufficiently smooth) function on ${\mathbb R}^n\setminus\{0\}$ that is homogeneous of degree $m \ne 0$, and we consider it on a two-sided ray $\{t\nu \mid t\in\mathbb R\}$ where $\nu$ is a unit vector and $p(\nu)\ne 0$, then

So for example, when $\nu$ is the inward normal $(0, 1) = \{(\xi ', \xi _n)\mid \xi ' = 0, \xi _n = 1\}$ to ${\mathbb R}^n_+$,

For $p(\xi)$ satisfying (3.1), this means that when $p(\nu)\ne 0$, it will also satisfy

in view of (3.3). This argument can be repeated, showing that

as long as the derivatives at $t = 1$ do not vanish. That can happen when $m$ is a nonnegative integer (namely from the $(m+1)$'st step on); then (3.4) is trivially satisfied. On the other hand, we cannot infer that derivatives of $\partial_\xi ^\alpha p$ for arbitrary $\alpha$ have the property (3.2); this will be illustrated in examples below.

In general, $\mu$ takes different values for different $\nu$. When $\Omega$ is a sufficiently smooth subset of ${\mathbb R}^n$ with interior normal $\nu (x)$ at boundary points $x\in\partial\Omega$, we say that $p$ satisfies the principal $\mu$-transmission condition at $\Omega$ if $\mu (x)$ is a function on $\partial\Omega$ such that (3.1) holds with this $\mu (x)$ at boundary points $x\in\partial\Omega$. For $\Omega = {\mathbb R}^n_+$, the normal $\nu$ equals $(0, 1)$ at all boundary points and $\mu$ is a constant; this is the situation considered in the present paper.

In ^[13] we have studied a special class of symbols first considered by Dipierro, Ros-Oton, Serra and Valdinoci in ^[5]:

the functions being $C^\infty$ for $\xi \ne 0$ and homogeneous in $\xi$ of degree $2a > 0$ ($a < 1$), and where $\mathcal A(\xi)$ is real and even in $\xi$ (i.e., $\mathcal A(-\xi) = \mathcal A(\xi)$), $\mathcal B(\xi)$ is real and odd in $\xi$ (i.e., $\mathcal B(-\xi) = -\mathcal B(\xi)$), and $\mathcal L$ is strongly elliptic (i.e., $\mathcal A(\xi) > 0$ for $\xi \ne 0$). As shown in [13,Sect. 2], $\mathcal L$ satisfies (3.1) on each unit vector $\nu$, for $m = 2a$ and

this follows straightforwardly (as in Example 2.3) from the observation that $\mathcal L(-\nu)/\mathcal L(\nu) = (1-ib)/(1+ib)$, $b = B(\nu)/\mathcal A(\nu)$. It then also satisfies (3.4) with this $\mu$.

But the full $\mu$-transmission condition need not hold. For example, the symbol $\mathcal L_1(\xi) = |\xi |+i\pmb b\cdot \xi$ in (2.3) (with $\pmb b\in {\mathbb R}^n$) satisfies the principal $\mu$-transmission condition for $\nu = (0, 1)$ with $\mu = \frac12+\delta$, $\delta\ne 0$ if $b_n\ne 0$, whereas

and its derivatives satisfy the conditions in (3.2) for $\nu = (0, 1)$ with $\mu$ replaced by $\frac12$.

The statement in [13,Th. 3.1] that solutions of the homogeneous Dirichlet problem have a structure with the factor $x_n^\mu$, was quoted from ^[8] based on the full $\mu$-transmision condition, and therefore applies to $L = \operatorname{Op}(\mathcal L)$ when $\mathcal B = 0$ (a case belonging to ^[8]), but not in general when $\mathcal B \ne 0$. Likewise, the integration by parts formulas for $L$ derived in ^[13] using details from the Boutet de Monvel calculus are justified when $\mathcal B = 0$ or when other operators $P$ satisfying the full $\mu$-transmission condition are inserted, but not in general when $\mathcal B\ne 0$. Fortunately, there are cruder methods that do lead to such results, on the basis of the principal $\mu$-transmission condition alone, and that is what we show in this paper.

The treatment of $\mathcal L$ will be incorporated in a treatment of general strongly elliptic homogeneous symbols in the following. This requires that we allow complex values of $\mu$.

Let $P = \operatorname{Op}(p(\xi))$ be defined by (2.1) from a symbol $p(\xi)$ that is $C^1$ for $\xi \ne 0$, homogeneous of order $m = 2a > 0$, and now also strongly elliptic (2.4). To fix the ideas, we shall consider the operator relative to the set ${\mathbb R}^n_+$, with interior normal $\nu = (0, 1)$. Denote $p(\xi)|\xi |^{-2a} = p_1(\xi)$; it is homogeneous of degree 0. Both $p$ and $p_1$ take values in a closed subsector of $\{z\in\mathbb C\mid \operatorname{Re}\xi _n > 0\}\cup \{0\}$. For any $\xi '\in \mathbb R^{n-1}$, one has for $+1$ and $-1$ respectively,

With the logarithm $\log z$ defined to be positive for real $z > 1$, with a cut along the negative real axis, denote $\log p(0, \pm 1) = \alpha _\pm$; here $\operatorname{Re}\alpha _\pm = \log|p(0, \pm 1)|$ and $\operatorname{Im}\alpha _\pm$ is the argument of $p(0, \pm 1)$. With this notation,

so (3.1) for $m = 2a$ holds with $\nu = (0, 1)$ when $\alpha _–\alpha _+ = i\pi (2a-2\mu)$, i.e.,

this $\mu$ is the factorization index. These calculations were given in [8,Sect. 3] (with $m = 2a$), and are in principle consistent with the determination of the factorization index by Eskin in [6,Ex. 6.1] (which has different plus/minus conventions because of a different definition of the Fourier transform).

Since $p(\xi)$ takes values in $\{\operatorname{Re}z > 0\}$ for $\xi \ne 0$, both $p(0, 1)$ and $p(0, -1)$ lie there and the difference between their arguments is less than $\pi$, so $|\operatorname{Im}(\alpha _+-\alpha _-)/2\pi | < \frac12$; in other words

Note that $\delta$ is real in the case (3.5).

We collect the information on $P$ in the following description:

Assumption 3.1. The operator $P = \operatorname{Op}(p(\xi))$ is defined from a symbol $p(\xi)$ that is $C^1$ for $\xi \ne 0$, homogeneous of order $m = 2a > 0$, and strongly elliptic $\rm(2.4)$. It satisfies the principal $\mu$-transmission condition in the direction $(0, 1)$:

with $\mu$ equal to the factorization index $\mu = a+\delta$ derived around $\rm(3.7)$, and $|\operatorname{Re}\delta | < \tfrac12$. Denote $\mu ' = 2a-\mu = a-\delta$.

In Eskin's book ^[6], the case of constant-coefficient pseudodifferential operators considered on ${\mathbb R}^n_+$ is studied in $\S\S$–17, and the calculations rely on the principal transmission condition up to and including $\S$. From $\S$ on, additional conditions on transversal derivatives are required (the symbol class $D^{(0)}_{\alpha +i\beta }$ seems to correspond to our full 0-transmission condition, giving operators preserving smoothness up to the boundary). In the following, we draw on some of the points made in $\S\S$–7 there.

For an operator $A$ defined from a homogeneous symbol $a(\xi)$, the behavior at zero can be problematic to deal with. In [6,§7], there is introduced a technique that leads to a nicer operator, in the context of operators relative to ${\mathbb R}^n_+$: One eliminates the singularity at $\xi ' = 0$ by replacing the homogeneous symbol $a(\xi ', \xi _n)$ by

the corresponding operator denoted $\widehat A$. (In comparison with ^[6] we have replaced the factor $1+|\xi '|$ used there by $\langle {{\xi '}} \rangle = (1+|\xi '|^2)^{\frac12}$.) It is shown there that when $a(\xi)$ is homogeneous of degree $\alpha +i\beta$, then

hence is of lower order in a certain sense. Many results with Sobolev estimates are then shown primarily for the "hatted" version $\widehat A = \operatorname{Op}(\widehat a)$, and supplied afterwards with information on $A' = \operatorname{Op}(a')$. Indeed, we shall see that the results we are after for our operators $P = \operatorname{Op}(p)$, can be obtained in a manageable way for $\widehat P = \operatorname{Op}(\widehat p)$, and then extended to $P$ by a supplementing analysis of $P'$. The important thing is that special properties with respect to $\xi _n$, such as holomorphic extendability into $\mathbb C_+$ or $\mathbb C_-$, are not disturbed when $a$ is replaced by $\widehat a$.

Some of the results that we shall show do not require ellipticity of $P$. We therefore introduce also a weaker assumption:

Assumption 3.2. The operator $P = \operatorname{Op}(p(\xi))$ is defined from a symbol $p(\xi)$ that is $C^1$ for $\xi \ne 0$, homogeneous of order $m = 2a > 0$, and satisfies the principal $\mu$-transmission condition in the direction $(0, 1)$ with $\mu = a+\delta$ for some $\delta \in\mathbb C$. Denote $a-\delta = \mu '$.

For the symbols $p$ considered in the rest of the paper, we assume at least that Assumption 3.2 holds. As noted earlier, when $P$ satisfies (3.1) for some $\mu$, it also does so with $\mu$ replaced by $\mu +k$, $k\in\mathbb Z$. The precision in Assumption 3.1, that $\mu$ should equal the factorization index, is needed for elliptic solvability statements.

3.2.   Reduction to symbols of order zero

Consider the symbols of "order-reducing" operators (more on them in Section 5):

the last entry is the usual notation. Together with our symbol $p(\xi)$ of order $2a$, we shall consider its reduction to a symbol $q$ of order 0 defined by:

The "hatted" version is:

Here $q$ is continuous and homogeneous of degree 0 for $\xi \ne 0$; it is $C^1$ in $\xi _n$ there, and $C^1$ in $\xi '$ for $\xi '\ne 0$ with bounded first derivatives on $|\xi | = 1$. Since $i = e^{i\pi /2}$,

so $q$ satisfies the principal 0-transmission condition in the direction $\nu = (0, 1)$:

In view of (3.1)–(3.4), we have moreover when $p(0, 1)\ne 0$ that

Note that since $\mu -a = \delta$, $q(0, 1) = e^{-i\pi \delta }p(0, 1)$. We shall denote

In the case $p = \mathcal L$ in (3.5)–(3.6), $\mathcal L(0, 1) = e^{i\pi \delta }|\mathcal L(0, 1)|$ with $\delta$ real, so

4.   The Wiener-Hopf decomposition

4.1.   The sum decomposition

Since $p(\xi)$ is only assumed to satisfy the principal $\mu$-transmission condition, $q(\xi)$ will in general only satisfy the principal $0$-transmission condition, not the full one, so the techniques of the Boutet de Monvel calculus brought forward in ^[8] are not available. Instead we go back to a more elementary application of the original Wiener-Hopf method ^[22].

When $b(\xi _n)$ is a function on $\mathbb R$, denote

when the integrals have a sense. When $b$ is suitably nice, $b_+$ is holomorphic in $\xi _n+i\tau$ for $\tau < 0$ and extends to a continuous function on $\overline{\mathbb C}_-$ (also denoted $b_+$), $b _-$ has these properties relative to $\overline{\mathbb C}_+$, and $b(\xi _n) = b_+(\xi _n)+b_-(\xi _n)$ on $\mathbb R$. With the notation of spaces $H$, $H^\pm$ introduced by Boutet de Monvel in ^[4], denoted $\mathcal H$, $\mathcal H^\pm$ in our subsequent works, the decomposition holds for $b\in \mathcal H$ with $b_{\pm}\in \mathcal H^\pm$ on $\mathbb R$. Since we are presently dealing with functions with cruder properties, we shall instead apply a useful lemma shown in [6,Lemma 6.1]:

Lemma 4.1. Suppose that $b(\xi ', \xi _n)$ is homogeneous of degree $0$ in $\xi$, is $C^1$ for $\xi '\ne 0$, and satisfies

Then the function defined for $\tau < 0$ by

is holomorphic with respect to $\xi _n+i\tau$ in $\mathbb C_-$, is homogeneous of degree $0$, extends by continuity with respect to $(\xi ', \xi _n+ i\tau)\in \overline{\mathbb C}_-$ for $|\xi |+|\tau | > 0$, $\tau \le 0$, and satisfies the estimate

There is an analogous statement for $b_-$ with $\mathbb C_-$ replaced by $\mathbb C_+$.

The symbol $q$ derived from $p$ by (3.12) satisfies

where $f$ is likewise homogeneous of degree 0, and has $f(0, 1) = f(0, -1) = 0$. We make two applications of Lemma 4.1. One is, under Assumption 3.2, to apply it directly to $f$ to get a sum decomposition $f = f_++f_-$ where the terms extend holomorphically to $\mathbb C_-$ resp. $\mathbb C_+$ with respect to $\xi _n$; this will be convenient in establishing the forward mapping properties and integration by parts formula for the present operators. The other is, under Assumption 3.1, to apply the lemma to the function $b(\xi) = \log q(\xi)$ to get a sum decomposition of $b$ and hence a factorization of $q$; this is used to show that $P$ has appropriate solvability properties (the solutions exhibiting a singularity $x_n^\mu$ at the boundary).

We show that $f$ has the properties required for Lemma 4.1 as follows: To see that (4.2) is verified by $f$, note that the second inequality follows since $\partial_jf$ is bounded on the unit sphere $\{|\xi | = 1\}$ and homogeneous of degree $-1$. For the first inequality we have, when $\xi _n > |\xi '|$ (hence $|\xi '/\xi _n| < 1$),

using the mean value theorem and the fact that $|\xi _n|\sim |\xi |$ when $|\xi _n|\ge |\xi '|$. A similar estimate is found for $\xi _n < -|\xi '|$. For $|\xi _n|\le |\xi '|$, we use that $q$ is bounded, so that $|q(\xi)-s_0||\xi |/|\xi '|\le c |q(\xi)-s_0||\xi '|/|\xi '|\le c'$. We have obtained:

Proposition 4.2. When $p$ satisfies Assumption $3.2$ and $q$ is derived from $p$ by $\rm(3.12)$, then there is a sum decomposition of $f = q-s_0$:

where $f_+(\xi ', \xi _n)$ is holomorphic with respect to $\xi _n+i\tau$ in $\mathbb C_-$, and continuous with respect to $(\xi ', \xi _n+ i\tau)\in \overline{\mathbb C}_-$ for $|\xi |+|\tau | > 0$, $\tau \le 0$, and satisfies estimates

and $f_-$ has the analogous properties with $\mathbb C_-$ replaced by $\mathbb C_+$.

For the corresponding hatted symbol, we then have $\widehat q = s_0+\widehat f_+ +\widehat f_-$, with $\widehat f_\pm$ defined from $f_\pm$. They have similar holomorphy properties, and satisfy estimates as in (4.6) with $|\xi '|$ replaced by $\langle {{\xi '}} \rangle$.

4.2.   The product decomposition

In order to obtain a factorization for symbols satisfying Assumption 3.1, we shall study $\log q$. By the strong ellipticity, $q(\xi)\ne 0$ for $\xi \ne 0$. Moreover, $p (\xi)|\xi |^{-2a} = \chi _{0, -}^{-a}p(\xi)\chi _{0, +}^{-a}$ takes values in a subsector of $\{z\in\mathbb C\mid\operatorname{Re}z > 0\}$ and the multiplication by $\chi _{0, -}^{\delta }$ and $\chi _{0, +}^{-\delta }$ gives the function $q$ taking values in the sector $\{z\in\mathbb C\mid |\arg z|\le \pi(\frac12+|\operatorname{Re}\delta |)\}$ disjoint from the negative real axis. So the logarithm is well-defined with inverse exp.

Assume first that $s_0 = 1$; this can simply be obtained by dividing out $q(0, 1)$. The function $b(\xi) = \log q(\xi)$ is homogeneous of degree 0 and has $b(0, 1) = b(0, -1) = 0$ and the appropriate continuity properties, and bounds on first derivatives, so the same proof as for $f$ applies to $b$ to give the decomposition $b = b_++b_-$. Then we define $q^\pm = \exp (b_\pm)$, they are homogeneous of degree 0. For example,

Here $|b_+(\xi)|\le C_\varepsilon |\xi '|^{1-\varepsilon }|\xi |^{-1+\varepsilon }$, and there is a constant $C'_\varepsilon$ such that $C_\varepsilon |\xi '|^{1-\varepsilon }|\xi |^{-1+\varepsilon }\le \frac12$ for $|\xi _n|\ge C'_\varepsilon |\xi '|$. On this set the series for $g^+$ converges with $|g^+|\le |b_+|$, hence $g^+$ satisfies an estimate of the form (4.4) there. It likewise does so on the set $|\xi _n|\le C'_\varepsilon |\xi '|$ since $|\xi '|\sim |\xi |$ there. There are similar results for $q^- = \exp (b_-) = 1+g^-$ with $\mathbb C_-$ replaced by $\mathbb C_+$. This shows:

Proposition 4.3. When $p$ satisfies Assumption $3.1$ and $q$ is derived from $p$ by $\rm(3.12)$ and satisfies $s_0 = 1$, then there is a factorization of $q$:

where $q^+(\xi ', \xi _n)$ is holomorphic with respect to $\xi _n+i\tau$ in $\mathbb C_-$, and continuous with respect to $(\xi ', \xi _n+ i\tau)\in \overline{\mathbb C}_-$ for $|\xi |+|\tau | > 0$, $\tau \le 0$. Moreover, $g^+ = q^+-1$ satisfies estimates

and $q^-$, $g^- = q^–1$ have the analogous properties with $\mathbb C_-$ replaced by $\mathbb C_+$. The symbols are homogeneous of degree $0$, and $q^+$ and $q^-$ are elliptic.

For general $s_0$, we apply the factorization to $q_0 = s_0^{-1}q$, so that $q_0 = q_0^-q_0^+$; then $q = q^-q^+$ with $q^- = s_0q_0^- = s_0(1+g^-)$ and $q^+ = q_0^+ = 1+g^+$.

The ellipticity follows from the construction as $\exp({b_\pm})$, or one can observe that the product $q^+q^- = q$ is elliptic (i.e., nonzero for $\xi \ne 0$).

The notation with upper index $\pm$ is chosen here to avoid confusion with the lower $+$ used later to indicate truncation, $P_+ = r^+Pe^+$.

Turning to the corresponding hatted symbols, we have obtained $\widehat q = \widehat q^- \widehat q^+$, with $\widehat q^\pm$, $\widehat g^\pm$ defined from $q^\pm$, $g^\pm$, respectively. They have similar holomorphy properties, the $\widehat q^\pm$ are elliptic, and the $\widehat g^\pm$ satisfy estimates as in (4.7) with $|\xi '|$ replaced by $\langle {{\xi '}} \rangle$:

5.   Mapping properties and the homogeneous Dirichlet problem

5.1.   Some function spaces

First recall some terminology: $\mathcal E'({\mathbb R}^n)$ is the space of distributions on ${\mathbb R}^n$ with compact support, $\mathcal S({\mathbb R}^n)$ is the Schwartz space of $C^\infty$-functions $f$ on ${\mathbb R}^n$ such that $x^\beta D ^\alpha f$ is bounded for all $\alpha, \beta$, and $\mathcal S'({\mathbb R}^n)$ is its dual space of temperate distributions. $\langle {\xi} \rangle$ stands for $(1+|\xi |^2)^\frac12$. We denote by $r^+$ the operator restricting distributions on ${\mathbb R}^n$ to distributions on ${\mathbb R}^n_+$, and by $e^+$ the operator extending functions on ${\mathbb R}^n_+$ by zero on ${\mathbb R}^n\setminus {\mathbb R}^n_+$. Then $r^+\mathcal S({\mathbb R}^n)$ is denoted $\mathcal S(\overline{\mathbb R}^n_+)$. The following notation for $L_2$-Sobolev spaces will be used, for $s\in\mathbb R$:

as in our earlier papers on fractional-order operators. An elaborate presentation of $L_p$-based spaces was given in ^[8]. (The notation with dots and overlines stems from Hörmander [17,App. B.2] and is practical in formulas where both types of spaces occur. There are other notations without the overline, and where the dot is replaced by a ring or twiddle.)

Here $\overline H^s({\mathbb R}^n_+)$ identifies with the dual space of $\dot H^{-s}(\overline{\mathbb R}^n_+)$ for all $s\in\mathbb R$ (the duality extending the $L_2({\mathbb R}^n_+)$ scalar product). When $|s| < \frac12$, there is an identification of $\dot H^s(\overline{\mathbb R}^n_+)$ with $\overline H^s({\mathbb R}^n_+)$ (more precisely with $e^+ \overline H^s({\mathbb R}^n_+)$). The trace operator $\gamma _0\colon u\mapsto \lim_{x_n\to 0+}u(x', x_n)$ extends to a continuous mapping $\gamma _0\colon \overline H^s({\mathbb R}^n_+)\to H^{s-\frac12}(\mathbb R^{n-1})$ for $s > \frac12$.

The order-reducing operators $\Xi _\pm^t$ are defined for $t\in{\mathbb C}$ by $\Xi _\pm^t = \operatorname{Op}(\chi _\pm^t)$, where $\chi _\pm^t = (\langle {{\xi '}} \rangle\pm i\xi _n)^t$, cf. (3.11). These operators have the homeomorphism properties:

$r^+\Xi ^{ t }_{-}e^+$ is often denoted $\Xi ^{ t}_{-, +}$ for short. For each $t\in\mathbb C$, the operators $\Xi ^t _{+}$ and $\Xi ^{\overline t}_{-, +}$ identify with each other's adjoints over $\overline{\mathbb R}^n_+$ (more comments on this in [8,Rem. 1.1]). Recall also the simple composition rules (as noted e.g., in [15,Th. 1.2]):

We define

and $\mathcal E_\mu (\overline{\mathbb R}^n_+)$ is defined successively as the linear hull of first-order derivatives of elements of $\mathcal E_{\mu +1}(\overline{\mathbb R}^n_+)$ when $\operatorname{Re}\mu \le -1$ (then distributions supported in the boundary can occur). The spaces were introduced in Hörmander's unpublished lecture notes ^[16] and are presented in ^[8] (and with a different notation in [17,Sect. 18.2]), and they satisfy for all $\mu$ (cf. [8,Props. 1.7,4.1]):

A sharper statement follows from [13,Lemma 6.1] (when $\operatorname{Re}\mu > -1$):

5.2.   Mapping properties of the zero-order operator in Sobolev spaces

Let $P$ satisfy Assumption 3.1, and consider $\widehat Q^{\pm} = \operatorname{Op}(\widehat q^{\pm})$, defined from the symbols $q^{\pm}(\xi)$ introduced in Proposition 4.3. Since $\widehat q^\pm$ are bounded symbols with bounded inverses, and extend holomorphically in $\xi _n$ into $\mathbb C_-$ resp. $\mathbb C_+$,

the latter follows since $r^+\widehat Q^-e^+$ is the adjoint of $\operatorname{Op}(\overline{\widehat q^-})$ over ${\mathbb R}^n_+$, where $\operatorname{Op}(\overline{\widehat q^-})$ defines homeomorphisms in $\dot H^s(\overline{\mathbb R}^n_+)$ (since $\overline{\widehat q^-}$ has similar properties as $\widehat q^+$). The inverses $(\widehat Q^{\pm})^{-1} = \operatorname{Op}((\widehat q^\pm)^{\, -1})$ have similar homeomorphism properties. Since $\overline H^s ({\mathbb R}^n_+) = \dot H^s (\overline{\mathbb R}^n_+)$ for $|s| < \frac12$, it follows that we also have for $|s| < \tfrac12$:

If $q$ satisfies the full 0-transmission condition, we are in the case studied in ^[8], and the bijectiveness in $\overline H^s({\mathbb R}^n_+)$ can be lifted to all higher $s$ by use of elements of the Boutet de Monvel calculus, as accounted for in the proof of [8,Th. 4.4]. The symbol $q$ presently considered is only known to satisfy the principal 0-transmission condition (and possibly a few more identities). We shall here show that a lifting is possible in general up to $s < \frac32$.

Proposition 5.1. Let $P$ satisfy Assumption $3.1$, and consider $\widehat Q^+ = \operatorname{Op}(\widehat q^+)$ derived from it in Section $\rm {4}$.

For any $-\frac12 < s < \frac32$, $\widehat Q^+_+ = r^+\widehat Q^+e^+$ is continuous

and the same holds for the operator $((\widehat Q^+)^{-1})_+$ defined from its inverse $(\widehat Q^+)^{-1}$.

In fact, $\rm(5.7)$ is a homeomorphism, and the inverse of $\widehat Q^+_+$ is $((\widehat Q^+)^{-1})_+$.

Proof. We already have the mapping property (5.7) for $|s| < \frac12$, because $\widehat q^+$ is a bounded symbol, and $e^+ \overline H^{s}({\mathbb R}^n_+)$ identifies with $\dot H^{s}(\overline{\mathbb R}^n_+)$ then. Now let $s = \frac32-\varepsilon$ for a small $\varepsilon > 0$. Here we need to show that when $u\in \overline H^{\frac32-\varepsilon }({\mathbb R}^n_+)$, then $r^+\partial_j\widehat Q^+e^+u\in \overline H^{\frac12-\varepsilon }({\mathbb R}^n_+)$ for $j = 1, \dots, n$. For $j < n$, this follows simply because $\partial_j$ can be commuted through $r^+$, $\widehat Q^+$ and $e^+$ so that we can use that $\partial_ju\in \overline H^{\frac12-\varepsilon }({\mathbb R}^n_+)$. For $j = n$, we proceed as follows:

Since $u\in \overline H^{\frac32-\varepsilon }({\mathbb R}^n_+)$, the extension by zero $e^+u$ has a jump at $x_n = 0$, and a rule for distributions applies:

(The rule is obvious when $u\in C^\infty (\overline{\mathbb R}^n_+)$, and extends by continuity to Sobolev spaces.) Therefore, since $\widehat Q^+ = I+\widehat G^+$ where $\widehat G^+ = \operatorname{Op}(\widehat g^+(\xi))$ from Proposition 4.3,

In the restriction to ${\mathbb R}^n_+$, $r^+I(\gamma _0u\otimes \delta (x_n))$ drops out, so we are left with

Here $K_{\widehat g^+}$ is a potential operator (in the terminology of Eskin ^[6] and Rempel-Schulze ^[18], generalizing the concept of Poisson operator of Boutet de Monvel ^[3,4]), which acts as follows:

By (4.8),

hence

since $\int_{\mathbb R}\langle {\xi} \rangle ^{-1-\varepsilon }\, d\xi _n = \langle {{\xi '}} \rangle^{-\varepsilon }\int_{\mathbb R}\langle {{\eta _n}} \rangle^{-1-\varepsilon }\, d\eta _n$. Inserting $\varphi = \gamma _0u$, we thus have

Thus

Altogether, this shows the desired mapping property for $s = \frac32-\varepsilon$, and the property for general $\frac12\le s < \frac32$ follows by interpolation with the case $s = 0$.

The mapping property (5.7) holds for the inverse $(\widehat Q^+)^{-1}$, since its symbol $(q^+)^{-1}$ equals $1+\sum_{k\ge 1}(-b_+)^k$ with essentially the same structure.

The identity $((\widehat Q^+)^{-1})_+\widehat Q^+_+ = I = \widehat Q^+_+((\widehat Q^+)^{-1})_+$ valid on $L_2({\mathbb R}^n_+)$, holds a fortiori on $\overline H^s({\mathbb R}^n_+)$ for $0 < s < \frac32$, and extends by continuity to $\overline H^s({\mathbb R}^n_+)$ for $-\frac12 < s < 0$.

When $P$ merely satisfies Assumption 3.2, we can still show a useful forward mapping property of $\widehat Q$, based on the decomposition in Proposition 4.2.

Proposition 5.2. Let $P$ satisfy Assumption $3.2$, and consider $\widehat Q$ and $\widehat F_\pm = \operatorname{Op}(\widehat f_\pm)$ derived from it in Section $\rm {4}$.

The operator $\widehat F_{+, +} = r^+\widehat F_+e^+$ is continuous

The operator $\widehat F_{-, +} = r^+\widehat F_-e^+$ is continuous from $\overline H^{s}({\mathbb R}^n_+)$ to $\overline H^{s }({\mathbb R}^n_+)$ for any $s\in \mathbb R$.

The operator $\widehat Q_{+} = r^+\widehat Qe^+$ is continuous

Proof. Since $\widehat F_+$ has bounded symbol, it maps $\dot H^s(\overline{\mathbb R}^n_+)$ into $H^s({\mathbb R}^n)$ for all $s$, so for $|s| < \frac12$, (5.9) follows since $\dot H^s(\overline{\mathbb R}^n_+) = e^+ \overline H^s({\mathbb R}^n_+)$ then. For $\frac12 < s < \frac32$, we proceed as in the proof of Proposition 5.1, using that

where $K_{\widehat f_+}$ satisfies similar estimates as $K_{\widehat g^+}$ by Proposition 4.2.

For $r^+\widehat F_-e^+$, the statement follows since it is on ${\mathbb R}^n_+$ the adjoint of $\operatorname{Op}(\overline{\widehat f_-})$, which preserves support in $\overline{\mathbb R}^n_+$ and therefore maps $\dot H^s(\overline{\mathbb R}^n_+)$ into itself for all $s\in \mathbb R$. For $\widehat Q$, the statement now follows since it equals $s_0+\widehat F_-+\widehat F_+$.

This is as far as we get by applying Lemma 4.1 to $f$. To obtain the mapping property for higher $s$ would require a control over the potential operators

for $j\ge 1$ as well. At any rate, the property shown in Proposition 5.2 will be sufficient for the integration by parts formulas we are aiming for.

In the elliptic case, we conclude from Proposition 5.1 for the operator $\widehat Q$:

Corollary 5.3. Let $P$ satisfy Assumption $3.1$, and consider the operators $\widehat Q$, $\widehat Q^+$, $\widehat Q^-$ with symbols $\widehat q$, $\widehat q^+$, $\widehat q^-$ derived from it in Section $\rm {4}$. The operator $\widehat Q_+\equiv r^+\widehat Qe^+$ acts like $r^+\widehat Q^-e^+r^+\widehat Q^+e^+ = \widehat Q^-_+\widehat Q^+_+$, mapping continuously and bijectively

and the inverse (continuous in the opposite direction) equals

Proof. We have for $u\in \dot H^s(\overline{\mathbb R}^n_+)\simeq \overline H^s({\mathbb R}^n_+)$, $|s| < \frac12$, that

since $r^-\widehat Q^+e^+u = 0$; this identity is also valid on the subspaces $\overline H^s({\mathbb R}^n_+)$ with $s\ge \frac12$. Combining the homeomorphism property of $r^+\widehat Q^+e^+$ shown in Proposition 5.1 with the known homeomorphism property of $r^+\widehat Q^-e^+$ on $\overline H^s({\mathbb R}^n_+)$-spaces (cf. (5.6)), we get (5.11). The inverse is pinned down by using that $r^+\widehat Q^-e^+$ has inverse $r^+(\widehat Q^-)^{-1}e^+$ on $\overline H^s({\mathbb R}^n_+)$ for all $s$, and $r^+\widehat Q^+e^+$ has inverse $r^+(\widehat Q^+)^{-1}e^+$ on $\overline H^s({\mathbb R}^n_+)$ for $-\frac12 < s < \frac32$ in view of Proposition 5.1.

5.3.   Mapping properties of the modified P, transmission spaces

Now turn the attention to $\widehat P$, which is related to $\widehat Q$ by

cf. (3.12)–(3.13).

We shall describe the solutions of the homogeneous Dirichlet problem (in the strongly elliptic case)

with $f$ given in a space $\overline H^{s }({\mathbb R}^n_+)$, and $u$ assumed a priori to lie in a space $\dot H^\sigma (\overline\Omega)$ for low $\sigma$, e.g., with $\sigma = a$.

First we observe for $\Xi ^{-\mu '}_{-, +} = r^+\Xi ^{-\mu '}_{-}e^+$ that

since, as accounted for in [8,Rem. 1.1,(1.13)], the action of $r^+\Xi ^{-\mu '}_{-}$ is independent of how $r^+\widehat P$ is extended into $\overline{\mathbb R}^n_-$. Thus, in view of the mapping properties (5.2) of $\Xi ^{-\mu '}_{-, +}$,

Composing the equation in (5.14) with $\Xi _{-, +}^{-\mu '}$ to the left, we can therefore write it as

Next, we shall also replace $u$. Because of the right-hand factor $\Xi _+^{-\mu }$ in the expression for $\widehat Q$ in (5.13), we need to introduce the $\mu$-transmission spaces

defined in ^[8]; they are Hilbert spaces. (For $t\le \operatorname{Re}\mu -\tfrac12$, the convention is to take $H^{\mu (t)}(\overline{\mathbb R}^n_+) = \dot H^t(\overline{\mathbb R}^n_+)$, but this is rarely used.) The following properties were shown in ^[8]:

Theorem 5.4. ^[8] Let $t > \operatorname{Re}\mu -\tfrac12$.

$1^\circ$ The mapping $r^+\Xi _+^\mu$ is a homeomorphism of $H^{\mu (t)}(\overline{\mathbb R}^n_+)$ onto $\overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ with inverse $\Xi _+^{-\mu }e^+$.

$2^\circ$ For $|t-\operatorname{Re}\mu | < \frac12$, $H^{\mu (t)}(\overline{\mathbb R}^n_+) = \dot H^{t }(\overline{\mathbb R}^n_+)$.

$3^\circ$ Assume $\operatorname{Re}\mu > -1$ and $t > \operatorname{Re}\mu +\frac12$. Then

where $\dot H^t(\overline{\mathbb R}^n_+)$ is replaced by $\dot H^{t-\varepsilon }(\overline{\mathbb R}^n_+)$ if $t-\operatorname{Re}\mu -\frac12\in \mathbb N$. Moreover, the trace of $u/x_n^{\mu }$ is well-defined on $H^{\mu (t) }(\overline{\mathbb R}^n_+)$ and satisfies

Rule $1^\circ$ is shown in [8,Prop. 1.7]. Rule $2^\circ$, shown in [8,(1.26)], holds because of the mapping property (5.2) for $\Xi _+^{-\mu }$ and the identification of $e^+ \overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ with $\dot H^{t-\operatorname{Re}\mu }(\overline{\mathbb R}^n_+)$ when $t-\operatorname{Re}\mu\in\, ]-\frac12, \frac12[\,$. Rule $3^\circ$ is shown in [8,Th. 5.1,Cor. 5.3,Th. 5.4]; it deals with a higher $t$, where $e^+ \overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ has a jump at $x_n = 0$, and the coefficient $x_n^\mu$ appears. Let us just mention the key formula

which indicates how $\Xi _+^{-\mu } = \operatorname{Op}((\langle {{\xi '}} \rangle+i\xi _n)^{-\mu })$ is connected with the factor $x_n^\mu$. Besides in [8,Sect. 5], explicit calculations are carried out e.g., in [12,Lemma 3.3] (and [9,Appendix]).

We note in passing that in the definition (5.18), one can equivalently replace the order-reducing operator family $\Xi _+^{t} = \operatorname{Op}((\langle {{\xi '}} \rangle+i\xi _n)^t)$ by $\operatorname{Op}(([\xi ']+i\xi _n)^t)$, or by $\Lambda _+^t$, as defined in ^[8].

Now continue the discussion of (5.17): In view of Theorem 5.4 $1^\circ$, we can set $v = r^+\Xi _+^\mu u$, where $u = \Xi _+^{-\mu }e^+v$, and hereby

Then the Eq (5.17) reduces to an equivalent equation

with $g$ given in $\overline H^{s+\operatorname{Re}\mu '}({\mathbb R}^n_+)$ and $v$ a priori taken in $\dot H^{\sigma -\operatorname{Re}\mu }(\overline{\mathbb R}^n_+)$. We shall denote $s = t-2a$, so $s+\operatorname{Re}\mu ' = t-2a+2a-\operatorname{Re}\mu = t-\operatorname{Re}\mu$. The equation was solved in Corollary 5.3 and we find for $r^+\widehat P$:

Theorem 5.5. Let $P$ satisfy Assumption $3.1$. For $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$, $r^+\widehat P$ defines a homeomorphism (continuous bijective operator with continuous inverse)

Furthermore, if $u$ is in $\dot H^\sigma (\overline{\mathbb R}^n_+)$ for some $\sigma > \operatorname{Re}\mu -\frac12$ (this includes the value $\sigma = a$) and solves $\rm(5.14)$ with $f\in \overline H^{t-2a}({\mathbb R}^n_+)$, then $u\in H^{\mu (t) }(\overline{\mathbb R}^n_+)$.

Here $\operatorname{Re}\mu > -\frac12$ since $a > 0$ and $|\operatorname{Re}\delta | < \frac12$, so the rules in Theorem 5.4 $3^\circ$ apply.

Proof. In view of (5.15) and (5.16), and the mapping property of $\widehat Q$ established in Corollary 5.3, $r^+\widehat P$ has the forward mapping property in (5.21).

To solve (5.14), let $\sigma = \operatorname{Re}\mu -\frac12+\varepsilon$ for a small $\varepsilon$, set $g = \Xi _{-, +}^{-\mu '}f\in \overline H^{t-2a+\operatorname{Re}\mu '}({\mathbb R}^n_+) = \overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ and $v = r^+\Xi _+^\mu u\in \dot H^{-\frac12+\varepsilon }(\overline{\mathbb R}^n_+)$. Then (5.14) reduces to solving

with $g$ given in $\overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ and $v$ a priori lying in $\dot H^{-\frac12+\varepsilon }(\overline{\mathbb R}^n_+)$. By Corollary 5.3, (5.22) has a unique solution $v\in \overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$, so $u$ must lie in $H^{\mu (t)}(\overline{\mathbb R}^n_+)$, and the mapping (5.21) is bijective.

Remark 5.6.This theorem differs from the strategy pursued in ^[6], and gives a new insight. The technique in [6,Th. 7.3] for showing solvability in a higher-order Sobolev space, say with $\frac12 < t-\operatorname{Re}\mu < \frac32$, $f$ given in $\overline H^{t-2a}({\mathbb R}^n_+)$, is to supplement $\widehat P$ with a potential operator $K_{\widehat P}$ constructed from $\widehat P$ such that the solutions are of the form $u = u_++K_{\widehat P}\varphi$ with $u_+\in \dot H^t(\overline{\mathbb R}^n_+)$, $\varphi$ a generalized trace derived from $f$. Our aim is to show that there is a universal description of the space of solutions $u$ of (5.14) with right-hand side in $\overline H^{t-2a}({\mathbb R}^n_+)$, that depends only on $\mu$, and applies to any $P$ of the given type. The $\mu$-transmission spaces (5.18) serve this purpose. In ^[8], they are shown to have this role for arbitrarily high $t$ when the full $\mu$-transmission condition holds. $

One more important property of $\mu$-transmision spaces is that the spaces with $C^\infty$-ingredients $\mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ and $e^+x_n^\mu \mathcal S(\overline{\mathbb R}^n_+)$ are dense subsets of $H^{\mu (t)}(\overline{\mathbb R}^n_+)$ for all $t > \operatorname{Re}\mu -\frac12$, $\operatorname{Re}\mu > -1$ (cf. [8,Prop. 4.1] and [13,Lemma 7.1]). Recall also (5.5), which makes the statement for $e^+x_n^\mu \mathcal S(\overline{\mathbb R}^n_+)$ rather evident, since $\mathcal S(\overline{\mathbb R}^n_+)$ is dense in $\overline H^s({\mathbb R}^n_+)$ for all $s\in\mathbb R$. Hence $r^+\widehat P$ applies nicely to these spaces.

When $P$ merely satisfies Assumption 3.2, we have at least the forward mapping part of (5.21):

Theorem 5.7. Let $P$ satisfy Assumption $3.2$. For $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$, $r^+\widehat P$ maps continuously

Proof. This follows as in the preceding proof, now using the mapping property of $r^+\widehat Qe^+$ established in Proposition 5.2.

5.4.   Consequences for the given operator P

The following consequences can be drawn for the original operator $P$:

Theorem 5.8. $1^\circ$ Let $P$ satisfy Assumption $3.2$. Then $P = \widehat P+P'$, where $\widehat P$ is defined by $\rm(3.9)$ and $P'$ is of order $2a-1$. For $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$, $r^+P$ maps continuously

$2^\circ$ Let $P$ satisfy Assumption $3.1$. Then in the decomposition $P = \widehat P+P'$, $r^+\widehat P$ is invertible, as described in Theorem $5.5$.

Let $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$, let $f\in \overline H^{t-2a}({\mathbb R}^n_+)$, and let $u\in \dot H^{\sigma }(\overline{\mathbb R}^n_+)$ (for some $\sigma > \operatorname{Re}\mu -\frac12$) solve the homogeneous Dirichlet problem

Then $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$.

Proof. The original operator $P$ equals $\operatorname{Op}(p(\xi))$ with $p(\xi)$ homogeneous on ${\mathbb R}^n$ of degree $2a > 0$; in particular it is continuous at 0. It is decomposed into

where $p'(\xi)$ is $O(\langle {\xi} \rangle ^{2a-1})$ for $|\xi |\ge 2$ by (3.10) and continuous, hence

This implies that $P' = \operatorname{Op}(p')$ maps $H^s({\mathbb R}^n)$ continuously into $H^{s-2a+1}({\mathbb R}^n)$ for all $s\in\mathbb R$, and hence

$1^\circ$. The forward mapping property (5.23) holds for $r^+\widehat P$ by Theorem 5.7. To show that it holds for $r^+P'$, let $\operatorname{Re}\mu -\frac12 < t < \operatorname{Re}\mu +\frac32$.

If $t-\operatorname{Re}\mu < \frac12$, then $H^{\mu (t) }(\overline{\mathbb R}^n_+) = \dot H^t(\overline{\mathbb R}^n_+)$, and $r^+P'\dot H^t(\overline{\mathbb R}^n_+)\subset \overline H^{t-2a+1}({\mathbb R}^n_+)\subset \overline H^{t-2a}({\mathbb R}^n_+)$ by (5.27), matching the mapping property of $\widehat P$.

If $\frac12\le t-\operatorname{Re}\mu < \frac32$, we use the definition of $H^{\mu (t)}(\overline{\mathbb R}^n_+)$ to see that for small $\varepsilon > 0$,

also matching the mapping property of $\widehat P$.

Now (5.24) follows by adding the statements for $P'$ and $\widehat P$. This shows $1^\circ$.

$2^\circ$. The first statement registers what we already know about $r^+\widehat P$. Proof of the regularity statement: With $u$ and $f$ as defined there, denote $\sigma = \operatorname{Re}\mu -\frac12+\varepsilon$; here $\varepsilon > 0$. Then

If $t\le \operatorname{Re}\mu +\frac12 +\varepsilon$, $r^+\widehat Pu\in \overline H^{t-2a}({\mathbb R}^n_+)$, and we conclude from Theorem 5.5 that $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$.

If $t > \operatorname{Re}\mu +\frac12 +\varepsilon$, $r^+\widehat Pu\in \overline H^{\operatorname{Re}\mu +\frac12+\varepsilon -2a}({\mathbb R}^n_+)$; here Theorem 5.5 applies to give the intermediate information that $u\in H^{\mu (\operatorname{Re}\mu +\frac12+\varepsilon)}(\overline{\mathbb R}^n_+)$. From this follows that

for any $\varepsilon ' > 0$. Then $r^+P'u\in \overline H ^{\operatorname{Re}\mu +\frac32-\varepsilon '-2a}({\mathbb R}^n_+)$. Choosing $\varepsilon '$ so small that $\operatorname{Re}\mu +\frac32-\varepsilon '\ge t$, we have that $r^+P'u\in \overline H ^{t-2a}(\overline{\mathbb R}^n_+)$; hence $r^+\widehat Pu\in \overline H ^{t-2a}(\overline{\mathbb R}^n_+)$, so it follows from Theorem 5.5 that $u\in H ^{\mu (t)}(\overline{\mathbb R}^n_+)$. This ends the proof of $2^\circ$.

Example 5.9. Theorem 5.8 applies to the operator $L = \operatorname{Op}(\mathcal L(\xi))$ described in (3.5)ff., showing that it maps $H^{\mu (t) }(\overline{\mathbb R}^n_+)$ to $\overline H^{t -2a }({\mathbb R}^n_+)$ for $-\frac12 < t-\mu < \frac32$, and that solutions of the homogeneous Dirichlet problem with $f\in \overline H^{t -2a }({\mathbb R}^n_+)$ are in $H^{\mu (t) }(\overline{\mathbb R}^n_+)$ for these $t$. The appearance of the factor $x_n^\mu$ (cf. (5.19)) is consistent with the regularity shown in terms of Hölder spaces in ^[5].

In particular, the result provides a valid basis for applying $r^+L$ to $\mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ or $e^+x_n^{\mu }\mathcal S(\overline{\mathbb R}^n_+)$, mapping these spaces into $\bigcap_{\varepsilon > 0} \overline H^{\frac32-a+\delta -\varepsilon }({\mathbb R}^n_+)$. $

Remark 5.10. The domain spaces $H^{\mu (t) }(\overline{\mathbb R}^n_+)$ entering in Theorem 5.8 can be precisely described: For $|t-\operatorname{Re}\mu | < \frac12$, we already know from Theorem 5.4 $2^\circ$ that $H^{\mu (t) }(\overline{\mathbb R}^n_+) = \dot H^t(\overline{\mathbb R}^n_+)$. For $\frac12 < t-\operatorname{Re}\mu < \frac32$, we have by [12,Lemma 3.3] that $u\in H^{\mu (t) }(\overline{\mathbb R}^n_+)$ if and only if

here $K_0$ is the Poisson operator $K_0\colon \varphi \mapsto z$ solving the Dirichlet problem for $1-\Delta$,

with $\varphi \in H^{t-\operatorname{Re}\mu -\frac12}(\mathbb R^{n-1})$. For $t-\operatorname{Re}\mu = \frac12$, we have the information $u\in \bigcap_{\varepsilon > 0}\dot H^{t-\varepsilon }(\overline{\mathbb R}^n_+)$. As a concrete example, the elements $u$ of $H^{\frac12(\frac32)}(\overline{\mathbb R}^n_+)$ are the functions $u = v+w$, where $w\in \dot H^\frac32(\overline{\mathbb R}^n_+)$ and $v = x_n^\frac12 K_0\varphi$ for some $\varphi \in H^\frac12(\mathbb R^{n-1})$; this $\varphi$ equals $\gamma _0(u/x_n^\frac12)$. $

6.   The integration by parts formula

6.1.   An integration by parts formula for the modified P

It will now be shown that the operators $P$ satisfying merely the principal $\mu$-transmission condition (Assumption 3.2) have an integration by parts formula over ${\mathbb R}^n_+$, involving traces $\gamma _0(u/x_n^{\mu })$. The study will cover the special operator $L$ in Example 5.9 (regardless of whether a full $\mu$-transmission condition might hold, as assumed in ^[13]). It also covers more general strongly elliptic operators, and it covers operators that are not necessarily elliptic.

The basic observation is:

Proposition 6.1. Let $\mu \in\mathbb C$. Let $w\in \bigcap_{s} \overline H^s({\mathbb R}^n_+)$, and let $u'\in \mathcal E_{\bar\mu }(\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$. Denote $w' = r^+\Xi _+^{\bar\mu }u'\in \bigcap_{s} \overline H^s({\mathbb R}^n_+)$; correspondingly $u' = \Xi _+^ {-\bar\mu }e^+w'$ in view of Theorem 5.4 $1^\circ$. Then

The left-hand side is interpreted as in $\rm(6.2)$ below when $\operatorname{Re}\mu \le 0$.

The formula extends to $w\in \overline H^{\frac12+\varepsilon}({\mathbb R}^n_+)$ and $u'\in H^{\bar\mu (t)}(\overline{\mathbb R}^n_+)$ with $t\ge\operatorname{Re}\mu +\frac12-\varepsilon$ (for small $\varepsilon > 0$), using the representation $\rm(6.2)$.

Proof. This was proved in [10,Th. 3.1] for $\mu = a > 0$ (see also Remark 3.2 there with the elementary case $a = 1$), and in [13,Th. 4.1] for real $\mu > -\frac12$, so the main task is to check that the larger range of complex $\mu$ is allowed. We write $\overline{u'}$ as $\bar u'$ for short.

Note that when $\operatorname{Im}\mu \ne 0$, $\mathcal E_{\mu }(\overline{\mathbb R}^n_+)$ is different from $\mathcal E_{\operatorname{Re}\mu }(\overline{\mathbb R}^n_+)$, e.g., since $x_n^\mu /x_n^{\operatorname{Re}\mu } = x_n^{i\operatorname{Im}\mu } = e^{i\operatorname{Im}\mu \log x_n}$ has absolute value 1 and is $C^\infty$ for $x_n > 0$, but oscillates when $x_n\to 0$.

By the mapping properties of $\Xi _{-, +}^\mu$ (cf. (5.2)), $r^+\Xi _{-}^\mu e^+w\in \bigcap_s \overline H^s({\mathbb R}^n_+)$, hence is integrable. When $\operatorname{Re}\mu > 0$, the function $\partial_nu'$ is $O(x_n^{\operatorname{Re}\mu -1})$ and compactly supported, so the left-hand side of (6.1) makes sense as an integral of an $L_1$-function. When $\mu$ is general, we observe that for any small $\varepsilon > 0$,

so the integral $I$ makes sense as the duality

Since the adjoint of $r^+\Xi _-^{ \mu }e^+$ equals $\Xi _+^{\bar \mu }$, $I$ is by transposition turned into

Note that $\partial_ne^+w$ satisfies an equation like (5.8), which fits in here since the space $\dot H^{-\frac12 -\varepsilon }(\overline{\mathbb R}^n_+)$ contains distributions of the form $\varphi (x')\otimes \delta (x_n)$. The expression is analysed as in [10,Th. 3.1] (and [13,Th. 4.1]), leading to

which shows (6.1).

For the whole analysis, it suffices that $w\in \overline H^s({\mathbb R}^n_+)$ with $s = \frac12+\varepsilon$, since $\Xi ^\mu _{-, +}w\in \overline H^{\frac12-\operatorname{Re}\mu +\varepsilon }({\mathbb R}^n_+)$ then. For $u'$, it then suffices that $u'\in H^{\bar\mu (t)}(\overline{\mathbb R}^n_+) = \Xi _+^{-\bar\mu }e^+ \overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ with $t\ge \operatorname{Re}\mu +\frac12-\varepsilon$ (assuming $0 < \varepsilon < 1$), since

then, so that the duality in (6.2) is well-defined.

We shall now show:

Theorem 6.2. Let $P$ satisfy Assumption $3.2$; it is of order $2a$ and satisfies the principal $\mu$-transmission condition in the direction $(0, 1)$ for some $\mu = a+\delta \in\mathbb C$, and we denote $a-\delta = \mu '$. Assume moreover that $\operatorname{Re}\mu > -1$, $\operatorname{Re}\mu' > -1$. Consider $\widehat P = \operatorname{Op}(\widehat p(\xi))$, as defined by $\rm(3.9)$. For $u\in \mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, $u'\in \mathcal E_{\bar\mu '} (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, there holds

where $s_0 = e^{-i\pi \delta }p(0, 1)$. The formula extends to $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$, $u'\in H^{\bar\mu '(t')}(\overline{\mathbb R}^n_+)$, for $t > \operatorname{Re}\mu +\frac12$, $t' > \operatorname{Re}\mu '+\frac12$.

The integrals over ${\mathbb R}^n_+$ are interpreted as dualities (as in Proposition $6.1$) when $\operatorname{Re}\mu$ or $\operatorname{Re}\mu '\le 0$, and when extended to general $u, u'$.

Proof. Since integration over ${\mathbb R}^n_+$ in itself indicates that the functions behind the integration sign are restricted to ${\mathbb R}^n_+$, we can leave out the explicit mention of $r^+$. Recall that

cf. (3.13). The adjoint is $\widehat P^* = \Xi _-^{\bar\mu }\widehat Q\, \Xi _+^{\bar\mu '}$. Recall from Proposition 4.2 that

where $\widehat f_\pm(\xi)$ extend holomorphically in $\xi _n+i\tau$ into $\mathbb C_-$ resp. $\mathbb C_+$, estimated as in (4.8).

Accordingly, $\widehat P$ splits up in three terms

Consider the contribution from $\widehat P_1$:

Recall that $s_0 = q(0, 1) = e^{-i\pi \delta }p(0, 1)$ by (3.16); this constant is left out of the next calculations.

When $u\in \mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, then $w = r^+\Xi _+^{\mu }u\in \bigcap_s \overline H^s ({\mathbb R}^n_+)$. Similarly as in (5.15), $r^+\Xi _-^{\mu '}\Xi _+^{\mu }u = r^+\Xi _-^{\mu '}e^+r^+\Xi _+^{\mu}u$, which equals $r^+\Xi _-^{\mu '}e^+w$, hence lies in $\bigcap_s \overline H^s ({\mathbb R}^n_+)$ by (5.2). An application of Proposition 6.1 with $\mu$ replaced by $\mu '$ gives:

where $w' = r^+\Xi _+^{\bar \mu '}u'$.

We can apply the analogous argument to show that the conjugate of $\int _{ {\mathbb R}^n_+}\partial_nu\, \overline{\Xi _-^{\bar \mu }\Xi _+^{\bar\mu '}u'}\, dx$ satisfies

here $w' = r^+\Xi _+^{\bar\mu '}u'$ and $w = r^+\Xi _+^{\mu }u$ are the same as the functions defined in the treatment of the first integral.

It follows by addition that

in the last step we used that $\int_{ {\mathbb R}^n_+}(w\partial_n\bar w'+\partial_nw \bar w')\, dx = -\int_{{\mathbb R}^{n-1}}\gamma _0w\gamma _0\bar w'\, dx'$. Insertion of $\gamma _0w = \gamma _0\Xi _+^{\mu }u = \Gamma(1+\mu)\gamma _0(u/x_n^{\mu })$ (cf. (5.20)), and similarly $\gamma _0w' = \gamma _0\Xi _+^{\bar\mu ' }u' = \Gamma(1+\bar\mu ')\gamma _0(u'/x_n^{\bar\mu ' })$, gives (6.4) with $\widehat P$ replaced by $\widehat P_1$ (using also that $\overline{ \Gamma(1+\bar\mu ')} = \Gamma(1+\mu ')$).

As for extension of the formula to larger spaces, we note that by Proposition 6.1, the calculations for the first integral allow $w\in \overline H^{\frac12+\varepsilon }({\mathbb R}^n_+)$, corresponding to $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$ with $t = \operatorname{Re}\mu +\frac12+\varepsilon$, and $u'\in H^{\bar\mu '(t')}(\overline{\mathbb R}^n_+)$ with $t'\ge \operatorname{Re}\mu '+\frac12-\varepsilon$. With the analogous conditions for the calculations of the second integral, we find altogether that $t > \operatorname{Re}\mu +\frac12$, $t' > \operatorname{Re}\mu '+\frac12$, is allowed.

The contributions from $\widehat P_2$ and $\widehat P_3$ will be treated by variants of this proof, where we show that their boundary integrals give zero.

Consider $\widehat P_2$. As in (5.15), we have:

where $\widehat F_+^* = \operatorname{Op}(\overline {\widehat f_+})$. Set

Here when $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$, $w\in \overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$, and when $u'\in H^{\bar\mu ' (t')}(\overline{\mathbb R}^n_+)$, $w'\in \overline H^{t'-\operatorname{Re}\mu '}({\mathbb R}^n_+)$. For $w_1$ we have since $u = \Xi _+^{-\mu }e^+w$ (by Theorem 5.4 $1^\circ$), that

when $-\frac12 < t-\operatorname{Re}\mu < \frac32$, by the mapping property for $\widehat F_+$ established in Proposition 5.2.

We can then apply Proposition 6.1 to the first integral for $\widehat P_2$, with $\mu$ replaced by $\mu '$, giving when $t-\operatorname{Re}\mu > \frac12$:

There is a general formula for the trace, entering in Vishik and Eskin's calculus as well as that of Boutet de Monvel,

where the integral over $\mathbb R$ is read either as an ordinary integral or, if necessary, as the integral $\int^+$ defined e.g., in [7,(10.85)] (also recalled in [11,(A.1),(A.15)]). Applying this to $w_1$, we find:

This integral gives 0 for the following reason: It suffices to take $w$ in the dense subspace of $\overline H^{t-\operatorname{Re}\mu }({\mathbb R}^n_+)$ of compactly supported functions in $C^\infty (\overline{\mathbb R}^n_+)$. Both $\widehat f_+$ and $\mathcal F(e^+w)$ are holomorphic in $\mathbb C_-$ as functions of $\xi _n$, $f_+$ being $O(\langle {{\xi _n}} \rangle^{-1+\varepsilon })$ and $\mathcal F(e^+w)$ being $O(\langle {{\xi _n}} \rangle^{-1})$ on $\overline {\mathbb C}_-$, whereby the integrand is $O(\langle {{\xi _n}} \rangle^{-2+\varepsilon })$ there (and is in $L_1$ on $\mathbb R$); then the integral over $\mathbb R$ can be transformed to a closed contour in $\mathbb C_-$ and gives 0.

We can then conclude:

The other contribution from $\widehat P_2$ is, in conjugated form,

where we used Proposition 6.1 in a similar way, and at the end used that $\gamma _0w_1 = 0$, cf. (6.8)ff. Finally, taking the contributions from $\widehat P_2$ together, we get

using again that $\gamma _0w_1 = 0$.

It is found in a similar way, using that $\widehat F_-^*$ is of plus-type, that $\widehat P_3$ contributes with zero.

6.2.   An integration by parts formula for the original P

To extend the formula to the original operator $P$, we shall show that $P' = P-\widehat P$ (cf. Theorem 5.8 $1^\circ$) gives a zero boundary contribution.

Lemma 6.3. Let $a > 0$ and let $S = \operatorname{Op}(s(\xi))$, where $s(\xi)$ is $O(\langle {\xi} \rangle ^{2a-1})$. Then

for any $u, u'\in \dot H^a(\overline{\mathbb R}^n_+)$.

Proof. Since $u\in \dot H^a(\overline{\mathbb R}^n_+)$, $r^+Su\in \overline H^{1-a}({\mathbb R}^n_+)$; moreover $\partial_nu'\in \dot H^{a-1}(\overline{\mathbb R}^n_+)$, so we can write the first integral as

Approximate $u'$ in $\dot H^a(\overline{\mathbb R}^n_+)$ by a sequence of functions $\varphi _k\in C_0^\infty ({\mathbb R}^n_+)$, $k\in\mathbb N$; then

With a similar argument for the second integral, we have

since $\partial_nS^* = S^*\partial_n = -(\partial_nS)^*$, and it is well-known that the operator $S_1 = \partial_nS$ of order $2a$ satisfies $\langle {{r^+S_1u, u'}} \rangle = \langle {{u, r^+S_1^*u'}} \rangle$ for $u, u'\in \dot H^a(\overline{\mathbb R}^n_+)$.

We can then conclude:

Theorem 6.4. Let $P$, $\mu$, $\mu '$ be as in Theorem $6.2$. For $u\in \mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, $u'\in \mathcal E_{\bar\mu '} (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, there holds

where $s_0 = e^{-i\pi \delta }p(0, 1)$. The formula extends to $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$, $u'\in H^{\bar\mu '(t')}(\overline{\mathbb R}^n_+)$, for $t > \operatorname{Re}\mu +\frac12$, $t' > \operatorname{Re}\mu '+\frac12$, with $t, t'\ge a$.

The integrals over ${\mathbb R}^n_+$ are interpreted as dualities (as in Proposition $6.1$ and Lemma $6.3$) when $\operatorname{Re}\mu$ or $\operatorname{Re}\mu '\le 0$, and when extended to general $u, u'$.

Proof. Recall that $P = \widehat P+P'$, where $P' = \operatorname{Op}(p')$, $|p'(\xi)|\le C\langle {{\xi }} \rangle^{2a-1}$ (cf. Theorem 5.8 $1^\circ$). We have the identities (6.10) with $S = P'$ and (6.4) for $u\in H^{\mu (t)}(\overline{\mathbb R}^n_+)$, $u'\in H^{\bar\mu '(t')}(\overline{\mathbb R}^n_+)$ with $t, t'\ge a$, $t > \operatorname{Re}\mu +\frac12$, $t' > \operatorname{Re}\mu '+\frac12$. Adding the identities for $\widehat P$ and $P'$ we obtain (6.11). It holds a fortiori for $u\in \mathcal E_\mu (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, $u'\in \mathcal E_{\bar\mu '} (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$.

Example 6.5. The theorem applies in particular to $L = \operatorname{Op}(\mathcal L(\xi))$ studied in (3.5)–(3.6) and Example 5.9, showing that

The value $s_0 = |\mathcal L(0, 1)| = (\mathcal A(0, 1)^2+\mathcal B(0, 1)^2)^{\frac12}$ is found in (3.17).

This result was proved in [5,Prop. 1.4] by completely different, real methods, for $\mu \in$ $\, ]0, 2a[\, \cap \, ]2a-1, 1[\,$.

The result is one of the key ingredients in the proof of integration by parts formulas for operators $L$ on bounded domains $\Omega \subset {\mathbb R}^n$ in ^[5], where $\mu (\nu)$ varies as the normal $\nu$ varies along the boundary. It would be interesting to extend this knowledge to general strongly elliptic operators $P$ on bounded domains by similar applications of Theorem 6.4.

Example 6.6. Here is an example of an application to a nonelliptic operator satisfying Assumption 3.2. Let

on ${\mathbb R}^3$, for some $1 < m < 2$. For $\mathbb R^3_+ = \{x_3 > 0\}$ we have the normal $\nu = (0, 0, 1)$, where

i.e., $\mu = (m-1)/2$, $\mu ' = (m+1)/2$. Then by Theorem 6.4,

for functions $u\in x_3^{(m-1)/2}\mathcal S(\overline{\mathbb R}^3_+)$, $v\in x_3^{(m+1)/2}\mathcal S(\overline{\mathbb R}^3_+)$.

The halfspace $\{x_2 > 0\}$ has the normal $\nu ' = (0, 1, 0)$ and

i.e., $\mu = m/2$, $\mu ' = m/2$. Here by Theorem 6.4,

for functions with a factor $x_2^{m/2}$. $

7.   Large solutions and a halfways Green's formula

7.1.   Large solutions, a nonhomogeneous Dirichlet problem

Let $P$ satisfy Assumption 3.1, and assume $\operatorname{Re}\mu > 0$. Along with the homogeneous Dirichlet problem (5.25), one can consider a nonhomogeneous local Dirichlet problem if the scope is expanded to allow so-called "large solutions", behaving like $x_n^{\mu -1}$ near the boundary of ${\mathbb R}^n_+$; such solutions blow up at the boundary when $\operatorname{Re}\mu < 1$. Namely, one can pose the nonhomogeneous Dirichlet problem

Problem (7.1) was studied earlier for operators satisfying the $a$-transmission property in ^[8,9] (including the fractional Laplacian $(-\Delta)^a$), and a halfways Green's formula was shown in [11,Cor. 4.5]. The problem (7.1) for the fractional Laplacian, and the halfways Green's formula——with applications to solution formulas——were also studied in Abatangelo ^[1] (independently of ^[8]); the boundary condition there is given in a less explicit way except when $\Omega$ is a ball. There have been further studies of such problems, see e.g., Abatangelo, Gomez-Castro and Vazquez ^[2] and its references.

Note that the boundary condition in (7.1) is local. There is a different problem which is also regarded as a nonhomogeneous Dirichlet problem, namely to prescribe nonzero values of $u$ in the exterior of $\Omega$; it has somewhat different solution spaces (a link between this and the homogeneous Dirichlet problem is described in ^[9]).

For the general operators $P$ considered here, we shall now show that problem (7.1) has a good sense for $u\in H^{(\mu -1)(t)}(\overline{\mathbb R}^n_+)$ with suitable $t$.

More precisely, since $P$ also satisfies the principal $(\mu -1)$-transmission condition (as remarked after Definition 2.1), Theorem 5.8 $1^\circ$ can be applied with $\mu$ replaced by $\mu -1$, implying that $r^+P$ maps

This is also valid in the case where $P$ is only assumed to satisfy Assumption 3.2.

From Theorem 5.4 we have (note that $\operatorname{Re}\mu -1 > -1$)

When $t-\operatorname{Re}\mu > -\frac12$, the weighted boundary value is well-defined, cf. (5.20):

The following regularity result holds for the nonhomogeneous Dirichlet problem:

Theorem 7.1. Let $P$ satisfy Assumption $3.1$ with $\operatorname{Re}\mu > 0$, and let $-\frac12 < t-\operatorname{Re}\mu < \frac12$. When $f\in \overline H^{t-2a}({\mathbb R}^n_+)$ and $\varphi \in H^{t-\operatorname{Re}\mu +\frac12}(\mathbb R^{n-1})$ are given, and $u$ solves the nonhomogeneous Dirichlet problem $\rm(7.1)$ with $u\in H^{(\mu -1)(\sigma) }(\overline{\mathbb R}^n_+)$ for some $-\frac12 < \sigma -\operatorname{Re}\mu < \frac12$, then in fact $u\in H^{(\mu -1)(t) }(\overline{\mathbb R}^n_+)$.

Proof. It is known from [8,Th. 6.1] that $H^{\mu (\sigma) }(\overline{\mathbb R}^n_+)$ is a closed subspace of $H^{(\mu -1)(\sigma) }(\overline{\mathbb R}^n_+)$, equal to the set of $v\in H^{(\mu -1)(\sigma) }(\overline{\mathbb R}^n_+)$ for which $\gamma _0(v/x_n^{\mu -1}) = 0$. From the given $\varphi$ we define

where $K_0$ is the standard Poisson operator $\varphi \mapsto K_0\varphi = \mathcal F^{-1}_{\xi '\to x'}[\hat \varphi (\xi ')e^{-\langle {{\xi '}} \rangle x_n}]$, $x_n>0$. Then in view of (7.4),

so that $v = u-w$ solves (7.1) with $f$ replaced by $f-r^+Pw\in \overline H^{t-2a}({\mathbb R}^n_+)$, $\varphi$ replaced by 0. This is a homogeneous Dirichlet problem as in (5.25). Since $v\in H^{(\mu -1)(\sigma) }(\overline{\mathbb R}^n_+)$ with $\gamma _0(v/x_n^{\mu -1}) = 0$, it is in $H^{\mu (\sigma) }(\overline{\mathbb R}^n_+)$. It then follows from Theorem 5.8 that $v\in H^{\mu (t) }(\overline{\mathbb R}^n_+)$, and hence $u = v+w\in H^{(\mu -1)(t) }(\overline{\mathbb R}^n_+)$.

For the hatted version $\widehat P$ there is even an existence and uniqueness result in these spaces.

Theorem 7.2. Let $P$ satisfy Assumption $3.1$ with $\operatorname{Re}\mu > 0$, and let $-\frac12 < t-\operatorname{Re}\mu < \frac12$. Then $r^+\widehat P$ together with $\gamma _0^{\mu -1}$ defines a homeomorphism:

Proof. The forward mapping properties are accounted for above. The existence of a unique solution $u\in H^{(\mu -1)(t) }(\overline{\mathbb R}^n_+)$ of

for given $f\in \overline H^{t-2a}({\mathbb R}^n_+)$, $\varphi \in H^{t-\operatorname{Re}\mu +\frac12}(\mathbb R^{n-1})$, is shown as in Theorem 7.1, now referring to Theorem 5.5 instead of Theorem 5.8.

These theorems show that $H^{(\mu -1)(t) }(\overline{\mathbb R}^n_+)$ is the correct domain space for the nonhomogeneous Dirichlet problem, at least in the small range $-\frac12 < t-\operatorname{Re}\mu < \frac12$. Recall that $\mathcal E_{\mu -1}(\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ and $e^+x_n^{\mu -1}\mathcal S(\overline{\mathbb R}^n_+)$ are dense subsets of $H^{(\mu -1) (t)}(\overline{\mathbb R}^n_+)$ for all $t > \operatorname{Re}\mu -\frac32$.

7.2.   An integration by parts formula involving the nontrivial Dirichlet trace

We now show a "halfways Green's formula", where one factor $u$ is in the domain of the nonhomogeneous Dirichlet problem for $P$ and the other factor $v$ is in the domain of the homogeneous Dirichlet problem for $P^*$:

Theorem 7.3. Let $P$ satisfy Assumption $3.2$, and assume moreover that $0 < \operatorname{Re}\mu < a+\frac12$, $\operatorname{Re}\mu ' > 0$.

For $u\in \mathcal E_{\mu -1}(\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ and $v\in \mathcal E_{\bar\mu '} (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, there holds

where $s_0 = e^{-i\pi \delta }p(0, 1)$. The formula extends to $u\in H^{(\mu -1)(t)}(\overline{\mathbb R}^n_+)$ with $t > \operatorname{Re}\mu -\frac12$, $v\in H^{\bar\mu '(t')}(\overline{\mathbb R}^n_+)$ with $t' > \operatorname{Re}\mu '+\frac12$.

The left-hand side is interpreted as follows, for small $\varepsilon > 0$:

Proof. We shall show how the result can be derived from Theorem 6.4. Let $u\in \mathcal E_{\mu -1}(\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ and $v\in \mathcal E_{\bar\mu '} (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$. As shown in [8,p. 494], there exist functions $U$ and $u_1$ in $\mathcal E_{\mu }(\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ such that $u = \partial_nU+u_1$.

In terms of the Hilbert spaces: When $u\in H^{(\mu -1)(t)}(\overline{\mathbb R}^n_+)$ with $|t-\operatorname{Re}\mu | < \frac12$, let $z = r^+\Xi _+^{\mu -1}u\in \overline H^{t-\operatorname{Re}\mu +1}({\mathbb R}^n_+)$, then (denoting $\operatorname{Op}(\langle {{\xi '}} \rangle) = \langle {{D'}} \rangle$)

Here $H^{\mu (t)}(\overline{\mathbb R}^n_+) = \dot H^t(\overline{\mathbb R}^n_+)$ since $|t-\operatorname{Re}\mu | < \frac12$. Moreover, when $t = \operatorname{Re}\mu -\frac12+\varepsilon$ for a small $\varepsilon > 0$, then

where both terms are in $\overline H^{t-2a}({\mathbb R}^n_+) = \overline H^{\operatorname{Re}\mu-\frac12 +\varepsilon -2a}({\mathbb R}^n_+) = \overline H^{\, -\operatorname{Re}\mu '-\frac12+\varepsilon }({\mathbb R}^n_+)$; we here use Theorem 5.8 $1^\circ$.

For $v$, we note that when $v\in H^{\bar\mu '(t')}(\overline{\mathbb R}^n_+)$ with $t' = \operatorname{Re}\mu '+\frac12+\varepsilon$, then

Then the dualities in (7.8) are well-defined and serve as an interpretation of the left-hand side in (7.7).

The formula (7.7) will first be proved for $u\in \mathcal E_{\mu -1}(\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$ and $v\in \mathcal E_{\bar\mu '} (\overline{\mathbb R}^n_+)\cap \mathcal E'({\mathbb R}^n)$, and afterwards be extended by continuity to general $u, v$. We use the decomposition (7.9), that leads to elements of $\mathcal E_\mu (\overline{\mathbb R}^n_+)$ for $t\to \infty$. When $u$ is supported in a ball $\{|\xi |\le R\}$, we can cut $u_1$ and $U$ down to have support in $\{|\xi |\le 2R\}$.

Consider the contribution from $u_1$. Here there holds

when $u_1$ and $v$ are in $\dot H^a(\overline{\mathbb R}^n_+)$, since $P$ is of order $2a$. This gives the contribution 0 to (7.7) since $t = a$ is allowed in the definition of $u_1$ (recall that $a > \operatorname{Re}\mu -\frac12$ by hypothesis), and $t'\ge a$ holds for the values of $t'$ allowed in the definition of $v$ (where $t' > \operatorname{Re}\mu '+\frac12 = 2a-\operatorname{Re}\mu +\frac12 > 2a-a = a$). Thus $u_1$ contributes to the boundary integral with 0.

For the contribution from $\partial_nU$, we note that, writing $U = x_n^\mu w$ for $x_n > 0$, $w\in C^\infty (\overline{\mathbb R}^n_+)$,

so the weighted boundary value for $x_n\to 0+$ satisfies (since $x_n^\mu\partial_nw/x_n^{\mu -1} = x_n\partial_nw \to 0$)

Moreover, by a simple integration by parts,

since $\gamma _0v = 0$ because of $\operatorname{Re}\mu ' > 0$. Thus, by use of Theorem 6.4 and (7.12),

Since $u_1\in \mathcal E_\mu (\overline{\mathbb R}^n_+)$, $\gamma _0(u_1/x_n^{\mu -1}) = 0$, so $u_1$ can be added to $\partial_nU$ in the last integral. Adding also (7.11) to the left-hand side, we find (7.7).

Since the expressions depend continuously on $u, v$ in the presented norms, the formula extends to the indicated spaces.

Example 7.4. Theorems 7.1 and 7.2 apply in particular to the operator $L$ considered in (3.5)–(3.6) and Examples 5.9 and 6.5, when $\mu > 0$ (this holds automatically if $a\ge \frac12$, since $|\delta | < \frac12$). Theorem 7.3 applies to $L$ when $\mu$ and $\mu ' > 0$ (again automatically satisfied when $a\ge \frac12$). $

Remark 7.5. The transmission spaces can also be defined in terms of other scales of function spaces. The case of Bessel-potential spaces $H^s_p$, $1 < p < \infty$, is a main subject in our preceding papers. There is also the Hölder-Zygmund scale $C_*^s({\mathbb R}^n)$, coinciding with the Hölder scale $C^s({\mathbb R}^n)$ when $s\in \mathbb R_+\setminus \mathbb N$, with spaces over ${\mathbb R}^n_+$ defined as in (5.1). Here since $C_*^{s+\varepsilon }({\mathbb R}^n)\subset H^s({\mathbb R}^n)$, also $C_*^{\mu (s+\varepsilon)}(\overline{\mathbb R}^n_+)\subset H^{\mu (s)}(\overline{\mathbb R}^n_+)$ for $\varepsilon > 0$. (More details on such spaces in our earlier papers, e.g., in ^[12].) So the results dealing with forward mapping properties of $r^+P$ have useful consequences involving these spaces as well. Namely, Theorem 5.8 $1^\circ$ implies that $r^+P$ maps

and the integration by parts formulas in Sections 6 and 7 hold for functions in $C_*^{\mu (t)}$-type spaces, for the same $t$.

In the opposite direction, an inclusion of an $H^s$-space in a Hölder spaces loses $n/2$ in the regularity parameter, hence does not give very good results. For better regularity results, it would be interesting to extend the above theory to $H^s_p$-spaces with general $1 < p < \infty$, possibly under further hypotheses; this remains to be done. More smoothness than $C^1$ is needed for a symbol $q(\xi)$ to be a Fourier multiplier in $L_p$ (some well-known conditions are recalled in [15,Sect. 1.3]). There is an extension of Vishik and Eskin's work to $L_p$-based spaces by Shargorodsky ^[21], which should be useful. It is there pointed out that [6,Lemma 17.1] shows how smoothness properties carry over to the factors in the Wiener-Hopf factorization. $

Conflict of interest

The author declares no conflict of interest.