- Source: Khintchine inequality
In mathematics, the Khintchine inequality, named after Aleksandr Khinchin and spelled in multiple ways in the Latin alphabet, is a theorem from probability, and is also frequently used in analysis. Heuristically, it says that if we pick
N
{\displaystyle N}
complex numbers
x
1
,
…
,
x
N
∈
C
{\displaystyle x_{1},\dots ,x_{N}\in \mathbb {C} }
, and add them together each multiplied by a random sign
±
1
{\displaystyle \pm 1}
, then the expected value of the sum's modulus, or the modulus it will be closest to on average, will be not too far off from
|
x
1
|
2
+
⋯
+
|
x
N
|
2
{\displaystyle {\sqrt {|x_{1}|^{2}+\cdots +|x_{N}|^{2}}}}
.
Statement
Let
{
ε
n
}
n
=
1
N
{\displaystyle \{\varepsilon _{n}\}_{n=1}^{N}}
be i.i.d. random variables
with
P
(
ε
n
=
±
1
)
=
1
2
{\displaystyle P(\varepsilon _{n}=\pm 1)={\frac {1}{2}}}
for
n
=
1
,
…
,
N
{\displaystyle n=1,\ldots ,N}
,
i.e., a sequence with Rademacher distribution. Let
0
<
p
<
∞
{\displaystyle 0
and let
x
1
,
…
,
x
N
∈
C
{\displaystyle x_{1},\ldots ,x_{N}\in \mathbb {C} }
. Then
A
p
(
∑
n
=
1
N
|
x
n
|
2
)
1
/
2
≤
(
E
|
∑
n
=
1
N
ε
n
x
n
|
p
)
1
/
p
≤
B
p
(
∑
n
=
1
N
|
x
n
|
2
)
1
/
2
{\displaystyle A_{p}\left(\sum _{n=1}^{N}|x_{n}|^{2}\right)^{1/2}\leq \left(\operatorname {E} \left|\sum _{n=1}^{N}\varepsilon _{n}x_{n}\right|^{p}\right)^{1/p}\leq B_{p}\left(\sum _{n=1}^{N}|x_{n}|^{2}\right)^{1/2}}
for some constants
A
p
,
B
p
>
0
{\displaystyle A_{p},B_{p}>0}
depending only on
p
{\displaystyle p}
(see Expected value for notation). The sharp values of the constants
A
p
,
B
p
{\displaystyle A_{p},B_{p}}
were found by Haagerup (Ref. 2; see Ref. 3 for a simpler proof). It is a simple matter to see that
A
p
=
1
{\displaystyle A_{p}=1}
when
p
≥
2
{\displaystyle p\geq 2}
, and
B
p
=
1
{\displaystyle B_{p}=1}
when
0
<
p
≤
2
{\displaystyle 0
.
Haagerup found that
A
p
=
{
2
1
/
2
−
1
/
p
0
<
p
≤
p
0
,
2
1
/
2
(
Γ
(
(
p
+
1
)
/
2
)
/
π
)
1
/
p
p
0
<
p
<
2
1
2
≤
p
<
∞
and
B
p
=
{
1
0
<
p
≤
2
2
1
/
2
(
Γ
(
(
p
+
1
)
/
2
)
/
π
)
1
/
p
2
<
p
<
∞
,
{\displaystyle {\begin{aligned}A_{p}&={\begin{cases}2^{1/2-1/p}&0
where
p
0
≈
1.847
{\displaystyle p_{0}\approx 1.847}
and
Γ
{\displaystyle \Gamma }
is the Gamma function.
One may note in particular that
B
p
{\displaystyle B_{p}}
matches exactly the moments of a normal distribution.
Uses in analysis
The uses of this inequality are not limited to applications in probability theory. One example of its use in analysis is the following: if we let
T
{\displaystyle T}
be a linear operator between two Lp spaces
L
p
(
X
,
μ
)
{\displaystyle L^{p}(X,\mu )}
and
L
p
(
Y
,
ν
)
{\displaystyle L^{p}(Y,\nu )}
,
1
<
p
<
∞
{\displaystyle 1
, with bounded norm
‖
T
‖
<
∞
{\displaystyle \|T\|<\infty }
, then one can use Khintchine's inequality to show that
‖
(
∑
n
=
1
N
|
T
f
n
|
2
)
1
/
2
‖
L
p
(
Y
,
ν
)
≤
C
p
‖
(
∑
n
=
1
N
|
f
n
|
2
)
1
/
2
‖
L
p
(
X
,
μ
)
{\displaystyle \left\|\left(\sum _{n=1}^{N}|Tf_{n}|^{2}\right)^{1/2}\right\|_{L^{p}(Y,\nu )}\leq C_{p}\left\|\left(\sum _{n=1}^{N}|f_{n}|^{2}\right)^{1/2}\right\|_{L^{p}(X,\mu )}}
for some constant
C
p
>
0
{\displaystyle C_{p}>0}
depending only on
p
{\displaystyle p}
and
‖
T
‖
{\displaystyle \|T\|}
.
Generalizations
For the case of Rademacher random variables, Pawel Hitczenko showed that the sharpest version is:
A
(
p
(
∑
n
=
b
+
1
N
x
n
2
)
1
/
2
+
∑
n
=
1
b
x
n
)
≤
(
E
|
∑
n
=
1
N
ε
n
x
n
|
p
)
1
/
p
≤
B
(
p
(
∑
n
=
b
+
1
N
x
n
2
)
1
/
2
+
∑
n
=
1
b
x
n
)
{\displaystyle A\left({\sqrt {p}}\left(\sum _{n=b+1}^{N}x_{n}^{2}\right)^{1/2}+\sum _{n=1}^{b}x_{n}\right)\leq \left(\operatorname {E} \left|\sum _{n=1}^{N}\varepsilon _{n}x_{n}\right|^{p}\right)^{1/p}\leq B\left({\sqrt {p}}\left(\sum _{n=b+1}^{N}x_{n}^{2}\right)^{1/2}+\sum _{n=1}^{b}x_{n}\right)}
where
b
=
⌊
p
⌋
{\displaystyle b=\lfloor p\rfloor }
, and
A
{\displaystyle A}
and
B
{\displaystyle B}
are universal constants independent of
p
{\displaystyle p}
.
Here we assume that the
x
i
{\displaystyle x_{i}}
are non-negative and non-increasing.
See also
Marcinkiewicz–Zygmund inequality
Burkholder-Davis-Gundy inequality
References
Thomas H. Wolff, "Lectures on Harmonic Analysis". American Mathematical Society, University Lecture Series vol. 29, 2003. ISBN 0-8218-3449-5
Uffe Haagerup, "The best constants in the Khintchine inequality", Studia Math. 70 (1981), no. 3, 231–283 (1982).
Fedor Nazarov and Anatoliy Podkorytov, "Ball, Haagerup, and distribution functions", Complex analysis, operators, and related topics, 247–267, Oper. Theory Adv. Appl., 113, Birkhäuser, Basel, 2000.
Kata Kunci Pencarian:
- Khintchine inequality
- Marcinkiewicz–Zygmund inequality
- List of inequalities
- Concentration inequality
- Rademacher distribution
- Aleksandr Khinchin
- List of statistics articles
- Itô calculus
- Haar wavelet
- List of probability topics
