Skip to main content
Log in

On the ε-entropy of diffusion processes

  • Published:
Annals of the Institute of Statistical Mathematics Aims and scope Submit manuscript

Summary

In the present paper we give an evaluation of ε-entropy of a one dimensional diffusion process ξ(t) 0≦tT whose generator is

$$\mathfrak{G} = \frac{1}{2}a(x)^2 \frac{{d^2 }}{{dx^2 }} (x \in R),$$
((1))

where the diffusion coefficienta(x) 2 satisfies

$$\left| {a(x) - a(y)} \right| \leqq L\left| {x - y} \right|,$$
((2))
$$0< k \leqq a(x)^2 \leqq K$$
((3))

for everyx andy (L, k andK are positive constants). We assume ξ(0)=0 for simplicity of calculation. Then we can prove the following:Theorem.Under the conditions (2)and (3),ε-entropy H ε ({ξ(t)})of ξ(t), 0≦tT is asymptotically evaluated for small ε>0

$$\frac{k}{{eK}} \cdot \frac{1}{{\pi ^2 }}\left\{ {\int_0^T {\sqrt {Ea(\xi (u))^2 } du} } \right\}^2 \frac{1}{{\varepsilon ^2 }} \precsim H_\varepsilon (\left\{ {\xi (t)} \right\}) \precsim \frac{2}{{\pi ^2 }}\left\{ {\int_0^T {\sqrt {Ea(\xi (u))^2 } du} } \right\}^2 \frac{1}{{\varepsilon ^2 }}.$$

Previously Kolmogorov stated in [3] without proof “For a diffusion process whose generator is given by (1)H ε ({ξ(t)}) is calculated by the formula:

$$H_\varepsilon (\left\{ {\xi (t)} \right\}) = \frac{4}{\pi }\left\{ {\int_0^T {Ea(\xi (u))^2 du} } \right\}\frac{1}{{\varepsilon ^2 }} + o\left( {\frac{1}{{\varepsilon ^2 }}} \right) (\varepsilon \to 0)$$

under certain natural conditions”. However, in consideration of Pinsker’s results for Gaussian processes [5] and our present theorem this formula appears inaccurate. For the proof of the theorem we use the well-known formula of ε-entropy for finite dimensional random variables (lemma 3).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. R. Courant and D. Hilbert,Methoden der matematischen Physik I, Springer, 1931.

  2. A. M. Geerish and P. M. Schultheiss, “Information rates of non-Gaussian processes,”IEEE Transac. Inform, Theory, IT-10 (1964), 265–271.

  3. A. N. Kolmogorov, “Theory of transmission of information,”Amer. Math. Soc. Transl., Ser. 2, 291–321.

  4. Yu. N. Linikov, “Calculation of ε-entropy of random variables for small ε,” (in Russian),Problems of Transmission of Information, 1, No. 2 (1965), 18–27.

    Google Scholar 

  5. M. S. Pinsker, “Gaussian sources,” (in Russian),Problems of Transmission of Information 14 (1963), 59–100.

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

\(f(\varepsilon ) \precsim g(\varepsilon )\) means\(\overline {\mathop {\lim }\limits_{\varepsilon \to 0} } \frac{{f(\varepsilon )}}{{g(\varepsilon )}} \leqq 1\)

The Institute of Statistical Mathematics

About this article

Cite this article

Kazi, K. On the ε-entropy of diffusion processes. Ann Inst Stat Math 21, 347–356 (1969). https://doi.org/10.1007/BF02532263

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02532263

Keywords

Navigation