Fundamentals of Probability: A First Course pp 213-242 | Cite as

# Normal Approximations and the Central Limit Theorem

## Abstract

Many of the special discrete and special continuous distributions that we have discussed can be well approximated by a normal distribution for suitable configurations of their underlying parameters. Typically, the normal approximation works well when the parameter values are such that the skewness of the distribution is small. For example, binomial distributions are well approximated by a normal distribution when *n* is large and *p* is not too small or too large. Gamma distributions are well approximated by a normal distribution when the shape parameter α is large. Whenever we see a certain phenomenon empirically all too often, we might expect that there is a unifyingmathematical result there, and in this case indeed there is. The unifyingmathematical result is one of the most important results in all of mathematics and is called the *central limit theorem*. The subject of central limit theorems is incredibly diverse. In this chapter, we present the basic or the *canonical central limit theorem* and its applications to certain problems with which we are already familiar. Among numerous excellent references on central limit theorems, we recommend Feller (1968, 1971) and Pitman (1992) for lucid expositions and examples. The subject of central limit theorems also has a really interesting history; we recommend Le Cam (1986) and Stigler (1986) in this area. Careful and comprehensive mathematical treatments are available in Hall (1992) and Bhattacharya and Rao (1986). For a diverse selection of examples, see DasGupta (2008).

## Keywords

Central Limit Theorem Normal Approximation Continuity Correction Binomial Probability Fair Coin## Preview

Unable to display preview. Download preview PDF.

## References

- Abramowitz, M. and Stegun, I. (1970).
*Handbook of Mathematical Functions*, Dover, New York.Google Scholar - Bhattacharya, R. and Rao, R. (1986).
*Normal Approximation and Asymptotic Expansions*, Wiley, New York.MATHGoogle Scholar - Charlier, C. (1931).
*Applications de la théorie des probabilités á l’astronomie*, Gauthier-Villars, Paris.MATHGoogle Scholar - DasGupta, A. (2008).
*Asymptotic Theory of Statistics and Probability*, Springer, New York.MATHGoogle Scholar - Edgeworth, F. (1904). The law of error, Trans. Cambridge Philos. Soc., 20, 36–65, 113–141.Google Scholar
- Feller, W. (1968).
*Introduction to Probability Theory and Its Applications*,*Vol. I*, Wiley, New York.Google Scholar - Feller, W. (1971).
*Introduction to Probability Theory and Its Applications*,*Vol. II*, Wiley, New York.MATHGoogle Scholar - Hall, P. (1992).
*The Bootstrap and Edgeworth Expansion*, Springer, New York.Google Scholar - Le Cam, L. (1986). The central limit theorem around 1935, Statist. Sci., 1, 78–91.CrossRefMathSciNetGoogle Scholar
- Patel, J. and Read, C. (1996).
*Handbook of the Normal Distribution*, Marcel Dekker, New York.MATHGoogle Scholar - Pitman, J. (1992).
*Probability*, Springer, New York.Google Scholar - Stigler, S. (1986).
*History of Statistics: Measurement of Uncertainty before 1900*, Harvard University press, Cambridge, MA.MATHGoogle Scholar