Abstract
The core classical theorems in probability and statistics are the following:
-
The law of large numbers (LLN): Suppose {X n ,n ≥ 1} are independent, identically distributed (iid) random variables with common mean E(X n ) = μ. The LLN says the sample average is approximately equal to the mean, so that
$$ \frac{1}{n}\sum\limits_{i = 1}^n {{X_i}} \to \mu $$.
An immediate concern is what does the convergence arrow “→” mean? This result has far-reaching consequences since, if
$$ {X_i}\left\{ {\begin{array}{*{20}{c}} {1,}&{ifeventAoccurs,} \\ {0,}&{otherwise} \end{array}} \right. $$then the average \( \sum\nolimits_{i = 1}^n {{X_i}} /n \) is the relative frequency of occurrence of A in n repetitions of the experiment and μ = P(A). The LLN justifies the frequency interpretation of probabilities and much statistical estimation theory where it underlies the notion of consistency of an estimator.
-
Central limit theorem (CLT): The central limit theorem assures us that sample averages when centered and scaled to have mean 0 and variance 1 have a distribution that is approximately normal. If {X n , n ≥ 1} are iid with common mean E(X n ) = μ and variance Var(X n ) = σ 2, then
$$ P\left[ {\frac{{\sum\nolimits_{i = 1}^n {{X_i} - n\mu } }}{{\sigma \sqrt n }}x} \right] \to N(x): = \int_{ - \infty }^x {\frac{{{e^{ - {u^2}/2}}}}{{\sqrt {2\pi } }}} du $$.
This result is arguably the most important and most frequently applied result of probability and statistics. How is this result and its variants proved?
-
Martingale convergence theorems and optional stopping: A martingale is a stochastic process {X n , n ≥ 0} used to model a fair sequence of gambles (or, as we say today, investments). The conditional expectation of your wealth X n +1 after the next gamble or investment given the past equals the current wealth X n . The martingale results on convergence and optimal stopping underlie the modern theory of stochastic processes and are essential tools in application areas such as mathematical finance. What are the basic results and why do they have such far reaching applicability?
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer Science+Business Media New York
About this chapter
Cite this chapter
Resnick, S.I. (2005). Sets and Events. In: A Probability Path. Birkhäuser, Boston, MA. https://doi.org/10.1007/978-1-4612-1818-0_1
Download citation
DOI: https://doi.org/10.1007/978-1-4612-1818-0_1
Publisher Name: Birkhäuser, Boston, MA
Print ISBN: 978-1-4612-7297-7
Online ISBN: 978-1-4612-1818-0
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)