Regression of polynomial statistics on the sample mean and natural exponential families

Abstract

A polynomial Q = Q(X ₁, …, X _n ) of degree m in independent identically distributed random variables with distribution function F is an unbiased estimator of a functional q(α ₁(F), …, α _m (F)), where q(u ₁, …, u _m ) is a polynomial in u ₁, …, u _m and α _j (F) is the jth moment of F (assuming the necessary moment of F exists). It is shown that the relation E(Q | X ₁ + … + X n) = 0 holds if and only if q(α ₁(θ), …, α _m (θ)) ≡ 0, where α _j (θ) is the jth moment of the natural exponential family generated by F. This result, based on the fact that X ₁ + … + X n is a complete sufficient statistic for a parameter θ in a sample from a natural exponential family of distributions F _θ(x) = ∫ ^x_−∞ e ^θu−k(θ) dF(u), explains why the distributions appearing as solutions of regression problems are the same as solutions of problems for natural exponential families though, at the first glance, the latter seem unrelated to the former.