Abstract
Inspired by the Conjugate Variables Theorem in physics, we provide a general expectation identity for univariate continuous random variables by utilizing integration by parts. We then apply the general expectation identity to some common univariate continuous random variables (normal, gamma (including chi-square and exponential), beta, double exponential, F, inverse gamma, logistic, lognormal, Pareto, t, uniform, and Weibul) and obtain their specific expectation identities from the general expectation identity. After that, we use the specific expectation identities to derive high-order moments of the corresponding univariate continuous random variables.
Similar content being viewed by others
References
Baquero-Ruiz M, Manke F, Furno I, Fasoli A, Ricci P (2018) Meandering particle bunches and a link between averages of time series of particle counts and higher-order moments. Phys Rev E 98(3):321
Bourin C, Bondon P (1998) Efficiency of high-order moment estimates. IEEE Trans Signal Process 46(1):255–258
Casella G, Berger RL (2002) Statistical inference, 2nd edn. Duxbury, Pacific Grove
Chakraborti S, Jardim F, Epprecht E (2019) Higher-order moments using the survival function: the alternative expectation formula. Am Stat 73(2):191–194
Chan LH, Chen K, Li CX, Wong CW, Yau CY (2020) On higher-order moment and cumulant estimation. J Stat Comput Simul 90(4):747–771
Dault D, Shanker B (2016) A mixed potential mlfma for higher order moment methods with application to the generalized method of moments. IEEE Trans Antennas Propag 64(2):650–662
Davis S, Gutierrez G (2012) Conjugate variables in continuous maximum-entropy inference. Phys Rev E 86(051136):1–6
Davis S, Gutierrez G (2016) Applications of the divergence theorem in Bayesian inference and maxent. AIP Conf Proc 1757(020002):1–7
Deng AW, Gwo CY (2018) Fast and stable algorithms for high-order pseudo Zernike moments and image reconstruction. Appl Math Comput 334:239–253
Ding FQ, Yao DJ (2011) Dividend payments in jump-diffusion risk model with interest and constant dividend barrier. Chin J Appl Probab Statist 27:210–223
Djordjevic M, Notaros BM (2005) Higher order hybrid method of moments-physical optics modeling technique for radiation and scattering from large perfectly conducting surfaces. IEEE Trans Antennas Propag 53(2):800–813
Dong YF, Zhang JY, Yan GW (2010) A higher-order moment method of the lattice Boltzmann model for the conservation law equation. Appl Math Model 34(2):481–494
Essadki M, de Chaisemartin S, Laurent F, Massot M (2018) High order moment model for polydisperse evaporating sprays towards interfacial geometry description. SIAM J Appl Math 78(4):2003–2027
Fonollosa JR, Nikias CL (1993) Wigner higher-order moment spectra—definition, properties, computation and application to transient signal analysis. IEEE Trans Signal Process 41(1):245–266
Girard S, Guillou A, Stupfler G (2012) Estimating an endpoint with high order moments in the Weibull domain of attraction. Stat Probab Lett 82(12):2136–2144
Gomez TA, Nagayama T, Kilcrease DP, Montgomery MH, Winget DE (2016) Effect of higher-order multipole moments on the stark line shape. Phys Rev A 94(2):022501
Haegele D, Schefczik F (2018) Higher-order moments, cumulants, and spectra of continuous quantum noise measurements. Phys Rev B 98(20):205143
Hall P, Presnell B (1999) Biased bootstrap methods for reducing the effects of contamination. J R Stat Soc Ser B 61:661–680
Hossjer O (2003) Determining inheritance distributions via stochastic penetrances. J Am Stat Assoc 98(464):1035–1051
Hu ZC, Hu GH (2019) An efficient steady-state solver for microflows with high-order moment model. J Comput Phys 392:462–482
Hudson HM (1978) A natural identity for exponential families with applications in multiparameter estimation. Ann Stat 8:473–484
Hwang JT (1982) Improving upon standard estimators in discrete exponential families with applications to Poisson and negative binomial cases. Ann Stat 10:857–867
Jiang J, Shang PJ, Zhang ZQ, Li XM (2018) The multi-scale high-order statistical moments of financial time series. Physica A 512:474–488
Kah D, Laurent F, Massot M, Jay S (2012) A high order moment method simulating evaporation and advection of a polydisperse liquid spray. J Comput Phys 231(2):394–422
Kundu C, Sarkar K (2017) Characterizations based on higher order and partial moments of inactivity time. Stat Pap 58(3):607–626
Lin ZC, Gu ZJ, Zhao XW, Zhang Y, Liu HW (2018) An efficient matrix equation parallel direct solver for higher-order method of moments in solution of complex electromagnetic problems. IEEE Access 6:29784–29792
Ling SQ, Li WK (1997) On fractionally integrated autoregressive moving-average time series models with conditional heteroscedasticity. J Am Stat Assoc 92(439):1184–1194
Lu H, Cao S, Zhu ZC, Zhang YM (2020) An improved high order moment-based saddlepoint approximation method for reliability analysis. Appl Math Model 82:836–847
Meijer E (2005) Matrix algebra for higher order moments. Linear Algebra Appl 410:112–134
Mohamed C, Sedory SA, Singh S (2017) Imputation using higher order moments of an auxiliary variable. Commun Stat 46(8):6588–6617
Peralta J, Loyola C, Loguercio H, Davis S (2017) A method for density estimation based on expectation identities. AIP Conf Proc 1853(110001):1–6
Seo JS, Lee S (2011) Higher-order moments for musical genre classification. Signal Process 91(8):2154–2157
Singh C, Upneja R (2014) Accurate calculation of high order pseudo-zernike moments and their numerical stability. Digital Signal Process 27:95–106
Singh S, Chen CC (2009) Utilization of higher order moments of scrambling variables in randomized response sampling. J Stat Plann Inference 139(9):3377–3380
Stein C (1973) Estimation of the mean of a multivariate distribution. In: Proceedings of the Prague symposium on asymptotic statistics, pp 345–381, Prague. Charles University
Stein C (1981) Estimation of the mean of a multivariate normal distribution. Ann Stat 9:1135–1151
Tawfik A, Magdy N, Diab A (2014) Polyakov linear su(3) sigma model: features of higher-order moments in a dense and thermal hadronic medium. Phys Rev C 89(5):055210
Vicinanza M, Cardone VF, Maoli R, Scaramella R, Er XZ (2018) Increasing the lensing figure of merit through higher order convergence moments. Phys Rev D 97(2):023519
Zhang YH, Zhou XF (2019) High order moments of first hitting times for single death processes. Front Math China 14(5):1037–1061
Zhang YY, Rong TZ, Li MM (2019) Expectation identity for the binomial distribution and its application in the calculations of high-order binomial moments. Commun Stat 48:5467–5476
Funding
The research was supported by the Ministry of Education (MOE) Project of Humanities and Social Sciences on the West and the Border Area (Grant No. 20XJC910001), the National Social Science Fund of China (Grant No. 21XTJ001), and the National Natural Science Foundation of China (Grant Nos. 11671060; 12001068; 72071019).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Hong-Jiang Wu and Ying-Ying Zhang are co-first authors.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Wu, HJ., Zhang, YY. & Li, HY. Expectation identities from integration by parts for univariate continuous random variables with applications to high-order moments. Stat Papers 64, 477–496 (2023). https://doi.org/10.1007/s00362-022-01329-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-022-01329-5
Keywords
- Conjugate variables theorem
- Expectation identity
- High-order moments
- Integration by parts
- Univariate continuous random variables