Abstract
We propose two substantive extensions to the saddlepoint-based bootstrap (SPBB) methodology, whereby inference in parametric models is made through a monotone quadratic estimating equation (QEE). These are motivated through the first-order moving average model, where SPBB application is complicated by the fact that the usual estimators, method of moments (MOME), least squares, and maximum likelihood (MLE), all have mixed distributions and tend to be roots of high-order polynomials that violate the monotonicity requirement. A unifying perspective is provided by demonstrating that these estimators can all be cast as roots of appropriate QEEs. The first extension consists of two double saddlepoint-based Monte Carlo algorithms for approximating the Jacobian term appearing in the approximated density function of estimators derived from a non-monotone QEE. The second extension considers inference under QEEs from exponential power families. The methods are demonstrated for the MLE under a Gaussian distribution, and the MOME under a joint Laplace distribution for the process.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, T. W., Takemura, A. (1986). Why do noninvertible estimated moving averages occur? Journal of Time Series Analysis, 7, 235–254.
Azzalini, A., Capitanio, A. (1999). Statistical applications of the multivariate skew normal distribution. Journal of the Royal Statistical Society, B61, 579–602.
Azzalini, A., Dalla Valle, A. (1996). The multivariate skew-normal distribution. Biometrika, 83, 715–726.
Barnard, R. W., Trindade, A. A., Wickramasinghe, R. I. P. (2013). Some results for the first order moving average model under exponential power distributions. Preprint.
Branco, M. D., Dey, D. K. (2001). A general class of multivariate skew-elliptical distributions. Journal of Multivariate Analysis, 79, 99–113.
Brockwell, P. J., Davis, R. A. (1991). Time series: theory and methods (2nd ed.). New York: Springer.
Butler, R. W. (2007). Saddlepoint approximations with applications. New York: Cambridge University Press.
Cryer, J. D., Chan, K.-S. (2008). Time series analysis: with applications in R (2nd ed.). New York: Springer.
Cryer, J. D., Ledolter, J. (1981). Small-Sample properties of the maximum likelihood estimator in the first-order moving average model. Biometrika, 68, 691–694.
Daniels, H. E. (1983). Saddlepoint approximations for estimating equations. Biometrika, 70, 89–96.
Davis, R. A., Dunsmuir, W. T. M. (1996). Maximum likelihood estimation for MA(1) processes with a root on or near the unit circle. Econometric Theory, 12, 1–29.
Davis, R. A., Song, L. (2011). Unit roots in moving averages beyond first order. The Annals of Statistics, 39, 3062–3091.
Davis, R. A., Chen, M., Dunsmuir, W. T. M. (1995). Inference for MA(1) processes with a root on or near the unit circle. Probability and Mathematical Statistics, 15, 227–242.
Fang, K. T., Anderson, T. W. (1990). Statistical inference in elliptically contoured and related distributions. New York: Allerton Press.
Fang, K. T., Zhang, Y. T. (1990). Generalized multivariate analysis. Berlin: Springer-Verlag.
Fang, K., Kotz, S., Ng, K. W. (1990). Symmetric multivariate and related distributions, Monographs on Statistics and Applied Probability. New York: Chapman and Hall/CRC.
Feuerverger, A., Wong, A. (2000). Computation of Value-at-Risk for nonlinear portfolios. Journal of Risk, 3, 37–55.
Gomez, E., Gomez-Villegas, M. A., Marin, J. M. (1998). A multivariate generalization of the power exponential family of distributions. Communications in Statistics, A27, 589–600.
Gomez, E., Gomez-Villegas, M. A., Marin, J. M. (2002). Continuous elliptical and exponential power linear dynamic models. Journal of Multivariate Analysis, 83, 22–36.
Gupta, A. K., Huang, W. J. (2002). Quadratic forms in skew normal variates. Journal of Mathematical Analysis and Applications, 273, 558–564.
Gupta, A. K., Gonzalez-Farias, G., Dominguez-Molina, J. A. (2004). A Multivariate skew normal distribution. Journal of Multivariate Analysis, 89, 181–190.
Hall, P. (1988). Theoretical comparison of bootstrap confidence intervals (with discussion). The Annals of Statistics, 16, 927–985.
Huang, W.-J., Chen, Y.-H. (2006). Quadratic forms of multivariate skew normal-symmetric distributions. Statistics and Probability Letters, 9, 871–879.
Kotz, S., Kozubowski, T., Podgórski, K. (2001). The laplace distribution and generalizations: A revisit with applications to communications, economics, engineering, and finance. Boston: Birkhäuser.
Lugannani, R., Rice, S. O. (1980). Saddlepoint approximations for the distribution of sums of independent of random variables. Advances in Applied Probability, 12, 475–490.
Lund, R. B., Butler, R. W., Paige, R. L. (1999). Prediction of shot noise. Journal of Applied Probability, 36, 374–388.
Mineo, A. M., Ruggieri, M. (2005). A software tool for the exponential power distribution: the normalp package. Journal of Statistical Software, 12(4), 1–23.
Nadarajah, S. (2005). A generalized normal distribution. Journal of Applied Statistics, 32, 685–694.
Paige, R. L., Fernando, P. (2008). Robust inference in conditionally linear nonlinear regression models. Scandinavian Journal of Statistics, 35, 158–168.
Paige, R. L., Trindade, A. A. (2008). Practical small sample inference for single lag subset autoregressive models. Journal of Statistical Planning and Inference, 138, 1934–1949.
Paige, R. L., Trindade, A. A. (2010). The Hodrick-Prescott Filter: a special case of penalized spline smoothing. Electronic Journal of Statistics, 4, 856–874.
Paige, R. L., Trindade, A. A. (2013). Fast and accurate inference for the smoothing parameter in semiparametric models. Australian and New Zealand Journal of Statistics, 55, 25–41.
Paige, R. L., Trindade, A. A., Fernando, P. H. (2009). Saddlepoint-Based bootstrap inference for quadratic estimating equations. Scandinavian Journal of Statistics, 36, 98–111.
Plosser, C. I., Schwertz, G. W. (1977). Estimation of a non-invertible moving average process: the case for overdifferencing. Journal of Econometrics, 6, 199–224.
Provost, S. B., Cheong, Y.-H. (2002). The distribution of Hermitian quadratic forms in elliptically contoured random vectors. Journal of Statistical Planning and Inference, 102, 303–316.
Robert, C. P., Casella, G. (2004). Monte Carlo statistical methods (2nd ed.). New York: Springer.
Shumway, R. H., Stoffer, D. S. (2011). Time series analysis and its applications: with R examples (3rd ed.). New York: Springer.
Skovgaard, I. M. (1990). On the density of minimum contrast estimators. The Annals of Statistics, 18, 779–789.
Spady, R. H. (1991). Saddlepoint approximations for regression models. Biometrika, 78, 879–889.
Tanaka, K. (1990). Testing for a moving average unit root. Econometric Theory, 6, 433–444.
Wang, T., Li, B., Gupta, A. K. (2009). Distribution of quadratic forms under skew normal settings. Journal of Multivariate Analysis, 100, 533–545.
Wickramasinghe, R. I. P. (2012). Extensions of saddlepoint-based bootstrap inference with application to the moving average model of order one, PhD Dissertation. Texas Tech University, Lubbock.
Young, G. A. (2009). Routes to higher-order accuracy in parametric inference. Australian and New Zealand Journal of Statistics, 51, 115–126.
Acknowledgments
The paper has greatly benefited from the comments of two anonymous referees.
Author information
Authors and Affiliations
Corresponding author
About this article
Cite this article
Paige, R.L., Trindade, A.A. & Wickramasinghe, R.I.P. Extensions of saddlepoint-based bootstrap inference. Ann Inst Stat Math 66, 961–981 (2014). https://doi.org/10.1007/s10463-013-0434-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-013-0434-9