The Optimistic Method for Model Estimation
We present the method of optimistic estimation, a novel paradigm that seeks to incorporate robustness to errors-in-variables biases directly into the estimation objective function. This approach protects parameter estimates in statistical models from data set corruption. We apply the optimistic paradigm to estimation of linear regression, logistic regression, and Ising graphical models in the presence of noise and demonstrate that more accurate predictions of the model parameters can be obtained.
KeywordsOrdinary Little Square Ising Model Robust Optimization Optimistic Estimator Interior Point Algorithm
The authors wish to thank Abigail Gertner and Jason Ventrella of The MITRE Corporation for helpful comments and recommendations. The author’s affiliation with The MITRE Corporation is provided for identification purposes only, and is not intended to convey or imply MITRE’s concurrence with, or support for, the positions, opinions or viewpoints expressed by the author. Approved for Public Release; Distribution Unlimited. Case Number 16-0621.