Improving Prediction Interval Quality: A Genetic Algorithm-Based Method Applied to Neural Networks
The delta technique has been proposed in literature for constructing prediction intervals for targets estimated by neural networks. Quality of constructed prediction intervals using this technique highly depends on neural network characteristics. Unfortunately, literature is void of information about how these dependences can be managed in order to optimize prediction intervals. This study attempts to optimize length and coverage probability of prediction intervals through modifying structure and parameters of the underlying neural networks. In an evolutionary optimization, genetic algorithm is applied for finding the optimal values of network size and training hyper-parameters. The applicability and efficiency of the proposed optimization technique is examined and demonstrated using a real case study. It is shown that application of the proposed optimization technique significantly improves quality of constructed prediction intervals in term of length and coverage probability.
KeywordsNeural network genetic algorithm prediction interval
Unable to display preview. Download preview PDF.
- 5.Nix, D.A., Weigend, A.S.: Estimating the mean and variance of the target probability distribution. In: IEEE International Conference on Neural Networks (1994)Google Scholar
- 7.Khosravi, A., Nahavandi, S., Creighton, D.: Constructing Prediction Intervals for Neural Network Metamodels of Complex Systems. In: International Joint Conference on Neural Networks, IJCNN 2009 (2009)Google Scholar
- 8.Khosravi, A., Nahavandi, S., Creighton, D.: A Prediction Interval-Based Approach to Determine Optimal Structures of Neural Network Metamodels. Expert Systems with Applications (August 2009) (in Press) (accepted Manuscript)Google Scholar
- 11.Gen, M., Cheng, R.: Genetic algorithms and engineering design. Wiley, New York (1997)Google Scholar
- 15.Asuncion, A., Newman, D.J.: UCI Machine Learning Repository, Irvine, CA, University of California, School of Information and Computer Science (2009), http://www.ics.uci.edu/~mlearn/MLRepository.html