Skip to main content
SpringerLink
Log in

A new hybrid constructive neural network method for impacting and its application on tungsten price prediction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

To accurately predict the price of tungsten with an optimal architecture of neural networks (NNs) and better generalization performance, based on poor generalization and overfitting of a predictor such as a NNs, this paper presents a new hybrid constructive neural network method (HCNNM) to repair the impacting value in the original data in the same manner as the jumping points of a function. A series of theorems was proven that show a function with m jumping discontinuity points (or impacting points) can be approximated with the simplest NNs and a constructive decay Radial basis function (RBF) NNs, and a function with m jumping discontinuity points can be constructively approximated by hybrid constructive NNs. The hybrid networks have an optimal architecture and generalize well. Additionally, a practical problem regarding Tungsten prices from 1900 to 2014 is presented with some impacting points to more accurately approximate the sample data set and forecast future prices with the HCNNM, and some performance measures, such as the training time, testing RMSE and neurons, are compared with traditional algorithms (BP, SVM, ELM and Deep Learning) through many numerical experiments that fully verify the superiority, correctness and validity of the theory.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  1. Chakhmouradian AR, Smith MP, Kynicky J (2015) From strategic tungsten to green neodymium: a century of critical metals at a glance. Ore Geol Rev 64:455–458

    Article  Google Scholar 

  2. Xibing YYL (2010) Statistic model of supply and demand factors’ affect and prediction on tungsten’s value [J]. Mod Mining 1:027

    Google Scholar 

  3. Stock JH, Watson MW (1988) A probability model of the coincident economic indicators. National Bureau of Economic Research, Cambridge

    Book  Google Scholar 

  4. Tang H, Chun K, Xu L (2003) Finite mixture of ARMA-GARCH model for stock price prediction. In: Proc. of 3rd International Workshop on Computational Intelligence in Economics and Finance (CIEF2003), North Carolina, USA

  5. Garcia RC, et al (2005) A GARCH forecasting model to predict day-ahead electricity prices. IEEE Trans Power Syst 20(2):867–874

    Article  Google Scholar 

  6. Xi L, et al (2014) A new constructive neural network method for noise processing and its application on stock market prediction. Appl Soft Comput 15:57–66

    Article  Google Scholar 

  7. Zekic M Neural network applications in stock market predictions-a methodology analysis. In: Proceedings of the 9th International Conference on Information and Intelligent Systems 1998: Citeseer

  8. Wang Y-F (2002) Predicting stock price using fuzzy grey prediction system. Expert Syst Appl 22(1):33–38

    Article  Google Scholar 

  9. Ince H, Trafalis TB (2007) Kernel principal component analysis and support vector machines for stock price prediction. IIE Trans 39(5):629–637

    Article  Google Scholar 

  10. Muzhou H, Ming C, Yangchun Z (2015) A Self-Organizing Mixture Extreme Leaning Machine for Time Series Forecasting. In: Proceedings of ELM-2014, vol 1. Springer, pp 225–236

  11. Palm RB (2012) Prediction as a candidate for learning deep hierarchical models of data. https://github.com/rasmusbergpalm/DeepLearnToolbox

  12. Noriega JR, Wang H (1998) A direct adaptive neural-network control for unknown nonlinear systems and its application. IEEE Trans Neural Netw 9(1):27–34

    Article  Google Scholar 

  13. Carpenter GA, Grossberg S (1988) The ART of adaptive pattern recognition by a self-organizing neural network. Computer 21(3):77–88

    Article  Google Scholar 

  14. Liu Y-J, et al (2011) Adaptive neural output feedback tracking control for a class of uncertain discrete-time nonlinear systems. IEEE Trans Neural Netw 22(7):1162–1167

    Article  Google Scholar 

  15. Ge S, Hang C, Zhang T (1999) Adaptive neural network control of nonlinear systems by state and output feedback. IEEE Trans Syst Man Cybern B Cybern 29(5):818–828

    Article  Google Scholar 

  16. Polycarpou MM (1996) Stable adaptive neural control scheme for nonlinear systems. IEEE Trans Autom Control 41(3):447–451

    Article  MathSciNet  MATH  Google Scholar 

  17. Hagiwara K, Fukumizu K (2008) Relation between weight size and degree of over-fitting in neural network regression. Neural Netw 21(1):48–58

    Article  MATH  Google Scholar 

  18. Tetko IV, Livingstone DJ, Luik AI (1995) Neural network studies. 1. Comparison of overfitting and overtraining. J Chem Inf Comput Sci 35(5):826–833

    Article  Google Scholar 

  19. Schittenkopf C, Deco G, Brauer W (1997) Two strategies to avoid overfitting in feedforward networks. Neural Netw 10(3):505–516

    Article  Google Scholar 

  20. Yu Z, et al The design of RBF neural networks for solving overfitting problem. In: intelligent control and automation, 2006. WCICA 2006. The Sixth World Congress on: IEEE

  21. Perrone MP, Cooper LN (1992) When networks disagree: Ensemble methods for hybrid neural networks. DTIC Document

  22. Tay F, Cao L (2001) Application of support vector machines in financial time series forecasting. Omega-Oxford-Pergamon Press- 29:309–317

    Google Scholar 

  23. Doan C, Liong S (2004) Generalization for multilayer neural network: Bayesian regularization or early stopping

  24. Liu J, Demirci O, Calhoun VD (2008) A parallel independent component analysis approach to investigate genomic influence on brain function. IEEE Signal Process Lett 15:413–416

    Article  Google Scholar 

  25. Soltani S (2002) On the use of the wavelet decomposition for time series prediction. Neurocomputing 48 (1):267–277

    Article  MATH  Google Scholar 

  26. Karhunen J, et al (1997) A class of neural networks for independent component analysis. IEEE Trans Neural Netw 8(3):486–504

    Article  Google Scholar 

  27. Hyvärinen A, Oja E (2000) Independent component analysis: algorithms and applications. Neural Netw 13(4-5):411–430

    Article  Google Scholar 

  28. Prasad GK, Sahambi J Classification of ECG arrhythmias using multi-resolution analysis and neural networks. 2003: IEEE

  29. Shyu LY, Wu YH, Hu W (2004) Using wavelet transform and fuzzy neural network for VPC detection from the Holter ECG. IEEE Trans Biomed Eng 51(7):1269–1273

    Article  Google Scholar 

  30. He Y, Tan Y, Sun Y Wavelet neural network approach for fault diagnosis of analogue circuits. 2004: IET

  31. Chen B, et al (1999) Application of wavelets and neural networks to diagnostic system development, 1, feature extraction. Comput Chem Eng 23(7):899–906

    Article  Google Scholar 

  32. Shah S, Palmieri F, Datum M (1992) Optimal filtering algorithms for fast learning in feedforward neural networks. Neural Netw 5(5):779–787

    Article  Google Scholar 

  33. Connor JT, Martin RD, Atlas L (1994) Recurrent neural networks and robust time series prediction. IEEE Trans Neural Netw 5(2):240–254

    Article  Google Scholar 

  34. Feraund R, et al (2001) A fast and accurate face detector based on neural networks. IEEE Trans Pattern Anal Mach Intell 23(1):42–53

    Article  Google Scholar 

  35. Haykin S Neural networks and learning machines. Vol. 3. 2009: Prentice Hall

  36. Fan L, et al (2008) Singular points detection based on zero-pole model in fingerprint images. IEEE Trans Pattern Anal Mach Intell 30(5):929–940

    Google Scholar 

  37. Chang CC, Lin CJ (2011) LIBSVM: A library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):27

    Google Scholar 

  38. Haykin S, Network N (2004) A comprehensive foundation. Neural Netw:2

  39. Simon H Neural networks: a comprehensive foundation. 1999: Prentice Hall

  40. Huang GB, Zhu QY, Siew CK Extreme learning machine: a new learning scheme of feedforward neural networks. 2004: IEEE

  41. Huang GB, Chen L (2007) Convex incremental extreme learning machine. Neurocomputing 70 (16-18):3056–3062

    Article  Google Scholar 

  42. Islam MM, Yao X, Murase K (2003) A constructive algorithm for training cooperative neural network ensembles. IEEE Trans Neural Netw 14(4):820–834

    Article  Google Scholar 

  43. Liu D, Chang TS, Zhang Y (2002) A constructive algorithm for feedforward neural networks with incremental training. IEEE Transa Circuits Syst Part 1 Fundam Theory Appl 49(12):1876–1879

    Article  Google Scholar 

  44. Park J, Sandberg IW (1991) Universal approximation using radial-basis-function networks. Neural Comput 3(2):246–257

    Article  Google Scholar 

  45. Er MJ, et al (2002) Face recognition with radial basis function (RBF) neural networks. IEEE Trans Neural Netw 13(3):697–710

    Article  Google Scholar 

  46. Mai-Duy N, Tran-Cong T (2003) Approximation of function and its derivatives using radial basis function networks. Appl Math Model 27(3):197–220

    Article  MATH  Google Scholar 

  47. Hou M, Han X (2010) Constructive approximation to multivariate function by decay RBF neural network. IEEE Trans Neural Netw 21(9):1517–1523

    Article  Google Scholar 

  48. Llanas B, Sainz F (2006) Constructive approximate interpolation by neural networks. J Comput Appl Math 188(2):283–308

    Article  MathSciNet  MATH  Google Scholar 

  49. Islam MM, et al (2009) A new constructive algorithm for architectural and functional adaptation of artificial neural networks. IEEE Trans Syst Man Cybern B Cybern 39(5):1590–1605

    Article  Google Scholar 

  50. Zhao-qing K (2009) Analysis on periodical changes and the future trend of tungsten prices under domestic and overseas markets [J]. China Tungsten Ind 24(2):1–5

    MathSciNet  Google Scholar 

  51. Hao Z, et al (2013) Decomposition laws of tungsten prices fluctuation since 1900 and its applications. Trans Nonferrous Metals Soc China 23(9):2807–2816

    Article  Google Scholar 

  52. Kai W, et al (2008) An expanded training set based validation method to avoid overfitting for neural network classifier. In: Natural Computation, 2008. ICNC ’08 Fourth International Conference on

  53. Liu ZP, Castagna JP (1999) Avoiding overfitting caused by noise using a uniform training mode. In: Neural Networks IJCNN ’99. International Joint Conference on, p 1999

  54. Pinkus A (1999) Approximation theory of the MLP model in neural networks. Acta Numer 8(1):143–195

    Article  MathSciNet  MATH  Google Scholar 

  55. Cybenko G (1989) Approximation by superpositions of a sigmoidal function. Math Control Signals Syst (MCSS) 2(4):303–314

    Article  MathSciNet  MATH  Google Scholar 

  56. Chui CK (1992) An introduction to wavelets, vol 1. Academic Press, New York

    MATH  Google Scholar 

  57. Delyon B, Juditsky A, Benveniste A (1995) Accuracy analysis for wavelet approximations. IEEE Trans Neural Netw 6(2):332–348

    Article  Google Scholar 

  58. Huang CJ, Chen PW, Pan WT (2011) Using multi-stage data mining technique to build forecast model for Taiwan stocks. Neural Comput & Applic:1–7

  59. Huang G-B Extreme Learning Machines [Online]. http://www3.ntu.edu.sg/home/egbhuang

  60. Lin CCCaCJ LIBSVM – A Library for Support Vector Machines. https://www.csie.ntu.edu.tw/cjlin/libsvm/

Download references

Acknowledgments

This work was supported by the Natural Science Foundation of China under Grants 61375063, 61271355, 11301549 and 11271378.

Author information

Authors and Affiliations

  1. School of Mathematics and Statistics, Central South University, Changsha, 410083, China

    Hou Muzhou, Liu Taohua, Yang Yunlei, Zhu Hao, Liu Hongjuan & Liu Xinge

  2. Institute of Engineering Modeling and Scientific Computing, Central South University, Changsha, 410083, China

    Yuan Xiugui

Authors
  1. Hou Muzhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liu Taohua
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yang Yunlei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhu Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Liu Hongjuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yuan Xiugui
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Liu Xinge
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hou Muzhou.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Muzhou, H., Taohua, L., Yunlei, Y. et al. A new hybrid constructive neural network method for impacting and its application on tungsten price prediction. Appl Intell 47, 28–43 (2017). https://doi.org/10.1007/s10489-016-0882-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-016-0882-z

Keywords

Search

Navigation