Integrated CS optimization and OLS for recurrent neural network in modeling microwave thermal process

  • Tong Liu
  • Shan LiangEmail author
  • Qingyu Xiong
  • Kai Wang
Engineering Applications of Neural Networks 2018


In this paper, we propose a novel hybrid algorithm to construct an improved recurrent neuron network (RNN) for modeling tunnel microwave thermal process. The new design involves a hierarchical learning process, in which the recurrent neurons of RNN are optimized by the cuckoo search (CS) algorithm, while effectiveness and efficiency of the model are guaranteed by using the orthogonal least squares (OLS) method, which is a fast approach for construction of neural networks in a stepwise forward procedure. The major contribution is to integrate seamlessly the OLS model selection and CS neuron optimization in an innovative way so that it can well track the underlying dynamic of this complicated thermal process with a very sparse model. By conducting a microwave rice drying experiment, a set of real-world datasets is used to drive the RNN model. Simulation results demonstrate the effectiveness of the proposed model compared with existing well-known approaches in terms of modeling accuracy and model compactness.


Tunnel microwave thermal process Recurrent neuron network Cuckoo search optimization Orthogonal least squares 



This work was supported by the National Natural Science Foundation of China under Grant 61771077, the Key Research Program of Chongqing Science & Technology under Grant CSTC2017jcyjBX0025 and the UK Engineering and Physical Sciences Research Council (EPSRC) under Grant EP/P004636/1. The authors would like to thank Y. Xiong and S. Gan for their helpful suggestions and careful reading of the manuscript.


  1. 1.
    Osepchuk JM (2003) A history of microwave heating applications. IEEE Trans Microw Theory Tech 32(9):1200–1224CrossRefGoogle Scholar
  2. 2.
    Vongpradubchai S, Rattanadecho P (2009) The microwave processing of wood using a continuous microwave belt drier. Chem Eng Process Process Intensif 48(5):997–1003CrossRefGoogle Scholar
  3. 3.
    Rattanadecho P, Suwannapum N, Chatveera B, Atong D, Makul N (2008) Development of compressive strength of cement paste under accelerated curing by using a continuous microwave thermal processor. Mater Sci Eng A 472(1–2):299–307CrossRefGoogle Scholar
  4. 4.
    Atong D, Ratanadecho P, Vongpradubchai S (2006) Drying of a slip casting for tableware product using microwave continuous belt dryer. Dry Technol 24(5):589–594CrossRefGoogle Scholar
  5. 5.
    Yuan Y, Liang S, Gan S, Zhong J, Xiong Q (2017) Expert control system based multi-mode hybrid switching control strategy for microwave lignite drying. Dry Technol 35(12):1468–1480CrossRefGoogle Scholar
  6. 6.
    Zhao D, Wang Y, Zhu Y, Ni Y (2016) Effect of carbonic maceration pre-treatment on drying behaviour and physicochemical compositions of sweet potato dried with intermittent or continuous microwave. Dry Technol 34(13):1604–1612CrossRefGoogle Scholar
  7. 7.
    Zhong J, Liang S, Yuan Y, Xiong Q (2016) Coupled electromagnetic and heat transfer ODE model for microwave heating with temperature-dependent permittivity. IEEE Trans Microw Theory Tech 64(8):2467–2477CrossRefGoogle Scholar
  8. 8.
    Sundberg M, Risman PO, Kildal PS, Ohlsson T (1996) Analysis and design of industrial microwave ovens using the finite difference time domain method. J Microw Power Electromagn Energy 31(3):115–123CrossRefGoogle Scholar
  9. 9.
    Sundberg M, Kildal P, Ohlsson T (1998) Moment method analysis of a microwave tunnel oven. J Microw Power Electromagn Energy 33(1):36–48CrossRefGoogle Scholar
  10. 10.
    Hallac A, Metaxas AC (2006) Modelling of industrial conveyorized applicators using higher order vector finite elements. J Microw Power Electromagn Energy Publ Int Microw Power Inst 40(2):101Google Scholar
  11. 11.
    Chen H, Tang J, Liu F (2008) Simulation model for moving food packages in microwave heating processes using conformal FDTD method. J Food Eng 88(3):294–305CrossRefGoogle Scholar
  12. 12.
    Momenzadeh L, Zomorodian A, Mowla D (2011) Experimental and theoretical investigation of shelled corn drying in a microwave-assisted fluidized bed dryer using artificial neural network. Food Bioprod Process 89(1):15–21CrossRefGoogle Scholar
  13. 13.
    Krishna Murthy TP, Manohar B (2012) Microwave drying of mango ginger (Curcuma amada roxb): prediction of drying kinetics by mathematical modelling and artificial neural network. Int J Food Sci Technol 47(6):1229–1236CrossRefGoogle Scholar
  14. 14.
    Motavali A, Najafi GH, Abbasi S, Minaei S, Ghaderi A (2013) Microwave-vacuum drying of sour cherry: comparison of mathematical models and artificial neural networks. J Food Sci Technol 50(4):714CrossRefGoogle Scholar
  15. 15.
    Nikbakht AM, Motevali A, Minaei S (2014) Energy and exergy investigation of microwave assisted thin-layer drying of pomegranate arils using artificial neural networks and response surface methodology. J Saudi Soc Agric Sci 13(2):81–91Google Scholar
  16. 16.
    Yousefi G, Emam-Djomeh PZ, Omid M, Askari GR (2014) Prediction of physicochemical properties of raspberry dried by microwave-assisted fluidized bed dryer using artificial neural network. Dry Technol 32(1):4–12CrossRefGoogle Scholar
  17. 17.
    Tsoi AC, Back AD (1994) Locally recurrent globally feedforward networks: a critical review of architectures. IEEE Trans Neural Netw 5(2):229–239CrossRefGoogle Scholar
  18. 18.
    Cf J (2004) A hybrid of genetic algorithm and particle swarm optimization for recurrent network design. IEEE Trans Syst Man Cybern B Cybern 34(2):997–1006CrossRefGoogle Scholar
  19. 19.
    Xiao P, Venayagamoorthy GK, Corzine KA (2007) Combined training of recurrent neural networks with particle swarm optimization and backpropagation algorithms for impedance identification. In: IEEE swarm intelligence symposium, pp 9–15Google Scholar
  20. 20.
    Seyab RKA, Cao Y (2008) Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation. J Process Control 18(6):568–581CrossRefGoogle Scholar
  21. 21.
    Chen CC, Shen LP (2018) Improve the accuracy of recurrent fuzzy system design using an efficient continuous ant colony optimization. Int J Fuzzy Syst 20(2):1–18MathSciNetGoogle Scholar
  22. 22.
    Yang X-S, Deb S (2014) Cuckoo search: recent advances and applications. Neural Comput Appl 24(1):169–174CrossRefGoogle Scholar
  23. 23.
    Ma H, Li S, Li S, Lv Z, Wang J (2018) An improved dynamic self-adaption cuckoo search algorithm based on collaboration between subpopulations. Neural Comput Appl 31:1–15Google Scholar
  24. 24.
    Cheng J, Wang L, Xiong Y (2018) Modified cuckoo search algorithm and the prediction of flashover voltage of insulators. Neural Comput Appl 30(2):355–370CrossRefGoogle Scholar
  25. 25.
    Elazim SA, Ali E (2016) Optimal power system stabilizers design via cuckoo search algorithm. Int J Electr Power Energy Syst 75:99–107CrossRefGoogle Scholar
  26. 26.
    Abdelaziz A, Ali E (2015) Cuckoo search algorithm based load frequency controller design for nonlinear interconnected power system. Int J Electr Power Energy Syst 73:632–643CrossRefGoogle Scholar
  27. 27.
    Nguyen TT, Nguyen TT, Vo DN (2018) An effective cuckoo search algorithm for large-scale combined heat and power economic dispatch problem. Neural Comput Appl 30(11):3545–3564CrossRefGoogle Scholar
  28. 28.
    Chi R, Su Y, Zhang D, Chi X, Zhang H (2017) A hybridization of cuckoo search and particle swarm optimization for solving optimization problems. Neural Comput Appl 31:1–18Google Scholar
  29. 29.
    Zhang W, Wei D (2018) Prediction for network traffic of radial basis function neural network model based on improved particle swarm optimization algorithm. Neural Comput Appl 29(4):1143–1152CrossRefGoogle Scholar
  30. 30.
    Selvanambi R, Natarajan J, Karuppiah M, Islam SH, Hassan MM, Fortino G (2018) Lung cancer prediction using higher-order recurrent neural network based on glowworm swarm optimization. Neural Comput Appl. CrossRefGoogle Scholar
  31. 31.
    Yang L, Chen H (2018) Fault diagnosis of gearbox based on RBF-PF and particle swarm optimization wavelet neural network. Neural Comput Appl. CrossRefGoogle Scholar
  32. 32.
    Kankal M, Uzlu E (2017) Neural network approach with teaching-learning-based optimization for modeling and forecasting long-term electric energy demand in Turkey. Neural Comput Appl 28(1):737–747CrossRefGoogle Scholar
  33. 33.
    Sun Y-S, Zhang Q (2018) Optimization design and reality of the virtual cutting process for the boring bar based on PSO-BP neural networks. Neural Comput Appl 29(5):1357–1367CrossRefGoogle Scholar
  34. 34.
    Chen S, Billings SA, Luo W (1989) Orthogonal least squares methods and their application to non-linear system identification. Int J Control 50(5):1873–1896zbMATHCrossRefGoogle Scholar
  35. 35.
    Chen S, Wu Y, Luk BL (1999) Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks. IEEE Trans Neural Netw 10(5):1239CrossRefGoogle Scholar
  36. 36.
    Chen S, Hong X, Harris CJ (2010) Particle swarm optimization aided orthogonal forward regression for unified data modeling. IEEE Trans Evol Comput 14(4):477–499CrossRefGoogle Scholar
  37. 37.
    Bataineh M, Marler T (2017) Neural network for regression problems with reduced training sets. Neural Netw 95:1CrossRefGoogle Scholar
  38. 38.
    Gu L, Tok DKS, Yu DL (2016) Development of adaptive p-step rbf network model with recursive orthogonal least squares training. Neural Comput Appl 12:1–10Google Scholar
  39. 39.
    Yu DL, Yu DW (2007) A new structure adaptation algorithm for RBF networks and its application. Neural Comput Appl 16(1):91–100CrossRefGoogle Scholar
  40. 40.
    Wei HL, Billings SA, Zhao YF, Guo LZ (2010) An adaptive wavelet neural network for spatio-temporal system identification. Neural Netw 23(10):1286–1299CrossRefGoogle Scholar
  41. 41.
    Shi D, Chen F, Ng GS, Gao J (2006) The construction of wavelet network for speech signal processing. Neural Comput Appl 15(3–4):217–222CrossRefGoogle Scholar
  42. 42.
    Chen S, Cowan C, Grant P (1991) Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans Neural Netw 2(2):302–9CrossRefGoogle Scholar
  43. 43.
    Kaasová J, Kadlec P, Bubník Z, Hubáčková B, Příhoda J (2002) Physical and chemical changes during microwave drying of rice. Chem Pap 56(1):32–35Google Scholar
  44. 44.
    Jayas DS (2006) Non-uniformity of surface temperatures of grain after microwave treatment in an industrial microwave dryer. Dry Technol 24(12):1559–1567CrossRefGoogle Scholar
  45. 45.
    Kumar R, Srivastava S, Gupta JRP, Mohindru A (2018) Diagonal recurrent neural network based identification of nonlinear dynamical systems with Lyapunov stability based adaptive learning rates. Neurocomputing 8(287):102–117CrossRefGoogle Scholar
  46. 46.
    Hong X, Mitchell RJ, Chen S, Harris CJ, Li K, Irwin GW (2008) Model selection approaches for non-linear system identification: a review. Int J Syst Sci 39(10):925–946MathSciNetzbMATHCrossRefGoogle Scholar
  47. 47.
    Frans VDB, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  • Tong Liu
    • 1
    • 2
  • Shan Liang
    • 1
    • 2
    Email author
  • Qingyu Xiong
    • 1
    • 3
  • Kai Wang
    • 1
    • 2
  1. 1.Key Laboratory of Complex System Safety and Control (Ministry of Education)Chongqing UniversityChongqingChina
  2. 2.School of AutomationChongqing UniversityChongqingChina
  3. 3.School of Big Data & Software EngineeringChongqing UniversityChongqingChina

Personalised recommendations