Supervisory Control for Rotary Kiln Temperature Based on Reinforcement Learning

  • Xiaojie Zhou
  • Heng Yue
  • Tianyou Chai
  • Binhao Fang
Part of the Lecture Notes in Control and Information Sciences book series (LNCIS, volume 344)


The burning zone temperature in rotary kiln process is a vitally important controlled variable, on which the sinter quality mainly relies. Boundary conditions such as components of raw material slurry often change during kiln operation, but related offline analysis data delay to reach or even are unknown to the human operator. This causes unsatisfactory performance of the burning zone temperature controller and subsequent unstable production quality. To deal with this problem, a Q-learning-based supervisory control approach for burning zone temperature is proposed, in which the signals of human intervention are regarded as the reinforcement learning signals, so that the set point of burning zone temperature can be duly adjusted to adapt the fluctuations of the boundary conditions. This supervisory control system has been developed in DCS and successfully applied in an alumina rotary kiln. Satisfactory results have shown that the adaptability and performances of the control system have been improved effectively, and remarkable benefit has been obtained.


Reinforcement Learn Model Predictive Control Supervisory Control Rotary Kiln Supervisory Control System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Holmblad, L. P., Østergaard, J.-J.: The FLS Application of Fuzzy Logic, Fuzzy Sets and Systems, 70 (1995) 135–146CrossRefGoogle Scholar
  2. 2.
    Jarvensivu, M., Saari, K., Jamsa-Jounela, S. L.: Intelligent Control System of an Industrial Lime Kiln Process, Control Engineering Practice, 9(6) (2001) 589–606CrossRefGoogle Scholar
  3. 3.
    Jarvensivua, M., Esko Juusob, Olli Ahavac: Intelligent Control of a Rotary Kiln Fired with Producer Gas Generated from Biomass, Engineering Applications of Artificial Intelligence, 14(5) (2001)Google Scholar
  4. 4.
    Liu, Z. Q., Liu, Z. H., Li, X. L.: Status and Prospect of the Application of Municipal solid waste incineration in China, Applied Thermal Engineering, 26(11–12) (2006) 1193–1197CrossRefGoogle Scholar
  5. 5.
    Rolando Zanovello, Hector Budman: Model Predictive Control with Soft Constraints with Application to Lime Kiln Control, Computers and Chemical Engineering, 23(6) (1999) 791–806CrossRefGoogle Scholar
  6. 6.
    Sutton, R. S.: Generalization in Reinforcement Learning: Successful Examples using Sparse Coarse Coding, In: D. Touretzky, M. Mozer, M. Hasselmo, (eds.) Advances in Neural Information Processing Systems, NY: MIT Press (1996) 1038–1044Google Scholar
  7. 7.
    Sutton, R. S., Barto, A. G.: Reinforcement Learning: An Introduction, Cambridge, MA: MIT Press (1998)Google Scholar
  8. 8.
    Tsitsiklis, J. N., Van Roy, B.: Feature-based Methods for Large Scale Dynamic Programming, Machine Learning, 22(1–3) (1996) 59–94zbMATHGoogle Scholar
  9. 9.
    Watkins, J. C. H., Dayan, P., Q-Learning, Machine Learning, 8(3–4) (1992) 279–292zbMATHGoogle Scholar
  10. 10.
    Zhou, X. J., Xu, D. B., Zhang, L., Chai, T. Y.: Integrated Automation System of a Rotary Kiln Process for Alumina Production, Journal of Jilin University (Engineering and Technology Edition), sup: 350–353 (in Chinese) (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Xiaojie Zhou
    • 1
  • Heng Yue
    • 1
  • Tianyou Chai
    • 1
  • Binhao Fang
    • 1
  1. 1.Research Center of AutomationNortheastern UniversityShenyangP.R. China

Personalised recommendations