Skip to main content
SpringerLink
Log in

A novel residual hybrid dynamic model for unmanned helicopters: combining both physical and deep learning models

  • Original Paper
  • Published:
Nonlinear Dynamics Aims and scope Submit manuscript

Abstract

Unmanned helicopters are unstable, high-order nonlinear systems. It is difficult to model the system dynamics accurately by physical models due to simplifications and assumptions. Deep learning based modeling methods could achieve high prediction accuracy without any simplifications and assumptions, while their results are hard to interpret. To ensure both accuracy and interpretability, a novel residual hybrid dynamic model is proposed, which combines a physical model, describing the essential dynamic characteristics of unmanned helicopters, and a convolutional neural network and long short-term memory neural network (CNN-LSTM) based deep learning model, compensating the errors of the physical model by the residual connection. Meanwhile, the CNN-LSTM model could efficiently learn the information in both state-control and time dimensions due to the well-designed network structure. Moreover, a two-step optimization method is proposed to optimize parameters of the residual hybrid dynamic model on the flight data from the Stanford Autonomous Helicopter Project. The experiment results demonstrate that the proposed residual hybrid dynamic model exhibits superior accuracy, efficiency, and generalization capabilities compared to the baseline models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

All data generated or analyzed during this study are included in this article.

References

  1. Padfield, G.D.: Helicopter Flight Dynamics: The Theory and Application of Flying Qualities and Simulation Modeling, 2nd edn. Blackwell Publishing, Oxford (2007)

    Book  Google Scholar 

  2. Baier, A., Boukhers, Z., Staab, S.: Hybrid physics and deep learning model for interpretable vehicle state prediction. arXiv:2103.06727 (2021)

  3. Cheng, H.T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H.B., Anderson, G., Corrado, G.S., Chai, W., Ispir, M., Anil, R., Haque, Z., Hong, L., Jain, V., Liu, X., Shah, H.: Wide & deep learning for recommender systems. In: Proceedings of the 1st Workshop on Deep Learning for Recommender Systems (2016)

  4. Padfield, G.D.: Helicopter flight dynamics: the theory and application of flying qualities and simulation modeling. AIAA education series, Washington DC (1996)

  5. Seddon, J.M., Newman, S.: Basic Helicopter Aerodynamics, 3rd edn. Wiley, Hoboken (2011)

    Book  Google Scholar 

  6. Leishman, G.J.: Principles of Helicopter Aerodynamics with CD Extra. Cambridge University Press, Cambridge (2006)

    Google Scholar 

  7. Lai, G., Liu, Z., Zhang, Y., Chen, C.L.P.: Adaptive position/attitude tracking control of aerial robot with unknown inertial matrix based on a new robust neural identifier. IEEE Trans. Neural Netw. Learn. Syst. 27, 18–31 (2016)

    Article  MathSciNet  Google Scholar 

  8. Abbeel, P., Coates, A., Ng, A.: Autonomous helicopter aerobatics through apprenticeship learning. Int. J. Rob. Res. 29, 1608–1639 (2010)

    Article  Google Scholar 

  9. Martin, B.: Nonlinear state estimation and modeling of a helicopter UAV. Ph.D. thesis, Department of Electrical and Computer Engineering, University of Alberta, Canada (2012)

  10. Fang, X., Wu, A., Shang, Y., Dong, N.: A novel sliding mode controller for small-scale unmanned helicopters with mismatched disturbance. Nonlinear Dyn. 83, 1053–1068 (2016)

    Article  MathSciNet  Google Scholar 

  11. Qi, G., Huang, D.: Modeling and dynamical analysis of a small-scale unmanned helicopter. Nonlinear Dyn. 98, 2131–2145 (2019)

    Article  Google Scholar 

  12. Civita, M.L., Messner, W.C., Kanade, T.: Modeling of small-scale helicopters with integrated first-principles and system-identification techniques, pp. 2505–2516 (2002)

  13. Chen, L., Zhu, Y., Ahn, C.K.: Novel quantized fuzzy adaptive design for nonlinear systems with sliding mode technique. Nonlinear Dyn. 96, 1635–1648 (2019)

    Article  Google Scholar 

  14. Punjani, A., Abbeel, P.: Deep learning helicopter dynamics models. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 3223–3230 (2015)

  15. Zhou, B., Li, Z., Zheng, Z., Tang, S.: Nonlinear adaptive tracking control for a small-scale unmanned helicopter using a learning algorithm with the least parameters. Nonlinear Dyn. 89, 1289–1308 (2017)

    Article  Google Scholar 

  16. Quaranta, G., Lacarbonara, W., Masri, S.F.: A review on computational intelligence for identification of nonlinear dynamical systems. Nonlinear Dyn. 99, 1709–1761 (2020)

    Article  Google Scholar 

  17. Chen, S., Cao, Y., Kang, Y., Zhu, R., Li, P.: Deep CNN identifier for dynamic modelling of unmanned helicopter (2017)

  18. Liu, Y., Zhou, Y., Li, X.: Attitude estimation of unmanned aerial vehicle based on lstm neural network. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–6 (2018)

  19. Amiruddin, B.P., Iskandar, E.A., Fatoni, A., Santoso, A.: Deep learning based system identification of quadcopter unmanned aerial vehicle. In: 2020 3rd International Conference on Information and Communications Technology (ICOIACT), pp. 165–169 (2020)

  20. Mohajerin, N., Mozifian, M., Waslander, S.L.: Deep learning a quadrotor dynamic model for multi-step prediction. In: 2018 IEEE International Conference on Robotics and Automation (ICRA), pp. 2454–2459 (2018)

  21. Mohajerin, N., Waslander, S.L.: Multistep prediction of dynamic systems with recurrent neural networks. IEEE Trans. Neural Netw. Learn. Syst. 30, 3370–3383 (2019)

    Article  Google Scholar 

  22. Woo, J., Park, J., Yu, C., Kim, N.: Dynamic model identification of unmanned surface vehicles using deep learning network. Appl. Ocean Res. 78, 123–133 (2018)

    Article  Google Scholar 

  23. Kang, Y., Chen, S., Wang, X., Cao, Y.: Deep convolutional identifier for dynamic modeling and adaptive control of unmanned helicopter. IEEE Trans. Neural Netw. Learn. Syst. 30(2), 524–538 (2019)

    Article  MathSciNet  Google Scholar 

  24. Agga, A., Abbou, A., Labbadi, M., Houm, Y.E.: Short-term self consumption pv plant power production forecasts based on hybrid cnn-lstm, convlstm models. Renew. Energ. 177, 101–112 (2021)

    Article  Google Scholar 

  25. Strang, G.: Introduction to Linear Algebra, 5th edn (2016)

  26. Bottou, L., Curtis, F.E., Nocedal, J.: Optimization methods for large-scale machine learning. SIAM Rev. 60, 223–311 (2016)

    Article  MathSciNet  Google Scholar 

  27. Suzuki, J.: A Markov chain analysis on simple genetic algorithms. IEEE Trans. Syst. Man Cybern. 25, 655–659 (1995)

    Article  Google Scholar 

  28. Ming, L., Wang, Y., Cheung, Y.: On convergence rate of a class of genetic algorithms. In: 2006 World Automation Congress, pp. 1–6 (2006)

  29. Looper, S., Waslander, S.L.: Temporal convolutions for multi-step quadrotor motion prediction. In: 2022 19th Conference on Robots and Vision (CRV), pp. 32–39 (2022)

  30. Wang, Y., Dou, Y., Peng, C., Gu, Z., Fu, H.: Multi step prediction method of ship pitch based on conv-informer model. OCEANS 2023—Limerick, pp. 1–6 (2023)

  31. Vaswani, A., Shazeer, N.M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., Polosukhin, I.: Attention is all you need (2017)

  32. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., Houlsby, N.: An image is worth 16x16 words: transformers for image recognition at scale. arXiv:2010.11929 (2020)

  33. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.: Swin transformer: hierarchical vision transformer using shifted windows. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 9992–10002 (2021)

Download references

Funding

This work was supported by the Natural Science Foundations of China (Nos. 62173267, 62273269, 61573276, 62173266, and U1809202) and the Natural Science Basic Research Program of Shaanxi (Program Nos. 2019JM-111 and 2020JC-05).

Author information

Authors and Affiliations

  1. Ministry of Education Key Laboratory of Intelligent and Network Security, Faculty of Electronics and Information Engineering, Xi’an Jiaotong University, Xi’an, 710049, China

    Hailang Zhang & Jing Liu

Authors
  1. Hailang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jing Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by HZ. The first draft and revision of the manuscript was written by HZ supervised by JL. All authors commented on previous versions of the manuscript and approved the final manuscript.

Corresponding author

Correspondence to Jing Liu.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, H., Liu, J. A novel residual hybrid dynamic model for unmanned helicopters: combining both physical and deep learning models. Nonlinear Dyn (2024). https://doi.org/10.1007/s11071-024-09689-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11071-024-09689-3

Keywords

Search

Navigation