Skip to main content

Reinforcement Learning-Based Dynamic Control Allocation for Spacecraft Attitude Stabilization

  • Chapter
  • First Online:
Intelligent Autonomous Control of Spacecraft with Multiple Constraints
  • 272 Accesses

Abstract

As space missions become more and more complex, higher requirements are placed on the rapid maneuverability of spacecraft. The control moment gyros (CMGs) are more suitable for the rapid maneuvering of large-mass satellites due to the characteristic of moment amplification (Hill in J Guidance Control Dyn 39(10):2406–2418 (2016), [1]).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Hill DE (2016) Dynamics and control of spacecraft using control moment gyros with friction compensation. Journal of Guidance, Control, and Dynamics 39(10): 2406–2418

    Article  Google Scholar 

  2. Leve FA (2013) Evaluation of steering algorithm optimality for single-gimbal control moment gyroscopes. IEEE Transactions on Control Systems Technology 22(3): 1130–1134

    Article  Google Scholar 

  3. de Vries PS, Van Kampen EJ (2019) Reinforcement learning-based control allocation for the innovative control effectors aircraft. In: AIAA Scitech 2019 Forum, San Diego, CA, United states, p 0144

    Google Scholar 

  4. Kassarian E, Rognant M, Evain H, Alazard D, Chauffaut C (2020) Convergent ekf-based control allocation: general formulation and application to a control moment gyro cluster. In: Proceedings of the American Control Conference, Denver, CO, United states, pp 4454–4459

    Google Scholar 

  5. Argha A, Su SW, Celler BG (2019) Control allocation-based fault tolerant control. Automatica 103: 408–417

    Article  MathSciNet  MATH  Google Scholar 

  6. Zhang D, Liu G, Zhou H, Zhao W (2018) Adaptive sliding mode fault-tolerant coordination control for four-wheel independently driven electric vehicles. IEEE Transactions on Industrial Electronics 65(11): 9090–9100

    Article  Google Scholar 

  7. Chen M (2015) Constrained control allocation for overactuated aircraft using a neurodynamic model. IEEE Transactions on Systems, Man, and Cybernetics: Systems 46(12): 1630–1641

    Article  Google Scholar 

  8. Tjønnås J, Johansen TA (2008) Adaptive control allocation. Automatica 44(11): 2754–2765

    Article  MathSciNet  MATH  Google Scholar 

  9. Kolaric P, Lopez VG, Lewis FL (2020) Optimal dynamic control allocation with guaranteed constraints and online reinforcement learning. Automatica 122: 109265

    Article  MathSciNet  MATH  Google Scholar 

  10. Modares H, Lewis FL, Jiang ZP (2015) \({{H}_{\infty }}\) tracking control of completely unknown continuous-time systems via off-policy reinforcement learning. IEEE Transactions on Neural Networks and Learning Systems 26(10): 2550–2562

    Article  MathSciNet  Google Scholar 

  11. Wang D, He H, Liu D (2017) Adaptive critic nonlinear robust control: A survey. IEEE Transactions on Cybernetics 47(10): 3429–3451

    Article  Google Scholar 

  12. Wei C, Luo J, Dai H, Duan G (2018) Learning-based adaptive attitude control of spacecraft formation with guaranteed prescribed performance. IEEE Transactions on Cybernetics 49(11): 4004–4016

    Article  Google Scholar 

  13. Wu HN, Luo B (2012) Neural network based online simultaneous policy update algorithm for solving the hji equation in nonlinear \({{H}_{\infty }}\) control. IEEE Transactions on Neural Networks and Learning Systems 23(12): 1884–1895

    Article  Google Scholar 

  14. Mu C, Ni Z, Sun C, He H (2016) Air-breathing hypersonic vehicle tracking control based on adaptive dynamic programming. IEEE Transactions on Neural Networks and Learning Systems 28(3): 584–598

    Article  MathSciNet  Google Scholar 

  15. Kong L, He W, Yang C, Sun C (2020) Robust neurooptimal control for a robot via adaptive dynamic programming. IEEE Transactions on Neural Networks and Learning Systems 32(6): 2584–2594

    Article  MathSciNet  Google Scholar 

  16. Dong H, Zhao X, Yang H (2020) Reinforcement learning-based approximate optimal control for attitude reorientation under state constraints. IEEE Transactions on Control Systems Technology 29(4): 1664–1673

    Article  Google Scholar 

  17. Hu Q, Tan X (2019) Dynamic near-optimal control allocation for spacecraft attitude control using a hybrid configuration of actuators. IEEE Transactions on Aerospace and Electronic Systems 56(2): 1430–1443

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qinglei Hu .

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hu, Q., Shao, X., Guo, L. (2023). Reinforcement Learning-Based Dynamic Control Allocation for Spacecraft Attitude Stabilization. In: Intelligent Autonomous Control of Spacecraft with Multiple Constraints. Springer, Singapore. https://doi.org/10.1007/978-981-99-0681-9_6

Download citation

Publish with us

Policies and ethics