Computer Aided Systems Theory - EUROCAST 2009

Volume 5717 of the series Lecture Notes in Computer Science pp 75-82

Learning Autonomous Helicopter Flight with Evolutionary Reinforcement Learning

  • José Antonio Martín H.Affiliated withDep. Sistemas Informáticos y Computación, Universidad Complutense de Madrid
  • , Javier de LopeAffiliated withDept. Applied Intelligent Systems, Universidad Politécnica de Madrid

* Final gross prices may vary according to local VAT.

Get Access


In this paper we present a method to obtain a near optimal neuro-controller for the autonomous helicopter flight by means of an ad hoc evolutionary reinforcement learning method. The method presented here was developed for the Second Annual Reinforcement Learning Competition (RL2008) held in Helsinki-Finland. The present work uses a Helicopter Hovering simulator created in the Stanford University that simulates a Radio Control XCell Tempest helicopter in the flight regime close to hover. The objective of the controller is to hover the helicopter by manipulating four continuous control actions based on a 12-dimensional state space.


Reinforcement Learning Evolutionary Computation Autonomous Helicopter