AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles

  • Shital ShahEmail author
  • Debadeepta Dey
  • Chris Lovett
  • Ashish Kapoor
Conference paper
Part of the Springer Proceedings in Advanced Robotics book series (SPAR, volume 5)


Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of annotated training data in a variety of conditions and environments. We present a new simulator built on Unreal Engine that offers physically and visually realistic simulations for both of these goals. Our simulator includes a physics engine that can operate at a high frequency for real-time hardware-in-the-loop (HITL) simulations with support for popular protocols (e.g. MavLink). The simulator is designed from the ground up to be extensible to accommodate new types of vehicles, hardware platforms and software protocols. In addition, the modular design enables various components to be easily usable independently in other projects. We demonstrate the simulator by first implementing a quadrotor as an autonomous vehicle and then experimentally comparing the software components with real-world flights.


  1. 1.
    Kober, J., Bagnell, J.A., Peters, J.: Reinforcement learning in robotics: a survey. Int. J. Rob. Res. 32(11), 1238–1274 (2013).
  2. 2.
    Bagnell, J.A.: An invitation to imitation. Technical Report, CMU ROBOTICS INST (2015)Google Scholar
  3. 3.
    Weiss, K., Khoshgoftaar, T.M., Wang, D.: A survey of transfer learning. J. Big Data 3(1), 9 (2016).
  4. 4.
    Shah, S., Dey, D., Lovett, C., Kapoor, A.: Airsim open source platform at github. (2017)
  5. 5.
    Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: IROS (2004)Google Scholar
  6. 6.
    Meyer, J., Sendobry, A., Kohlbrecher, S., Klingauf, U., Von Stryk, O.: Comprehensive simulation of quadrotor uavs using ros and gazebo. In: SIMPAR, pp. 400–411. Springer (2012)Google Scholar
  7. 7.
    Furrer, F., Burri, M., Achtelik, M., Siegwart, R.: Rotorsa modular gazebo mav simulator framework. In: Robot Operating System (ROS), pp. 595–625. Springer (2016)Google Scholar
  8. 8.
    Babushkin, A.: Jmavsim.
  9. 9.
    Meier, L., Tanskanen, P., Fraundorfer, F., Pollefeys, M.: Pixhawk: A system for autonomous flight using onboard computer vision. In: ICRA, pp. 2992–2997. IEEE (2011)Google Scholar
  10. 10.
    Jackson, J., Ellingson, G., McLain, T.: Rosflight: a lightweight, inexpensive mav research and development tool. In: ICUAS, pp. 758–762 (2016).
  11. 11.
    Hackflight: Simple quadcopter flight control firmware and simulator for c++ hackers.
  12. 12.
    Karis, B., Games, E.: Real shading in unreal engine 4. In: Proceedings Physically Based Shading Theory Practice (2013)Google Scholar
  13. 13.
    Moore, H.: Creating assets for the open world demo (2015)Google Scholar
  14. 14.
    Brandt, J., Deters, R., Ananda, G., Selig, M.: Uiuc propeller database, university of illinois at urbana-champaign. (2015)
  15. 15.
    Tapley, B., Ries, J., Bettadpur, S., Chambers, D., Cheng, M., Condi, F., Poole, S.: The ggm03 mean earth gravity model from grace. In: American Geophysical Union, G42A-03 (2007)Google Scholar
  16. 16.
    Chulliat, A., Macmillan, S., Alken, P., Beggan, C., Nair, M., Hamilton, B., Woods, A., Ridley, V., Maus, S., Thomson, A.: The US/UK world magnetic model for 2015–2020 (2015).
  17. 17.
    Lanza, R., Meloni, A.: The Earth’s Magnetism: An Introduction for Geologists. Springer Science & Business Media (2006)Google Scholar
  18. 18.
    Stull, R.: Practical Meteorology: An Algebra-based Survey of Atmospheric Science. University of British Columbia (2015)Google Scholar
  19. 19.
    Braeunig, R.: Atmospheric models. (2014)
  20. 20.
    Taylor, J.: Classical Mechanics. University Science Books (2005)Google Scholar
  21. 21.
    Nakayama, Y., Boucher, R.: Introduction to Fluid Mechanics. Butterworth-Heinemann (1998)Google Scholar
  22. 22.
    Herman, R.: A first course in differential equations for scientists and engineers. (2017)
  23. 23.
    Hecker, C.: Physics, Part 3: Collision Response. Game Developer Magazine (1997)Google Scholar
  24. 24.
    Sabatini, A.M., Genovese, V.: A stochastic approach to noise modeling for barometric altimeters. Sensors (Basel, Switzerland) 13(11), 15,692–15,707 (2013)Google Scholar
  25. 25.
    Burch D., B.T.: Mariner’s Pressure Atlas: Worldwide Mean Sea Level Pressures and Standard Deviations for Weather Analysis. Starpath School of Navigation (2014)Google Scholar
  26. 26.
    Woodman, O.J.: An introduction to inertial navigation. Technical Report UCAM-CL-TR-696, University of Cambridge, Computer Laboratory (2007)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Shital Shah
    • 1
    Email author
  • Debadeepta Dey
    • 1
  • Chris Lovett
    • 1
  • Ashish Kapoor
    • 1
  1. 1.Microsoft ResearchRedmondUSA

Personalised recommendations