Abstract
Interface designs native to handheld control and feedback devices (e.g., smartphones and tablets) are becoming more accessible within the small unmanned aerial system (sUAS) community due to increased usage in remote control (R/C) model aircraft platforms [33], improved processing to cost [4], and increased interoperability supporting custom development and programming [2], [33]. These smaller, power efficient control systems have the potential to change the paradigm of sUAS control to be more aligned with semi-autonomous operations based on their innate ability to provide intuitive user interactions [44], low cost, reduction of latency effects on control, and improved real-time configuration and data measurement [33]. The objective of this study is to identify common themes in the advancement and application of human-machine-interface technologies in UAS control. This paper proposes to review available literature, associated technology designs, and identify how the UAS community can best leverage this technology and interaction concepts to support safe and efficient operations of UAS.
Chapter PDF
Similar content being viewed by others
Keywords
References
American Institute of Aeronautics and Astronautics. UAV Roundup 2013. Aerospace America, July-August (2013), http://www.aerospaceamerica.org/Documents/AerospaceAmerica-PDFs-2013/July-August-2013/UAVRoundup2013t-AA-Jul-Aug2013.pdf (retrieved)
Anderson, C.: Introduction to PixHawk ground control station (including source code) (Web log post) (April 4, 2010), http://diydrones.com/profiles/blogs/introduction-to-pixhawk-ground?xg_source=activity (retrieved)
Arhippainen, L., Pakanen, M., Hickey, S.: Towards a 3D user interface in a touch screen device context: An iterative and evaluation process. In: ACHI 2013: The Sixth International Conference on Advances in Computer-Human Interactions, 47–52 (2013), http://www.thinkmind.org/download.php?articleid=achi_2013_3_10_20352
Aroca, R.V., Péricles, A., de Oliveira, B.S., Marcos, L., Gonçalves, G.: Towards smarter robots with smartphones. In: 5th Workshop in Applied Robotics and Automation, Robocontrol 2012 (2012), http://www.natalnet.br/~aroca/RoboControl.pdf (retrieved)
Association for Unmanned Vehicle Systems International. The economic impact of unmanned aircraft systems integration in the United States (2013), http://higherlogicdownload.s3.amazonaws.com/AUVSI/958c920a-7f9b-4ad2-9807-f9a4e95d1ef1/UploadedImages/New_Economic%20Report%202013%20Full.pdf (retrieved)
Association for Unmanned Vehicle Systems International. Unmanned aircraft system integration into the United States National Airspace System: An assessment of the impact on job creation in the U.S. aerospace industry (2010), http://uas.usgs.gov/pdf/AUVSI/0510JobsReport.pdf (retrieved)
Black Swift Technologies LLC. Products, http://www.blackswifttech.com/products.html (2013) (retrieved)
Chao, H., Cao, Y., Chen, Y.: Autopilots for small unmanned aerial vehicles: A survey. International Journal of Control, Automation, and Systems 8(1), 36–44 (2010), doi:10.1007/s12555-010-0105-z
Cowling, I.D., Yakimenko, O.A., Whidborne, J.F., Cooke, A.K.: A prototype of an autonomous controller for a quadrotor UAV. In: Proceedings of ECC (2007), Retrieved from the University of Arizona website, http://www2.engr.arizona.edu/~sprinkjm/research/c2wt/uploads/Main/paper1.pdf
Dension (n.d.). WiRC users manual v2.0 (Report no. WRC-9201-1), http://wirc.dension.com/sites/default/files/downloads/wirc_manual_v2_rel_mod11.pdf
Dion, B.: FACE, ARINC, DO-187C avionics standards help U.S. DoD’s vision of reusing technology to take off. Military Embedded Systems (2013), http://mil-embedded.com/articles/face-vision-reusable-technology-take-off/ (retrieved)
Draper, M.H., Ruff, H.A., Repperger, D.W., Lu, L.G.: Multi-sensory interface concepts supporting turbulence detection by UAV controllers. In: Proceedings of the First Human Performance, Situational Awareness and Automation Conference, pp. 107–112 (2000)
Endurance R/C (n.d.). Guide to PWM and PPM, http://www.endurance-rc.com/ppmtut.php (retrieved)
Federal Aviation Administration (FAA). Integration of civil unmanned aircraft systems (UAS) in the National Airspace System (NAS) roadmap. Author, Washington, DC (2013a)
Federal Aviation Administration (FAA). Unmanned aircraft (UAS): Question and answers (2013b), http://www.faa.gov/about/initiatives/uas/uas_faq/ (retrieved)
Federal Aviation Administration. Airworthiness Certification of Unmanned Aircraft Systems and Optionally Piloted Aircraft (2013c), http://www.faa.gov/documentLibrary/media/Order/8130.34C.pdf (retrieved)
Federal Aviation Administration. Integration of civil unmanned aircraft systems (UAS) in the National Airspace System (NAS) roadmap (2013d), http://www.faa.gov/about/initiatives/uas/media/uas_roadmap_2013.pdf (retrieved)
Hayward, K.: Unmanned aerial vehicles: A new industrial system? Retrieved from Royal Aeronautical Society (2013), http://aerosociety.com/Assets/Docs/Publications/DiscussionPapers/UASDiscussionPaper.pdf
Federal Aviation Administration. Advisory circular 20-152 (2005), http://www.faa.gov/documentLibrary/media/Advisory_Circular/AC_20-152.pdf (retrieved)
Harvey, C., Stanton, N., Pickering, C., McDonald, M., Zheng, P.: To twist or poke? A method for identifying usability issues with the rotary controller and touch screen control of in-vehicle information systems. Ergonomics 54(7), 609–625 (2011)
Hoskinson, C.: Simplifying control of unmanned systems. Defense Systems (April 26, 2013), http://defensesystems.com/articles/2013/04/26/uas-command-and-control.aspx (retrieved)
Hopcroft, R., Burchat, E., Vince, J.: Unmanned Aerial Vehicles for Maritime Patrol: Human Factors Issues. DSTO-GD-0463. Department of Defense, Defence Science and Technology Organisation, Commonwealth of Australia (2006)
Huanh, Y., Thomson, S.J., Hoffmann, W.C., Lan, Y., Fritz, B.K.: Development and prospect of unmanned aerial vehicle technologies for agricultural production management. International Journal of Agricultural and Biological Engineering 6(3), 1–10 (2013)
Humanistic Robotics, Inc. (n.d.). Safe Remote Control System, http://humanisticrobotics.com/wp-content/uploads/2013/08/HRI_Safe_Remote_Control_System.pdf (retrieved)
Kutta Technologies (n.d.). Unified ground control station- UGCS, http://www.kuttatech.com/UGCS.html (retrieved)
Lacher, A., Maroney, D.: A new paradigm for small UAS. (2012), Retrieved from MITRE Corporation website http://www.mitre.org/sites/default/files/pdf/12_2840.pdf
Martin, L.: mGCS capabilities guide: Mini and small UAV ground control operator software (2013), http://www.lockheedmartin.com/content/dam/lockheed/data/ms2/documents/cdl-systems/mGCSCapabilitiesGuide-2013.pdf (retrieved)
McKenna, E.: Product focus: Cockpit switches. Avionics Today (January 1, 2013), http://www.aviationtoday.com/av/business-and-general-aviation/Product-Focus-Cockpit-Switches_78093.html (retrieved)
Mostafa, G.: FlyPad-fly your RC plane with your iPhone. The Tech Journal (June 6, 2010), http://thetechjournal.com/electronics/iphone/flypad-fly-your-rc-plane-with-your-iphone.xhtml (retrieved)
NASA. The glass cockpit (2000), http://www.nasa.gov/centers/langley/news/factsheets/Glasscockpit.html (retrieved)
Neville, K., Blickensderfer, B., Archer, J., Kaste, K., Luxion, S.: A cognitive work analysis to identify human-machine interface design challenges unique to uninhabited aircraft systems. In: Procedings of the Human Factors and Ergonomics Society 56th Annual Meeting (2012), doi:10.1177/107181312561094
Northrup Grumman Corp. New release: Northrop Grumman, U.S. Navy demonstrate precision, wireless ground handling of X-47B unmanned aircraft (2012), http://investor.northropgrumman.com/phoenix.zhtml?c=112386&p=irol-newsArticle_print&ID=1759076&highlight= (retrieved)
Ott, J.: Announcing Iris, a totally-ready-to-fly UAV quadcopter with our next-gen autopilot, http://3drobotics.com/2013/08/iris-press-release/ (2013a) (retrieved)
Ott, J.: PX4 and 3D Robotics announce PixHawk, http://3drobotics.com/2013/08/px4-and-3d-robotics-announce-pixhawk/ (2013b) (retrieved)
PixHawk: Computer Vision on Autonomous Aerial Robots. (n.d.). About, https://pixhawk.ethz.ch/overview (retrieved)
Pullen, S., Enge, P., Lee, J.: Local-area differential GNSS architectures optimized to support unmanned aerial vehicles (UAVs). Presented at the ION Institute of Navigation International Technical Meeting, San Diego, CA (2013), Retrieved from Stanford University GPS Lab website: http://gps.stanford.edu/papers/LADGNSSforUAVNetworksITM2013final.pdf
Rogers, W., Fisk, A., McLaughlin, A., Pak, R.: Touch a screen or turn a knob: Choosing the best device for the job. Human Factors 47(2), 271–288 (2005)
Skaff, M.: F-35 Lightning II computer vision. SAE International (2010), http://www.fujitsu.com/downloads/MICRO/fma/marcom/convergence/data/papers/2010-01-2330.pdf (retrieved)
Space and Naval Warfare Systems Center Pacific. (n.d.). Multi-robot Operator Control Unit (MOCU), http://www.public.navy.mil/spawar/Pacific/Robotics/Pages/MOCU.aspx (retrieved)
Stanton, N., Harvey, C., Plant, K., Bolton, L.: To twist, roll, stroke or poke? A study of input devices for menu navigation in the cockpit. Ergonomics 56(4), 590–611 (2013)
Stroumtsos, N., Gilbreth, G., Przybylski, S.: An intuitive graphical user interface for small UAS. In: SPIE Proceedings 8741: Unmanned Systems Technology XV (2013), Retrieved from Space and Naval Warfare Systems Center Pacific website: http://www.public.navy.mil/spawar/Pacific/Robotics/Documents/Publications/2013/SPIE2013-Raven.pdf
Tang, Z., Zhang, A.: Human-machine-cooperation design methodology for civil aircraft cockpit. In: 2nd International Symposium on Computer, Communication, Control and Automation (2013), Retrieved from Atlantic Press website, http://www.atlantis-press.com/php/download_paper.php?id=10144
Tozicka, J., Balata, J., Mikovec, Z.: Diverse trajectory planning for UAV control displays (demonstration). In: AAMAS 2013 Proceedings of the 2013 International Conference on Autonomous Agents and Multi-Agent Systems, pp. 1411–1412 (2013), http://www.ifaamas.org/Proceedings/aamas2013/docs/p1411.pdf (retrieved)
Walker, A.M., Miller, D.P., Ling, C.: Spatial orientation aware smartphones for tele-operated robot control in military environments: A usability experiment. Proceedings of the Human Factors and Ergonomics Society Meeting 57(1), 2027–2031 (2013)
UAS Europe. SkyView: Ground control station (2013), http://www.uas-europe.se/documents/SkyView%20GCS.pdf (retrieved)
UAS Vision. Unmanned community making progress on airspace access (2013), http://www.uasvision.com/2013/08/12/unmanned-community-making-progress-on-airspace-access/ (retrieved)
Unmanned Systems Group (n.d.). Ground control stations (GCS), http://www.unmannedgroup.com/index.php?page=2&subpage=6&data=9 (retrieved)
U.S. Department of Transportation, John A. Volpe National Transportation Systems Center. Unmanned aircraft system (UAS) service demand 2015-20135: Literature review and projections of future usage (Report no. DOT-VNTSC-DoD-13-01) (2013), http://ntl.bts.gov/lib/48000/48200/48226/UAS_Service_Demand.pdf (retrieved)
U.S. Department of Defense. Unmanned systems integrated roadmap FY2013-2038 (Report no. 14-S-0553) (2013), http://www.defense.gov/pubs/DOD-USRM-2013.pdf
WiRC (n.d.). WiRC WiFi RC receiver, http://wirc.dension.com/wirc (retrieved)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Terwilliger, B.A., Ison, D.C., Vincenzi, D.A., Liu, D. (2014). Advancement and Application of Unmanned Aerial System Human-Machine-Interface (HMI) Technology. In: Yamamoto, S. (eds) Human Interface and the Management of Information. Information and Knowledge in Applications and Services. HIMI 2014. Lecture Notes in Computer Science, vol 8522. Springer, Cham. https://doi.org/10.1007/978-3-319-07863-2_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-07863-2_27
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07862-5
Online ISBN: 978-3-319-07863-2
eBook Packages: Computer ScienceComputer Science (R0)