Autonomous Robots

, Volume 38, Issue 1, pp 89–105

Provably correct reactive control from natural language

  • Constantine Lignos
  • Vasumathi Raman
  • Cameron Finucane
  • Mitchell Marcus
  • Hadas Kress-Gazit
Article

DOI: 10.1007/s10514-014-9418-8

Cite this article as:
Lignos, C., Raman, V., Finucane, C. et al. Auton Robot (2015) 38: 89. doi:10.1007/s10514-014-9418-8

Abstract

This paper presents an integrated system for generating, troubleshooting, and executing correct-by-construction controllers for autonomous robots using natural language input, allowing non-expert users to command robots to perform high-level tasks. This system unites the power of formal methods with the accessibility of natural language, providing controllers for implementable high-level task specifications, easy-to-understand feedback on those that cannot be achieved, and natural language explanation of the reason for the robot’s actions during execution. The natural language system uses domain-general components that can easily be adapted to cover the vocabulary of new applications. Generation of a linear temporal logic specification from the user’s natural language input uses a novel data structure that allows for subsequent mapping of logical propositions back to natural language, enabling natural language feedback about problems with the specification that are only identifiable in the logical form. We demonstrate the robustness of the natural language understanding system through a user study where participants interacted with a simulated robot in a search and rescue scenario. Automated analysis and user feedback on unimplementable specifications is demonstrated using an example involving a robot assistant in a hospital.

Keywords

Natural language Formal methods High-level control Synthesis 

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Constantine Lignos
    • 1
  • Vasumathi Raman
    • 2
  • Cameron Finucane
    • 3
  • Mitchell Marcus
    • 1
  • Hadas Kress-Gazit
    • 3
  1. 1.Department of Computer and Information ScienceUniversity of PennsylvaniaPhiladelphiaUSA
  2. 2.Department of Computing and Mathematical SciencesCalifornia Institute of TechnologyPasadenaUSA
  3. 3.Sibley School of Mechanical and Aerospace EngineeringCornell UniversityIthacaUSA

Personalised recommendations