Skip to main content
Log in

Robotic drawing communication protocol: a framework for building a semantic drawn language for robotic fabrication

  • Original Paper
  • Published:
Construction Robotics Aims and scope Submit manuscript

Abstract

Robots are usually operated through text-based inputs made on an external computer or through an associated human machine interface (HMI). This requires skill and expert knowledge to take full advantage of the robot as machine, tool and extension of the human operator, thus limiting applications for users who hold manual skills but not machine knowledge. Consequently, this research aims to identify processes that allow a non-specialist to operator a robot with a similar ease as a specialist. This paper presents research into minimizing (or fully negating) text-based programming for robotic fabrication, thereby opening a potential for adopting robotic fabrication by users with a broader level of skills. This can be achieved by introducing a process for non-specialists to use a semantic drawn language, whereby manual instructions are drawn on a workpiece before being robotically processed. The language can be extended by the operator through interaction with a machine learning (ML) system operated on an HMI, which parses the language and informs the robot what to do. The paper discusses further research into a previously developed tablet interface framework that manages this process, and specifically details the process of adding ML functionalities that can continuously improve the framework. It describes the development process of a data gathering method; provides an overview use cases for classification results and choice of training system; and discusses results and limitations, with discussion of future work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data availability

The datasets will be placed on GitHub.

Code availability

Not available.

References

Download references

Funding

The research is partly funded by the Danish Innovation fund.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jens Pedersen.

Ethics declarations

Conflict of interest

Not applicable.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pedersen, J., Reinhardt, D. Robotic drawing communication protocol: a framework for building a semantic drawn language for robotic fabrication. Constr Robot 6, 239–249 (2022). https://doi.org/10.1007/s41693-022-00089-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41693-022-00089-w

Keywords

Navigation