Grammars and Discourse Theory to Describe and Recognize Mechanical Assemblies

  • Christian Bauckhage
  • Susanne Kronenberg
  • Franz Kummert
  • Gerhard Sagerer
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1876)


In recent years numerous approaches to automatic reasoning about mechanical assemblies have been published. CAD techniques, graph-based approaches and semantic methods to model assembled objects were proposed. However, all these methods are difficult to employ for visually supervising assembly processes since they lack the flexibility, generality or ease required in practice. This paper presents the idea of using syntactic methods known from discourse theory in order to model classes of mechanical assemblies. Moreover, a criterion to derive recursive grammatical production rules is introduced so that the representation of a class of assemblies becomes especially compact. This general representation scheme allows to automatically derive hierarchical structural descriptions of individual assemblies by means of computer vision.


  1. 1.
    K.N. Brown, C.A. McMahon, and J.H. Sims Williams. Describing process plans as the formal semantics of a language of shape. Artificial Intelligence in Engineering, 10(2):153–169, 1996.CrossRefGoogle Scholar
  2. 2.
    S. Chakrabarty and J. Wolter. A Structure-Oriented Approach to Assembly Sequence Planning. IEEE Transactions on Robotics and Automation, 13(1):14–29, 1997.CrossRefGoogle Scholar
  3. 3.
    T.L. De Fazio, S.J. Rhee, and D.E. Whitney. Design-Specific Approach to Design fo Assembly (DFA) for Complex Mechanical Assemblies. IEEE Transactions on Robotics and Automation, 15(5):869–881, 1999.CrossRefGoogle Scholar
  4. 4.
    G.A. Fink, N. Jungclaus, F. Kummert, H. Ritter, and G. Sagerer. A Distributed System for Integrated Speech and Image Understanding. In International Symposium on Artificial Intelligence, pages 117–126, 1996.Google Scholar
  5. 5.
    K.S. Fu editor. Syntactic Pattern Recognition, Applications. Springer-Verlag, Berlin, 1977.zbMATHGoogle Scholar
  6. 6.
    C. Gardent. Discourse tree adjoining grammar. Technical report, University of Saarland, CLAUS report 91, 1997.Google Scholar
  7. 7.
    K. Ikeuchi and T. Suehiro. Towards an Assembly Plan from Observation Part I: Task Recognition with Polyhedral Objects. IEEE Transactions on Robotics and Automation, 10(3):368–385, 1994.CrossRefGoogle Scholar
  8. 8.
    R.E Jones, R.H. Wilson, and T.L. Calton. On Constraints in Assembly Planning. IEEE Transactions on Robotics and Automation, 14(6):849–863, 1998.CrossRefGoogle Scholar
  9. 9.
    S. Kronenberg and F. Kummert. Syntax coordination: Interaction of discourse and extrapositions. In ICSLP, volume 5 pages 2071–2074, 1998.Google Scholar
  10. 10.
    S. Kronenberg and F. Kummert. Soft unification: Towards robust parsing of spontanous speech. In IASTED Int. Conf. on Artificial Intelligence and Soft Computing, pages 381–385, 1999.Google Scholar
  11. 11.
    S. Kronenberg and F. Kummert. Structural dependencies between syntactic relations: A robust parsing model for extrapositions in spontaneous speech. In ASRU: IEEE Int. Workshop on Automatic Speech Recognition and Understanding, [Online], 1999. Available HTTP:
  12. 12.
    F. Kummert, G.A. Fink, G. Sagerer, and E. Braun. Hybrid Object Recognition in Image Sequences. In ICPR, volume II, pages 1165–1170, 1998.Google Scholar
  13. 13.
    R. Scha and L. Polanyi. An augmented context free grammar for discourse. In Proc. 12th Int. Conf. of the Association for Computational Linguistics, pages 573–577, 1988.Google Scholar
  14. 14.
    W. van Holland, W.F. Bronsvoort, and F.W. Jansen. Feature Modelling for Assembly. In W. Straßer and F.M. Wahl, editors, Graphics and Robotics, pages 131–148. Springer-Verlag, Berlin, 1995.Google Scholar
  15. 15.
    Bonnie Lynn Webber. Structure and ostension in the interpretation of discourse deixis. Language and Cognition Processes, pages 107–135, 1991.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Christian Bauckhage
    • 1
  • Susanne Kronenberg
    • 1
  • Franz Kummert
    • 1
  • Gerhard Sagerer
    • 1
  1. 1.Technische Fakultät, AG Angewandte InformatikBielefeld UniversityBielefeldGermany

Personalised recommendations