Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Computation for Metaphors, Analogy, and Agents

CMAA 1998: Computation for Metaphors, Analogy, and Agents pp 242–291Cite as

An Introduction to Algebraic Semiotics, with Application to User Interface Design

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1562))

Abstract

This paper introduces a new approach to user interface design and other areas, called algebraic semiotics. The approach is based on a notion of sign, which allows complex hierarchical structure and incorporates the insight (emphasized by Saussure) that signs come in systems, and should be studied at that level, rather than individually. A user interface can be considered as a representation of the underlying functionality to which it provides access, and thus user interface design can be considered a craft of constructing such representations, where both the interface and the underlying functionality are considered as (structured) sign systems. In this setting, representations appear as mappings, or morphisms, between sign systems, which should preserve as much structure as possible. This motivates developing a calculus having systematic ways to combine signs, sign systems, and representations. One important mode of composition is blending, introduced by Fauconnier and Turner; we relate this to certain concepts from the very abstract area of mathematics called category theory. Applications for algebraic semiotics include not only user interface design, but also cognitive linguistics, especially metaphor theory and cognitive poetics. The main contribution of this paper is the precision it can bring to such areas. Building on an insight from computer science, that discrete structures can be described by algebraic theories, sign systems are defined to be algebraic theories with extra structure, and semiotic morphisms are defined to be mappings of algebraic theories that (to some extent) preserve the extra structure. As an aid for practical design, we show that the quality of representations is closely related to the preservation properties of semiotic morphisms; these measures of quality also provide the orderings needed by our category theoretic formulation of blending. ©

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. William P. Alston. Sign and symbol. In Paul Edwards, editor, Encyclopaedia of Philosophy, Volume 7, pages 437–441. Macmillan, Free Press, 1967. In 8 volumes; republished 1972 in 4 books.

    Google Scholar 

  2. Peter B. Andersen. Dynamic logic. Kodikas, 18(4):249–275, 1995.

    Google Scholar 

  3. Mikhail Bakhtin. The Dialogic Imagination: Four Essays. University of Texas at Austin, 1981.

    Google Scholar 

  4. Roland Barthes. S/Z: An Essay and Attitudes. Hill and Wang, 1974. Trans. Richard Miller.

    Google Scholar 

  5. Jon Barwise and John Perry. Situations and Attitudes. MIT (Bradford), 1983.

    Google Scholar 

  6. John Bowers. The politics of formalism. In Martin Lea, editor, Contexts of Computer-Mediated Communication. Harvester Wheatsheaf, 1992.

    Google Scholar 

  7. William S. Burroughs. The Adding Machine: Selected Essays. Arcade, 1986.

    Google Scholar 

  8. John Carroll. Learning, using, and designing filenames and command paradigms. Behavior and Information Technology., 1(4):327–246, 1982.

    Article  Google Scholar 

  9. Alain Cohen. Blade Runner: Aesthetics of agonistics and the law of response. π Cannocchiale, 3:43–58, 1996.

    Google Scholar 

  10. Gilles Fauconnier and Mark Turner. Conceptual projection and middle spaces. Technical Report 9401, University of California at San Diego, 1994. Dept. of Cognitive Science.

    Google Scholar 

  11. Gilles Fauconnier and Mark Turner. Blending as a central process of grammar. In Adele E. Goldberg, editor, Conceptual Structure, Discourse and Language, pages 113–129. CSLI, 1996.

    Google Scholar 

  12. Gilles Fauconnier and Mark Turner. Conceptual integration networks. Cognitive Science, 22(2):133–187, 1998.

    Article  Google Scholar 

  13. Syd Field. Screenplay: The Foundations of Screenwriting. Dell, 1982. Third edition.

    Google Scholar 

  14. Deidre Gentner. Structure-mapping: A theoretical framework for analogy. Cognitive Science, 7(2):155–170, 1983.

    Article  Google Scholar 

  15. Joseph Goguen. Semantics of computation. In Ernest Manes, editor, Proceedings, First International Symposium on Category Theory Applied to Computation and Control, pages 151–163. Springer, 1975. (San Fransisco, February 1974.) Lecture Notes in Computer Science, Volume 25.

    Google Scholar 

  16. Joseph Goguen. What is unification? A categorical view of substitution, equation and solution. In Maurice Nivat and Hassan Aït-Kaci, editors, Resolution of Equations in Algebraic Structures, Volume 1: Algebraic Techniques, pages 217–261. Academic, 1989.

    Google Scholar 

  17. Joseph Goguen. A categorical manifesto. Mathematical Structures in Computer Science, 1(1):49–67, March 1991.

    Article  MATH  MathSciNet  Google Scholar 

  18. Joseph Goguen. Types as theories. In George Michael Reed, Andrew William Roscoe, and Ralph F. Wachter, editors, Topology and Category Theory in Computer Science, pages 357–390. Oxford, 1991. Proceedings of a Conference held at Oxford, June 1989.

    Google Scholar 

  19. Joseph Goguen. On notation (a sketch of the paper). In Boris Magnusson, Bertrand Meyer, and Jean-Francois Perrot, editors, TOOLS 10: Technology of Object-Oriented Languages and Systems, pages 5–10. Prentice-Hall, 1993. The extended version of this paper may be obtained from http://www.cs.ucsd.edu/users/goguen/ps/notn.ps.gz.

  20. Joseph Goguen. Requirements engineering as the reconciliation of social and technical issues. In Marina Jirotka and Joseph Goguen, editors, Requirements Engineering: Social and Technical Issues, pages 165–200. Academic, 1994.

    Google Scholar 

  21. Joseph Goguen. Towards a social, ethical theory of information. In Geoffrey Bowker, Leigh Star, William Turner, and Les Gasser, editors, Social Science, Technical Systems and Cooperative Work: Beyond the Great Divide, pages 27–56. Erlbaum, 1997.

    Google Scholar 

  22. Joseph Goguen. Social and semiotic analyses for theorem prover user interface design, submitted for publication 1998.

    Google Scholar 

  23. Joseph Goguen. Theorem Proving and Algebra. MIT, to appear.

    Google Scholar 

  24. Joseph Goguen and Rod Burstall. Institutions: Abstract model theory for specification and programming. Journal of the Association for Computing Machinery, 39(1):95–146, January 1992.

    MATH  MathSciNet  Google Scholar 

  25. Joseph Goguen, Kai Lin, Akira Mori, Grigore Roşu, and Akiyoshi Sato. Distributed cooperative formal methods tools. In Michael Lowry, editor, Proceedings, Automated Software Engineering, pages 55–62. IEEE, 1997.

    Google Scholar 

  26. Joseph Goguen, Kai Lin, Akira Mori, Grigore Roşu, and Akiyoshi Sato. Tools for distributed cooperative design and validation. In Proceedings, CafeOBJ Symposium. Japan Advanced Institute for Science and Technology, 1998. Nomuzu, Japan, April 1998.

    Google Scholar 

  27. Joseph Goguen and Charlotte Linde. Optimal structures for multi-media instruction. Technical report, SRI International, 1984. To Office of Naval Research, Psychological Sciences Division.

    Google Scholar 

  28. Joseph Goguen and Grant Malcolm. Algebraic Semantics of Imperative Programs. MIT, 1996.

    Google Scholar 

  29. Joseph Goguen and Grant Malcolm. A hidden agenda. Technical Report CS97-538, UCSD, Dept. Computer Science & Eng., May 1997. To appear in special issue of Theoretical Computer Science on Algebraic Engineering, edited by Chrystopher Nehaniv and Masamo Ito. Early abstract in Proc., Conf. Intelligent Systems: A Semiotic Perspective, Vol. I, ed. J. Albus, A. Meystel and R. Quintero, Nat. Inst. Science & Technology (Gaithersberg MD, 20–23 October 1996), pages 159–167.

    Google Scholar 

  30. Joseph Goguen and Grant Malcolm. Hidden coinduction: Behavioral correctness proofs for objects. Mathematical Structures in Computer Science, to appear 1999.

    Google Scholar 

  31. Joseph Goguen, Akira Mori, and Kai Lin. Algebraic semiotics, ProofWebs and distributed cooperative proving. In Yves Bartot, editor, Proceedings, User Interfaces for Theorem Provers, pages 25–34. INRIA, 1997. (Sophia Antipolis, 1–2 September 1997).

    Google Scholar 

  32. Joseph Goguen, James Weiner, and Charlotte Linde. Reasoning and natural explanation. International Journal of Man-Machine Studies, 19:521–559, 1983.

    Article  Google Scholar 

  33. Robert Goldblatt. Topoi, the Categorial Analysis of Logic. North-Holland, 1979.

    Google Scholar 

  34. Martin Heidegger. Being and Time. Blackwell, 1962. Translated by John Macquarrie and Edward Robinson from Sein und Zeit, Niemeyer, 1927.

    Google Scholar 

  35. Masako K. Hiraga. Diagrams and metaphors: Iconic aspects in language. Journal of Pragmatics, 22:5–21, 1994.

    Article  Google Scholar 

  36. Masako K. Hiraga. Rough seas and the milky way: ‘Blending’ in a haiku text. In Plenary Working Papers in Computation for Metaphors, Analogy and Agents, pages 17–23. University of Aizu, 1998. Technical Report 98-1-005, Graduate School of Computer Science and Engineering.

    Google Scholar 

  37. Masako K. Hiraga. ‘Blending’ and an interpretation of haiku: A cognitive approach. Poetics Today, to appear 1998.

    Google Scholar 

  38. Marina Jirotka and Joseph Goguen. Requirements Engineering: Social and Technical Issues. Academic, 1994.

    Google Scholar 

  39. William Labov. The transformation of experience in narrative syntax. In Language in the Inner City, pages 354–396. University of Pennsylvania, 1972.

    Google Scholar 

  40. George Lakoff and Mark Johnson. Metaphors We Live By. Chicago, 1980.

    Google Scholar 

  41. Saunders Mac Lane. Categories for the Working Mathematician. Springer, 1971.

    Google Scholar 

  42. Bruno Latour. Science in Action. Open, 1987.

    Google Scholar 

  43. Bruno Latour. Aramis, or the Love of Technology. Harvard, 1996.

    Google Scholar 

  44. John Lechte. Fifty Key Contemporary Thinkers. Routledge, 1994.

    Google Scholar 

  45. Eric Livingston. The Ethnomethodology of Mathematics. Routledge & Kegan Paul, 1987.

    Google Scholar 

  46. Grant Malcolm and Joseph Goguen. Signs and representations: Semiotics for user interface design. In Ray Paton and Irene Nielson, editors, Visual Representations and Interpretations. Springer Workshops in Computing, 1998. Proceedings of an international workshop held in Liverpool.

    Google Scholar 

  47. José Meseguer and Joseph Goguen. Initiality, induction and computability. In Maurice Nivat and John Reynolds, editors, Algebraic Methods in Semantics, pages 459–541. Cambridge, 1985.

    Google Scholar 

  48. Donald A. Norman. The Design of Everyday Things. Doubleday, 1988.

    Google Scholar 

  49. Charles Saunders Peirce. Collected Papers. Harvard, 1965. In 6 volumes; see especially Volume 2: Elements of Logic.

    Google Scholar 

  50. Eleanor Rosch. On the internal structure of perceptual and semantic categories.In T.M. Moore, editor, Cognitive Development and the Acquisition of Language.Academic, 1973.

    Google Scholar 

  51. Eleanor Rosch. Cognitive reference points. Cognitive Psychology, 7, 1975.

    Google Scholar 

  52. Harvey Sacks. On the analyzability of stories by children. In John Gumpertz and Del Hymes, editors, Directions in Sociolinguistics, pages 325–345. Holt, Rinehart and Winston, 1972.

    Google Scholar 

  53. Harvey Sacks. Lectures on Conversation. Blackwell, 1992. Edited by Gail Jefferson.

    Google Scholar 

  54. Ferdinand de Saussure. Course in General Linguistics. Duckworth, 1976. Translated by Roy Harris.

    Google Scholar 

  55. Ben Shneiderman. Designing the User Interface. Addison Wesley, 1997.

    Google Scholar 

  56. Susan Leigh Star. The structure of ill-structured solutions: Boundary objects and heterogeneous problem-solving. In Les Gasser and Michael Huhns, editors, Distributed Artificial Intelligence, volume 2, pages 37–54. Pitman, 1989.

    Google Scholar 

  57. Lucy Suchman. Plans and Situated Actions: The Problem of Human-machine Communication. Cambridge, 1987.

    Google Scholar 

  58. Mark Turner. The Literary Mind. Oxford, 1997.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. Computer Science & Engineering, Univ. of California at San Diego, USA

    Joseph Goguen

Authors
  1. Joseph Goguen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Engineering and Information Sciences, University of Hertfordshire, College Lane, Hatfield Herts, AL10 9AB, UK

    Chrystopher L. Nehaniv

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Goguen, J. (1999). An Introduction to Algebraic Semiotics, with Application to User Interface Design. In: Nehaniv, C.L. (eds) Computation for Metaphors, Analogy, and Agents. CMAA 1998. Lecture Notes in Computer Science(), vol 1562. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48834-0_15

Download citation

  • DOI: https://doi.org/10.1007/3-540-48834-0_15

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65959-4

  • Online ISBN: 978-3-540-48834-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation