Advertisement

An Introduction to Algebraic Semiotics, with Application to User Interface Design

  • Joseph Goguen
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1562)

Abstract

This paper introduces a new approach to user interface design and other areas, called algebraic semiotics. The approach is based on a notion of sign, which allows complex hierarchical structure and incorporates the insight (emphasized by Saussure) that signs come in systems, and should be studied at that level, rather than individually. A user interface can be considered as a representation of the underlying functionality to which it provides access, and thus user interface design can be considered a craft of constructing such representations, where both the interface and the underlying functionality are considered as (structured) sign systems. In this setting, representations appear as mappings, or morphisms, between sign systems, which should preserve as much structure as possible. This motivates developing a calculus having systematic ways to combine signs, sign systems, and representations. One important mode of composition is blending, introduced by Fauconnier and Turner; we relate this to certain concepts from the very abstract area of mathematics called category theory. Applications for algebraic semiotics include not only user interface design, but also cognitive linguistics, especially metaphor theory and cognitive poetics. The main contribution of this paper is the precision it can bring to such areas. Building on an insight from computer science, that discrete structures can be described by algebraic theories, sign systems are defined to be algebraic theories with extra structure, and semiotic morphisms are defined to be mappings of algebraic theories that (to some extent) preserve the extra structure. As an aid for practical design, we show that the quality of representations is closely related to the preservation properties of semiotic morphisms; these measures of quality also provide the orderings needed by our category theoretic formulation of blending. ©

Keywords

Sign System Category Theory Conceptual Space Base Graph Extra Structure 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    William P. Alston. Sign and symbol. In Paul Edwards, editor, Encyclopaedia of Philosophy, Volume 7, pages 437–441. Macmillan, Free Press, 1967. In 8 volumes; republished 1972 in 4 books.Google Scholar
  2. 2.
    Peter B. Andersen. Dynamic logic. Kodikas, 18(4):249–275, 1995.Google Scholar
  3. 3.
    Mikhail Bakhtin. The Dialogic Imagination: Four Essays. University of Texas at Austin, 1981.Google Scholar
  4. 4.
    Roland Barthes. S/Z: An Essay and Attitudes. Hill and Wang, 1974. Trans. Richard Miller.Google Scholar
  5. 5.
    Jon Barwise and John Perry. Situations and Attitudes. MIT (Bradford), 1983.Google Scholar
  6. 6.
    John Bowers. The politics of formalism. In Martin Lea, editor, Contexts of Computer-Mediated Communication. Harvester Wheatsheaf, 1992.Google Scholar
  7. 7.
    William S. Burroughs. The Adding Machine: Selected Essays. Arcade, 1986.Google Scholar
  8. 8.
    John Carroll. Learning, using, and designing filenames and command paradigms. Behavior and Information Technology., 1(4):327–246, 1982.CrossRefGoogle Scholar
  9. 9.
    Alain Cohen. Blade Runner: Aesthetics of agonistics and the law of response. π Cannocchiale, 3:43–58, 1996.Google Scholar
  10. 10.
    Gilles Fauconnier and Mark Turner. Conceptual projection and middle spaces. Technical Report 9401, University of California at San Diego, 1994. Dept. of Cognitive Science.Google Scholar
  11. 11.
    Gilles Fauconnier and Mark Turner. Blending as a central process of grammar. In Adele E. Goldberg, editor, Conceptual Structure, Discourse and Language, pages 113–129. CSLI, 1996.Google Scholar
  12. 12.
    Gilles Fauconnier and Mark Turner. Conceptual integration networks. Cognitive Science, 22(2):133–187, 1998.CrossRefGoogle Scholar
  13. 13.
    Syd Field. Screenplay: The Foundations of Screenwriting. Dell, 1982. Third edition.Google Scholar
  14. 14.
    Deidre Gentner. Structure-mapping: A theoretical framework for analogy. Cognitive Science, 7(2):155–170, 1983.CrossRefGoogle Scholar
  15. 15.
    Joseph Goguen. Semantics of computation. In Ernest Manes, editor, Proceedings, First International Symposium on Category Theory Applied to Computation and Control, pages 151–163. Springer, 1975. (San Fransisco, February 1974.) Lecture Notes in Computer Science, Volume 25.Google Scholar
  16. 16.
    Joseph Goguen. What is unification? A categorical view of substitution, equation and solution. In Maurice Nivat and Hassan Aït-Kaci, editors, Resolution of Equations in Algebraic Structures, Volume 1: Algebraic Techniques, pages 217–261. Academic, 1989.Google Scholar
  17. 17.
    Joseph Goguen. A categorical manifesto. Mathematical Structures in Computer Science, 1(1):49–67, March 1991.zbMATHMathSciNetCrossRefGoogle Scholar
  18. 18.
    Joseph Goguen. Types as theories. In George Michael Reed, Andrew William Roscoe, and Ralph F. Wachter, editors, Topology and Category Theory in Computer Science, pages 357–390. Oxford, 1991. Proceedings of a Conference held at Oxford, June 1989.Google Scholar
  19. 19.
    Joseph Goguen. On notation (a sketch of the paper). In Boris Magnusson, Bertrand Meyer, and Jean-Francois Perrot, editors, TOOLS 10: Technology of Object-Oriented Languages and Systems, pages 5–10. Prentice-Hall, 1993. The extended version of this paper may be obtained from http://www.cs.ucsd.edu/users/goguen/ps/notn.ps.gz.
  20. 20.
    Joseph Goguen. Requirements engineering as the reconciliation of social and technical issues. In Marina Jirotka and Joseph Goguen, editors, Requirements Engineering: Social and Technical Issues, pages 165–200. Academic, 1994.Google Scholar
  21. 21.
    Joseph Goguen. Towards a social, ethical theory of information. In Geoffrey Bowker, Leigh Star, William Turner, and Les Gasser, editors, Social Science, Technical Systems and Cooperative Work: Beyond the Great Divide, pages 27–56. Erlbaum, 1997.Google Scholar
  22. 22.
    Joseph Goguen. Social and semiotic analyses for theorem prover user interface design, submitted for publication 1998.Google Scholar
  23. 23.
    Joseph Goguen. Theorem Proving and Algebra. MIT, to appear.Google Scholar
  24. 24.
    Joseph Goguen and Rod Burstall. Institutions: Abstract model theory for specification and programming. Journal of the Association for Computing Machinery, 39(1):95–146, January 1992.zbMATHMathSciNetGoogle Scholar
  25. 25.
    Joseph Goguen, Kai Lin, Akira Mori, Grigore Roşu, and Akiyoshi Sato. Distributed cooperative formal methods tools. In Michael Lowry, editor, Proceedings, Automated Software Engineering, pages 55–62. IEEE, 1997.Google Scholar
  26. 26.
    Joseph Goguen, Kai Lin, Akira Mori, Grigore Roşu, and Akiyoshi Sato. Tools for distributed cooperative design and validation. In Proceedings, CafeOBJ Symposium. Japan Advanced Institute for Science and Technology, 1998. Nomuzu, Japan, April 1998.Google Scholar
  27. 27.
    Joseph Goguen and Charlotte Linde. Optimal structures for multi-media instruction. Technical report, SRI International, 1984. To Office of Naval Research, Psychological Sciences Division.Google Scholar
  28. 28.
    Joseph Goguen and Grant Malcolm. Algebraic Semantics of Imperative Programs. MIT, 1996.Google Scholar
  29. 29.
    Joseph Goguen and Grant Malcolm. A hidden agenda. Technical Report CS97-538, UCSD, Dept. Computer Science & Eng., May 1997. To appear in special issue of Theoretical Computer Science on Algebraic Engineering, edited by Chrystopher Nehaniv and Masamo Ito. Early abstract in Proc., Conf. Intelligent Systems: A Semiotic Perspective, Vol. I, ed. J. Albus, A. Meystel and R. Quintero, Nat. Inst. Science & Technology (Gaithersberg MD, 20–23 October 1996), pages 159–167.Google Scholar
  30. 30.
    Joseph Goguen and Grant Malcolm. Hidden coinduction: Behavioral correctness proofs for objects. Mathematical Structures in Computer Science, to appear 1999.Google Scholar
  31. 31.
    Joseph Goguen, Akira Mori, and Kai Lin. Algebraic semiotics, ProofWebs and distributed cooperative proving. In Yves Bartot, editor, Proceedings, User Interfaces for Theorem Provers, pages 25–34. INRIA, 1997. (Sophia Antipolis, 1–2 September 1997).Google Scholar
  32. 32.
    Joseph Goguen, James Weiner, and Charlotte Linde. Reasoning and natural explanation. International Journal of Man-Machine Studies, 19:521–559, 1983.CrossRefGoogle Scholar
  33. 33.
    Robert Goldblatt. Topoi, the Categorial Analysis of Logic. North-Holland, 1979.Google Scholar
  34. 34.
    Martin Heidegger. Being and Time. Blackwell, 1962. Translated by John Macquarrie and Edward Robinson from Sein und Zeit, Niemeyer, 1927.Google Scholar
  35. 35.
    Masako K. Hiraga. Diagrams and metaphors: Iconic aspects in language. Journal of Pragmatics, 22:5–21, 1994.CrossRefGoogle Scholar
  36. 36.
    Masako K. Hiraga. Rough seas and the milky way: ‘Blending’ in a haiku text. In Plenary Working Papers in Computation for Metaphors, Analogy and Agents, pages 17–23. University of Aizu, 1998. Technical Report 98-1-005, Graduate School of Computer Science and Engineering.Google Scholar
  37. 37.
    Masako K. Hiraga. ‘Blending’ and an interpretation of haiku: A cognitive approach. Poetics Today, to appear 1998.Google Scholar
  38. 38.
    Marina Jirotka and Joseph Goguen. Requirements Engineering: Social and Technical Issues. Academic, 1994.Google Scholar
  39. 39.
    William Labov. The transformation of experience in narrative syntax. In Language in the Inner City, pages 354–396. University of Pennsylvania, 1972.Google Scholar
  40. 40.
    George Lakoff and Mark Johnson. Metaphors We Live By. Chicago, 1980.Google Scholar
  41. 41.
    Saunders Mac Lane. Categories for the Working Mathematician. Springer, 1971.Google Scholar
  42. 42.
    Bruno Latour. Science in Action. Open, 1987.Google Scholar
  43. 43.
    Bruno Latour. Aramis, or the Love of Technology. Harvard, 1996.Google Scholar
  44. 44.
    John Lechte. Fifty Key Contemporary Thinkers. Routledge, 1994.Google Scholar
  45. 45.
    Eric Livingston. The Ethnomethodology of Mathematics. Routledge & Kegan Paul, 1987.Google Scholar
  46. 46.
    Grant Malcolm and Joseph Goguen. Signs and representations: Semiotics for user interface design. In Ray Paton and Irene Nielson, editors, Visual Representations and Interpretations. Springer Workshops in Computing, 1998. Proceedings of an international workshop held in Liverpool.Google Scholar
  47. 47.
    José Meseguer and Joseph Goguen. Initiality, induction and computability. In Maurice Nivat and John Reynolds, editors, Algebraic Methods in Semantics, pages 459–541. Cambridge, 1985.Google Scholar
  48. 48.
    Donald A. Norman. The Design of Everyday Things. Doubleday, 1988.Google Scholar
  49. 49.
    Charles Saunders Peirce. Collected Papers. Harvard, 1965. In 6 volumes; see especially Volume 2: Elements of Logic.Google Scholar
  50. 50.
    Eleanor Rosch. On the internal structure of perceptual and semantic categories.In T.M. Moore, editor, Cognitive Development and the Acquisition of Language.Academic, 1973.Google Scholar
  51. 51.
    Eleanor Rosch. Cognitive reference points. Cognitive Psychology, 7, 1975.Google Scholar
  52. 52.
    Harvey Sacks. On the analyzability of stories by children. In John Gumpertz and Del Hymes, editors, Directions in Sociolinguistics, pages 325–345. Holt, Rinehart and Winston, 1972.Google Scholar
  53. 53.
    Harvey Sacks. Lectures on Conversation. Blackwell, 1992. Edited by Gail Jefferson.Google Scholar
  54. 54.
    Ferdinand de Saussure. Course in General Linguistics. Duckworth, 1976. Translated by Roy Harris.Google Scholar
  55. 55.
    Ben Shneiderman. Designing the User Interface. Addison Wesley, 1997.Google Scholar
  56. 56.
    Susan Leigh Star. The structure of ill-structured solutions: Boundary objects and heterogeneous problem-solving. In Les Gasser and Michael Huhns, editors, Distributed Artificial Intelligence, volume 2, pages 37–54. Pitman, 1989.Google Scholar
  57. 57.
    Lucy Suchman. Plans and Situated Actions: The Problem of Human-machine Communication. Cambridge, 1987.Google Scholar
  58. 58.
    Mark Turner. The Literary Mind. Oxford, 1997.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • Joseph Goguen
    • 1
  1. 1.Dept. Computer Science & EngineeringUniv. of California at San DiegoUSA

Personalised recommendations

Cite paper

Buy options