Skip to main content

At the Confluence of Software Engineeringand Human-Computer Interaction:A Personal Account

  • Chapter
  • First Online:
The French School of Programming
  • 41 Accesses

Abstract

In this chapter, I review how the fields of Human Computer Interaction (HCI) and Computer Science have come together over the last 60 years to create and support novel forms of interaction. We see how interaction models have progressively incorporated human skills and abilities, as well as the physical and social properties taken from the real world. I organize this evolution into three periods—pre-HCI, seminal HCI, ubiquitous HCI. Each of these periods is illustrated with key reference works that have influenced my own research as well as contributions of French researchers to the field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Coutaz, J., Crowley, J. L., Dobson, S. and Garlan, D. Context is Key. In Communication of the ACM, Vol. 48, No. 3, 2005, 49–53, https://doi.org/10.1145/1047671.1047703.

  2. Grudin, J. Three faces of Human-Computer Interaction. In EEE Annals of History of Computing, Vol. 17, No. 4, Oct.-Dec. 2005, 46–62, https://doi.org/10.1109/MAHC.2005.67.

  3. Hansen, W., J. Engineering Principles for Interactive Systems. In Proceedings of the American Federation of Information Processing Societies Fall joint Conference (AFIPS’71), ACM, 1971, 523–532, https://doi.org/10.1145/1479064.1479159.

  4. Norman, D., A. Design Principles for Human-Computer Interfaces. CHI’83 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Dec. 1983, ACM, 1–10, https://doi.org/10.1145/800045.801571.

  5. Tufte, W. R. The Visual Display of Quantitative Information, Graphics Press, 1986. Second Edition, 2001.

    Google Scholar 

  6. Dourish, P. Where the Action Is; The Foundations of Embodied Interaction. MIT Press, 2001.

    Google Scholar 

  7. Moggridge, B. Designing Interactions. MIT Press, 2007.

    Google Scholar 

  8. Hutchins, E., L., Hollan, J., D. and D., A., Norman. Direct Manipulation Interfaces. In User Centered System Design; New Perspectives on Human-Computer Interaction, edited by Norman, D., A. and Draper, S. W., Chap. 5, Lawrence Erlbaum Associates, 1986, 87–124.

    Google Scholar 

  9. Russel, A.L. An Interview with Najah Naffah, 2 April 2012, Paris, France

    Google Scholar 

  10. Shneiderman, B. Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison Wesley, 1987.

    Google Scholar 

  11. Barnard, P., J. Cognitive Resources and the Learning of Human-Computer Dialogs. In Interfacing Thought: Cognitive Aspects of Human-Computer Interaction, edited by Carroll, J., M., MIT Press, 1987, 112–158.

    Google Scholar 

  12. Norman, D., A. and Draper, S. User Centered System Design: New Perspectives on Human-Computer Interaction, Lawrence Erlbaum Associates, 1986.

    Book  Google Scholar 

  13. Card, S., K., Moran, T., P. and Newell, A. The Psychology of Human-Computer Interaction, Taylor & Francis, 1983.

    Google Scholar 

  14. MacKenzie, S. Fitts’ Law as a Research and Design Tool in Human-Computer Interaction. In Human-Computer Interaction, Taylor & Francis, Vol. 7, No.1, 1992, 91–139.

    Google Scholar 

  15. Douglas, S.A, Kirkpatrick, A.E. and Mackenzie, I.S. Testing Pointing Device Performance and User Assessment with the ISO 9241, Part 9 standard. In CHI’99 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, May 1999, ACM, 215–222, https://doi.org/10.1145/302979.303042.

  16. Callahan, J., Hopkins, D., Weiser, M. and Shneiderman, B. An Empirical Comparison of Pie vs. Linear Menus. In CHI’88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, May 1988, ACM, 95-100, https://doi.org/10.1145/57167.57182.

  17. Guillon, M., Leitner, F. and Nigay, L. Investigating Visual Feedforward for Target Expansion Techniques. In CHI 2015 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 120155, ACM, 2777-2786, https://dl.acm.org/doi/10.1145/2702123.2702375.

  18. Zhai, S., Conversy, S., Beaudouin-Lafon, M. and Guiard, Y. Human On-line Response to Target Expansion. Proceedings of the Conference on Human Factors in Computing Systems, CHI’03, ACM, 2003, 177–184.

    Google Scholar 

  19. McGuffin, M. and Balakrishnan, R. Fitts’ Law and Expanding Targets: Experimental Studies and Designs for User Interfaces. In ACM Transaction on Computer Human-Interaction (TOCHI), Vol. 12, No. 4, Dec. 2005, 388–422, https://doi.org/https://doi.org/10.1145/1121112.1121115.

  20. Blanch, R., Guiard, Y. and Beaudouin-Lafon, M. Semantic Pointing: improving target acquisition with control-display ratio adaptation. In CHI’04 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2004, ACM, 519–526.

    Google Scholar 

  21. Guiard, Y., Blanch, R. and Beaudouin-Lafon, M. Object pointing: a complement to bitmap pointing in GUIs. In Proceedings of Graphics Interfaces 2004, 2004, 9–16.

    Google Scholar 

  22. Guiard, Y. and Beaudouin-Lafon, M. Target acquisition in multiscale electronic worlds. In International Journal of Man Machine Studies, Vol. 61, No. 6, Academic Press, 2004, 875–905.

    Google Scholar 

  23. Mackinlay, J., Card, S. and Robertson, G. A Semantic Analysis of the Design Space of Input Devices, Human-Computer Interaction, Vol. 5, Lawrence Erlbaum Associates, 1990, 145–190.

    Google Scholar 

  24. Pinder, C., Vermeulen, J., Cowan, B. and Beale, R. Digital Behaviour Change Interventions to Break and Form habits. In ACM Transactions on Computer-Human Interaction, Vol. 25, No. 3, article no 15, 2018, 1–66.

    Google Scholar 

  25. Hartson, R. and Gray, P., D. Temporal Aspects of Tasks in the User Action Notation. In Human-Computer Interaction, Taylor & Francis, Vol. 7, No.1, 1992, 1–46.

    Google Scholar 

  26. Paternò, F. Concur Task Trees: An Engineered Notation for Task Models. In The Handbook of Task Analysis for Human-Computer Interaction, edited by Diaper, D. and Stanton, N., Lawrence Erlbaum Associates, 2003, 483–503.

    Google Scholar 

  27. Payne, S. and Green, T., R., G. Task-Actions Grammars: A Model of the Mental Representation of Task Languages. In Human-Computer Interaction, Taylor & Francis, Vol. 2, No. 2, 1986, 93–133, https://doi.org/10.1207/s15327051hci0202_1.

  28. Tauber, M. ETAG: Extended Task Actions Grammar – A Language for the Description of the User’s Task Language. In Proceedings of IFIP Conference INTERACT’90, edited by Diaper, D. Gilmore, D. Cockton, G. and Shackel, B., North Holland, 1990, 163–174.

    Google Scholar 

  29. Caffiau, S., Scapin, D., Girard, P., Baron, M. and Jambon, F. Increasing the Expressive Power of Task Analysis: Systematic Comparison and Empirical Assessment of Tool-Supported Task Models. Interacting with Computers, Oxford University Press, Vol. 22, No. 6, Nov. 2010, 569–593, https://doi.org/10.1016/j.intcom.2010.06.003.

  30. Vanderdonckt, J. and Bodard, F. Encapsulating Knowledge for Intelligent Automatic Interaction Object Selection. In Proceedings of the joint ACM conference on Human Factors in Computing Systems CHI and IFIP Conference on Human Computer Interaction INTERACT (InterCHI’93), May 1993, Amsterdam, 1999, 424–429, https://doi.org/10.1145/169059.169340.

    Google Scholar 

  31. Pangoli, S. and Paternò, F. Automatic Generation of Task-Oriented Help. In Proceedings of the 8th Annual ACM Symposium on User Interface Software and Technology (UIST ‘95), Dec. 1995, ACM, 181–187, https://doi.org/10.1145/215585.215971.

  32. Carroll, J., M. Training Wheels in a User Interface. In Communication of the ACM, Vol. 27, No. 8, August 1984, 800–806, https://doi.org/10.1145/358198.358218.

  33. Palanque, P. and Bastide, R. Petri net-based design of user-driven interfaces using the interactive cooperative objects formalism. In Interactive systems: Design, specification, verification, Springer, 1995, 383–400.

    Chapter  Google Scholar 

  34. Oliveira, R., Palanque, P., Weyers, B., Bowen, J. and Dix, A. State of the Art on Formal Methods for Interactive Systems. In The Handbook of Formal Methods in Human-Computer Interaction, Human-Computer Interaction Series, Springer, 2017, Chap. 1, https://doi.org/10.1007/978-3-319-51838-1, 3–55.

  35. Weyers, B., Bowen, J., Dix, A. and Palanque, P. The Handbook of Formal Methods in Human-Computer Interaction, Human-Computer Interaction Series, Springer, 2017, https://doi.org/10.1007/978-3-319-51838-1.

  36. Palanque, P., De Almeida P., De Almeida, M. Winckler, C., Winckler A., Antonio, M. Designing and Assessing Interactive Systems Using Task Models. In IFIP TC13 International Conference on Human-Computer Interaction (INTERACT 2017), Sept. 2017.

    Google Scholar 

  37. Paternò, F. Model-based Design and Evaluation of Interactive Applications. Applied Computing book series, Springer, 1999.

    Google Scholar 

  38. McCall, J. Factors in Software Quality. General Electric, 1977.

    Google Scholar 

  39. Abowd, G., D., Coutaz, J. and Nigay, L. Structuring the Space of Interactive System Properties. In Proceedings of the IFIP TC2/WG2.7 Working Conference on Engineering for Human Computer Interaction, Ellivuori, Finland, August 1992, North Holland Publ., edited by Larson, J. and Unger, C., 1992, 113–130.

    Google Scholar 

  40. Gram, C. and Cockton, G. Design Principles for Interactive Software. Chapman & Hall, 1996.

    Book  Google Scholar 

  41. Guiard, Y. Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. In Journal of motor behavior, Vol. 19, No. 4, 1987, 486–517.

    Google Scholar 

  42. MacKenzie, S. and Guiard, Y. The two-handed Desktop Interface: Are We There Yet? CHI’01 Extended Abstract of the SIGCHI Conference on Human Factors in Computing Systems, March 2001, ACM, 351–352, https://doi.org/10.1145/634067.634275.

  43. Bolt, R.A. “Put-that-there”, Voice and Gesture at the Graphics Interface. In SIGGRAPH Computer Graphics, Vol. 14, No. 3, ACM, 1980, 262–270.

    Google Scholar 

  44. Krasner, G. and Pope, T. A Description of Model-View-Controller User Interface Paradigm in the Smalltalk-80 System. In Journal of Object-Oriented Programming (JOOP), Vol. 1, No. 3, 1988, 26–49.

    Google Scholar 

  45. Coutaz, J. PAC, an Object-Oriented Model for Dialog Design. In Proceedings of Human-Computer Interaction, INTERACT’87, edited by Bullinger H.-J. and Shackel, B., North Holland, 1987, 431–436.

    Chapter  Google Scholar 

  46. Bass, L., John, B., E., and Kates, J. Achieving Usability Through Software Architecture. Technical report, Software Engineering Institute, Carnegie Mellon University, CMU/SEI-2001-TR-005, ESC-TR-2001-005, June 2001.

    Google Scholar 

  47. Carroll, J., M. Making Use: Scenario-Based Design of Human-Computer Interactions. MIT Press, 2000

    Google Scholar 

  48. Shaw, M. and Garlan, D. Software Architecture: Perspectives on an Emerging Discipline. Prentice Hall, 1996.

    Google Scholar 

  49. Bass, L. and Coutaz, J. Developing Software for the User Interface. Addison Wesley, SEI series in Software Engineering), 1991.

    Google Scholar 

  50. Coutaz, J. Architectural Design for User Interfaces. The Encyclopedia of Software Engineering, edited by Marciniak, J., Wiley and Sons, second edition, 2001.

    Google Scholar 

  51. Coutaz, J. and Balbo, S. Applications: A Dimension space for user interface management systems. In CHI’91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1991, ACM, 27–32.

    Google Scholar 

  52. Pfaff, S. Ed. User Interface Management Systems. Eurographics Seminars, Springer Verlag, New York, 1985.

    Google Scholar 

  53. The UIMS Tool Developers Workshop. A Metamodel for the runtime architecture of an interactive system. In ACM/SIGCHI Bulletin, Vol.24, No.1, ACM, 1992, 32–21.

    Google Scholar 

  54. Oviatt, S., L., DeAngeli, A. and Kuhn, K. Integration and Synchronization of Input Modes During Multimodal Human-Computer Interaction. In CHI’97 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, March 1997, ACM, 415–422, https://doi.org/10.1145/258549.258821.

  55. Nigay, L. and Coutaz, J. Building User Interfaces: Organizing Software Agents. Proceedings of the ESPRIT’91 Conference, Brussels, Nov. 1991, 707–719.

    Google Scholar 

  56. Nigay, L. and Coutaz, J. A Generic Platform for Addressing the Multimodal Challenge. In CHI’95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, May 1995, ACM, 98-105, https://doi.org/10.1145/223904.223917.

  57. Dey, T. A. Comparative Analysis on Modelling and Implementing with MVC Architecture. In Proceedings of the IEEE International Conference on Web Services Computing (ICWSC’2011), July 2011, Washington, USA, Vol. 1, 44–49.

    Google Scholar 

  58. Buschman, F., Meunier, R., Rohnert, H., Sommerlad, P. and Stal, M. Pattern-oriented Software Architecture: a System of Patterns, Vol. 1, John Wiley &Son, 2001.

    Google Scholar 

  59. Balme, L., Demeure, A., Barralon, N., Coutaz, J. and Calvary, G. CAMELEON-RT: a Software Architecture Reference Model for Distributed, Migratable, and Plastic User Interfaces. In Proceedings of the 2nd European Symposium on Ambient Intelligence (EUSAI 2004), Lecture Notes in Computer Science (LNCS 3295), Springer, 2004, 291–302.

    Google Scholar 

  60. Weiser, M. The Computer for the 21st Century. Scientific American, Sept. 1991. Also in IEEE Pervasive Computing, Vol. 1, No.1, 2002.

    Google Scholar 

  61. Post, E., R. and Orth, M. Smart Fabric, or “Wearable Clothing”. In Proceedings of the First International Symposium on Wearable Computers (ISWC’97), 1997, 167–168, https://doi.org/10.1109/ISWC.1997.629937.

  62. Kim, H., Coutrix, C. and Roudaut, A. KnobSlider: Design of a Shape-Changing UI for Parameter Control. In CHI’2018 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 2018, Montreal, Canada, ACM, 1–13, https://doi.org/10.1145/3173574.3173913.

  63. Harrison, C. Tan, D. and Morris, D. Skinput: Appropriating the Body as an Input Surface. In CHI’2010 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 2010, Atlanta, USA, ACM, 453–462, https://doi.org/10.1145/1753326.1753394.

  64. Fishkin, K., P., Gujar, A., Harrison, B. Moran, P. and Want, R. Embodied User Interfaces for Really Direct Manipulation. In Communication of the ACM, Vol. 43, No. 9, 2000, 74–80.

    Google Scholar 

  65. Fitzmaurice, G., W., Ishii, H. and Buxton, W. Bricks: Laying the Foundations for Graspable User Interfaces. In CHI’95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, May 1995, ACM, 442–449, https://doi.org/10.1145/223904.223964.

  66. Ishii, H. and Ullmer, B. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. In CHI’97 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, March 1997, Atlanta, USA, ACM, 234–241, https://doi.org/10.1145/258549.258715.

  67. Holmquist, L., E., Redström, J. and Ljungstrand, P. Token-based Access to Digital Information. In Procedings of the 1rst international symposium on handheld and ubiquitous computing (HUC’99), edited by H.W. Gellersen, Lecture Notes in Computer Scienc, vol. 1707, Springer, https://doi.org/10.1007/3-540-48157-5_22.

  68. Fishkin, K., P. A Taxonomy for and Analysis of Tangible Interfaces. In Personal and Ubiquitous Computing, Springer, Vol. 8, No. 5, 2004, 347–358, https://doi.org/10.1007/s00779-004-0297-4.

  69. Jansen, Y., Dragicevic, P., Isenberg, P., Alexander, J. et al. Opportunities and Challenges for Data Physicalization. In CHI’2015 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 2015, New York, ACM, 3227–3236, https://doi.org/10.1145/2702123.2702180.

  70. Daniel, M., Rivière, G. and Couture, N. CairnFORM: a Shape-Changing Ring Chart Notifying Renewable Energy Availability in Peripheral Locations. In Proceedings of the 13th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’19), Tempe, USA, ACM, 275–286, https://doi.org//10.1145/3294109.3295634.

  71. Ballagas, R., Ringel, M., Stone, M. and Borchers, J. iStuff: A Physical User Interface Toolkit for Ubiquitous Computing Environments. In CHI’2003 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 2003, Fort Lauderdale, USA, ACM, 537–544, https://doi.org/10.1145/642611.642705.

  72. Klemmer, S. R., Li, J., Lin, J., Landay, J. A. Papier-Mâché: Toolkit Support for Tangible Input. In CHI’2004 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 2004, Vienna, Austria, ACM, 24–29, https://doi.org/10.1145/985692.985743.

  73. Shaer, O., Leland, N., Calvillo-Gamez, E., H. and Jacob, R., J., K. The TAC Paradigm: Specifying Tangible User Interfaces. In Personal and Ubiquitous Computing, Vol. 8, No. 5, 2004, 359–369, Springer Verlag, https://doi.org/10.1007/s00779-004-0298-3.

  74. Wellner, P., Mackay, W. and Gold, R. Computer Augmented Environments: Back to the Real World. In Communication of the ACM, Vol. 36, No. 7, July 1993, 24–25.

    Google Scholar 

  75. Bau, O. and Mackay, W. OctoPocus: a Dynamic Guide for Learning Gesture-based Command Sets. In Proceedings of the 21st annual ACM Symposium on User Interface Software and Technology (UIST 2008), 37–46, https://doi.org/10.1145/1449715.1449724.

  76. Bérard, F. The Magic Table: Computer-vision Based Augmentation of a Whiteboard for Creative Meetings. In Proceedings of the ICCV Workshop on Projected-Camera Systems (ProCams). IEEE Computer Society Press, Oct. 2003.

    Google Scholar 

  77. Borkowski, S., Crowley, J., L., Letessier, J. and Bérard, F. User-Centric Design of a Vision System for Interactive Applications. Fourth IEEE International Conference on Computer Vision Systems (ICVS’06), 9 pages, https://doi.org/10.1109/ICVS.2006.61.

  78. Sharma, A., Agarwal, M. and Gupta, S. Sixth Sense Technology. In International Journal on Recent and Innovation Trends in Computing and Communication, Vol. 1, No. 4, 2013, 277–282.

    Google Scholar 

  79. Plasson, C., Cunin, D., Laurillau, Y. and Nigay, L. 3D Tabletop AR: a Comparison of Mid-Air, Touch and Touch+Mid-Air Interaction. In Proceeding of the International Conference on Advanced Visual Interface (AVI’20), Sept. 2020, article No. 40, 1–5, https://doi.org/10.1145/3399715.3399836.

  80. Stavness, I., Lam, B. and Fels, S. pCubee: a Perspective-Corrected Handheld Cubic Display. In CHI’2010 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 2010, ACM, 1381–1390, https://doi.org/10.1145/1753326.1753535.

  81. Louis, T., Troccaz, J., Rochet-Capellan, A. and Bérard, F. GyroSuite: General Purpose Interactions for Handheld Perspective Corrected Displays. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST 2020), Oct. 2020, Minneapolis, USA, 1248–1260, https://doi.org/10.1145/3379337.3415893.

    Google Scholar 

  82. Bérard, F. and Louis, T. The Object Inside: Assessing 3D Examination with a Spherical Handheld Perspective-Corrected Display. In CHI’2017 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2017, Denver, USA, ACM, 4396–4404, https://doi.org/10.1145/3025453.3025806.

  83. Borkowski, S., Riff, O. and Crowley, J., L., Projecting Rectified Images in an Augmented Environment. In Proceedings of the ICCV Workshop on Projected-Camera Systems (ProCams), IEEE Computer Society Press, Oct. 2003.

    Google Scholar 

  84. Coutaz, J., Borkowski, S. and Barralon, N. Coupling Interaction Resources: an Analytical Model. In Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence (SOC-EUSAI’ 2005), 2005, 183–188, https://doi.org/10.1145/1107548.1107596.

  85. Coutaz, J. Meta-User Interfaces for Ambient Spaces. In Proceedings of the 5th International Workshop on Task Models and Diagrams for User Interface Design (TAMODIA 2006), Oct. 2006, 9 pages.

    Google Scholar 

  86. Coutaz, J. and Calvary, G. HCI and Software Engineering for User Interface Plasticity. In Human Computer Handbook – Fundamentals, Evolving Technologies, and Emerging Applications, 3rd edition, edited by Sears, A. and Jacko J., A., CRC Press Taylor & Francis Group, 2012, chap. 52, 1195–1220, https://hal.archives-ouvertes.fr/hal-00752122.

  87. Thevenin, D. and Coutaz, J. Plasticity of User Interfaces: Framework and Research Agenda. In Proceedings of INTERACT’99, edited by Sasse, A. and Johnson, C., IFIP IOS Press, 1999, 110–117.

    Google Scholar 

  88. Calvary, G., Coutaz, J., Thevenin, D., Limbourg, Q., Bouillon, L. and Vanderdonckt, J. A Unifying Reference Framework for Multi-Target User Interfaces. In Interacting with Computers, Oxford Academics, Vol. 15, No. 3, 2003, 289-308, https://doi.org/10.1016/S0953-5438(03)00010-9.

  89. Stephanidis, C. and Savidis, A. Universal Access in the Information Society: Methods, Tools, and interaction technologies. Journal of the Universal Access in Information Society (UAIS), Vol. 1, No. 1, Springer, 40–55.

    Google Scholar 

  90. Ferry, N., Hourdin, V., Lavirotte, S., Rey, G., Riveill, M. and Tigli, J.-Y. WComp, a Middleware for Ubiquitous Computing. In Ubiquitous Computing, edited by Babkin, E., Intech Open, Chap. 8, 2011, https://doi.org/10.5772/14755.

  91. Kurtev, I., Bézivin, J., and Aksit, M. Technological spaces: An initial appraisal. CoopIS, DOA’2002 Federated Conferences, Industrial Track, 2002.

    Google Scholar 

  92. Calvary, G., Coutaz, J. and Thevenin, D. A Unifying Framework for the Development of Plastic User Interfaces. In Proceedings of the IFIP WG2.7(13) Working Conference on Engineering Human-Computer Interaction (EHCI01), edited by Reed Little, M. and Nigay, L., Lecture Notes in Computer Science book Series (LNCS, vol. 2254), Springer, 2001, 173–192.

    Google Scholar 

  93. Limbourg, Q. and Vanderdonckt, J. UsiXML: A User Interface Description Language Supporting Multiple Levels of Independence. In Proceedings of the Workshop on Engineering Advanced Web Applications in connection with the 4th International Conference on Web Engineering (ICWE 2004), July 2004.

    Google Scholar 

  94. Becker, C., Julien, C., Lalanda, P. and Zambonelli, F. Pervasive Computing Middleware: Current trends and Emerging Challenges. In Transactions on Pervasive Computing and Interaction, Vol. 1, 2019, 10–23, https://doi.org/10.1007/s42486-019-00005-2.

  95. Lalanda, P., McCann, J. A., and Diaconescu, A. Autonomic computing: principles, design and implementation, Springer Sciences and Business Media, 2013.

    Book  Google Scholar 

  96. Burnett, M. and Myers, B. Future of End-User Software Engineering: Beyond the Silos. In Proceedings of the International Conference on Software Engineering (ICSE 2014), ACM, 2014, 201–211, https://doi.org/10.1145/2593882.2593896.

  97. Scaffidi, C., Bogart, C., Burnett, M., Cypher, A., Myers, B. and Shaw, M. Predicting Reuse of End-User Web Macro Scripts. In Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), 2009, 93–100, https://10.1109/VLHCC.2009.5295290.

  98. Humble, J., Crabtree, A., Hemmings, T. and Akesson, K-P. “Playing with the Bits”: User-Configuration of Ubiquitous Domestic Environments. In Proceedings of 5th International Conference on Ubiquitous Computing (UbiComp 2003), Springe (LNCS 2864), 2003, 256–263, https://doi.org/10.1007/978-3-540-39653-6_20.

    Google Scholar 

  99. Truong, K., N., Huang, E., M. and Abowd, G. CAMP: A Magnetic Poetry Interface for End-User Programming of Capture Applications for the Home. In Proceedings of 6th International Conference on Ubiquitous Computing (UbiComp 2004), Springe (LNCS 3205), 2004, 143–160, https://doi.org/10.1007/978-3-540-30119-6_9.

    Google Scholar 

  100. Dey, A., Sohn, T., Streng, S. and Kodama, J. iCAP: Interactive Prototyping of Context-aware Applications. In Proceedings of the 4th International Conference on Pervasive Computing (Pervasive 2006), 2006, Springer (LNCS 3968), 254_271, https://doi.org/10.1007/11748625_16.

    Google Scholar 

  101. Drey, Z. and Consel, C. Taxonomy-Driven Prototyping of Home Automation Applications: a Novice-Programmer Visual Language and its Evaluation. Journal of Visual Languages & Programming, Vol. 23, No. 6, 2012, 60–67, https://doi.org/https://doi.org/10.1016/j.jvlc.2012.07.002.

  102. Coutaz, J. and Crowley, J., L. A First Person Experience with End-User Development for Smart Homes. In IEEE Pervasive Computing, Special Issue on Domestic Pervasive Computing, Vol. 15, No. 2, May-June 2016, 26–39, https://doi.org/10.1109/MPRV.2016.24

  103. Perera, C., Aghaee, S. and Blackwell, A. Natural Notation for the Domestic Internet of Things. In Proceedings of the 5th International Symposium on End-User Development (IS-EUD 2015), Springer (LNCS 9083), 2015, 25–41, https://doi.org/10.1007/978-3-319-18425-8–3.

    Google Scholar 

  104. Crowley, J., L., Coutaz, J., Grosinger, J., Vasquez, J., Angulo, C., Sanfeliu, A., Iocchi, L. and Cohn, A. G. A Hierarchical Framework for Collaborative Artificial Intelligence. In IEEE Pervasive, Vol. 22, No. 1, March 2023, https://doi.org/https://doi.org/10.1109/MPRV.2022.3208321.

  105. Ploix, S., Amayri, M. and Bouquila, N. Towards Energy Smart Homes: Algorithms, Technologies, and Applications, Springer, 2021, https://doi.org/https://doi.org/10.1007/978-3-030-76477-7.

  106. Carroll, J., M. Why Should Humans Trust AI? In Interactions (IX), Vol. 29, No. 4, ACM, 2022, 73–77.

    Google Scholar 

Download references

Acknowledgements

I owe a debt of gratitude to the members of my research group IIHM at LIG as well as to the many doctoral students that shared with me the enthusiasm of bringing together Software Engineering and HCI. Worthy of special thanks are Laurence Nigay, Gaëlle Calvary, and François Bérard for their passion and early involvement in the group at a time HCI was not mainstream research. My deep gratitude to James L. Crowley for his expertise in Computer Vision as well as his continued encouragement and support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joëlle Coutaz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Coutaz, J. (2024). At the Confluence of Software Engineeringand Human-Computer Interaction:A Personal Account. In: Meyer, B. (eds) The French School of Programming. Springer, Cham. https://doi.org/10.1007/978-3-031-34518-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34518-0_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34517-3

  • Online ISBN: 978-3-031-34518-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics