Understanding engineering email: the development of a taxonomy for identifying and classifying engineering work

  • James Wasiak
  • Ben Hicks
  • Linda Newnes
  • Andy Dong
  • Laurie Burrow
Original Paper

Abstract

It is widely believed that email is increasingly becoming the medium where in collaborative engineering work is done; yet, this assumption has not been properly examined. Thus, the extent of engineering information contained in emails and their potential importance within the context of knowledge management is unknown. To address this question, a study was undertaken with a large aerospace propulsion company to investigate the role and characteristics of email communication in engineering design projects. This paper describes the development of a taxonomy and classification method for achieving an understanding of email content and hence its use. The proposed approach is based on relevant techniques for analyzing communication and design text. The method codes the content of e-mail based on a hierarchical scheme by assigning email to categories and sub-categories that denote what topics the email is about, for which communicative purpose it has been sent, and whether it shows evidence of engineering work. The method is applied to a corpus related to the full life cycle of an engineering design project. Metrics for validation are discussed and applied to a sample case. Exemplar findings are presented to illustrate the type of investigations the method supports—including eliciting knowledge about project performance and identifying and accessing engineering knowledge. Finally, lessons from the development of the method, including a discussion of iteratively adaptive variants used to arrive at the final outcome, are discussed.

Keywords

Knowledge management Information handling behavior Content analysis Email Engineering work 

Notes

Acknowledgments

The work reported in this paper has been undertaken as part of the EPSRC Innovative Manufacturing Research Centre at the University of Bath (grant reference GR/R67507/0). The work has also been supported by a number of industrial companies and engineers. The authors gratefully acknowledge this support and express their thanks for the advice and support of all concerned. In particular the authors would like to thank Laurie Burrow, Hamish McAlpine and Craig Loftus who contributed to the development of the candidate schemes.

References

  1. Ahmed S, Wallace K (2003) Indexing design knowledge based upon descriptions of design process. International conference on engineering design ICED 03, StockholmGoogle Scholar
  2. AIMM International (2003) Email policies and practices: an industry study conducted by AIIM International and Kahn Consulting, Inc. Industry WatchGoogle Scholar
  3. AIMM International (2006) Email management: an oxymoron? An industry study conducted by AIIM International and Tower Software. Industry WatchGoogle Scholar
  4. Ainscough M, Yazdani B (2000) Concurrent engineering within British industry. Concurr Eng 8:2–11Google Scholar
  5. Aurisicchio M (2005) Characterising information acquisition in engineering design, engineering department. Cambridge University, CambridgeGoogle Scholar
  6. Bach K, Harnish RM (1979) Linguistic communication and speech acts. MIT Press, CambridgeGoogle Scholar
  7. Bales RF (1950) A set of categories for the analysis of small group interaction. Am Sociol Rev 15:7Google Scholar
  8. Bales RFSF (1951) Phases in group problem solving. J Abnorm Soc Psychol 46:485–495CrossRefGoogle Scholar
  9. Bellotti V, Ducheneaut N, Howard M, Smith T (2003) Taking email to task: the design and evaluation of a task management centered email tool. Association for Computing Machinery, Ft. LauderdaleGoogle Scholar
  10. Bellotti V, Ducheneaut N, Howard M, Smith I, Grinter RE (2005) Quality versus quantity: e-mail-centric task management and its relation with overload. Hum Comput Interact 20:89–138CrossRefGoogle Scholar
  11. Bouikni N, Rivest L, Desrochers A (2008) A multiple views management system for concurrent engineering and PLM. Concurr Eng 16:61–72CrossRefGoogle Scholar
  12. Burn J, Barnett M (1999) Communicating for advantage in the virtual organization. IEEE Trans Prof Commun 42:215–222CrossRefGoogle Scholar
  13. Coates G, Duffy AHB, Whitfield I, Hills W (2004) Engineering management: operational design coordination. J Eng Design 15:433–446CrossRefGoogle Scholar
  14. Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Measure 20:37–46CrossRefGoogle Scholar
  15. Conklin J (2003) Dialog mapping: reflections on an industrial strength case study. In: Kirschner P, Buckingham Shum S, Carr C (eds) Vizualising argumentation: software tools for collaborative and educational sense making. Springer, LondonGoogle Scholar
  16. Cross N, Dorst K, Roozenburg N (1992) Research in design thinking. Delft University Press, DelftGoogle Scholar
  17. Dalli A, Xia Y, Wilks Y (2004) FASIL email summarisation system. Proceedings of the 20th international conference on computational linguistics. Association for Computational Linguistics, Geneva Google Scholar
  18. Dong A (2006) How am I doing? The language of appraisal in design. In: Gero JS (ed) Design computing and cognition ‘06 (DCC06). Kluwer, EindhovenGoogle Scholar
  19. Dong A, Kleinsmann M, Valkenburg R (2009) Affect-in-cognition through the language of appraisals. In: Mcdonnell J, Lloyd P (eds) About: designing—analysing design meetings. Taylor and Francis, LondonGoogle Scholar
  20. Dredze M, Lau T, Kushmerick N (2006) Automatically classifying emails into activities. Proceedings of the 11th international conference on intelligent user interfaces. ACM, SydneyGoogle Scholar
  21. Eckert C (2001) The communication bottleneck in knitwear design: analysis and computing solutions. Comp Support Cooperative Work CSCW 10:29–74CrossRefMathSciNetGoogle Scholar
  22. Eckert CM, Stacey MK (2001) Dimensions of communication in design. 13th International Conference on Engineering Design (ICED’01), GlasgowGoogle Scholar
  23. Eppler MJ, Mengis J (2004) The concept of information overload: a review of literature from organization science, accounting, marketing, mis, and related disciplines. Inf Soc 20:325–344CrossRefGoogle Scholar
  24. Ericsson KA, Simon HA (1993) Protocol analysis: verbal reports as data. MIT Press, CambridgeGoogle Scholar
  25. Field M, Keller L (1998) Project management. International Thompson Series Press, LondonGoogle Scholar
  26. Fisher D, Brush AJ, Gleave E, Smith MA (2006) Revisiting Whittaker and Sidner’s “email overload” ten years later. Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work. ACM, BanffGoogle Scholar
  27. Gantz J, Reinsel D, Chute C, Schlichting W, Mcarthur J, Minton S, Xheneti I, Toncheva A, Manfrediz A (2007) The expanding digital universe: a forecast of worldwide information growth Through 2010. IDC, MassachusettsGoogle Scholar
  28. Gero J, Mc Neill T (1998) An approach to the analysis of design protocols. Design studies 19:21–61CrossRefGoogle Scholar
  29. Goel V (1995) Sketches of thought. MIT Press, CambridgeGoogle Scholar
  30. Gorse CA, Emmitt S (2003) Investigating interpersonal communication during construction progress meetings: challenges and opportunities. Eng Construct Arch Manage 10:234–244CrossRefGoogle Scholar
  31. Gorse CA, Emmitt S (2007) Communication behaviour during management and design team meetings: a comparison of group interaction. Construct Manage Econ 25:1197–1213CrossRefGoogle Scholar
  32. Graveline A, Geisler C, Danchak M (2000) Teaming together apart: emergent patterns of media use in collaboration at a distance. Proceedings of IEEE professional communication society international professional communication conference and Proceedings of the 18th annual ACM international conference on Computer documentation: technology and teamwork. IEEE Educational Activities Department, CambridgeGoogle Scholar
  33. Gray CF, Larson EW (2000) Project management: the managerial process, (1 Nov 2002), 2nd revised edition. McGraw-Hill Inc.,USA, ISBN-10:0071213406Google Scholar
  34. Haberberg A, Rieple A (2001) The strategic management of organisations. Financial Times/ Prentice Hall, LondonGoogle Scholar
  35. Hicks BJ, Culley SJ, Allen RD, Mullineux G (2002) A framework for the requirements of capturing, storing and reusing information and knowledge in engineering design, Int J Inf Manage 22(4):263–280. ISSN 0268-4012Google Scholar
  36. Hicks BJ, Dong A, Palmer R, Mcalpine HC (2008) Organizing and managing personal electronic files: a mechanical engineer’s perspective. ACM Trans Inf Syst 26:1–40CrossRefGoogle Scholar
  37. Hicks BJ (2007) Lean information management: understanding and eliminating waste. Int J Inf Manage 27(4):233–249, May 2007. ISSN 0268-4012Google Scholar
  38. Hiltz SR, Johnson K, Rabke AM (1980) The process of communication in face to face vs. computerized conferences: a controlled experiment using Bales Interaction Process Analysis. Proceedings of the 18th annual meeting on Association for Computational Linguistics. Association for Computational Linguistics Morristown, PhiladelphiaGoogle Scholar
  39. Huet G (2006) Design transaction monitoring: understanding design reviews for extended knowledge capture. Department of Mechanical Engineering, University of Bath, UKGoogle Scholar
  40. Jackson TW, Burgess A, Edwards J (2006) A simple approach to improving email communication. Commun ACM 49:107–109CrossRefGoogle Scholar
  41. Kim S (2002) User modelling for knowledge sharing in e-mail communication. SouthamptonGoogle Scholar
  42. Kleinsmann M, Dong A (2007) Investigating the affective force on creating shared understanding. 19th international conference on design theory and methodology. ASME Press, New YorkGoogle Scholar
  43. Koprinska I, Poon J, Clark J, Chan J (2007) Learning to classify e-mail. Inf Sci 177:2167–2187CrossRefGoogle Scholar
  44. Krippendorff K (1980) Content analysis: an introduction to its methodology. Sage Publications, Beverly Hills Google Scholar
  45. Kurasaki KS (2000) Inter-coder reliability for validating conclusions drawn from open-ended interview data. Field Methods 12:179–194CrossRefGoogle Scholar
  46. Larson RR (2005) Information life cycle, a model of the social aspects of digital libraries. http://www.sims.berkeley.edu/courses/is202/f98/Lecture2/index.htm
  47. Leuski A (2004) Email is a stage: discovering people roles from email archives. Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, SheffieldGoogle Scholar
  48. Li Z, Ramani K (2007) Ontology-based design information extraction and retrieval. Artif Intell Eng Design Anal Manuf AIEDAM 21:137–154Google Scholar
  49. Lincoln YS, Guba EG (1985) Naturalistic inquiry. Sage Publications, New DelhiGoogle Scholar
  50. Lindquist A, Berglund F, Johannesson H (2008) Supplier integration and communication strategies in collaborative platform development. Concurr Eng 16:23–35CrossRefGoogle Scholar
  51. Lombard M, Snyder-Duch J, Bracken CC (2002) Content analysis in mass communication: assessment and reporting of inter-coder reliability. Hum Commun Res 28:587–604CrossRefGoogle Scholar
  52. Lowe A (2002) Studies of information use by engineering designers and the development of strategies to aid in its classification and retrieval. Department of Mechanical Engineering. University of Bristol, UKGoogle Scholar
  53. Lusk EJ (2006) Email: Its decision support systems inroads—an update. Decision Support Syst 42:328–332CrossRefGoogle Scholar
  54. Mackay WE (1988) More than just a communication system: Diversity in the use of electronic mail. Proceedings of the CSCW 89 Conference on Computer Supported Cooperative Work. ACM, PortlandGoogle Scholar
  55. Maher ML, Rosenman M, Merrick K (2007) Agents for multidisciplinary design in virtual worlds. AI EDAM 21:267–277CrossRefGoogle Scholar
  56. Marsden W (2002) Aerospace for materials: the quality and quantity of materials data generated and available within the aerospace industry is without parallel, because aerospace components operate under extreme conditions (information management). Adv Mater Process 160:37–39Google Scholar
  57. Mcalpine H, Hicks BJ, Huet G, Culley SJ (2006) “An investigation into the use and content of the engineer’s logbook”. Design Stud, Springer 27(4):481–504, July 2006. ISSN 0142-694XGoogle Scholar
  58. Mcmahon C, Lowe A, Culley S (2004) Knowledge management in engineering design: personalization and codification. J Eng Design 15:307–325CrossRefGoogle Scholar
  59. Medland AJ (1992) Forms of communications observed during the study of design activities in industry. J Eng Design 5:243–253CrossRefGoogle Scholar
  60. Mesihovic S, Malmqvist J, Pikosz P (2004) Product data management system-based support for engineering project management. J Eng Design 15:389–403CrossRefGoogle Scholar
  61. O’Kane P, Hargie O (2007) Intentional and unintentional consequences of substituting face-to-face interaction with e-mail: an employee-based perspective. Interact Comp 19:20–31CrossRefGoogle Scholar
  62. O’Kane P, Palmer M, Hargie O (2007) Workplace interactions and the polymorphic role of e-mail. Leadersh Organ Dev J 28:308–324CrossRefGoogle Scholar
  63. Pahl G, Beitz W (1996) Engineering design: a systematic approach. Springer, BerlinGoogle Scholar
  64. Patton MQ (2002) Qualitative research and evaluation methods. Sage Publications, New DelhiGoogle Scholar
  65. Puade OA, Wyeld TG (2007) Visualising collaboration: qualitative analysis of an email visualisation case study. Information Visualization, 2007. IV ‘07. 11th International Conference. IEEE, ZurichGoogle Scholar
  66. Reid FJM, Malinek V, Stott CJT, Evans J (1996) The messaging threshold in computer-mediated communication. Ergonomics 39:1017–1037CrossRefGoogle Scholar
  67. Renaud K, Ramsay J, Hair M (2006) “You’ve Got E-Mail!” Shall I Deal With It Now? Electronic mail from the recipient’s perspective. Int J Hum Comp Interact 21:313–332CrossRefGoogle Scholar
  68. Schmidt K, Wagner I (2004) Ordering systems: coordinative practices and artifacts in architectural design and planning. Comput Support Coop Work (CSCW) 13(5–6):349–408. doi:10.1007/s10606-004-5059-3, ISSN 0925-9724
  69. Sim SK, Duffy AHB (2003) Towards an ontology of generic engineering design activities. Res Eng Design 14:200–223CrossRefGoogle Scholar
  70. Simon HA (1969) The sciences of the artificial. MIT Press, CambridgeGoogle Scholar
  71. Smith NJ (2007) Engineering project management. Blackwell, OxfordGoogle Scholar
  72. Stempfle J, Badke-Schaub P (2002) Thinking in design teams—an analysis of team communication. Design Stud 23:473–496CrossRefGoogle Scholar
  73. Teresko J (2008) Growing the PLM market—strong PLM growth will propel market to exceed $30 billion by 2011. Industry week, http://www.industryweek.com/
  74. Treasury Board of Canada (2005) Framework for management of information: the information lifecycle. http://www.cio-dpi.gc.ca/
  75. Tyler JR, Wilkinson DM, Huberman BA (2005) E-mail as spectroscopy: automated discovery of community structure within organizations. Inf Soc 21:133–141CrossRefGoogle Scholar
  76. Valkenburg R, Dorst K (1998) Reflective practice of design teams. Design Stud 19:249–271CrossRefGoogle Scholar
  77. Viegas FB, Golder S, Donath J (2006) Visualizing email content: portraying relationships from conversational histories. Association for Computing Machinery, Montreal, 10036-5701Google Scholar
  78. Wattenberg M, Rohall SL, Gruen D, Kerr B (2005) E-Mail research: targeting the enterprise. Hum Comp Interact 20:139–162CrossRefGoogle Scholar
  79. Wengraf T (2001) Qualitative research interviewing: biographic narrative and semi-structured methods. Sage Publications, LondonGoogle Scholar
  80. Whittaker S, Sidner C (1996) Email overload: exploring personal information management of email. The 1996 conference on human factors in computing systemsGoogle Scholar
  81. Wilson EV (2002) Email winners and losers. Commun ACM 45:121–126CrossRefGoogle Scholar
  82. Yang H, Callan J (2008) Ontology generation for large email collections. Proceedings of the 2008 international conference on Digital government research. Digital Government Society of North America, MontrealGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2009

Authors and Affiliations

  • James Wasiak
    • 1
  • Ben Hicks
    • 1
  • Linda Newnes
    • 1
  • Andy Dong
    • 2
  • Laurie Burrow
    • 3
  1. 1.Department of Mechanical Engineering, Innovative Design and Manufacturing Research CentreUniversity of BathBathUK
  2. 2.Design Lab, Faculty of Architecture, Design and PlanningUniversity of SydneySydneyAustralia
  3. 3.Converteam LtdRugbyUK

Personalised recommendations