Text Mining Decision Elements from Meeting Transcripts

  • Caroline ChibelushiEmail author
  • Mike Thelwall
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 52)


The frequent but unfortunate need to rework software development projects may often be caused by inappropriate decision making. The first step in addressing this issue is to explore decision making processes and to extract the tangible elements of decision making within meetings. This chapter explores the hypothesis that text mining techniques can be used to extract the elements of decision making from software development project meetings and can ultimately be used as a facility to develop a decision management system. Theories of discourse, lexical chaining and cohesion are presented and used as the basis for the analysis of meeting transcripts. Information retrieval and data mining methods are also used. To assess the performance of the algorithm the C99 and TextTiling algorithms are used as comparators. The evaluation results show that our method is able to identify and extract the needs and actions of decision making with a high recall of 85–95% at a precision of 54–68%.


Decision making process Rework Software development projects Text mining [1] 


  1. 1.
    Rayson, P., Sharp, B., Alderson, A., Cartmell, J., Chibelushi, C., Clarke, R., Dix, A., Onditi, V., Quek, A., Ramduny, D., Salter, A., Shah, H., Sommerville, I., & Windridge, P. (2003). Tracker: a framework to support reducing rework through decision management. Presented at Proceedings of 5th International Conference on Enterprise Information Systems ICEIS2003, Angers, France.Google Scholar
  2. 2.
    Boehm, B., & Basil, V.R. (2001). Software reduction defects top 10 list. IEEE Computer, 34, 135–137.CrossRefGoogle Scholar
  3. 3.
    Jones, T. (1986). Software Productivity. McGraw-Hill, OH, USA.Google Scholar
  4. 4.
    Melo, W., Briand, L., & Basili, V. (1995). Measuring the impact of reuse on quality and productivity in object-oriented systems, Department of Computer Science, University of Maryland, College Park, MD, Technical Report CS-TR-3395.Google Scholar
  5. 5.
    ESA (1996). Ariane 5 – Flight 501 Failure. European Space Agency.Google Scholar
  6. 6.
    Nuseibeh, B. (1997). Ariane 5: Who dunnit? IEEE Software, 14, 15–16.CrossRefGoogle Scholar
  7. 7.
    Cross, S. (2002). Message from the Director, Software Engineering Institute, Annual Report 2002.Google Scholar
  8. 8.
    Goodman, J. (2002). Lessons learned from flights of “Off the shelf. aviation navigation units on the space shuttle,” presented at Joint Navigation Conference, Orlando, Florida.Google Scholar
  9. 9.
    Simon, H. (1960). The new science of management decision. New York: Harper & Row.CrossRefGoogle Scholar
  10. 10.
    Janis, I.L. (1968). Stages in the decision making process. In Theories of Cognitive Consistency: A Sourcebook, ed. Robert P. Abelson et al. Chicago: Rand McNally, pp. 577–588.Google Scholar
  11. 11.
    Schrenk, L.P. (1969). Aiding the decision maker – a decision process model, Ergonomics (pp. 543–557).Google Scholar
  12. 12.
    Witte, E. (1972). Field research on complex decision-making processes – the phase theorem. International studies of management and organization (pp. 156–182).Google Scholar
  13. 13.
    Henrikke, B. (1998). Life cycle assessment and decision making-theories and practices. GÖteborg: Chalmers University of Technology.Google Scholar
  14. 14.
    Adair, J. (1985). Effective decision-making. London: Pan Books.Google Scholar
  15. 15.
    Fulop, L., Linstead, S., Lilley, S., & Clarke, R.J. (1999). Decision making in organizations, in management: a critical text (pp. 462–494). Australia: Macmillan Education.Google Scholar
  16. 16.
    Pescatore, C., & Vári, A. (2004). Stepwise approach to decision making for long-term radioactive waste management, The NEA Radioactive Waste Management Committee NEA No. 4429.Google Scholar
  17. 17.
    Mintzberg, H., & Westley, F. (2001). Decision making: it’s not what you think. MIT Sloan Management Review, 42, 89–93.Google Scholar
  18. 18.
    March, J.G. (1984). Theories of choice and making decisions. In Lane, F.A. (Ed.), Current Issues in Public Administration, St Martin’s Press, New York, USAGoogle Scholar
  19. 19.
    Hoy, W., & Miskel, C. (1991). Educational administration: theory, research, and practice (4th edn.). New York: McGraw-Hill.Google Scholar
  20. 20.
    Chen, J. (2002). A comparative study on decision making approach in a dilemma between taiwanese and italian business, in graduate institute of management sciences. Taiwan: Tamkang University.Google Scholar
  21. 21.
    Harrison, F. (1999). The managerial decision-making process. USA: Houghton Mifllin Company.Google Scholar
  22. 22.
    Grosz, B.J., & Sidner, C.L. (1986). Attention, intentions, and the structure of discourse. Computational Linguistics, 12, 175–204.Google Scholar
  23. 23.
    Morris, J., & Hirst. G. (1991). Lexical cohesion computed. Computational Linguistics, 17, 21–48.Google Scholar
  24. 24.
    Halliday, M., & Hasan, R. (1976). Cohesion in English. London: Longman.Google Scholar
  25. 25.
    Hearst, M. (1997). TextTilling: segmenting text into multi-paragraph subtopic passages. Computational Linguistics, 23, 33–64.Google Scholar
  26. 26.
    Reynar, J. (1998). Topic segmentation: algorithms and applications, in computer and information science. College Park, Maryland: University of Pennsylvania.Google Scholar
  27. 27.
    Stokes, N. (2004). Applications of lexical cohesion analysis in the topic detection and tracking domain. Department of Computer Science: University College Dublin.Google Scholar
  28. 28.
    Stairmand, A.M. (1996). A computational analysis of lexical cohesion with applications in information retrieval. Department of language Engineering: University of Manchester Institute of Science and Technology.Google Scholar
  29. 29.
    Rayson, P. (2001). Wmatrix: a web-based corpus processing environment. Presented at ICAME 2001 Conference. Belgium: Université Catholique de Louvain.Google Scholar
  30. 30.
    Hearst, M. (1994). Multi-paragraph segmentation of expository text, presented at Proceedings of the 32th Annual Meeting of the Association for Computational Linguistics. Las Cruces, New Mexico.Google Scholar
  31. 31.
    Mandreoli, F., Martoglia, R., & Tiberio, P. (2005). Text clustering as a mining task, in text mining and its applications to intelligence. In A. Zanasi (Ed.), CRM and knowledge management. GB: WIT, pp. 75–108.Google Scholar
  32. 32.
    Manning, C., & Schütze, H. (2003). Foundations of natural language processing (6 edn.). London: MIT.Google Scholar
  33. 33.
    Meij, J., & Bosch, A. (2002). Text mining techniques. In J. Meij (Ed.), Dealing with the data flood (pp. 746–753). The Hague, Netherland: STT/Beweton.Google Scholar
  34. 34.
    Steinbach, M., Karypis, G., & Kumar, V. (2000). A comparison of document clustering techniques, presented at Proceedings of the KDD Workshop on Text Mining. Boston, MA, USA.Google Scholar
  35. 35.
    Lagus, K. (2000). Text mining with the WEBSOM, in computer science and engineering (pp. 58). Helsinki: Helsinki University.Google Scholar
  36. 36.
    Kohonen, T. (1989). Self organization and associative memory. Berlin, Heidelberg, New York: Springer.CrossRefGoogle Scholar
  37. 37.
    Chibelushi, C., & Sharp, B. (2008). Tracker text segmentation approach: integrating complex lexical and conversation cue features, presented at Proceedings of the 5th International Natural Language Processing and Cognitive Science Workshop. Bacelona, Spain.Google Scholar
  38. 38.
    Manning, C. (1998). Rethinking text segmentation models: an information extraction case study, University of Sydney, Sydney, Australia.Google Scholar
  39. 39.
    Beeferman, D., Berger, A., & Laffety, J. (1999). Statistical models for text segmentation, machine learning, Special Issue on Natural Language Processing, 34, 177–210.zbMATHGoogle Scholar
  40. 40.
    Bilan, Z., & Nakagawa, M. (2005). Segmentation of on-line handwritten japanese text of arbitrary line direction by a neural network for improving text recognition presented at Proceedings of the Eighth International Conference on Document Analysis and Recognition.Google Scholar
  41. 41.
    J. Renjie, Q. Feihu, L. Xu, & Wu G. (2006) Detecting and segmenting text from natural scenes with 2-stage classification presented at Proceedings of the Sixth International Conference on Intelligent Systems Design and Applications (ISDA’06)Google Scholar
  42. 42.
    Senda, S., & Yamada, K. (2001). A maximum-likelihood approach to segmentation-based recognition of unconstrained handwriting text, presented at Proceedings of the Sixth International Conference on Document Analysis and Recognition.Google Scholar
  43. 43.
    Youmans, G. (1991). A new tool for discourse analysis: the vocabulary management profile, in languages, 67(4), 763–789.Google Scholar
  44. 44.
    Reynar, J. (1999). Statistical models for topic segmentation, presented at Proceedings of the Association for Computational Linguistics. College Park, USA.Google Scholar
  45. 45.
    Kan, M., Klavans, J.L., & McKeown, K.R. (1998). Linear segmentation and segment relevance, presented at Proceedings of the Sixth Workshop on Very Large Corpora.Google Scholar
  46. 46.
    Beeferman, D., Berger, A., & Laffety, J. (1997). Text segmentation using exponantial models, presented at Proceedings of EMNLP-2. Madrid, Spain.Google Scholar
  47. 47.
    Levow, G. (2004). Prosodic cues to discourse segment boundaries in human-computer dialogue, presented at Proceedings of the 5th SIGdial Workshop on Discourse and Dialogue, USA.Google Scholar
  48. 48.
    Chibelushi, C. (2008). Text mining for meeting transcripts analysis to support decision management. In Faculty of Computing Engineering and Technology Stafford: Staffordshire University.Google Scholar
  49. 49.
    Passoneau, R., & Litman, D. (1997). Discourse segmentation by human and automated means. Computational Linguistics, 23, 103–139.Google Scholar
  50. 50.
    Katz, S.M. (1996). Distribution of context words and phrases in text and language modeling. Natural language Engineering, 2, 15–59.CrossRefGoogle Scholar
  51. 51.
    Pevzner, L., & Hearst, M. (2002). Evaluation metric for text segmentation. Computational Linguistics, 28, 19–36.CrossRefGoogle Scholar
  52. 52.
    Choi, F.Y. (2000). Advances in domain independent linear text segmentation presented at Proceedings of the 1st Meeting of the North American Chapter of the Association for Computational Linguistics (ANLP-NAACL-00), Seattle.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2009

Authors and Affiliations

  1. 1.School of Computing and IT, University of WolverhamptonWolverhamptonUK

Personalised recommendations