A Hybrid VFT-GQM Method for Developing Performance Criteria and Measures

  • Corlane BarclayEmail author
  • Kweku-Muata Osei-Bryson
Part of the Integrated Series in Information Systems book series (ISIS, volume 34)


This chapter utilizes the principles of the Value Focused Thinking (VFT) and Goal Question Metric (GQM) to present a tool for managing the foundation processes of projects, programs and portfolios. The Project Performance Development Framework (PPDF) promotes the use of formal steps for identifying project criteria and measures that are used as the basis to evaluate the performance of the project. It addresses critical problems in project management where objectives typically are not clearly defined and stakeholders have multiple views and objectives on what is important to them in the project, which in turn impacts how the project performance is perceived. The PPDF has several iterative steps including stakeholder identification, objectives identification and structuring, definition of project measurement and prioritization to aid in stakeholder management and project objectives identification, prioritization and management. The PPDF artifact presented is demonstrated and evaluated for utility through a single Process Quality Management Development Project. The findings support the goals of PPDF and show that the formal approach provides added advantages in identifying important values of the stakeholders thereby improving the likelihood of managing stakeholders’ needs and achieving identified goals.


Analytic Hierarchy Process Project Management Project Performance Performance Criterion Case Study Approach 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



Material in this chapter previously appeared in: “PPDF: An Approach for Developing Performance Criteria and Measures for Information Systems (IS) Projects”, International Journal of Production Economics 124:1, 272–292 (2010).


  1. Agarwal N, Rathod U (2006) Defining ‘success’ for software projects: an exploratory revelation. Int J Proj Manage 24(4):358–370CrossRefGoogle Scholar
  2. Ala-Risku T, Kärkkäinen M (2006) Material delivery problems in construction projects: a possible solution. Int J Prod Econ 104(1):19–29CrossRefGoogle Scholar
  3. Alleman GB (2005) Agile project management for it projects. In: Y-HK, Carayannis EG, Anbari FT (eds) The story of managing projects: an interdisciplinary approach. Greenwood Press, New York, pp 373Google Scholar
  4. APM (2006) The apm body of knowledge, 5th edn. The Association of Project ManagementGoogle Scholar
  5. Arshinder, Kanda A, Deshmukh SG (2008) Supply chain coordination: Perspectives, empirical studies and research directions. Int J Prod Econ 115(2):316–335Google Scholar
  6. Atkinson R (1999) Project management: Cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria. Int J Proj Manage 17(6):337–342CrossRefGoogle Scholar
  7. Atkinson R, Crawford L, Ward S (2006) Fundamental uncertainties in projects and the scope of project management. Int J Proj Manage 24:687–698CrossRefGoogle Scholar
  8. Azzone G, Masella C, Bertele U (1991) Design of performance measures for time-based companies. Int J Oper Prod Manage 11(3):77–85CrossRefGoogle Scholar
  9. Baccarini D (1999) The logical framework method for defining project success. Proj Manage J 30(4):25–32Google Scholar
  10. Barclay C (2008) Towards an integrated measurement of is project performance: The project performance scorecard. Inf Syst Front 10:331–345CrossRefGoogle Scholar
  11. Barclay C, Osei-Bryson KM (2008) The project objectives measurement model (POMM): An alternative view to information systems project measurement. Electron J Inf Syst Eval 11(3):139–154Google Scholar
  12. Basili VR (1999) Foreword. In: Solingen R, Berghout E (eds) The goal/question/metric method, a practical method for quality improvement of software development. McGraw Hill, LondonGoogle Scholar
  13. Basili VR, Weiss DM (1984) A methodology for collecting valid software engineering data. IEEE Trans Softw Eng 10(6):728–738CrossRefGoogle Scholar
  14. Belassi W, Tukel OI (1996) A new framework for determining critical success/failure factors in projects. Int J Proj Manage 14(3):141–151CrossRefGoogle Scholar
  15. Bhushan N, Rai K (2004) Strategic decision making: applying the analytic hierarchy process. Springer, LondonGoogle Scholar
  16. Bourne L, Walker DHT (2006) Using a visualising tool to study stakeholder influence—two australian examples. Proj Manage J 37(1):5–21Google Scholar
  17. Bryde DJ, Robinson L (2005) Client versus contractor perspectives on project success criteria. Int J Proj Manage 23(8):622–629CrossRefGoogle Scholar
  18. Brynjolfsson E (1993) The productivity paradox of information technology. Commun ACM 36(12):67–77CrossRefGoogle Scholar
  19. Bryson N (1997) Supporting consensus formation in group support systems using the qualitative discriminant process. Interface between information systems and operations research. Ann Oper Res 71:75–91Google Scholar
  20. Cannon-Bowers JA, Salas E, Converse S (1993) Shared mental models in expert team decision making. In: Castellan JNJ (ed) Individual and group decision making: current issues. Lawrence Erlbaum, Hillsdale, pp 221–246Google Scholar
  21. Caldiera VRBG, Rombach HD (1994) The goal question metric approach. Encycl Softw Eng 2:528–532.Google Scholar
  22. Chen SC, Dhillon GS (2003) Interpreting dimensions of consumer trust in e-commerce. J Inf Technol Manage 4(2–3):303–318Google Scholar
  23. CMMI (2002) Capability maturity model® integration (cmmism), version 1.1, cmu/sei-2002-tr-011Google Scholar
  24. Cohen DJ, Graham RJ (2001) The project manager’s mba: How to translate project decisions into business success. Wiley, LondonGoogle Scholar
  25. Collins A, Baccarini D (2004) Project success—a survey. J Constr Res 5(2):211–231CrossRefGoogle Scholar
  26. Cooke-Davies T (2002) The “real” success factors on projects. Int J Proj Manage 20(3):185–190CrossRefGoogle Scholar
  27. Darke P, Shanks G, Broadbent M (1998) Sucessfully completing case study research: Combining rigor, relevance and pragmatism. Inf Syst J 8:273–289CrossRefGoogle Scholar
  28. Dhillon G, Torkzadeh G (2006) Value-focused assessment of information system security in organizations. Inf Syst J 16:293–314CrossRefGoogle Scholar
  29. Dixon JR, Nanni AJ, Vollmann TE (1990) New performance challenge: Measuring operations for world-class competition (irwin/apics series in production management). McGraw-Hill Professional Publishing, HomewoodGoogle Scholar
  30. Drevin L, Kruger HA, Steyn T (2007) Value-focused assessment of ict security awareness in an academic environment. Comput & Secur 26(1):36–43CrossRefGoogle Scholar
  31. Engwall M (2003) No project is an island: Linking projects to history and context. Res Policy 32:789–808CrossRefGoogle Scholar
  32. Esteves JM, Pastor J, Casanovas J (2003) A goal/question/metric research proposal to monitor user involvement and participation in ERP implementation projects. Paper presented at the information resources management association conference (IRMA), Philadelphia, USAGoogle Scholar
  33. Ewusi-Mensah K (1997) Critical issues in abandoned information systems development projects. Commun ACM 40(9):71–80CrossRefGoogle Scholar
  34. Fitzgerald G (1998) Evaluating information systems project: a multidimensional approach. J Inf Technol 13(1):15–27CrossRefGoogle Scholar
  35. Folan P, Browne J (2005) A review of performance measurement: towards performance management. Comput Ind 56:663–680CrossRefGoogle Scholar
  36. Fortune J, White D (2006) Framing of project critical success factors by a systems model. Int J Proj Manage 24(1):53–65CrossRefGoogle Scholar
  37. Freeman M, Beale P (1992) Measuring project success. Proj Manage J 23(1):8–17Google Scholar
  38. Glass RL (2005) IT failure rates—70% or 10–15%?. Software IEEE 22(3):112–111Google Scholar
  39. Globerson S (1985) Issues in developing a performance criteria system for an organisation. Int J Prod Res 23(4):639–646CrossRefGoogle Scholar
  40. Hartman F, Ashrafi RA (2002) Project management in the lnformation systems and lnformation technologies industries. Proj Manage J 33(3):5–15Google Scholar
  41. Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105Google Scholar
  42. Huber G (1991) Organizational learning: the contributing processes and the literatures. Organ Sci 2(1):88–115CrossRefGoogle Scholar
  43. ISO/IEC (2000) Quality management systems—requirements: international organization for standardizationGoogle Scholar
  44. Kaplan RS, Norton DP (1992) The balanced scorecard: Measures that drive performance. Harvard Bus Rev 70(1):71–79Google Scholar
  45. Katzenbach JR, Smith DK (2003) The wisdom of teams: Creating the high-performance organization. Harper Collins, New YorkGoogle Scholar
  46. Keeney RL (1992) Value-focused thinking: a path to creative decision making. Harvard University Press, CambridgeGoogle Scholar
  47. Keeney RL (1996) Value-focused thinking: identifying decision opportunities and creating alternatives. Eur J Oper Res 92:537–549CrossRefGoogle Scholar
  48. KPMG (2005) Global it project management survey: KPMG Information Risk ManagementGoogle Scholar
  49. Kumar RL (2003) Understanding the value of information technology enabled responsiveness. Electron J Inf Syst Eval, EJISE 1(1)Google Scholar
  50. Leonard-Barton D (1990) A dual methodology for case studies: synergistic use of a longitudinal single site with replicated multiple sites. Organ Sci 1(3):248–266Google Scholar
  51. Lim CS, Mohamed MZ (1999) Criteria of project success: an exploratory re-examination. Int J Proj Manage 17(4):243–248CrossRefGoogle Scholar
  52. Lyytinen K, Hirschheim R (1988) Information systems failures—a survey and classification of the empirical literature. In: Zorkoczy P (ed) Oxford surveys in information technology. Oxford University Press Inc, New York, pp 257–309Google Scholar
  53. March ST, Smith GF (1995) Design and natural science research on information technology. Decis Support Syst 15:251–266CrossRefGoogle Scholar
  54. Martinsons M, Davison R, Tse D (1999) The balanced scorecard: a foundation for the strategic management of information systems. Decis Support Syst 25:71–88CrossRefGoogle Scholar
  55. Melville N, Kraemer K, Gurbaxani V (2004) Review: information technology and organisational performance: An integrative model of it business value. MIS Q 28(2):283–322Google Scholar
  56. Milis K, Mercken R (2002) Success factors regarding the implementation of ict investment projects. Int J Prod Econ 80(1):105–117CrossRefGoogle Scholar
  57. Morris P (2004) Current trends in project and programme management. Association for Project Management (APM), High WycombeGoogle Scholar
  58. Nelson RR (2005) Project retrospectives: evaluating project success, failure and everything in between. MIS Q Executive 4(3):361–372Google Scholar
  59. Niebecker K, Eager D, Kubitza K (2008) Improving cross-company project management performance with a collaborative project scorecard. Int J Manag Proj Bus 1(3):368–386CrossRefGoogle Scholar
  60. PMI (2004) A guide to project management body of knowledge, 3rd edn. Project Management Institute, Newtown SquareGoogle Scholar
  61. Pouloudi A, Whitley EA (1997) Stakeholder identification in inter-organizational systems: Gaining insights for drug use management systems. Eur J Inf Syst 6:1–14CrossRefGoogle Scholar
  62. Saaty TL (1990) How to make a decision: the analytic hierarchy process. Eur J Oper Res 48(1):9–26CrossRefGoogle Scholar
  63. Sharp H, Finkelstein A, Galal G (1999) Stakeholder identification in the requirements engineering process. Paper presented at the 10th international workshop on database & expert systems applicationsGoogle Scholar
  64. Shenhar AJ, Dvir D, Levy O, Maltz AC (2001) Project success: a multi-dimensional strategic perspective. Long Range Plan 34:699–725CrossRefGoogle Scholar
  65. Shenhar AJ, Tisler A, Dvir D, Lipostevsky S, Lechler T (2002) Refining the search for project success factors: a multivariate typographical approach. R & D Manage 32(2):111–126CrossRefGoogle Scholar
  66. Siau K, Sheng H, Nah FF-H (2004) The value of mobile commerce to customers. Paper presented at the third annual workshop on HCI research in MIS, Washington, D.C.Google Scholar
  67. Stewart RA (2008) A framework for the life cycle management of information technology projects: ProjectIT. Int J Proj Manage 26:203–212CrossRefGoogle Scholar
  68. Thamhain H (1994) Designing modern project management systems for a radically changing world. Proj Manage J 25(4):6Google Scholar
  69. The Standish Group (2001) Extreme chaosGoogle Scholar
  70. The Standish Group (2004) 2004 third quarter research report: The standish group internationalGoogle Scholar
  71. Wateridge J (1998) How can is/it projects be measured for success? Int J Proj Manage 16(1):59–63CrossRefGoogle Scholar
  72. Wegelius-Lehtonen T (2001) Performance measurement in construction logistics. Int J Prod Econ 69(1):107–116CrossRefGoogle Scholar
  73. White D, Fortune J (2002) Current practice in project management—an empirical study. Int J Proj Manage 20:1–11CrossRefGoogle Scholar
  74. Winter M, Smith C, Cooke-Davies T, Cicmil S (2006a) The importance of ‘process’ in rethinking project management: the story of a uk government-funded research network. Int J Proj Manage 24:650–662CrossRefGoogle Scholar
  75. Winter M, Smith C, Morris P, Cicmil S (2006b) Directions for future research in project management: the main findings of a uk government-funded research network. Int J Proj Manage 24:638–649CrossRefGoogle Scholar
  76. Yin RK (1994) Case study research: design and methods, 2nd edn. Sage Publishing, Beverly HillsGoogle Scholar
  77. Yin RK (2003) Case study research: designs and methods, 3rd edn. Sage Publishing, Beverly HillsGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.School of Computing and Information TechnologyUniversity of TechnologyKingstonJamaica
  2. 2.Department of Information SystemsVirginia Commonwealth UniversityRichmondUSA

Personalised recommendations