Skip to main content
SpringerLink
Log in
Book cover

Advances in Research Methods for Information Systems Research pp 197–221Cite as

A Hybrid VFT-GQM Method for Developing Performance Criteria and Measures

  • Chapter
  • First Online:

  • 1998 Accesses

Part of the book series: Integrated Series in Information Systems ((ISIS,volume 34))

Abstract

This chapter utilizes the principles of the Value Focused Thinking (VFT) and Goal Question Metric (GQM) to present a tool for managing the foundation processes of projects, programs and portfolios. The Project Performance Development Framework (PPDF) promotes the use of formal steps for identifying project criteria and measures that are used as the basis to evaluate the performance of the project. It addresses critical problems in project management where objectives typically are not clearly defined and stakeholders have multiple views and objectives on what is important to them in the project, which in turn impacts how the project performance is perceived. The PPDF has several iterative steps including stakeholder identification, objectives identification and structuring, definition of project measurement and prioritization to aid in stakeholder management and project objectives identification, prioritization and management. The PPDF artifact presented is demonstrated and evaluated for utility through a single Process Quality Management Development Project. The findings support the goals of PPDF and show that the formal approach provides added advantages in identifying important values of the stakeholders thereby improving the likelihood of managing stakeholders’ needs and achieving identified goals.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Agarwal N, Rathod U (2006) Defining ‘success’ for software projects: an exploratory revelation. Int J Proj Manage 24(4):358–370

    Article  Google Scholar 

  • Ala-Risku T, Kärkkäinen M (2006) Material delivery problems in construction projects: a possible solution. Int J Prod Econ 104(1):19–29

    Article  Google Scholar 

  • Alleman GB (2005) Agile project management for it projects. In: Y-HK, Carayannis EG, Anbari FT (eds) The story of managing projects: an interdisciplinary approach. Greenwood Press, New York, pp 373

    Google Scholar 

  • APM (2006) The apm body of knowledge, 5th edn. The Association of Project Management

    Google Scholar 

  • Arshinder, Kanda A, Deshmukh SG (2008) Supply chain coordination: Perspectives, empirical studies and research directions. Int J Prod Econ 115(2):316–335

    Google Scholar 

  • Atkinson R (1999) Project management: Cost, time and quality, two best guesses and a phenomenon, its time to accept other success criteria. Int J Proj Manage 17(6):337–342

    Article  Google Scholar 

  • Atkinson R, Crawford L, Ward S (2006) Fundamental uncertainties in projects and the scope of project management. Int J Proj Manage 24:687–698

    Article  Google Scholar 

  • Azzone G, Masella C, Bertele U (1991) Design of performance measures for time-based companies. Int J Oper Prod Manage 11(3):77–85

    Article  Google Scholar 

  • Baccarini D (1999) The logical framework method for defining project success. Proj Manage J 30(4):25–32

    Google Scholar 

  • Barclay C (2008) Towards an integrated measurement of is project performance: The project performance scorecard. Inf Syst Front 10:331–345

    Article  Google Scholar 

  • Barclay C, Osei-Bryson KM (2008) The project objectives measurement model (POMM): An alternative view to information systems project measurement. Electron J Inf Syst Eval 11(3):139–154

    Google Scholar 

  • Basili VR (1999) Foreword. In: Solingen R, Berghout E (eds) The goal/question/metric method, a practical method for quality improvement of software development. McGraw Hill, London

    Google Scholar 

  • Basili VR, Weiss DM (1984) A methodology for collecting valid software engineering data. IEEE Trans Softw Eng 10(6):728–738

    Article  Google Scholar 

  • Belassi W, Tukel OI (1996) A new framework for determining critical success/failure factors in projects. Int J Proj Manage 14(3):141–151

    Article  Google Scholar 

  • Bhushan N, Rai K (2004) Strategic decision making: applying the analytic hierarchy process. Springer, London

    Google Scholar 

  • Bourne L, Walker DHT (2006) Using a visualising tool to study stakeholder influence—two australian examples. Proj Manage J 37(1):5–21

    Google Scholar 

  • Bryde DJ, Robinson L (2005) Client versus contractor perspectives on project success criteria. Int J Proj Manage 23(8):622–629

    Article  Google Scholar 

  • Brynjolfsson E (1993) The productivity paradox of information technology. Commun ACM 36(12):67–77

    Article  Google Scholar 

  • Bryson N (1997) Supporting consensus formation in group support systems using the qualitative discriminant process. Interface between information systems and operations research. Ann Oper Res 71:75–91

    Google Scholar 

  • Cannon-Bowers JA, Salas E, Converse S (1993) Shared mental models in expert team decision making. In: Castellan JNJ (ed) Individual and group decision making: current issues. Lawrence Erlbaum, Hillsdale, pp 221–246

    Google Scholar 

  • Caldiera VRBG, Rombach HD (1994) The goal question metric approach. Encycl Softw Eng 2:528–532.

    Google Scholar 

  • Chen SC, Dhillon GS (2003) Interpreting dimensions of consumer trust in e-commerce. J Inf Technol Manage 4(2–3):303–318

    Google Scholar 

  • CMMI (2002) Capability maturity model® integration (cmmism), version 1.1, cmu/sei-2002-tr-011

    Google Scholar 

  • Cohen DJ, Graham RJ (2001) The project manager’s mba: How to translate project decisions into business success. Wiley, London

    Google Scholar 

  • Collins A, Baccarini D (2004) Project success—a survey. J Constr Res 5(2):211–231

    Article  Google Scholar 

  • Cooke-Davies T (2002) The “real” success factors on projects. Int J Proj Manage 20(3):185–190

    Article  Google Scholar 

  • Darke P, Shanks G, Broadbent M (1998) Sucessfully completing case study research: Combining rigor, relevance and pragmatism. Inf Syst J 8:273–289

    Article  Google Scholar 

  • Dhillon G, Torkzadeh G (2006) Value-focused assessment of information system security in organizations. Inf Syst J 16:293–314

    Article  Google Scholar 

  • Dixon JR, Nanni AJ, Vollmann TE (1990) New performance challenge: Measuring operations for world-class competition (irwin/apics series in production management). McGraw-Hill Professional Publishing, Homewood

    Google Scholar 

  • Drevin L, Kruger HA, Steyn T (2007) Value-focused assessment of ict security awareness in an academic environment. Comput & Secur 26(1):36–43

    Article  Google Scholar 

  • Engwall M (2003) No project is an island: Linking projects to history and context. Res Policy 32:789–808

    Article  Google Scholar 

  • Esteves JM, Pastor J, Casanovas J (2003) A goal/question/metric research proposal to monitor user involvement and participation in ERP implementation projects. Paper presented at the information resources management association conference (IRMA), Philadelphia, USA

    Google Scholar 

  • Ewusi-Mensah K (1997) Critical issues in abandoned information systems development projects. Commun ACM 40(9):71–80

    Article  Google Scholar 

  • Fitzgerald G (1998) Evaluating information systems project: a multidimensional approach. J Inf Technol 13(1):15–27

    Article  Google Scholar 

  • Folan P, Browne J (2005) A review of performance measurement: towards performance management. Comput Ind 56:663–680

    Article  Google Scholar 

  • Fortune J, White D (2006) Framing of project critical success factors by a systems model. Int J Proj Manage 24(1):53–65

    Article  Google Scholar 

  • Freeman M, Beale P (1992) Measuring project success. Proj Manage J 23(1):8–17

    Google Scholar 

  • Glass RL (2005) IT failure rates—70% or 10–15%?. Software IEEE 22(3):112–111

    Google Scholar 

  • Globerson S (1985) Issues in developing a performance criteria system for an organisation. Int J Prod Res 23(4):639–646

    Article  Google Scholar 

  • Hartman F, Ashrafi RA (2002) Project management in the lnformation systems and lnformation technologies industries. Proj Manage J 33(3):5–15

    Google Scholar 

  • Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28(1):75–105

    Google Scholar 

  • Huber G (1991) Organizational learning: the contributing processes and the literatures. Organ Sci 2(1):88–115

    Article  Google Scholar 

  • ISO/IEC (2000) Quality management systems—requirements: international organization for standardization

    Google Scholar 

  • Kaplan RS, Norton DP (1992) The balanced scorecard: Measures that drive performance. Harvard Bus Rev 70(1):71–79

    Google Scholar 

  • Katzenbach JR, Smith DK (2003) The wisdom of teams: Creating the high-performance organization. Harper Collins, New York

    Google Scholar 

  • Keeney RL (1992) Value-focused thinking: a path to creative decision making. Harvard University Press, Cambridge

    Google Scholar 

  • Keeney RL (1996) Value-focused thinking: identifying decision opportunities and creating alternatives. Eur J Oper Res 92:537–549

    Article  Google Scholar 

  • KPMG (2005) Global it project management survey: KPMG Information Risk Management

    Google Scholar 

  • Kumar RL (2003) Understanding the value of information technology enabled responsiveness. Electron J Inf Syst Eval, EJISE 1(1)

    Google Scholar 

  • Leonard-Barton D (1990) A dual methodology for case studies: synergistic use of a longitudinal single site with replicated multiple sites. Organ Sci 1(3):248–266

    Google Scholar 

  • Lim CS, Mohamed MZ (1999) Criteria of project success: an exploratory re-examination. Int J Proj Manage 17(4):243–248

    Article  Google Scholar 

  • Lyytinen K, Hirschheim R (1988) Information systems failures—a survey and classification of the empirical literature. In: Zorkoczy P (ed) Oxford surveys in information technology. Oxford University Press Inc, New York, pp 257–309

    Google Scholar 

  • March ST, Smith GF (1995) Design and natural science research on information technology. Decis Support Syst 15:251–266

    Article  Google Scholar 

  • Martinsons M, Davison R, Tse D (1999) The balanced scorecard: a foundation for the strategic management of information systems. Decis Support Syst 25:71–88

    Article  Google Scholar 

  • Melville N, Kraemer K, Gurbaxani V (2004) Review: information technology and organisational performance: An integrative model of it business value. MIS Q 28(2):283–322

    Google Scholar 

  • Milis K, Mercken R (2002) Success factors regarding the implementation of ict investment projects. Int J Prod Econ 80(1):105–117

    Article  Google Scholar 

  • Morris P (2004) Current trends in project and programme management. Association for Project Management (APM), High Wycombe

    Google Scholar 

  • Nelson RR (2005) Project retrospectives: evaluating project success, failure and everything in between. MIS Q Executive 4(3):361–372

    Google Scholar 

  • Niebecker K, Eager D, Kubitza K (2008) Improving cross-company project management performance with a collaborative project scorecard. Int J Manag Proj Bus 1(3):368–386

    Article  Google Scholar 

  • PMI (2004) A guide to project management body of knowledge, 3rd edn. Project Management Institute, Newtown Square

    Google Scholar 

  • Pouloudi A, Whitley EA (1997) Stakeholder identification in inter-organizational systems: Gaining insights for drug use management systems. Eur J Inf Syst 6:1–14

    Article  Google Scholar 

  • Saaty TL (1990) How to make a decision: the analytic hierarchy process. Eur J Oper Res 48(1):9–26

    Article  Google Scholar 

  • Sharp H, Finkelstein A, Galal G (1999) Stakeholder identification in the requirements engineering process. Paper presented at the 10th international workshop on database & expert systems applications

    Google Scholar 

  • Shenhar AJ, Dvir D, Levy O, Maltz AC (2001) Project success: a multi-dimensional strategic perspective. Long Range Plan 34:699–725

    Article  Google Scholar 

  • Shenhar AJ, Tisler A, Dvir D, Lipostevsky S, Lechler T (2002) Refining the search for project success factors: a multivariate typographical approach. R & D Manage 32(2):111–126

    Article  Google Scholar 

  • Siau K, Sheng H, Nah FF-H (2004) The value of mobile commerce to customers. Paper presented at the third annual workshop on HCI research in MIS, Washington, D.C.

    Google Scholar 

  • Stewart RA (2008) A framework for the life cycle management of information technology projects: ProjectIT. Int J Proj Manage 26:203–212

    Article  Google Scholar 

  • Thamhain H (1994) Designing modern project management systems for a radically changing world. Proj Manage J 25(4):6

    Google Scholar 

  • The Standish Group (2001) Extreme chaos

    Google Scholar 

  • The Standish Group (2004) 2004 third quarter research report: The standish group international

    Google Scholar 

  • Wateridge J (1998) How can is/it projects be measured for success? Int J Proj Manage 16(1):59–63

    Article  Google Scholar 

  • Wegelius-Lehtonen T (2001) Performance measurement in construction logistics. Int J Prod Econ 69(1):107–116

    Article  Google Scholar 

  • White D, Fortune J (2002) Current practice in project management—an empirical study. Int J Proj Manage 20:1–11

    Article  Google Scholar 

  • Winter M, Smith C, Cooke-Davies T, Cicmil S (2006a) The importance of ‘process’ in rethinking project management: the story of a uk government-funded research network. Int J Proj Manage 24:650–662

    Article  Google Scholar 

  • Winter M, Smith C, Morris P, Cicmil S (2006b) Directions for future research in project management: the main findings of a uk government-funded research network. Int J Proj Manage 24:638–649

    Article  Google Scholar 

  • Yin RK (1994) Case study research: design and methods, 2nd edn. Sage Publishing, Beverly Hills

    Google Scholar 

  • Yin RK (2003) Case study research: designs and methods, 3rd edn. Sage Publishing, Beverly Hills

    Google Scholar 

Download references

Acknowledgments

Material in this chapter previously appeared in: “PPDF: An Approach for Developing Performance Criteria and Measures for Information Systems (IS) Projects”, International Journal of Production Economics 124:1, 272–292 (2010).

Author information

Authors and Affiliations

  1. School of Computing and Information Technology, University of Technology, 237 Old Hope Road, Kingston, Jamaica

    Corlane Barclay

  2. Department of Information Systems, Virginia Commonwealth University, 301 W. Main Street, Richmond, VA, 23284, USA

    Kweku-Muata Osei-Bryson

Authors
  1. Corlane Barclay
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kweku-Muata Osei-Bryson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Corlane Barclay .

Editor information

Editors and Affiliations

  1. Department of Information Systems, Virginia Commonwealth University, Richmond, Virginia, USA

    Kweku-Muata Osei-Bryson

  2. Department of Information Systems, Ryerson University, Toronto, Ontario, Canada

    Ojelanki Ngwenyama

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media New York

About this chapter

Cite this chapter

Barclay, C., Osei-Bryson, KM. (2014). A Hybrid VFT-GQM Method for Developing Performance Criteria and Measures. In: Osei-Bryson, KM., Ngwenyama, O. (eds) Advances in Research Methods for Information Systems Research. Integrated Series in Information Systems, vol 34. Springer, Boston, MA. https://doi.org/10.1007/978-1-4614-9463-8_15

Download citation

Publish with us

Policies and ethics

Search

Navigation