Advertisement

Multicriteria Portfolio Decision Analysis for Project Selection

  • Alec MortonEmail author
  • Jeffrey M. Keisler
  • Ahti Salo
Part of the International Series in Operations Research & Management Science book series (ISOR, volume 233)

Abstract

Multicriteria Portfolio Analysis spans several methods which typically build on MCDA to guide the selection of a subset (i.e., portfolio) of available objects, with the aim of maximising the performance of the resulting portfolio with regard to multiple criteria, subject to the requirement that the resources consumed by the portfolio does not exceed the availability of resources and, moreover, satisfies other relevant constraints as well. In this chapter, we present a formal model of this selection problem and describe how this model can present both challenges (e.g. portfolio value may, due to the interactions of elements, depend on project-level decisions in complex and non-additive ways) and opportunities (e.g. triage rules can be used to focus elicitation on projects which are critical for value assessment). We also survey the application of Portfolio Decision Analysis in several domains, such as allocation of R&D expenditure, military procurement, prioritisation of healthcare projects, and environment and energy planning, and conclude by outlining possible future research directions.

Keywords

Project selection Portfolio selection Portfolio management Multicriteria decision analysis 

Notes

Acknowledgements

Thanks to Eeva Vilkkumaa and Juuso Liesiö for their help in generating Figs. 28.1 and 28.2.

References

  1. 1.
    Airoldi, M., Morton, A.: Portfolio decision analysis for population health. In: Salo, A., Keisler, J., Morton, A. (eds.) Portfolio decision analysis: improved methods for resource allocation. Springer, New York (2011)Google Scholar
  2. 2.
    Airoldi, M., Morton, A., Smith, J., Bevan, R.G.: STAR – people powered prioritization: a 21st century solution to allocation headaches. Med. Decis. Making 34, 965–975 (2014)CrossRefGoogle Scholar
  3. 3.
    Andrews, C.: Evaluating risk management strategies in resource planning. IEEE Trans. Power Syst. 10(1), 420–426 (1995)CrossRefGoogle Scholar
  4. 4.
    Awerbuch, S.: Portfolio-based electricity generation planning: policy implications for renewables and energy security. Mitig. Adapt. Strateg. Glob. Chang. 11(3), 693–710 (2006)CrossRefGoogle Scholar
  5. 5.
    Balasubramaniam, A., Voulvoulis, N.: The appropriateness of multicriteria analysis in environmental decision-making problems. Environ. Technol. 26(9), 951–962 (2005)CrossRefGoogle Scholar
  6. 6.
    Baltussen, R., Niessen, L.: Priority setting of health interventions: the need for multicriteria decision analysis. Cost Eff. Resour. Alloc. 4(14) (2006)Google Scholar
  7. 7.
    Baltussen, R., Stolk, E., Chisholm, D., Aikins, M.: Towards a multi-criteria approach for priority setting: an application to Ghana. Health Econ. 15(7), 689–696 (2006)CrossRefGoogle Scholar
  8. 8.
    Baltussen, R., Ten Asbroek, A.H.A., Koolman, X., Shrestha, N., Bhattarai, P., Niessen, L.W.: Priority setting using multiple criteria: should a lung health programme be implemented in Nepal? Health Policy Plan. 22(3), 178–185 (2007)CrossRefGoogle Scholar
  9. 9.
    Bana e Costa, C.A., Oliveira, R.C.: Assigning priorities for maintenance, repair and refurbishment in managing a municipal housing stock. Eur. J. Oper. Res. 138, 380–391 (2002)Google Scholar
  10. 10.
    Bana e Costa, C., Thomaz, J.: Locating centres of information and recruitment of volunteers for the Portugese armed forces: a decision analysis case study. In: Proceedings of the 42nd Annual Conference of the International Military Testing Association (IMTA), Edinburgh, pp. 173–180, 7-9 November 2000 (CD-ROM edition)Google Scholar
  11. 11.
    Bana e Costa, C., da Costa-Lobo, M.L., Ramos, I.A., Vansnick, J.-C.: Multicriteria approach for strategic planning: the case of Barcelos. In: Bouyssou, D., Jacquet-Lagreze, E., Perny, P., Slowinsky, R., Vanderpooten, D., Vincke, P. (eds.) Aiding Decisions with Multiple Criteria: Essays in Honour of Bernard Roy. Kluwer, Dordrecht (2002)Google Scholar
  12. 12.
    Bard, J.F.: Using multicriteria methods in the early stages of new product development. J. Oper. Res. Soc. 41(8), 755–766 (1990)CrossRefGoogle Scholar
  13. 13.
    Bard, J.F., Balachandra, R., Kaufmann, P.E.: An interactive approach to R-and-D project selection and termination. IEEE Trans. Eng. Manag. 35(3), 139–146 (1988)CrossRefGoogle Scholar
  14. 14.
    Bell, M.L., Hobbs, B.F., Elliott, E.M., Ellis, H., Robinson, Z.: An evaluation of multicriteria decision-making methods in integrated assessment of climate policy. In: Research and Practice in Multiple Criteria Decision Making: Proceedings of the XIVth International Conference on Multiple Criteria Decision Making, Charlottesville, 8–12 June 1998, p. 228. Springer, Berlin (2000)Google Scholar
  15. 15.
    Berry, T., Jaccard, M.: The renewable portfolio standard: design considerations and an implementation survey. Energy Policy 29(4), 263–277 (2001)CrossRefGoogle Scholar
  16. 16.
    Bitman, W.R., Sharif, N.: A conceptual framework for ranking R&D projects. IEEE Trans. Eng. Manag. 55(2), 267–278 (2008)CrossRefGoogle Scholar
  17. 17.
    Blau, G.E., Pekny, J.F., Varma, V.A., Bunch, P.R.: Managing a portfolio of interdependent new product candidates in the pharmaceutical industry. J. Prod. Innov. Manag. 21(4), 227–245 (2004)CrossRefGoogle Scholar
  18. 18.
    Bordley, R.F.: R&D project selection versus R&D project generation. IEEE Trans. Eng. Manag. 45(4) (1998)Google Scholar
  19. 19.
    Bouyssou, D.: Using DEA as a tool for MCDM: some remarks. J. Oper. Res. Soc. 50(9), 974–978 (1999)CrossRefGoogle Scholar
  20. 20.
    Brambleby, P.: A survivors guide to program budgeting. Health Policy 33(2), 127–145 (1995)CrossRefGoogle Scholar
  21. 21.
    Brummer, V., Konnola, T., Salo, A.: Foresight within ERA-NETs: experiences from the preparation of an international research program. Technol. Forecast. Soc. Chang. 75(4), 483–495 (2008)CrossRefGoogle Scholar
  22. 22.
    Buckshaw, D.L., Parnell, G.S, Unkenholz, W.L., Parks, D.L., Wallner, J.L., Saydjari, O.S.: Mission oriented risk and design analysis of critical information systems. Mil. Oper. Res. Alexandria 10(2), 19 (2005)CrossRefGoogle Scholar
  23. 23.
    Burk, R.C., Parnell, G.S.: Portfolio decision analysis: lessons from military applications. In: Salo, A., Keisler, J., Morton, A. (eds.) Portfolio Decision Analysis: Methods for Improved Resource Allocation. Springer, New York (2011)Google Scholar
  24. 24.
    Carazo, A.F., Gomez, T., Molina, J., Hernandez-Diaz, A.G., Guerrero, F.M., Caballero, R.: Solving a comprehensive model for multiobjective project portfolio selection. Comput. Oper. Res. 37(4), 630–639 (2010)CrossRefGoogle Scholar
  25. 25.
    Cardus, D., Fuhrer, M.J., Martin, A.W., Thrall, R.M.: Use of benefit-cost-analysis in the peer-review of proposed research. Manag. Sci. 28(4), 439–445 (1982)Google Scholar
  26. 26.
    Charnes, A., Cooper, W.W., Niehaus, R.J.: Dynamic multiattribute models for mixed manpower systems. Nav. Res. Logist. Q. 22(2), 205–220 (1975)CrossRefGoogle Scholar
  27. 27.
    Chien, C.F.: A portfolio-evaluation framework for selecting R&D projects. R&D Manag. 32(4), 359–368 (2002)CrossRefGoogle Scholar
  28. 28.
    Chien, C.F., Sainfort, F.: Evaluating the desirability of meals: an illustrative multiattribute decision analysis procedure to assess portfolios with interdependent items. J. Multi-Criteria Decis. Anal. 7, 230–238 (1998)CrossRefGoogle Scholar
  29. 29.
    Christou, M.D., Mattarelli, M.: Land-use planning in the vicinity of chemical sites: risk-informed decision making at a local community level. J. Hazard. Mater. 78(1-3), 191–222 (2000)CrossRefGoogle Scholar
  30. 30.
    Chung, E.S., Lee, K.S.: Prioritization of water management for sustainability using hydrologic simulation model and multicriteria decision making techniques. J. Environ. Manag. 90(3), 1502–1511 (2009)CrossRefGoogle Scholar
  31. 31.
    Clemen, R.T., Smith, J.E.: On the choice of baselines in multiattribute portfolio analysis: a cautionary note. Decis. Anal. 6(4), 156–262 (2009)CrossRefGoogle Scholar
  32. 32.
    Cooper, R.G., Edgett, S.J., Kleinschmidt, E.J.: Portfolio Management for New Products, 2nd edn. Basic Books, New York (2001)Google Scholar
  33. 33.
    Costello, D.: A practical approach to R-and-D project selection. Technol. Forecast. Soc. Chang. 23(4), 353–368 (1983)CrossRefGoogle Scholar
  34. 34.
    Czajkowski, A.F., Jones, S.: Selecting interrelated research-and-development projects in space technology planning. IEEE Trans. Eng. Manag. 33(1), 17–24 (1986)CrossRefGoogle Scholar
  35. 35.
    Daniels, N.: Accountability for reasonableness - establishing a fair process for priority setting is easier than agreeing on principles. Br. Med. J. 321(7272), 1300–1301 (2000)CrossRefGoogle Scholar
  36. 36.
    Danila, N.: Strategic evaluation and selection of R & D projects. R&D Manag. 19(1), 47–62 (1989)CrossRefGoogle Scholar
  37. 37.
    David, P.K., Shaver, R.D., Beck, J.: Portfolio analysis methods for assessing capability options. Rand Corporation, Santa Monica (2008)Google Scholar
  38. 38.
    Dean, B.V., Nishry, M.J.: Scoring and profitability models for evaluating and selecting research projects. Oper. Res. 13(4), 550–569 (1965)CrossRefGoogle Scholar
  39. 39.
    Doerner, K., Gutjahr, W.J., Hartl, R.F., Strauss, C., Stummer, C.: Pareto ant colony optimization: a metaheuristic approach to multiobjective portfolio selection. Ann. Oper. Res. 131(1-4), 79–99 (2004)CrossRefGoogle Scholar
  40. 40.
    Drechsler, M., Frank, K., Hanski, I., O’Hara, R.B., Wissel, C.: Ranking metapopulation extinction risk: from patterns in data to conservation management decisions. Ecol. Appl. 13(4), 990–998 (2003)CrossRefGoogle Scholar
  41. 41.
    Drummond, K.F., Sculpher, M.J., Torrance, G.W., O’ Brien, B.J., Stoddart, G.L.: Methods for the Economic Evaluation of Health Care Programmes. Oxford University Press, Oxford (2005)Google Scholar
  42. 42.
    Dyer, J., Edmunds, T., Butler, J.C., Jia, J.: A multiattribute utility analysis of alternatives for the disposition of surplus weapons-grade plutonium. Oper. Res. 46(6), 749–762 (1998)CrossRefGoogle Scholar
  43. 43.
    Fahrni, P., Spatig, M.: An application-oriented guide to research-and-development project selection and evaluation methods. R&D Manag. 20(2), 155–171 (1990)CrossRefGoogle Scholar
  44. 44.
    Farquhar, P.H., Rao, V.R.: A balance model of revaluating subsets of multiattributed items. Manag. Sci. 22(5), 528–539 (1976)CrossRefGoogle Scholar
  45. 45.
    Fox, G.E., Baker, N.R., Bryant, J.L.: Economic-models for R-and-D project selection in the presence of project interactions. Manag. Sci. 30(7), 890–902 (1984)CrossRefGoogle Scholar
  46. 46.
    Friend, J., Hickling, A.: Planning Under Pressure: The Strategic Choice Approach, 2nd edn. Pergamon, Oxford (1997)Google Scholar
  47. 47.
    Friend, J.K., Jessop, W.N.: Local Government and Strategic Choice: An Operational Research Approach to the Processes of Public Planning. Tavistock, London (1969)Google Scholar
  48. 48.
    Gass, S.I.: Military manpower planning models. Comput. Oper. Res. 18(1), 65–73 (1991)CrossRefGoogle Scholar
  49. 49.
    Gass, N.: Conflict analysis in the politico-military environment of a new world order. J. Oper. Res. Soc. 45(2), 133–142 (1994)CrossRefGoogle Scholar
  50. 50.
    Golabi, K.: Selecting a portfolio of nonhomogeneous R and D proposals. Eur. J. Oper. Res. 21(3), 347–357 (1985)CrossRefGoogle Scholar
  51. 51.
    Golabi, K., Kirkwood, C.W., Sicherman, A.: Selecting a portfolio of solar energy projects using multiattribute preference theory. Manag. Sci. 27, 174–189 (1981)CrossRefGoogle Scholar
  52. 52.
    Gold, M.R., Siegel, J.E., Russell, L.B., Weinstein, M.C. (eds.): Cost-Effectiveness in Health and Medicine. Oxford University Press, Oxford (1996)Google Scholar
  53. 53.
    Greening, L.A., Bernow, S.: Design of coordinated energy and environmental policies: use of multi-criteria decision-making. Energy Policy 32(6), 721–735 (2004)CrossRefGoogle Scholar
  54. 54.
    Greiner, M.A., Fowler, J.W., Shunk, D.L., Carlyle, W.M., McNutt, R.T.: A hybrid approach using the analytic hierarchy process and integer programming to screen weapon systems projects. IEEE Trans. Eng. Manag. 50(2), 192–203 (2003)CrossRefGoogle Scholar
  55. 55.
    Grushka-Cockayne, Y., De Reyck, B.: Towards a single European sky. Interfaces 39(5), 400–414 (2009)CrossRefGoogle Scholar
  56. 56.
    Grushka-Cockayne, Y., De Reyck, B., Degraeve, Z.: An integrated decision-making approach for improving European air traffic management. Manag. Sci. 54(8), 1395–1409 (2008)CrossRefGoogle Scholar
  57. 57.
    Gustafsson, J., Salo, A.: Contingent portfolio programming for the management of risky projects. Oper. Res. 53(6), 946–956 (2005)CrossRefGoogle Scholar
  58. 58.
    Gustafson, D.H., Pai, G.K., Kramer, G.C.: A “weighted aggregate” approach to R & D project selection. AIIE Trans. 3(1), 22–31 (1972)CrossRefGoogle Scholar
  59. 59.
    Gustafsson, J., De Reyck, B., Degraeve, Z., Salo, A.: Valuation of risky projects and other illiquid investments using portfolio selection models. In: Salo, A., Keisler, J., Morton, A. (eds.) Portfolio Decision Analysis: Methods for Improved Resource Allocation. Springer, New York (2011)Google Scholar
  60. 60.
    Gutjahr, W.J., Reiter, P.: Bi-objective project portfolio selection and staff assignment under uncertainty. Optimization 59(3), 417–445 (2010)CrossRefGoogle Scholar
  61. 61.
    Gutjahr, W.J., Katzensteiner, S., Reiter, P., Stummer, C., Denk, M.: Multi-objective decision analysis for competence-oriented project portfolio selection. Eur. J. Oper. Res. 205(3), 670–679 (2010)CrossRefGoogle Scholar
  62. 62.
    Haralambopoulos, D.A., Polatidis, H.: Renewable energy projects: structuring a multi-criteria group decision-making framework. Renew. Energy 28(6), 961–973 (2003)CrossRefGoogle Scholar
  63. 63.
    Heidenberger, K., Stummer, C.: Research and development project selection and resource allocation: a review of quantitative modelling approaches. Int. J. Manag. Rev. 1(2), 197–224 (1999)CrossRefGoogle Scholar
  64. 64.
    Henig, M., Katz, H.: R and D project selection: a decision process approach. J. Multi-Criteria Decis. Anal. 5, 169–171 (1996)CrossRefGoogle Scholar
  65. 65.
    Henriksen, A.D., Traynor, A.J.: A practical R & D project-selection scoring tool. IEEE Trans. Eng. Manag. 46(2), 158–170 (1999)CrossRefGoogle Scholar
  66. 66.
    Hirst, E., Schweitzer, M.: Electric-utility resource planning and decision-making: the importance of uncertainty. Risk Anal. 10(1), 137–146 (1990)CrossRefGoogle Scholar
  67. 67.
    Holm, S.: Goodbye to the simple solutions: the second phase of priority setting in health care. Br. Med. J. 317(7164), 1000–1002 (1998)CrossRefGoogle Scholar
  68. 68.
    Howard, R.A.: Decision analysis: practice and promise. Manag. Sci. 34(6), 679–695 (1988)CrossRefGoogle Scholar
  69. 69.
    Hsu, Y.-G., Tzeng, W.-H., Shyu, J.Z.: Fuzzy multiple criteria selection of government-sponsored frontier technology projects. R&D Manag. 33(5), 539–551 (2003)CrossRefGoogle Scholar
  70. 70.
    Huang, J.P., Poh, K.L., Ang, B.W.: Decision analysis in energy and environmental modeling. Energy 20(9), 843–855 (1995)CrossRefGoogle Scholar
  71. 71.
    Huang, C.C., Chu, P.Y., Chiang, Y.H.: A fuzzy AHP application in government-sponsored R&D project selection. Omega Int. J. Manag. Sci. 36(6), 1038–1052 (2008)CrossRefGoogle Scholar
  72. 72.
    Ilinitch, A.Y., Schaltegger, S.C.: Developing a green business portfolio. Long Range Plan. 28(2), 29–38 (1995)CrossRefGoogle Scholar
  73. 73.
    Jackson, J., Kloeber Jr., J.M., Ralston, B.E., Deckro, R.F.: Selecting a portfolio of technologies: an application of decision analysis. Decis. Sci. 30(1), 217–238 (1999)CrossRefGoogle Scholar
  74. 74.
    Jayanthi, S., Witt, E.C., Singh, V.: Evaluation of potential of innovations: a DEA-based application to us photovoltaic industry. IEEE Trans. Eng. Manag. 56(3), 478–493 (2009)CrossRefGoogle Scholar
  75. 75.
    Jehu-Appiah, C., Baltussen, R., Acquah, C., Aikins, M., d’Almeida, S.A., Bosu, W.K., Koolman, X., Lauer, J., Osei, D., Adjei, S.: Balancing equity and efficiency in health priorities in Ghana: the use of multicriteria decision analysis. Value Health 11(7), 1081–1087 (2008)CrossRefGoogle Scholar
  76. 76.
    Jones, M., Hope, C., Hughes, R.: A multi-attribute value model for the study of UK energy policy. J. Oper. Res. Soc. 41(10), 919–929 (1990)CrossRefGoogle Scholar
  77. 77.
    Kangaspunta, J., Liesiö, J., Salo, A.: Cost-efficiency analysis of weapon system portfolios. Eur. J. Oper. Res. 223(1), 264–275 (2012)CrossRefGoogle Scholar
  78. 78.
    Karsu, Ö., Morton, A.: Incorporating balance concerns in resource allocation decisions: a bicriteria modelling approach. OMEGA – Int. J. Manag. Sci. 44, 70–82 (2014)Google Scholar
  79. 79.
    Karvetski, C.W., Lambert, J.H., Linkov, I.: Scenario and multiple criteria decision analysis for energy and environmental security of military and industrial installations. Integr. Environ. Assess. Manag. 7,228–236 (2010)CrossRefGoogle Scholar
  80. 80.
    Keefer, D.L.: Allocation planning for R & D with uncertainty and multiple objectives. IEEE Trans. Eng. Manag. EM-25(1), 8–14 (1978)CrossRefGoogle Scholar
  81. 81.
    Keefer, D.L., Kirkwood, C.W.: A multiobjective decision analysis: budget planning for product engineering. J. Oper. Res. Soc. 29(5), 435–442 (1978)CrossRefGoogle Scholar
  82. 82.
    Keeney, R.L.: An analysis of the portfolio of sites to characterize for selecting a nuclear repository. Risk Anal. 7(2), 195–218 (1987)CrossRefGoogle Scholar
  83. 83.
    Keeney, R.L.: Value focused Thinking: A Path to Creative Decision Making. Harvard University Press, Cambridge (1992)Google Scholar
  84. 84.
    Keisler, J.: Value of information in portfolio decision analysis. Decis. Anal. 1(3), 177–189 (2004)CrossRefGoogle Scholar
  85. 85.
    Keisler, J.: The value of assessing weights in multi-criteria portfolio decision analysis. J. Multi-Criteria Decis. Anal. 15, 111–123 (2009)CrossRefGoogle Scholar
  86. 86.
    Keisler, J.M., Sundell, R.C.: Combining multi-attribute utility and geographic information for boundary decisions: an application to park planning. J. Geogr. Inf. Decis. Anal. 1(2), 101–118 (1997)Google Scholar
  87. 87.
    Keown, A.J., Taylor, B.W., Duncan, C.P.: Allocation of research and development funds - zero-one goal programming approach. Omega Int. J. Manag. Sci. 7(4), 345–351 (1979)CrossRefGoogle Scholar
  88. 88.
    Kettunen, J.: Applications of stochastic modelling for investment decision making under market uncertainties. Ph.D. thesis, Helsinki University of Technology (2009)Google Scholar
  89. 89.
    Khorramshahgol, R., Gousty, Y.: Delphic Goal Programming (DGP) - a multiobjective cost-benefit approach to research-and-development portfolio analysis. IEEE Trans. Eng. Manag. 33(3), 172–175 (1986)CrossRefGoogle Scholar
  90. 90.
    Kiker, G.A., Bridges, T.S., Varghese, A., Seager, T.P., Linkov, I.: Application of multicriteria decision analysis in environmental decision making. Integr. Environ. Assess. Manag. 1(2), 95–108 (2005)CrossRefGoogle Scholar
  91. 91.
    Kirkwood, C.W.: Strategic Decision Making: Multiobjective Decision Analysis with Spreadsheets. Duxbury, Belmont (1997)Google Scholar
  92. 92.
    Kleinmuntz, D.N.: Resource allocation decisions. In: Edwards, W., Miles, R.F., von Winterfeldt, D. (eds.) Advances in Decision Analysis, pp. 400–418. Cambridge University Press, Cambridge (2007)CrossRefGoogle Scholar
  93. 93.
    Kleinmuntz, D.N.: Foreword. In: Salo, A., Keisler, J., Morton, A. (eds.) Advances in Portfolio Decision Analysis: Improved Methods for Resource Allocation. Springer, New York (2011)Google Scholar
  94. 94.
    Klingman, D., Phillips, N.V.: Topological and computational aspects of preemptive multicriteria military personnel assignment problems. Manag. Sci. 30(11), 1362–1375 (1984)CrossRefGoogle Scholar
  95. 95.
    Kloeber, J.: Current and cutting edge methods of portfolio decision analysis in pharmaceutical R&D. In: Salo, A., Keisler, J., Morton, A. (eds.) Portfolio Decision Analysis: Methods for Improved Resource Allocation. Springer, New York (2011)Google Scholar
  96. 96.
    Lambert, J.H., Karvetski, C.W., Ditmer, R.D., Abdallah, T., Johnson, M.D., Linkov, I.: Energy security for industrial and military installations: emergent conditions that influence the strategic selection of technologies. In: Gheorghe, A., Muresan, L. (eds.) Energy Security: International Local Issues: Theoretical Perspectives and Critical Energy Infrastructures. Springer, New York (2011)Google Scholar
  97. 97.
    Lee, B.W., Green, K.: Towards commercial and environmental excellence: a green portfolio matrix. Bus. Strateg. Environ. 3(3), 1–9 (1994)CrossRefGoogle Scholar
  98. 98.
    Li, X., Chen, Y., Liu, X., Li, D., He, J.: Concepts, methodologies, and tools of an integrated geographical simulation and optimization system. Int. J. Geogr. Inf. Sci. 25(4), 633–655 (2011)CrossRefGoogle Scholar
  99. 99.
    Liberatore, M.J.: An extension of the Analytic Hierarchy Process for industrial research-and-development project selection and resource-allocation. IEEE Trans. Eng. Manag. 34(1), 12–18 (1987)CrossRefGoogle Scholar
  100. 100.
    Liberatore, M.J., Titus, G.J.: The practice of management science in R-and-D project-management. Manag. Sci. 29(8), 962–974 (1983)CrossRefGoogle Scholar
  101. 101.
    Liesiö, J.: Measureable multiattribute value functions for portfolio decision analysis. Decis. Anal. 11(1), 1–20 (2014)CrossRefGoogle Scholar
  102. 102.
    Liesiö, J., Mild, P., Salo, A.: Preference programming for robust portfolio modeling and project selection. Eur. J. Oper. Res. 181(3), 1488–1505 (2007)CrossRefGoogle Scholar
  103. 103.
    Liesiö, J., Mild, P., Salo, A.: Robust portfolio modeling with incomplete cost information and project interdependencies. Eur. J. Oper. Res. 190(3), 679–695 (2008)CrossRefGoogle Scholar
  104. 104.
    Lindstedt, M., Liesiö, J., Salo, A.: Participatory development of a strategic product portfolio in a telecommunication company. Int. J. Technol. Manag. 42(3), 250–266 (2008)CrossRefGoogle Scholar
  105. 105.
    Linkov, I., Varghese, A., Jamil, S., Seager, T., Kiker, G., Bridges, T.: Multi-criteria decision analysis: a framework for structuring remedial decisions at contaminated sites. In: Linkov, I., Bakr Ramadan, A. (eds.) Comparative Risk Assessment and Environmental Decision Making. Kluwer, Dordrecht (2005)CrossRefGoogle Scholar
  106. 106.
    Linkov, I., Satterstrom, F.K., Fenton, G.P.: Prioritization of capability gaps for joint small arms program using multi-criteria decision analysis. J. Multi-Criteria Decis. Anal. 16(5-6), 179–185 (2009)CrossRefGoogle Scholar
  107. 107.
    Linton, J.D., Walsh, S.T., Morabito, J.: Analysis, ranking and selection of R & D projects in a portfolio. R&D Manag. 32(2), 139–148 (2002)CrossRefGoogle Scholar
  108. 108.
    Liu, C., Frazier, P., Kumar, L., Macgregor, C., Blake, N.: Catchment-wide wetland assessment and prioritization using the multi-criteria decision-making method TOPSIS. Environ. Manag. 38(2), 316–326 (2006)CrossRefGoogle Scholar
  109. 109.
    Lockett, G., Stratford, M.: Ranking of research projects - experiments with 2 methods. Omega Int. J. Manag. Sci. 15(5), 395–400 (1987)CrossRefGoogle Scholar
  110. 110.
    Lourenço, J.C., Morton, A., Bana e Costa, C.A.B.: PROBE: a multicriteria decision support 1056 system for portfolio robustness evaluation. Decis. Support Syst. 54(1), 534–550 (2012)Google Scholar
  111. 111.
    Madey, G.R., Dean, B.V.: Strategic planning in R&D using decision analysis and mathematical programming. IEEE Trans. Eng. Manag. EM-32(2), 84–90 (1985)CrossRefGoogle Scholar
  112. 112.
    Malczewski, J.: GIS and Multicriteria Decision Analysis. Wiley, New York (1999)Google Scholar
  113. 113.
    Mandakovic, T., Souder, W.E.: A flexible hierarchical model for project selection and budget allocation. R&D Manag. 15(1), 23–29 (1985)CrossRefGoogle Scholar
  114. 114.
    Mandakovic, T., Souder, W.E.: An interactive decomposable heuristic for project selection. Manag. Sci. 31(10), 1257–1271 (1985)CrossRefGoogle Scholar
  115. 115.
    Mardle, S., Pascoe, S., Tamiz, M., Jones, D.: Resource allocation in the North sea demersal fisheries: a goal programming approach. Ann. Oper. Res. 94(1), 321–342 (2000)CrossRefGoogle Scholar
  116. 116.
    Martino, J.: R & D Project Selection. Wiley, Chichester (1995)Google Scholar
  117. 117.
    Matheson, D., Matheson, J.: The Smart Organisation: Creating Value Through Strategic R&D. Harvard Business School Press, Boston (1998)Google Scholar
  118. 118.
    Meade, L.M., Presley, A.: R&D project selection using the analytic networkwork process. IEEE Trans. Eng. Manag. 49(1) (2002)Google Scholar
  119. 119.
    Mehrez, A., Sinuany-stern, Z.: Resource-allocation to interrelated risky projects using a multiattribute utility function. Manag. Sci. 29(4), 430–439 (1983)CrossRefGoogle Scholar
  120. 120.
    Mellichamp, J.M., Dixon, W.L., Mitchell, S.L.: Ballistic-missile defense technology management with goal programming. Interfaces 10(5), 68–74 (1980)CrossRefGoogle Scholar
  121. 121.
    Mendoza, G.A., Martins, H.: Multi-criteria decision analysis in natural resource management: a critical review of methods and new modelling paradigms. For. Ecol. Manag. 230(1-3), 1–22 (2006)CrossRefGoogle Scholar
  122. 122.
    Mild, P., Salo, A.: Combining a multiattribute value function with an optimization model: an application to dynamic resource allocation for infrastructure maintenance. Decis. Anal. 6(3), 139–152 (2009).CrossRefGoogle Scholar
  123. 123.
    Mitton, C., Donaldson, C.: Twenty-five years of programme budgeting and marginal analysis in the health sector, 1974-1999. J. Health Serv. Res. Policy 6(4), 239–48 (2001)CrossRefGoogle Scholar
  124. 124.
    Mitton, C.R., Donaldson, C.: Setting priorities and allocating resources in health regions: lessons from a project evaluating program budgeting and marginal analysis (PBMA). Health Policy 64, 335–348 (2003)CrossRefGoogle Scholar
  125. 125.
    Mitton, C.R., Patten, S., Waldner, H., Donaldson, C.: Priority setting in health authorities: a novel approach to a historical activity. Soc. Sci. Med. 57, 1653–1663 (2003)CrossRefGoogle Scholar
  126. 126.
    Moffett, A., Dyer, J.S., Sarkar, S.: Integrating biodiversity representation with multiple criteria in North-Central Namibia using non-dominated alternatives and a modified analytic hierarchy process. Biol. Conserv. 129(2), 181–191 (2006)CrossRefGoogle Scholar
  127. 127.
    Montibeller, G., Franco, L.A.: Resource allocation in local government with facilitated portfolio decision analysis. In: Salo, A., Keisler, J., Morton, A. (eds.) Portfolio Decision Analysis: Methods for Improved Resource Allocation. Springer, New York (2011)Google Scholar
  128. 128.
    Montibeller, G., Franco, L.A., Lord, E., Iglesias, A.: Structuring resource allocation decisions: a framework for building multi-criteria portfolio models with area-grouped options. Eur. J. Oper. Res. 199(3), 846–856 (2009)CrossRefGoogle Scholar
  129. 129.
    Moore, J.R., Baker, N.R.: Computational analysis of scoring models for R and D project selection. Manag. Sci. 16(4), B212–232 (1969)CrossRefGoogle Scholar
  130. 130.
    Morton, A.: Measurement issues in the evaluation of projects in a project portfolio. Eur. J. Oper. Res. 245(16), 789–796 (2015)CrossRefGoogle Scholar
  131. 131.
    Morton, A., Fasolo, B.: Behavioural decision theory for multi-criteria decision analysis: a guided tour. J. Oper. Res. Soc. 60(2), 268–275 (2009)CrossRefGoogle Scholar
  132. 132.
    Morton, A., Bird, D., Jones, A., White, M.: Decision conferencing for science prioritisation in the UK public sector: a dual case study. J. Oper. Res. Soc. 62, 50–59 (2011)CrossRefGoogle Scholar
  133. 133.
    Moskowitz, H., Preckel, P.V., Yang, A.: Multiple-criteria robust interactive decision analysis (MCRID) for optimizing public policies. Eur. J. Oper. Res. 56(2), 219–236 (1992)CrossRefGoogle Scholar
  134. 134.
    Mullen, P.M.: Quantifying priorities in healthcare: transparency or illusion. Health Serv. Manage. Res. 17(1), 47–58 (2004)CrossRefGoogle Scholar
  135. 135.
    Naudé, P., Lockett, G., Holmes, K.: A case study of strategic engineering decision making using judgmental modeling and psychological profiling. IEEE Trans. Eng. Manag. 44(3), 237–247 (1997)CrossRefGoogle Scholar
  136. 136.
    Ohman, K.V.H., Hettiaratchi, J.P.A., Ruwanpura, J., Balakrishnan, J., Achari, G.: Development of a landfill model to prioritize design and operating objectives. Environ. Monit. Assess. 135(1), 85–97 (2007)CrossRefGoogle Scholar
  137. 137.
    Olundh, G., Ritzén, S.: Making an ecodesign choice in project portfolio selection. In: Proceedings of the IEEE International Engineering Management Conference, vol. 3, pp. 913–917. IEEE (2004)Google Scholar
  138. 138.
    Oral, M., Kettani, O., Lang, P.: A methodology for collective evaluation and selection of industrial research-and-development projects. Manag. Sci. 37(7), 871–885 (1991)CrossRefGoogle Scholar
  139. 139.
    Peacock, S.J., Richardson, J.R.J., Carter, R., Edwards, D.: Priority setting in health care using multi-attribute utility theory and programme budgeting and marginal analysis (PBMA). Soc. Sci. Med. 64(4), 897–910 (2007)CrossRefGoogle Scholar
  140. 140.
    Peerenboom, J.P., Buehring, W.A., Joseph, T.W.: Selecting a portfolio of environmental programs for a synthetic fuels facility. Oper. Res. 37(5), 689–699 (1989)CrossRefGoogle Scholar
  141. 141.
    Phillips, L.D.: The royal navy’s type 45 story: a case study. In: Salo, A., Keisler, J., Morton, A. (eds.) Portfolio Decision Analysis: Improved Methods for Resource Allocation. Springer, New York (2011)Google Scholar
  142. 142.
    Phillips, L.D., Bana e Costa, C.: Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing. Ann. Oper. Res. 154(1), 51–68 (2007)Google Scholar
  143. 143.
    Pohekar, S.D., Ramachandran, M.: Application of multi-criteria decision making to sustainable energy planning–a review. Renew. Sust. Energ. Rev. 8(4), 365–381 (2004)CrossRefGoogle Scholar
  144. 144.
    Randhir, T., Shriver, D.M.: Deliberative valuation without prices: a multiattribute prioritization for watershed ecosystem management. Ecol. Econ. 68(12), 3042–3051 (2009)CrossRefGoogle Scholar
  145. 145.
    Ringuest, J.L., Graves, S.B.: The linear multi-objective R-and-D project selection problem. IEEE Trans. Eng. Manag. 36(1), 54–57 (1989)CrossRefGoogle Scholar
  146. 146.
    Roberts, F.S.: Meaningfulness of conclusions from combinatorial optimization. Discret. Appl. Math. 29, 221–241 (1990)CrossRefGoogle Scholar
  147. 147.
    Roth, S., Hirschberg, S., Bauer, C., Burgherr, P., Dones, R., Heck, T., Schenler, W.: Sustainability of electricity supply technology portfolio. Ann. Nucl. Energy 36(3), 409–416 (2009)CrossRefGoogle Scholar
  148. 148.
    Roy, B.: Méthodologie multicritère d’aide á la décision. Economica, Paris (1985)Google Scholar
  149. 149.
    Rubinstein, A.H.: Selecting criteria for R and D. Harv. Bus. Rev. 35(1), 95–104 (1957)Google Scholar
  150. 150.
    Salo, A., Keisler, J., Morton, A.: Portfolio Decision Analysis: Improved Methods for Resource Allocation. Springer, New York (2011)CrossRefGoogle Scholar
  151. 151.
    Salo, A., Keisler, J., Morton, A. (eds.): Portfolio Decision Analysis: Methods for Improved Resource Allocation. Springer, New York (2011)Google Scholar
  152. 152.
    Schmidt, R.L.: A model for R&D project selection with combined benefit, outcome and resource interactions. IEEE Trans. Eng. Manag. 40(4), 403–410 (1993)CrossRefGoogle Scholar
  153. 153.
    Schmidt, R.L., Freeland, J.R.: Recent progress in modeling R&D project-selection processes. IEEE Trans. Eng. Manag. 39(2), 189–201 (1992)CrossRefGoogle Scholar
  154. 154.
    Scott, S.N., Lees, A.: Developing a prioritisation framework: experiences from a Scottish health authority. Health Expect. 4(1), 10–17 (2001)CrossRefGoogle Scholar
  155. 155.
    Shane, S.A., Ulrich, K.T.: Technological innovation, product development, and entrepreneurship in management science. Manag. Sci. 50(2), 133–144 (2004)CrossRefGoogle Scholar
  156. 156.
    Sherwin, R.G., Laurance, E.J.: Arms transfers and military capability: measuring and evaluating conventional arms transfers. Int. Stud. Q. 23(3), 360–389 (1979)CrossRefGoogle Scholar
  157. 157.
    Souder, W.E., Mandakovic, T.: Research-and-development project selection models. Res. Manag. 29(4), 36–42 (1986)Google Scholar
  158. 158.
    Spradlin, C.T., Kutoloski, D.M.: Action-oriented portfolio management. Res. Technol. Manag. 42(2), 26–32 (1999)Google Scholar
  159. 159.
    Stewart, T.J.: A multicriteria decision support system for R-and-D project selection. J. Oper. Res. Soc. 42(1), 17–26 (1991)CrossRefGoogle Scholar
  160. 160.
    Stewart, T.J., Joubert, A., Janssen, R.: MCDA framework for fishing rights allocation in South Africa. Group Decis. Negot. 19(3), 247–265 (2010)CrossRefGoogle Scholar
  161. 161.
    Stummer, C., Heidenberger, K.: Interactive R&D portfolio analysis with project interdependencies and time profiles of multiple objectives. IEEE Trans. Eng. Manag. 50(2), 175–183 (2003)CrossRefGoogle Scholar
  162. 162.
    Supriyasilp, T., Pongput, K., Boonyasirikul, T.: Hydropower development priority using MCDM method. Energy Policy 37(5), 1866–1875 (2009)CrossRefGoogle Scholar
  163. 163.
    Svoray, T., Bar Kutiel, P., Bannet, T.: Urban land-use allocation in a mediterranean ecotone: habitat heterogeneity model incorporated in a GIS using a multi-criteria mechanism. Landsc. Urban Plan. 72(4), 337–351 (2005)CrossRefGoogle Scholar
  164. 164.
    Taylor, B.W., Moore, L.J., Clayton, E.R.: R-and-D project selection and manpower allocation with integer non-linear goal programming. Manag. Sci. 28(10), 1149–1158 (1982)CrossRefGoogle Scholar
  165. 165.
    Thurston, D.L., Tian, Y.Q.: Integration of the analytic hierarchy process and integer programming with linear constraints for long range production planning. Math. Comput. Model. 17(4), 41–53 (1993)CrossRefGoogle Scholar
  166. 166.
    Tonn, B., English, M., Travis, C.: A framework for understanding and improving environmental decision making. J. Environ. Plan. Manag. 43(2), 163–183 (2000)CrossRefGoogle Scholar
  167. 167.
    Tsai, W.H., Chou, W.C., Hsu, W.: The sustainability balanced scorecard as a framework for selecting socially responsible investment: an effective MCDM model. J. Oper. Res. Soc. 60(10), 1396–1410 (2008)CrossRefGoogle Scholar
  168. 168.
    Twaddle, S., Walker, A.: Program budgeting and marginal analysis - application within programs to assist purchasing in Greater Glasgow Health Board. Health Policy 33(2), 91–105 (1995)CrossRefGoogle Scholar
  169. 169.
    Vaillancourt, K., Waaub, J.: Equity in international greenhouse gases abatement scenarios: a multicriteria approach. Eur. J. Oper. Res. 153(2), 489–505 (2004)CrossRefGoogle Scholar
  170. 170.
    Vilkkumaa, E., Salo, A., Liesiö, J.: Multicriteria portfolio modeling for the development of shared action agendas. Group Decis. Negot. 23, 772–783 (2014)CrossRefGoogle Scholar
  171. 171.
    Wang, J.J., Jing, Y.Y., Zhang, C.F., Zhao, J.H.: Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew. Sust. Energ. Rev. 13(9), 2263–2278 (2009)CrossRefGoogle Scholar
  172. 172.
    White, D.J.: Decision Methodology: A Formalisation of the OR Process. Wiley, London (1975)Google Scholar
  173. 173.
    Wilson, E.C.F., Rees, S.J., Fordham, R.J.: Developing a prioritisation framework in an English Primary Care Trust. Cost Eff. Resour. Alloc. 4(3) (2006)Google Scholar
  174. 174.
    Wilson, E., Sussex, J., MacLeod, C., Fordham, R.: Prioritizing health technologies in a Primary Care Trust. J. Health Serv. Res. Policy 12(2), 80–85 (2007)CrossRefGoogle Scholar
  175. 175.
    Wilson, E.C.F., Peacock, S.J., Ruta, D.: Priority setting in practice: what is the best way to compare costs and benefits? Health Econom. 18(4), 467–478 (2009)CrossRefGoogle Scholar
  176. 176.
    Zhou, P., Ang, B.W., Poh, K.L.: Decision analysis in energy and environmental modeling: an update. Energy 31(14), 2604–2622 (2006)CrossRefGoogle Scholar
  177. 177.
    Zopounidis, C., Doumpos, M.: Multicriteria classification and sorting methods: a literature review. Eur. J. Oper. Res. 138(2), 229–246 (2002)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.Department of Management ScienceUniversity of StrathclydeScotlandUK
  2. 2.College of ManagementUniversity of MassachusettsBostonUSA
  3. 3.Systems Analysis LaboratoryAalto UniversityHelsinkiFinland

Personalised recommendations