Evaluation of Government Information Systems Effectiveness: The Case of e-Participation Portals in Russia

  • Dmitrii Trutnev
  • Lyudmila Vidiasova
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11021)


This paper is devoted to the study of methods for assessing the effectiveness of public information systems that can identify the relationship between the characteristics of individual factors of their creation and assess the impact of these factors on their overall effectiveness and ability to create public values. After reviewing, selecting and adapting an evaluation methodology, it was tested with several e-participation portals. This choice was due to both the growing interest in increasing the effectiveness of these portals, and the relative availability of initial information for analysis. During the research, a number of hypotheses were formulated and tested. The results obtained and presented in this paper confirm the suitability of the chosen methodology to solve the stated tasks of effectiveness assessment of government information systems and the influencing factors.


Government information systems Effectiveness Public values e-Participation 



This work was conducted with support of RFBR grant No. 16-36-60035 “The research of social efficiency of e-participation portals in Russia”.


  1. 1.
    Faik, I., Walsham, G.: Modernization through ICTs: towards a network ontology of technological change. Inf. Syst. J. 23(4), 351–370 (2013)CrossRefGoogle Scholar
  2. 2.
    Bannister, F., Connolly, R.: ICT, public values and transformative government: a framework and programme for research. Gov. Inf. Quart. 31, 119–128 (2014)CrossRefGoogle Scholar
  3. 3.
    Helbig, N., Gil-Garcia, J.R., Ferro, E.: Understanding the complexity of electronic government: implications from the digital divide literature. Gov. Inf. Quart. 26(1), 89–97 (2009)CrossRefGoogle Scholar
  4. 4.
    Janssen, M., Chun, A., Gil-Garcia, J.R.: Building the next generation of digital government infrastructures. Gov. Inf. Quart. 26(2), 233–237 (2009)CrossRefGoogle Scholar
  5. 5.
    Gisselquist, R.M.: What does good governance mean? WIDER angle, 1 January 2012. SSRN:
  6. 6.
    Janowski, T.: Digital government evolution: from transformation to contextualization. Gov. Inf. Quart. 32(3), 221–236 (2015)CrossRefGoogle Scholar
  7. 7.
    Luna- Reyes, L.F., Gil-Garcia, J.R., Romero, G.: Towards a multidimensional model for evaluating electronic government: proposing a more comprehensive and integrative perspective. Gov. Inf. Quart. 29(3), 324–334 (2012)CrossRefGoogle Scholar
  8. 8.
    Harrison, T., et al.: Open government and e-government: democratic challenges from a public value perspective. Inf. Polity 17, 83–97 (2012)Google Scholar
  9. 9.
    Pereira, G.V., Macadar, M.A., Luciano, E.M., Testa, M.G.: Delivering public value through open government data initiatives in a Smart City context. Inf. Syst. Front. 19, 213–229 (2017)CrossRefGoogle Scholar
  10. 10.
    Hamilton, S., Chervany, N.L.: Evaluating information systems effectiveness - part I: comparing evaluation approaches. MIS Q. 5(3), 55–69 (1981). Scholar
  11. 11.
    ISACA: Cobit 5 - A Business Framework for the Governance and Management of Enterprise IT. ISACA, Rolling Meadows (2012).
  12. 12.
    Morton, M.S.: Management Decision Systems: Computer-based Support for Decision Making. Harvard University, Boston (1971)Google Scholar
  13. 13.
    Keen, P.G.W., Morton, M.S.: Decision Support Systems: An Organizational Perspective. Addison Wesley, Reading (1978)Google Scholar
  14. 14.
    Ginzberg, M.J.: Improving MIS project selection. OMEGA 7(6), 527–537 (1979)CrossRefGoogle Scholar
  15. 15.
    Leintz, B.P., Chen, M.: Assessing the impact of new technology in information systems. Long Range Plann. 14(6), 44–50 (1981)CrossRefGoogle Scholar
  16. 16.
    Moore, M.H.: Creating Public Value: Strategic Management in Government. Harvard University Press, London (1995)Google Scholar
  17. 17.
    Bozeman, B.: Public Value and Public Interest: Counterbalancing Economic Individualism. Georgetown University Press, Washington (2007)Google Scholar
  18. 18.
    Kelly, G., Muers, S.: Creating public value: an analytical framework for public service reform. Cabinet Office Strategy Unit, London (2002)., Accessed 16 Mar 2018
  19. 19.
    Alford, J., O’Flynn, J.: Making sense of public value: concepts, critiques and emergent meanings. Int. J. Public Adm. 32, 171–191 (2009)CrossRefGoogle Scholar
  20. 20.
    Benington, J.: Creating the public in order to create public value? Int. J. Public Adm. 32, 232–249 (2009)CrossRefGoogle Scholar
  21. 21.
    Kernaghan, K.: Integrating values into public service: the values statement as centrepiece. Public Adm. Rev. 63(6), 711–719 (2003)CrossRefGoogle Scholar
  22. 22.
    Jorgensen, T.B., Bozeman, B.: Public values an inventory. Adm. Soc. 39(3), 354–381 (2007)CrossRefGoogle Scholar
  23. 23.
    Heeks, R.: Success and failure rates of eGovernment in developing/transitional countries: overview (2008). Retrieved 15 March 2018. 16 Mar 2018
  24. 24.
    Al-Omari, A., Al-Omari, H.: e-Government readiness assessment model. J. Comput. Sci. 2(11), 841–845 (2006)CrossRefGoogle Scholar
  25. 25.
    Falivene, G.M., Silva, G.M.: Reflections and proposals on public officials training and promotion of e-government. Int. J. Electron. Gov. Res. 4(2), 43–58 (2008)CrossRefGoogle Scholar
  26. 26.
    Gauld, R., Goldfinch, S., Horsburgh, S.: Do they want it? Do they use it? The demand-side of e-government in Australia and New Zealand. Gov. Inf. Quart. 27, 177–186 (2010)CrossRefGoogle Scholar
  27. 27.
    Alford, J., Hughes, O.: Public value pragmatism as the next phase of public management. Am. Rev. Public Adm. 38(2), 130–148 (2008)CrossRefGoogle Scholar
  28. 28.
    Bryson, J., Crosby, B., Bloomberg, L.: Public value governance: moving beyond traditional public administration and the new public management. Public Adm. Rev. 74(4), 445–456 (2014)CrossRefGoogle Scholar
  29. 29.
    Di Maio, A.: Value for money is not enough in public sector IT-projects. Gartner Research, Stamford (2003)Google Scholar
  30. 30.
    Karunasena, K.: An investigation of the public value of e-government in Sri Lanka. Ph.D. Dissertation (2012). Accessed 16 Mar 2018
  31. 31.
    Sigwejo, A., Pather, S.: A citizen-centric framework for assessing e-government effectiveness. Electron. J. Inf. Syst. Dev. Ctries. 74(8), 1–27 (2016)Google Scholar
  32. 32.
    Hiziroglu, A.: Measuring the public value of e-government: evidence from Turkey. In: Proceedings of The IRES International Conference, Rio de Janeiro, Brazil, 27–28 January 2017. Accessed 16 Mar 2018
  33. 33.
    Chu, P.Y. Tseng, H.L., Lee, C.P., Huang, W.L., Huang, T.Y., Hung Y.T.: A longitudinal research of public value and electronic governance development in Taiwan. In: Proceedings of the 10th International Conference on Theory and Practice of Electronic Governance (ICEGOV 2017), pp. 459–464 (2017)Google Scholar
  34. 34.
    Benington, J., Moor, M.: Public Value Theory and Practice. Palgrave Macmillan, Basinstoke (2011)Google Scholar
  35. 35.
    Bryson, J.M., Crosby, B.C., Bloomberg, L.: Public Value and Public Administration. Georgetown University Press, Washington (2015)Google Scholar
  36. 36.
    Páscoa, C., Moreira, V., Tribolet, J.: Effectiveness index as an organizational cockpit instrument. Proc. Technol. 5, 244–254 (2012). 4th Conference of Enterprise Information Systems – aligning technology, organizations and people (CENTERIS 2012). ElsevierCrossRefGoogle Scholar
  37. 37.
    Creswell, J.W.: Research Design: Qualitative, Quantitative and Mixed Methods Approaches, 3rd edn. Sage Publication Inc., California (2009)Google Scholar
  38. 38.
    Woolley, C.M.: Meeting the mixed methods challenge of integration in a sociological study of structure and agency. J. Mix. Methods Res. 3(1), 7–25 (2009)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2018

Authors and Affiliations

  1. 1.ITMO UniversitySaint PetersburgRussia

Personalised recommendations