Abstract
Among the challenges faced by regulatory authorities in the water sector, the large number of municipal supply services to be inspected and the cost of on-site inspections are prominent. To overcome these issues, decisions regarding the priority of inspections based on indicators is an alternative. Therefore, this research aims to propose and evaluate the Regulatory Index of Quality of Water Supply Service (RIQS) to triage on-site inspections of water supply systems in cities of the state of Minas Gerais. The study was conducted with information from the Regulatory Agency of Water Supply and Sanitation Services of Minas Gerais (Arsae-MG). The methodology followed seven steps: (i) selection of available indicators; (ii) grouping of indicators according to their typology; (iii) screening of indicators; (iv) establishment of standardized scale; (v) evaluation of the relative importance of typologies and indicators, through the adaptation of the analytic hierarchy process (AHP); (vi) determination of the RIQS; and (vii) analysis of results. As a result, we selected 12 indicators to compose the RIQS, which deal with efficiency, effectiveness, and customer relationship. We noticed that the indicator of water supply service coverage (17.2%) had the highest weight in the calculation of the RIQS, and the index of requests for an inspection of the water connection served on time (2.1%) had the lowest weight. In addition, 95.1% of the 591 municipalities evaluated presented excellent or good performance. Based on these results, we show that the RIQS can be used to identify cities with low performance and prioritize inspections in the most urgent water systems. Furthermore, these outcomes reveal the possibility of extending and adapting the methodology to other regulatory agencies around the world for identifying the priority of inspections in water supply systems at a municipal level.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.
References
ABAR. (2014). Informações e indicadores de água e de esgoto no contexto regulatório [Water and sewage information and indicators in the regulatory context]. Retrieved June 20, 2021, from http://www.acertarbrasil.com/wp-content/uploads/2020/10/Nota-Tecnica-CTSan-Abar-01-2014-Informacoes-e-Indicadores-de-Agua-no-Contexto-Regulatorio.pdf
ABAR. (2019). Regulação Saneamento Básico [Sanitation regulation]. Retrieved January 12, 2021, from https://abar.org.br/biblioteca/#1581526808041-72662194-cb9a
ABES. (2018). Guia de Referência para Medição do Desempenho [Guide for measurement of performance]. Retrieved April 09, 2021, from http://abes-dn.org.br/pnqsnew/wp-content/uploads/2018/03/GRMD-2018-v1.pdf
ABNT (2012) Atividades relacionadas aos serviços de água potável e de esgoto – Diretrizes para a avaliação e para a melhoria dos serviços prestados aos usuários [Activities relating to water and wastewater services – Guidelines for the management of drinking water Utilities and for the assessment of drinking water services]. ABNT, Rio de Janeiro
ADASA. (2016). Resolução ADASA n° 08/2016. [ADASA normative resolution n° 08/2016]. Retrieved June 20, 2021, from http://www.adasa.df.gov.br/images/stories/anexos/8Legislacao/Res_ADASA/Resolucao008_2016.pdf
Alegre, H.; Baptista, J. M.; Cabrera, E.; Cubillo, F.; Duarte, P.; Hirner, W.; Merkel, W. & Parena, R. (2016) Performance indicators for water supply services. IWA Publishing
Alegre H, Hirner W, Baptista JM, Parena R (2000) Performance indicators for water supply services. IWA Publishing
Amgo-Otu R, Agyenim JB, Nimba-Bumah GB (2014) Correlation analysis of groundwater colouration from mountainous areas, Ghana. Environ Res, Eng Manage 67:1. https://doi.org/10.5755/j01.erem.67.1.4545
ANA. (2021). Indicadores de qualidade - Índice de Qualidade das Águas (IQA) [Quality indicators: water quality index (WQI)]. Retrieved June 20, 2021, from http://pnqa.ana.gov.br/indicadores-indice-aguas.aspx
Aparecido LEO, Rolim GS, Moraes JRSC, Rocha HG, Lense GHE, Souza PS (2018) Agroclimatic zoning for urucum crops in the state of Minas Gerais, Brazil. Agrometeorology 1:77. https://doi.org/10.1590/1678-4499.2016527
ARSAE. (2018). Resolução Arsae-MG n° 108/2018 [Arsae normative resolution n° 108/2018]. Retrieved June 20, 2021, from http://www.arsae.mg.gov.br/images/documentos/legislacao/Resolucao_ProSun.pdf
ARSAE. (2019). Resolução Arsae-MG n° 129/2019 [Arsae normative resolution n° 129/2019]. Retrieved January 11, 2021, from http://arsae.mg.gov.br/images/documentos/legislacao/2019/Resoluo%20ARSAE_MG%20n129.2019_gua.pdf
ARSAE. (2021a). Nota técnica CRE 03/2021 [CRE technical note 03/2021]. Retrieved June 20, 2021, from http://www.arsae.mg.gov.br/images/documentos/audiencia_publica/32/finais/NT_CRE_03_2021_Custos_Oprc_Eficientes_Fator_X_PosAP.pdf
ARSAE. (2021b). Parecer Técnico do município de Natalândia [Technical report of Natalândia]. Retrieved January 11, 2021, from http://www.arsae.mg.gov.br/pareceres/2021/PT_GIO_055_2021_Natalandia_Copasa.pdf
ARSAE. (2021c). Parecer Técnico do município de Delfim Moreira [Technical report of Delfim Moreira]. Retrieved January 11, 2021, from http://www.arsae.mg.gov.br/pareceres/2021/PT_GIO_063_2021_Delfim_Moreira.pdf
ARSAE (2022) Fiscalização Operacional [Operational Audit]. Retrieved January 8, 2022, from http://www.arsae.mg.gov.br/fiscalizacao-operacional/
ARSAE. (2023). Projeto MAIS A&E [Project MAIS A&E]. Retrieved May 17, 2023, from http://www.arsae.mg.gov.br/projeto-mais-agua-e-esgoto/
ARSESP. (2022). Índice Geral de Qualidade [Quality index]. Retrieved January 08, 2022, from http://www.arsesp.sp.gov.br/SitePages/saneamento/igq.aspx
Bolognesi T, Pflieger G (2021) In the shadow of sunshine regulation: explaining disclosure biases. Regul Gov 15. https://doi.org/10.1111/rego.12286
Brazil. (2019a). Plano Nacional de Saneamento Básico [National plan of basic sanitation]. Retrieved April 04, 2021, from https://antigo.mdr.gov.br/images/stories/ArquivosSDRU/ArquivosPDF/Versao_Conselhos_Resolu%C3%A7%C3%A3o_Alta_-_Capa_Atualizada.pdf
Brazil. (2019b). Lei Federal n° 13848/2019 [Federal Law n° 13848/2019]. Diário Oficial da República Federativa do Brasil
Brazil. (2020). Lei Federal n° 14026/2020 [Federal Law n° 14026/2020]. Diário Oficial da República Federativa do Brasil
Brazil Geological Survey. (2023). Brazilian rainfall atlas. Retrieved January 12, 2023, from https://www.cprm.gov.br/publique///Mapas-e-Publicacoes/Atlas-Pluviometrico-do-Brasil-1351.html
Brown RM, Mclelland NJ, Deininger RA, Tozer RG (1970) A water quality index do we dare? Water Sew Works 117:10
Carvalho AEC, Sampaio LMB (2015) Paths to universalize water and sewage services in Brazil: the role of regulatory authorities in promoting efficient service. Util Policy 34. https://doi.org/10.1016/j.jup.2015.03.001
Carvalho, B. E. F. C. (2013). A avaliação de desempenho da prestação de serviços de abastecimento de água independe da perspectiva do avaliador, se usuário ou prestador? [Does the performance evaluation of the provision of water supply services depend on the evaluator’s perspective, whether user or provider?]. Retrieved January 08, 2022, from https://repositorio.unb.br/bitstream/10482/15361/1/2013_BrunoEustaquioFerreiraCastrodeCarvalho.pdf
Carvalho J, Longaray AA (2021) Prioritization of water resources projects from the perspective of multicriteria decision aid models: a systematic review. Rev Engenharia Sanitária Ambiental 6:26. https://doi.org/10.1590/S1413-415220190259
Castillo CN, Degamo FK, Gitgano FT, Loo LA, Pacaanas SM, Toroy N, Ocampo L, Ocampo CO, Sai L (2017) Appropriate criteria set for personnel promotion across organizational levels using analytic hierarchy process (AHP). Int J Prod Manage Eng 5. https://doi.org/10.4995/ijpme.2017.5857
Cetesb. (2020). Índice de Qualidade das Águas - Anexo E [Water quality index - attachment E]. Retrieved January 08, 2022, from https://cetesb.sp.gov.br/aguas-interiores/publicacoes-e-relatorios/
Cetrulo TB, Marques RC, Malheiros TF (2019) An analytical review of the efficiency of water and sanitation utilities in developing countries. Water Res 161:2019. https://doi.org/10.1016/j.watres.2019.05.044
Chan FTS, Chan HK (2004) Development of the supplier selection model - a case study in the advanced technology industry. J Eng Mfr 218. https://doi.org/10.1177/095440540421801213
Costa, H. G. (2002). Introdução ao método de análise hierárquica: análise multicritério no auxílio à decisão [Introduction to the analytic hierarchy process: multi-criteria analysis in decision aid]. Retrieved January 08, 2022, from http://www.din.uem.br/sbpo/sbpo2004/pdf/arq0279.pdf
Costa SAB, Cortes LS, Coelho T, Freitas MM (2013) Indicadores em saneamento: Avaliação da prestação dos serviços de água e de esgoto de Minas Gerais [Sanitation indicators: assessment of water and sewage services in Minas Gerais]. Revista UFMG 20:2. https://doi.org/10.35699/2316-770X.2013.2704
Costa V (2017) Correlation and regression. In: Naghettini M (ed) Fundamentals of statistical hydrology, 1st edn. Springer, pp 391–440
Darko A, Chan APC, Ameyaw EE, Owusu EK, Pärn E, Edwards DJ (2019) Review of application of analytic hierarchy process (AHP) in construction. Int J Const Manage 5:19. https://doi.org/10.1080/15623599.2018.1452098
ERSAR. (2021). Guia Técnico n° 22 [Technical guide n° 22]. Retrieved June 20, 2021, from http://www.ersar.pt/pt/publicacoes/publicacoes-tecnicas/guias
Foroughi AA, Azad H (2021) A new AHP-prioritization method based on linear programming for crisp and interval preference relations. Int Trans Oper Res 6:29. https://doi.org/10.1111/itor.13084
Galvão Júnior AC, Paganini WS (2009) Conceptual aspects of the regulation of water and sewage services in Brazil. Rev Engenharia Sanitária Ambiental 1:14. https://doi.org/10.1590/S1413-41522009000100009
Galvão Júnior, A. C.; Silva, A. C.; Queiroz, E. A. & Basílio Sobrinho, G. (2006). Regulação: procedimentos de fiscalização em sistemas de abastecimento de água. Expressão Gráfica Ltda
Hamdan OHC, Libânio M, Costa VAF (2021) Assessment of performance indicators for different sizes of water supply systems in Minas Gerais, Brazil. Environ Monit Assess 193:12. https://doi.org/10.1007/s10661-021-09576-z
Hamdan, O. H. C.; Oliveira, M. D.; Fonseca, G. A. B.; Souza, S. L. (2017). Fiscalização dos serviços de saneamento: alternativas para melhoria da abrangência [Inspection of sanitation services: alternatives to improve coverage]. Retrieved January 14, 2022, from http://arsae-homo.prodemge.gov.br/images/Artigos/Fiscalizacao_integrada.pdf
IBGE. (2015). Estimativas populacionais para os municípios brasileiros [Population estimation for Brazilian municipalities]. Retrieved January 11, 2021, from http://www.ibge.gov.br/home/estatistica/populacao/estimativa2015/estimativa_dou.shtm
INFOHIDRO. (2021). Monitoramento de qualidade das águas [Monitoring of water quality]. Retrieved January 08, 2021, from http://portalinfohidro.igam.mg.gov.br/monitoramento-de-qualidade-das-aguas
IWA. (2023). Water and sanitation services. Retrieved June 20, 2021, from https://iwa-network.org/programs/water-and-sanitation-services/
James CA, Kershner J, Sambouri J, O’Neil S, Levin PS (2012) A methodology for evaluating and ranking water quantity indicators in support of ecosystem-based management. Environ Assess 49:3. https://doi.org/10.1007/s00267-012-9808-7
Kottegoda NT, Rosso R (2008) Applied statistics for civil and environmental engineers. Blackwell Publishing
Lam K, Zhao X (1998) An application of quality function deployment to improve the quality of teaching. Int J Qual Reliab Manag 15:4. https://doi.org/10.1108/02656719810196351
Lopes KGO, Coelho MML, Libânio M (2011) Aplicação do Método da Análise Hierárquica na Priorização da Reabilitação de Redes de Distribuição de Água [Application of the analytic hierarchy process in prioritizing the rehabilitation of water distribution networks]. Rev Bras Recur Hídricos 16:4. https://doi.org/10.21168/rbrh.v16n4.p181-194
Martins, C. S.; Souza, D. O. & Barros, M. S. (2009). O uso do método de análise hierárquica (AHP) na tomada de decisões gerenciais – um estudo de caso [Application of analytic hierarchy process (AHP) in the management decision making]. Retrieved June 20, 2021, from http://www2.ic.uff.br/~emitacc/AMD/Artigo%204.pdf
Martins FG, Coelho LS (2012) Aplicação do método de análise hierárquica do processo para o planejamento de ordens de manutenção em dutovias [Application of the analytic hierarchy process for the planning of maintenance orders in pipelines]. Gest Prod, Oper Sist 1. https://doi.org/10.15675/gepros.v0i1.317
Meadows D (1998) Indicators and information systems for sustainable development. The Sustainability Institute
Mello JCCBS, Gomes EG, Lins MPE (2001) Análise Multicritério da presença da Universidade Federal Fluminense com o uso do Método Macbeth [Multicriteria analysis of the presence of Universidade Federal Fluminense using the Macbeth method]. Rev Prod 11:2. https://doi.org/10.1590/S0103-65132001000200004
Molinos-Senante M, Delgado-Antequera L, Gómez T (2022) Measuring the quality of service of water companies: a two-stage goal programming synthetic index proposal. Socio-Econ Plan Sci 79. https://doi.org/10.1016/j.seps.2021.101140
Molinos-Senante M, Munoz S, Chamorro A (2019) Assessing the quality of service for drinking water supplies in rural settings: a synthetic index approach. J Environ Manage 247. https://doi.org/10.1016/j.jenvman.2019.06.112
Mundim BC, Volschan Junior I (2019) Evaluation of the operational and quality performance indicators of the Brazilian National System of Information in Sanitation for water supply and sanitation systems. DAE 68:277. https://doi.org/10.36659/dae.2020.079
Nahas MIP, Moura ASA, Carvalho RC, Heller L (2019) Inequality and discrimination in access to water and sanitation in the Belo Horizonte Metropolitan Region, Minas Gerais State Brazil. Cad Saúde Pública 35:4. https://doi.org/10.1590/0102-311X00100818
OECD. (2015). The governance of water regulators, OECD studies on water. Retrieved January 11, 2023, from https://read.oecd-ilibrary.org/governance/the-governance-of-water-regulators_9789264231092-en#page4
Ofwat. (2013). Key indicators – guidance. Retrieved June 20, 2021, from https://www.ofwat.gov.uk/wp-content/uploads/2015/12/prs_web_kpiprintable.pdf
Pinese Júnior JF, Rodrigues SC (2012) The analytic hierarchy process - AHP - as a support for determining the environmental vulnerability of Piedaderiver (MG) watershed. J Geogr Dep 23. https://doi.org/10.7154/RDG.2012.0023.0001
Reis, A. C. B. & Schramm, V. B. (2022). Guia para aplicação da análise multicritério em Análise de Impacto Regulatório (AIR) no Inmetro [Guide for the application of multicriteria analysis in regulatory impact analysis (AIR) in Inmetro]. Retrieved September 15, 2022, from https://www.gov.br/inmetro/pt-br/assuntos/regulamentacao/InmetroGuiaAnaliseMulticriterioemAIR.pdf
Ribeiro TG, Boaventura GR, Cunha LS, Pimenta SM (2016) Estudo da qualidade das águas por meio da correlação de parâmetros físico-químicos, Bacia Hidrográfica do Ribeirão Anicuns [Study of water quality through the correlation of physical-chemical parameters, Ribeirão Anicuns Watershed]. Geochim Bras 30:1. https://doi.org/10.21715/GB2358-2812.2016301084
Saaty TL, Özdemir MS (2014) How many judges should there be in a group? Ann Data Sci 1. https://doi.org/10.1007/s40745-014-0026-4
Saaty, T. L. & Vargas, L. G. (2001). Models, methods, concepts applications of the analytic hierarchy process. Kluwer Academic Plublishers
Shahin A, Mahbod MA (2007) Prioritization of key performance indicators: an integration of analytical hierarchy process and goal setting. Int J Product Perform Manag 56:3. https://doi.org/10.1108/17410400710731437
SNIS. (2021). Sistema Nacional sobre Saneamento 2021 [The Brazilian National System for Water and Sanitation data]. Retrieved May 17, 2023, from https://www.gov.br/mdr/pt-br/assuntos/saneamento/snis/painel
Souza META, Libânio M (2009) Proposal of a raw water quality index influent to conventional water treatment plants. Rev Eng Sanit Ambient 14:4. https://doi.org/10.1590/S1413-41522009000400007
Tavares RM, Tavares JL, Parry-Jones SL (2008) The use of a mathematical multicriteria decision-making model for selecting the fire origin room. Build Environ 43:12. https://doi.org/10.1016/j.buildenv.2007.12.010
United Nations. (2022). The sustainable development goals – report 2022. Retrieved January 11, 2023, from https://unstats.un.org/sdgs/report/2022/The-Sustainable-Development-Goals-Report-2022.pdf
Witte K, Saal DS (2010) Designing performance incentives, an international benchmark study in the water sector. CEJOR 18. https://doi.org/10.1007/s10100-009-0108-0
Code availability
Not applicable.
Author information
Authors and Affiliations
Contributions
OHCH wrote the manuscript in consultation with ML and VAFC. OHCH was responsible for acquiring and interpreting data. ML and VAFC made a substantial contribution to the manuscript’s design and interpretation of the results. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the Compliance Officer of Arsae-MG, Brazil. Furthermore, the research is classified as opinion poll with unidentified participants. The confidentiality of the names and locations of the municipalities has been ensured in this study.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Responsible Editor: Xianliang Yi
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Hamdan, .H.C., Libânio, M. & Costa, V.A.F. Proposal of a regulatory index of quality of water supply services—RIQS. Environ Sci Pollut Res 30, 93564–93581 (2023). https://doi.org/10.1007/s11356-023-28880-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11356-023-28880-4