Skip to main content
SpringerLink
Log in

A Method for Quality Evaluation of Supervision Software Using Fuzzy Concepts and the International Standard ISO/IEC 25000

  • Published:
Journal of Control, Automation and Electrical Systems Aims and scope Submit manuscript

Abstract

Supervision software is an important part of supervisory control and data acquisition systems. It is ubiquitous in industrial applications and there is an increasing need for management methods to evaluate this software. In this paper, we describe a new method to evaluate supervision software using fuzzy logic and ISO/IEC 25000 standards which, together, are able to organize the evaluation phases and to indicate the quality degree of the software product. The method aggregates the opinion of experts in a preferential voting system, in which the opinion is weighted by the expert experience and agreement with the majority. The method defines the quality degree of each software requirement in a quality index, which is obtained by comparing the results of the evaluation with the quality standard developed for this specific problem. A 1.5-year-long experiment with beginner programmers illustrates the application of the method, and the results show the improvements that must be made in the software developed by them. With this new way of evaluating supervision software, programmers can identify problems in requirements, evaluate software and propose efficient solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Adamo, F., Attivissimo, F., Cavone, G., & Giaquinto, N. (2007). SCADA/HMI systems in advanced educational courses. IEEE Transactions on Instrumentation and Measurement, 56, 4–10.

    Article  Google Scholar 

  • Angiz, M. Z., Tajaddini, A., Mustafa, A., & Kamali, M. J. (2012). Ranking alternatives in a preferential voting system using fuzzy concepts and data envelopment analysis. Computers and Industrial Engineering, 63(4), 784–790.

    Article  Google Scholar 

  • Aydogmus, Z. (2009). Implementation of a fuzzy-based level control using SCADA. Expert Systems with Applications, 36, 6593–6597.

    Article  Google Scholar 

  • Belchior, A. D. (1997). A fuzzy model for evaluating software quality. PhD Thesis, University of Rio de Janeiro.

  • Branco, H. M. G. C., Barbosa, D., Oleskovicz, M., & Coury, D. V. (2013). Classification of events in power transformers using wavelet packet transform and fuzzy logic. International Journal of Control, Automation and Electrical Systems, 24, 300–311.

    Article  Google Scholar 

  • Cheng, X., Chu, X., Xue, D., & Zhang, Z. (2010). An integrated approach for rating engineering characteristics’ final importance in product-service system development. Computers and Industrial Engineering, 59(4), 585–594.

    Article  Google Scholar 

  • Cordeiro, R., Pinto, J. O. P., Godoy, R. B., Suemitsu, W. I., Ribeiro, P. E. M. J., & Cerchiari, S. C. (2013). Fuzzy demand estimation as basis of an assistant tool for a strategic load management of PHEV. International Journal of Control, Automation and Electrical Systems, 24, 843–853.

    Article  Google Scholar 

  • Damghani, K. K., & Nezhad, S. S. (2013). A decision support system for fuzzy multi-objective multi-period sustainable project selection. Computer and Industrial Engineering, 64, 1045–1060.

    Article  Google Scholar 

  • Dash, P. K., Barik, S. K., & Patnaik, R. K. (2014). Detection and classification of islanding and nonislanding events in distributed generation based on fuzzy decision tree. International Journal of Control, Automation and Electrical Systems, 25, 699–719.

    Article  Google Scholar 

  • Depcik, C., & Assanis, D. N. (2005). Graphical user interfaces in an engineering educational environment. Computer Applications in Engineering Education, 13(1), 48–59.

    Article  Google Scholar 

  • Esaki, K. (2013). Verification of requirement analysis method for system based on ISSO/IEC 9126 six quality characteristics. Communications in Computer and Information Science, 320, 60–68.

    Article  Google Scholar 

  • Esaki, K., Azuma, M., & Komiyama, T. (2013). Introduction of quality requirement and evauation based on ISO/IEC SQuaRE series of standard. Communications in Computer and Information Science, 320, 94–101.

    Article  Google Scholar 

  • Glass, R. L. (2006). The Standish report: Does it really describe a software crisis? Communications of the ACM: Music Information Retrieval, 49, 15–16.

    Google Scholar 

  • ISO/IEC 25010. (2011). Systems and software engineering—Systems and software quality requirements and evaluation (SQuaRE)—System and software quality models. The International Organization for Standardization, Technical Committee ISO/IEC JTC 1/SC 7, catalogue ICS 35.080, Stage 90.60 (2016-06-17). https://www.iso.org/obp/ui/#iso:std:iso-iec:25010:ed-1:v1:en.

  • ISO/IEC 25040. (2011). Systems and software engineering—Systems and software quality requirements and evaluation (SQuaRE)—Evaluation process. The International Organization for Standardization, Technical Committee ISO/IEC JTC 1/SC 7, catalogue ICS 35.080, Stage 90.60 (2016-06-17). https://www.iso.org/obp/ui/#iso:std:iso-iec:25040:ed-1:v1:en.

  • Jung, H. J., & Hong, S. J. (2012). The quality control of software reliability based on functionality, reliability and usability. In Future generation information technology. Lecture notes in computer science (Vol. 7709, pp. 112–118). Springer Berlin Heidelberg. doi:10.1007/978-3-642-35585-1_15.

  • Lantada, A. D., Morgado, P. L., Guijosa, J. M. M., Otero, J. E., & Sanz, J. L. M. (2013). Comparative study of CAD–CAE programs taking account of the opinions of students and teachers. Computer Applications in Engineering Education, 21(4), 641–656.

    Article  Google Scholar 

  • Liu, S. T. (2012). Solution of fuzzy integrated production and marketing planning based on extension principle. Computer and Industrial Engineering, 63, 1201–1208.

    Article  Google Scholar 

  • Mahata, G. C., & Goswami, A. (2013). Fuzzy inventory models for items with imperfect quality and shortage backordering under crisp and fuzzy decision variables. Computer and Industrial Engineering, 64, 190–199.

    Article  Google Scholar 

  • Queiroz, C., Mahmood, A., & Tari, Z. (2011). SCADASim—A framework for building SCADA simulations. IEEE Transactions on Smart Grid, 2(4), 589–597.

    Article  Google Scholar 

  • Ribeiro, E. A. (2013). A contribution to the development and quality assessment of industrial supervision systems in light of the standards ISO/IEC 9126 and 14598. Master Thesis, University of Ceará.

  • Shyr, W. J. (2012). Development of working competence items for mechatronics with graphical monitoring and control. Computer Applications in Engineering Education, 20(1), 88–92.

    Article  Google Scholar 

  • Shyr, W. J. (2013). Graphical human interface technology for use in mechatronics in engineering education. Computer Applications in Engineering Education, 21(2), 322–327.

    Article  MathSciNet  Google Scholar 

  • Simoes, M. G., & Shaw, I. S. (2007). Fuzzy control and modeling (2nd ed.). São Paulo: Blucher.

    Google Scholar 

  • Soares, L. C., Medeiros, A. A. D., & Maitelli, A. L. (2011). SISAL: A supervisory system for oil wells. International Journal of Control, Automation and Electrical Systems, 22, 631–637.

    Google Scholar 

  • Yenitepe, R. (2012). Design and implementation of a SCADA-controlled MTMPS as a mechatronics training unit. Computer Applications in Engineering Education, 20(2), 247–254.

    Article  Google Scholar 

  • Zadeh, L. A. (1965). Fuzzy sets. Information and Control, 8, 338–353.

    Article  MathSciNet  MATH  Google Scholar 

  • Zadeh, L. A. (1988). Fuzzy logic. Computer, 21, 83–93.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Industry, Federal Institute of Education, Science and Technology of Ceará/IFCE, Av. 13 de Maio, 2081, Benfica, Fortaleza, CE, 60.040-531, Brazil

    E. A. Ribeiro

  2. Department of Teleinformatics Engineering, Federal University of Ceará/UFC, Rua Humberto Monte, Bela Vista, Fortaleza, CE, 60.455-900, Brazil

    G. A. P. Thé & J. M. Soares

Authors
  1. E. A. Ribeiro
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. G. A. P. Thé
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. M. Soares
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to E. A. Ribeiro.

Additional information

E. A. Ribeiro: SBA member.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ribeiro, E.A., Thé, G.A.P. & Soares, J.M. A Method for Quality Evaluation of Supervision Software Using Fuzzy Concepts and the International Standard ISO/IEC 25000. J Control Autom Electr Syst 28, 389–404 (2017). https://doi.org/10.1007/s40313-017-0303-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40313-017-0303-5

Keywords

Search

Navigation