Skip to main content

Advertisement

Log in

A BSC-based network DEA model equipped with computational linguistics for performance assessment and improvement

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

This research introduces a fusion architecture that integrates balanced scorecards (BSCs) and network data envelopment analysis (NDEA) to conduct a performance evaluation task from multiple perspectives. The architecture is able to capture the dynamics of production processes and sub-processes, uncover some of the components behind successful business practices, and shed light on needed actions for decision makers. Furthermore, the architecture not only can support decision makers to plan for improvement, but also equip them with forecasting ability. To enhance its forecasting quality, this study goes beyond quantitative ratios and extends them to qualitative ratios (i.e., readability: the complexities of disclosure) borrowed from computational linguistics. The results indicate that a poor readability score is highly associated with bad operations. Finally, to enlarge the mechanism’s applicable fields, the study executes the genetic algorithm (GA) to extract the inherent decision logics and represents them in a human-readable manner. The mechanism, examined by real cases, is a promising alternative for performance evaluation and forecasting.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Akbar S, Rehman S, Liu J, Shah SZA (2017) Credit supply constraints and financial policies of listed companies during the 2007–2009 financial crisis. Res Int Bus Financ 42:559–571

    Article  Google Scholar 

  2. Alhamdoosh M, Wang D (2014) Fast decorrelated neural network ensembles with random weights. Inf Sci 264:104–117

    Article  MathSciNet  MATH  Google Scholar 

  3. Amado CAF, Santos SP, Marques PM (2012) Integrating the data envelopment analysis and the balanced scorecard approaches for enhanced performance assessment. Omega 40:390–403

    Article  Google Scholar 

  4. Amado CAF, Santos SP, São José JMS (2018) Measuring and decomposing the gender pay gap: a new frontier approach. Eur J Oper Res 271:357–373

    Article  MathSciNet  MATH  Google Scholar 

  5. Banker RD, Chang H, Pizzini M (2011) The judgmental effects of strategy maps in balanced scorecard performance evaluations. Int J Account Inf Syst 12:259–279

    Article  Google Scholar 

  6. Barnett A, Leoffler K (1979) Readability of accounting and auditing messages. J Bus Commun 16:49–59

    Article  Google Scholar 

  7. Barakat N, Bradley AP (2010) Rule extraction from support vector machines: a review. Neurocomputing 1–3:178–190

    Article  Google Scholar 

  8. Basso A, Casarin F, Funari S (2018) How well is the museum performing? A joint use of DEA and BSC to measure the performance of museums. Omega 81:67–84

    Article  Google Scholar 

  9. Beattie V (2014) Accounting narratives and the narrative turn in accounting research: Issues, theory, methodology, methods and a research framework. The Brit Account Rev 46:111–134

    Article  Google Scholar 

  10. Breiman L (2001) Random forests. Mach Learn 45:5–32

    Article  MATH  Google Scholar 

  11. Bisoi R, Dash PK, Mishra SP (2019) Modes decomposition method in fusion with robust random vector functional link network for crude oil price forecasting. Appl Soft Comput 80:475–493

    Article  Google Scholar 

  12. Blanco, B., Dhole, S. (2017). Financial statement comparability, readability and accounting fraud. working paper. University of Adelaide

  13. Cabral I, Grilo A, Gonçalves-Coelho A, Mourão A (2016) An agent-based model for analyzing the impact of business interoperability on the performance of cooperative industrial networks. Data Knowl Eng 105:107–129

    Article  Google Scholar 

  14. Cai Y, Yang K, Huang D, Zhou Z, Lei X, Xie H, Wong TL (2019) (2019) A hybrid model for opinion mining based on domain sentiment dictionary. Int J Mach Learn Cyber 10(8):2131–2142

    Article  Google Scholar 

  15. Cao W, Wang X, Ming Z, Gao J (2018) A review on neural networks with random weights. Neurocomputing 275:278–287

    Article  Google Scholar 

  16. Charnes A, Cooper WW, Rhodes E (1978) Measuring the efficiency of decision making units. Eur J Oper Res 2:429–444

    Article  MathSciNet  MATH  Google Scholar 

  17. Chang TM, Hsu MF (2018) Integration of incremental filter-wrapper selection strategy with artificial intelligence for enterprise risk management. Int J Mach Learn Cyber 9(3):477–489

    Article  Google Scholar 

  18. Chen Y, Miao D, Wang R (2010) A rough set approach to feature selection based on ant colony optimization. Pattern Recognit Lett 31(3):226–233

    Article  Google Scholar 

  19. Cui S, Yin Y, Wang D, Li Z, Wang Y (2021) A stacking-based ensemble learning method for earthquake casualty prediction. Appl Soft Comput 101:107038

    Article  Google Scholar 

  20. Chia A, Hoon HS (2000) Adopting and creating balanced scorecards in singapore based companies. Singapore Manage Rev 22:1–15

    Google Scholar 

  21. Chien MS, Lawler JS, Uen JF (2010) Performance-based pay, procedural justice and job performance for R&D professionals: Evidence from the Taiwan high-tech sector. Int Journal Hum Resour Manag 21:2234–2248

    Article  Google Scholar 

  22. Cook WD, Zhu J, Gongbing B, Yang F (2010) Network DEA: additive efficiency decomposition. Eur J Oper Res 207:1122–1129

    Article  MATH  Google Scholar 

  23. Davis S, Albright T (2004) An investigation of the effect of the balanced scorecard implementation on financial performance. Manage Account Res 15:135–153

    Article  Google Scholar 

  24. Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30

    MathSciNet  MATH  Google Scholar 

  25. Dorigo M, Maniezzo V, Colorni A (1996) The Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern B 26(1):29–41

    Article  Google Scholar 

  26. Dridi A, Atzeni M, Reforgiato Recupero D (2019) FineNews: fine-grained semantic sentiment analysis on financial microblogs and news. Int J Mach Learn Cyber 10:2199–2207

    Article  Google Scholar 

  27. Fare R, Grosskopf S (1996) Productivity and intermediate products: a frontier approach. Econ Lett 50:65–70

    Article  MATH  Google Scholar 

  28. Farquad MAH, Bose I (2012) Preprocessing unbalanced data using support vector machine. Decis Support Syst 53:226–233

    Article  Google Scholar 

  29. Fourati H, Maaloul R, Chaari L (2021) A survey of 5G network systems: challenges and machine learning approaches. Int J Mach Learn Cyber 12:385–431

    Article  Google Scholar 

  30. Gajzler M (2010) Text and data mining techniques in aspect of knowledge acquisition for decision support system in construction industry. Technol Econ Dev Econ 16:219–232

    Article  Google Scholar 

  31. Geng R, Bose I, Chen X (2015) Prediction of financial distress: an empirical study of listed Chinese companies using data mining. Eur J Oper Res 241:236–247

    Article  Google Scholar 

  32. Ghalayini AM, Noble JS (1996) The changing basis of performance measurement. Int J Oper Prod Manag 16(8):63–80

    Article  Google Scholar 

  33. Gopal J, Sangaiah AK, Basu A, Gao XZ (2018) Integration of fuzzy DEMATEL and FMCDM approach for evaluating knowledge transfer effectiveness with reference to GSD project outcome. Int J Mach Learn Cyber 9(2):225–241

    Article  Google Scholar 

  34. Hajek P, Olej V, Myskova R (2014) Forecasting corporate financial performance using sentiment in annual reports for stakeholders’ decision-making. Technol Econ Dev Econ 20:721–738

    Article  Google Scholar 

  35. Hamamura J (2019) Unobservable transfer price exceeds marginal cost when the manager is evaluated using a balanced scorecard. Adv Account 44:22–28

    Article  Google Scholar 

  36. Hsieh LH, Lin LH (2010) A performance evaluation model for international tourist hotels in Taiwan—an application of the relational network DEA. Int J Hosp Manag 29:14–24

    Article  Google Scholar 

  37. Hsu MF, Chang TM, Lin SJ (2020) News-based soft information as a corporate competitive advantage. Technol Econ Dev Econ 26(1):48–70

    Article  Google Scholar 

  38. Hu KH, Lin SJ, Hsu MF, Chen FH (2020) A dynamic network-based decision architecture for performance evaluation and improvement. J Intell Fuzzy Syst 39(3):4299–4311

    Article  Google Scholar 

  39. Huang YP, Yen MF (2019) A new perspective of performance comparison among machine learning algorithms for financial distress prediction. Appl Soft Comput 83:105663

    Article  Google Scholar 

  40. Huang A, Zang A, Zheng R (2014) Evidence on the information content of text in analyst reports. Account Rev 89:2151–2180

    Article  Google Scholar 

  41. Hu X, Pedrycz W, Wang D (2019) Fuzzy rule-based models with randomized development mechanisms. Fuzzy Sets Syst 361:71–87

    Article  MathSciNet  Google Scholar 

  42. Houck M, Speaker PJ, Fleming AS, Riley RA Jr (2012) The balanced scorecard: Sustainable performance assessment for forensic laboratories. Sci Justice 52:209–216

    Article  Google Scholar 

  43. Jensen R, Shen Q (2005) Fuzzy-rough data reduction with ant colony optimization. Fuzzy Sets Syst 149(1):5–20

    Article  MathSciNet  MATH  Google Scholar 

  44. Kaplan RS, Norton DP (1992) The balanced scorecard-measures that drive performances. Harv Bus Rev 70:71–79

    Google Scholar 

  45. Kao C, Hwang SN (2008) Efficiency decomposition in two-stage data envelopment analysis: an application to non-life insurance companies in Taiwan. Eur J Oper Res 185:418–429

    Article  MATH  Google Scholar 

  46. Ko ASO, Lee SF (2000) Implementing the strategic formulation framework for the banking industry of Hong Kong. Manag Audit J 15:469–477

    Article  Google Scholar 

  47. Lamming RC, Johnsen TE, Zheng J, Harland CM (2000) An initial classification of supply networks. Int J Opera Prod Manage 20:675–691

    Article  Google Scholar 

  48. Lang M, Stice-Lawrence L (2015) Textual analysis and international financial reporting: Large sample evidence. J Account Econ 60:110–135

    Article  Google Scholar 

  49. Lacave C, Diez FJ (2004) A review of explanation methods for heuristic expert systems. Knowl Eng Rev 19:133–146

    Article  Google Scholar 

  50. Li F (2008) Annual report readability, current earnings, and earnings persistence. J Account Econ 45:221–224

    Article  Google Scholar 

  51. Li Y, Wang YZ, Cui Q (2015) Evaluating airline efficiency: an application of virtual frontier network SBM. Transport Res E Logist Transport Rev 81:1–17

    Article  Google Scholar 

  52. Liu P, Wang X, Yin L, Liu B (2020) Flat random forest: a new ensemble learning method towards better training efficiency and adaptive model size to deep forest. Int J Mach Learn Cyber 11:2501–2513

    Article  Google Scholar 

  53. Lin R, Li Z (2020) Directional distance based diversification super-efficiency DEA models for mutual funds. Omega 97:10209

    Article  Google Scholar 

  54. Lozano S (2015) Alternative SBM model for network DEA. Comput Ind Eng 82:33–40

    Article  Google Scholar 

  55. Lo K, Ramos F, Rogo R (2017) Earnings management and annual report readability. J Account Econ 63:1–25

    Article  Google Scholar 

  56. Mavi RK, Saen RF, Goh M (2019) Joint analysis of eco-efficiency and eco-innovation with common weights in two-stage network DEA: a big data approach. Technol Forecast Soc Chang 144:553–562

    Article  Google Scholar 

  57. Mariani MM, Visani F (2019) Embedding eWOM into efficiency DEA modelling: an application to the hospitality sector. Int J Hosp Manag 80:1–12

    Article  Google Scholar 

  58. Martens D, Baesens B, Gestel TV (2009) Decompositional rule extraction from support vector machines by active learning. IEEE Trans Knowl Data Eng 21:177–190

    Article  Google Scholar 

  59. Mirdehghan SM, Fukuyama H (2016) Pareto-Koopmans efficiency and network DEA. Omega 61:78–88

    Article  Google Scholar 

  60. Nowak-Brzezińska A, Wakulicz-Deja A (2019) Exploration of rule-based knowledge bases: a knowledge engineer’s support. Inf Sci 485:301–318

    Article  Google Scholar 

  61. Ni D, Xiao Z, Lim MK (2020) A systematic review of the research trends of machine learning in supply chain management. Int J Mach Learn Cyber 11:1463–1482

    Article  Google Scholar 

  62. Otley D (1999) Performance management: a framework for management control systems research. Manage Account Res 10:363–382

    Article  Google Scholar 

  63. Pawlak Z (1982) Rough sets. Int J Comput Inf Sci 11(5):341–356

    Article  MATH  Google Scholar 

  64. Pawlak Z (1997) Rough set approach to knowledge-based decision support. Eur J Oper Res 99(1):48–57

    Article  MATH  Google Scholar 

  65. Paradi JC, Rouatt S, Zhu H (2011) Two-stage evaluation of bank branch efficiencyusing data envelopment analysis. Omega 39:99–109

    Article  Google Scholar 

  66. Pao YH, Phillips SM, Sobajic DJ (1992) Neural-net computing and the intelligent control of systems. Int J Control 56:263–289

    Article  MathSciNet  MATH  Google Scholar 

  67. Ramberg R (1996) Construing and testing explanations in a complex domain. Comput Hum Behav 12:29–48

    Article  Google Scholar 

  68. Rodriguez JJ, Kuncheva LI, Alonso CJ (2006) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28:1619–1630

    Article  Google Scholar 

  69. Sainaghi R, Phillips P, Corti V (2013) Measuring hotel performance: Using a balanced scorecard perspectives’ approach. Int J Hosp Manag 34:150–159

    Article  Google Scholar 

  70. Salleb-Aouissi, A., Vrain, C., Nortet, C., Kong, X., Rathod, V., Cassard, D. (2013) QuantMiner for Mining Quantitative Association Rules. J Mach Learn Res 3153−3157.

  71. Sharma A, Rani R (2020) Drug sensitivity prediction framework using ensemble and multi-task learning. Int J Mach Learn Cyber 11:1231–1240

    Article  Google Scholar 

  72. Shafiee M, Lotfi FH, Saleh H (2014) Supply chain performance evaluation with data envelopment analysis and balanced scorecard approach. Appl Math Model 38:5092–5112

    Article  MathSciNet  MATH  Google Scholar 

  73. Shen YC, Chen PS, Wang CH (2016) A study of enterprise resource planning (ERP) system performance measurement using the quantitative balanced scorecard approach. Comput Ind 75:127–139

    Article  Google Scholar 

  74. Sueyoshi T, Yuan Y, Li A, Wang D (2017) Methodological comparison among radial, non-radial and intermediate approaches for DEA environmental assessment. Energy Econ 67:439–453

    Article  Google Scholar 

  75. Scardapane S, Wang D, Uncini A (2018) Bayesian random vector functional-link networks for robust data modeling. IEEE Trans Cyber 48:2049–2059

    Article  Google Scholar 

  76. Tavana M, Khalili-Damghani K, Santos Arteaga FJ, Hosseini A (2019) A fuzzy multi-objective multi-period network DEA model for efficiency measurement in oil refineries. Comput Ind Eng 135:143–155

    Article  Google Scholar 

  77. Tone K, Tsutsui M (2009) Network DEA: A slacks-based measure approach. Eur J Oper Res 197:243–252

    Article  MATH  Google Scholar 

  78. Wanke P, Barros C (2014) Two-stage DEA: an application to major Brazilian banks. Expert Syst Appl 41:2337–2344

    Article  Google Scholar 

  79. Wang Y, Wang D, Ye X, Wang Y, Yin Y, Jin Y (2019) A tree ensemble-based two-stage model for advanced-stage colorectal cancer survival prediction. Inf Sci 474:106–124

    Article  Google Scholar 

  80. Wang X, Yang J, Teng X, Xia W, Jensen R (2007) Feature selection based on rough sets and particle swarm optimization. Pattern Recognit Lett 28(4):459–471

    Article  Google Scholar 

  81. Wu HY (2012) Constructing a strategy map for banking institutions with key performance indicators of the balanced scorecard. Eval Program Plan 35:303–320

    Article  Google Scholar 

  82. Yang L, Xu Z (2019) Feature extraction by PCA and diagnosis of breast tumors using SVM with DE-based parameter tuning. Int J Mach Learn Cyber 10(3):591–601

    Article  MathSciNet  Google Scholar 

  83. Zhang L, Suganthan PN (2016) A survey of randomized algorithms for training neural networks. Inf Sci 364:146–155

    Article  MATH  Google Scholar 

  84. Zhang C, Zhou Y, Guo J, Wang G, Wang X (2019) Research on classification method of high-dimensional class-imbalanced datasets based on SVM. Int J Mach Learn Cyber 10(7):1765–1778

    Article  Google Scholar 

  85. Zhou L, Lu D, Fujita H (2015) The performance of corporate financial distress prediction models with features selection guided by domain knowledge and datamining approaches. Knowl-Based Syst 85:52–61

    Article  Google Scholar 

Download references

Acknowledgements

The author would like to thank the Ministry of Science and Technology, Taiwan, R.O.C. for financially supporting this work under contracts MOST. No.106-2410-H-034-011-MY3, No.108-2410-H-034-056-MY2 and No.109-2410-H-034-034-MY2.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sin-Jin Lin.

Ethics declarations

Conflict of interest

No conflict of interest exists in the submission of this manuscript.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hsu, MF., Lin, SJ. A BSC-based network DEA model equipped with computational linguistics for performance assessment and improvement. Int. J. Mach. Learn. & Cyber. 12, 2479–2497 (2021). https://doi.org/10.1007/s13042-021-01331-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-021-01331-7

Keywords

Navigation