, Volume 28, Issue 2, pp 334–337 | Cite as

Comments on: Data science, big data and statistics

  • Pedro DelicadoEmail author


The paper under discussion offers an accurate panoramic view about the effects that the emergence of big data and data science in the last decade is having on statistics. I congratulate the authors for such a well-written and stimulating piece of work, including an excellent bibliography review. I agree with them that statistics has been able to adapt to the new scenarios (abundance and heterogeneity of data, impressive computing capacity, other disciplines sharing the same objectives, among other), and I trust that the discipline will take advantage of the new challenges it will face in the future.

The authors’ belief on the need for convergence of different disciplines (statistics, machine learning, operation research, mathematics) is a position that I share completely. Specifically, they foresee that statistical ideas will be used to decompose and understand the forecasting rules created in other areas, [and] to identify the importance of the more relevant variables....



Work supported in part by the Spanish Ministerio de Economía, Industria y Competitividad, Grant MTM2017-88142-P.


  1. Baehrens D, Schroeter T, Harmeling S, Kawanabe M, Hansen K, MÞller KR (2010) How to explain individual classification decisions. J Mach Learn Res 11(Jun):1803–1831MathSciNetzbMATHGoogle Scholar
  2. Biecek P (2018) DALEX: explainers for complex predictive models in R. arXiv:1806.08915v2
  3. Biran O, Cotton C (2017) Explanation and justification in machine learning: a survey. In: Proceedings of The IJCAI-17 workshop on Explainable AI (XAI), pp 8–13Google Scholar
  4. Breiman L (2001) Statistical modeling: the two cultures. Stat Sci 16:199–231MathSciNetCrossRefzbMATHGoogle Scholar
  5. Datta A, Sen S, Zick Y (2016) Algorithmic transparency via quantitative input influence: theory and experiments with learning systems. In: 2016 IEEE symposium on security and privacy (SP). IEEE, pp 598–617Google Scholar
  6. Ferrando P (2018) Lighting the black box: explaining individual predictions of machine learning algorithms. Master Thesis, MESIO UPC-UB. Advisors: Belanche, L. and Delicado, P. Accessed 13 Dec 2018
  7. Fisher A, Rudin C, Dominici F (2018) All models are wrong but many are useful: Variable importance for black-box, proprietary, or misspecified prediction models, using model class reliance. arXiv:1801.01489v3
  8. Gregorutti B, Michel B, Saint-Pierre P (2015) Grouped variable importance with random forests and application to multiple functional data analysis. Comput Stat Data Anal 90:15–35MathSciNetCrossRefzbMATHGoogle Scholar
  9. Gregorutti B, Michel B, Saint-Pierre P (2017) Correlation and variable importance in random forests. Stat Comput 27(3):659–678MathSciNetCrossRefzbMATHGoogle Scholar
  10. Kononenko I et al (2010) An efficient explanation of individual classifications using game theory. J Mach Learn Res 11(Jan):1–18MathSciNetzbMATHGoogle Scholar
  11. van der Laan MJ (2006) Statistical inference for variable importance. Int J Biostat. MathSciNetGoogle Scholar
  12. Miller T (2019) Explanation in artificial intelligence: insights from the social sciences. Artif Intell 267:1–38. MathSciNetCrossRefGoogle Scholar
  13. Nott G (2017) Explainable artificial intelligence: cracking open the black box of AI. Computer World. Accessed 12 Dec 2018
  14. Ribeiro MT, Singh S, Guestrin C (2016) Why should i trust you?: explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1135–1144Google Scholar
  15. Staniak M, Biecek P (2018) Explanations of model predictions with live and breakDown packages. arXiv:1804.01955
  16. Wikipedia Contributors: Explainable Artificial Intelligence (2018) Wikipedia, the free encyclopedia (2018). Accessed 12 Dec 2018

Copyright information

© Sociedad de Estadística e Investigación Operativa 2019

Authors and Affiliations

  1. 1.Departament d’Estadística i Investigació OperativaUniversitat Politècnica d CatalunyaBarcelonaSpain

Personalised recommendations