Interpretability in Machine Learning – Principles and Practice
Theoretical advances in machine learning have been reflected in many research implementations including in safety-critical domains such as medicine. However this has not been reflected in a large number of practical applications used by domain experts. This bottleneck is in a significant part due to lack of interpretability of the non-linear models derived from data. This lecture will review five broad categories of interpretability in machine learning - nomograms, rule induction, fuzzy logic, graphical models & topographic mapping. Links between the different approaches will be made around the common theme of designing interpretability into the structure of machine learning models, then using the armoury of advanced analytical methods to achieve generic non-linear approximation capabilities.
KeywordsFuzzy Logic Latent Variable Model Rule Induction Machine Learning Model Predictive Inference
Unable to display preview. Download preview PDF.
- 1.Lisboa, P.J.G.: Industrial use of safety-related artificial neural networks. HSE CR 237/2001, HMSO (2001), http://www.hse.gov.uk/research/crr_pdf/2001/crr01327.pdf
- 6.Van Belle, V., Lisboa, P.J.G.: Research Directions in Interpretable Machine Learning. In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), Bruges, April 24-26, pp. 191–196 (2013)Google Scholar
- 8.Bacciu, D., Lisboa, P.J.G., Sperdutti, A., Villmann, T.: Probabilistic Modelling in Machine Learning. In: Alippi, C., et al. (eds.) Handbook on Computational Intelligence. Springer (accepted, 2013)Google Scholar
- 10.Bartholomew, Knott, Moustaki: Latent Variable Models and Factor Analysis: A Unified Approach, 3rd edn. (2011)Google Scholar
- 17.Fernandez, F., Duarte, A., Sanchez, A.: Optimization of the Fuzzy Partition of a Zero-order Takagi-Sugeno Model. In: Proc. Eleventh International Conference on Information Processing and Management of Uncertainty in Knowledge-based Systems (IPMU 2006), vol. I, pp. 898–905. Editions EDK (2006)Google Scholar
- 18.López de Mántaras, R., McSherry, D., Bridge, D., Leake, D., Smyth, B., Craw, S., Faltings, B., Maher, M.-L., Cox, M., Forbus, K., Keane, M., Aamodt, A., Watson, I.: Retrieval, reuse, revision, and retention in case-based reasoning. Knowledge Engineering Review 20(3), 215–240 (2005)CrossRefGoogle Scholar
- 19.Dutta, S., Bonissone, P.: Integrating Case Based And Rule Based Reasoning: The Possibilistic Connection. In: Proc. 6th Conference on Uncertainty in AI, Cambridge, MA, July 27-29, pp. 290–300 (1990)Google Scholar
- 20.Van Belle, V., Lisboa, P.J.G.: Automated Selection of Interaction Effects in Sparse Kernel Methods to Predict Pregnancy Viability. In: IEEE Symposium Series on Computational Intelligence, Singapore, April 16-19 (2013)Google Scholar