© 2020

Statistical Data Analysis and Entropy


Part of the Behaviormetrics: Quantitative Approaches to Human Behavior book series (BQAHB, volume 3)

Table of contents

  1. Front Matter
    Pages i-xi
  2. Nobuoki Eshima
    Pages 1-27
  3. Nobuoki Eshima
    Pages 91-140
  4. Nobuoki Eshima
    Pages 167-197
  5. Nobuoki Eshima
    Pages 225-257

About this book


This book reconsiders statistical methods from the point of view of entropy, and introduces entropy-based approaches for data analysis. Further, it interprets basic statistical methods, such as the chi-square statistic, t-statistic, F-statistic and the maximum likelihood estimation in the context of entropy. In terms of categorical data analysis, the book discusses the entropy correlation coefficient (ECC) and the entropy coefficient of determination (ECD) for measuring association and/or predictive powers in association models, and generalized linear models (GLMs). Through association and GLM frameworks, it also describes ECC and ECD in correlation and regression analyses for continuous random variables. In multivariate statistical analysis, canonical correlation analysis, T2-statistic, and discriminant analysis are discussed in terms of entropy. Moreover, the book explores the efficiency of test procedures in statistical tests of hypotheses using entropy. Lastly, it presents an entropy-based path analysis for structural GLMs, which is applied in factor analysis and latent structure models. Entropy is an important concept for dealing with the uncertainty of systems of random variables and can be applied in statistical methodologies. This book motivates readers, especially young researchers, to address the challenge of new approaches to statistical data analysis and behavior-metric studies.


Entropy-based Approaches for Data Analysis Entropy Association Measures Measuring the Associations in Contingency Tables Generalized linear Model Multivariate Analysis Path Analysis

Authors and affiliations

  1. 1.Center for Educational Outreach and AdmissionsKyoto UniversityKyotoJapan

About the authors

Nobuoki Eshima was born in Fukuoka, Japan in 1957. He was received B. Sc. and D. Sc. degrees in Mathematics from Kyushu University, Fukuoka, Japan in 1980 and 1993, respectively. In 1993, he joined Department of Statistics, Faculty of General Education, Nagasaki University as Associate Professor. In 1996, he joined Department of Medical Information Analysis, Faculty of Medicine, Oita Medical University as Professor. Since 2003 he is working as a Professor in Faculty of Medicine, Oita University, where the name of affiliation has changed because of combining with another university. From 2016, he is a professor of Center for Educational Outreach and Admissions, Kyoto University. He is an elected member of International Statistical Institute (ISI) and a reviewer for Mathematical Reviews of the American Mathematical Society (AMS).

Bibliographic information