Information and Entropy
The essence of data mining is the discovery of relationships among variables that we have measured. Throughout this book we will explore many ways to find, present, and capitalize on such relationships. In this chapter, we focus primarily on a specific aspect of this task: evaluating and perhaps improving the information content of a measured variable. What is information? This term has a rigorously defined meaning, which we will now pursue.