Uncertainty (or Entropy, in the sense of Shannon’s information theory) is a quantitative measure for the uncertainty of the outcome of a random experiment modeled by a probabilistic variable. Given a probabilistic variable X with outcome set \( \mathcal{X} \)