Chunk #42 — 3 Inverse solutions — 3.1 Non parametric optimization methods — 3.1.1 The Bayesian framework — Non-Gaussian priors
Text
Entropy is a probabilistic concept appearing in information theory and statistical mechanics. Assuming x ∈ ℝ n consists of positive entries x i > 0, i = 1, ..., n the entropy is defined as