Entropy

See also Classical Statistical Mechanics#Entropy..
Maybe should it be called "missing information" (see "The farewell to entropy"). We distinguish:

• Shannon entropy
• differential entropy