Data

Standardization

Average
Variance
Standard Deviation (sd)


sd = population_sd / SQRT(sample_size)


x' = x - mu / sd

Information:

Entropy:

Mutual Information/ Information Gain:


I(x,y) = H(x) - H(x|y)

Information Entropy