Data

Standardization

Average

Variance

Standard Deviation (sd)

sd = population_sd / SQRT(sample_size)

x' = x - mu / sd

Information:

Entropy:

Mutual Information/ Information Gain:

I(x,y) = H(x) - H(x|y) 

Information Entropy