Data

Standardization


Average
Variance
Standard Deviation (sd)

sd = population_sd / SQRT(sample_size)


x' = x - mu / sd


Information:


Entropy:




Mutual Information/ Information Gain:

I(x,y) = H(x) - H(x|y)


Information Entropy