# Important Terminologies in ML/AI

Entropy: It is the measure of the disorder / uncertainty / randomness in the information being processed. Our goal normally in machine learning is normally to reduce this. Mathematical formula of Entropy (sometime also represented as H):

$$E(S) = \sum_{i=1}^c – \; p_i \; log_2 \; p_i$$