Kullback–Leibler divergence (Q255166)
measurement of how one probability distribution is different from a second, reference probability distribution
Language:
(P31) (Q5423634)
(P138) (Q896641)
(Q2150086)
(P2534) D_\text{KL}(P \parallel Q) = \sum_{x\in\mathcal{X}} P(x) \log\left(\frac{P(x)}{Q(x)}\right)
(P2579) (Q217413)
(Q11473)
(Q131222)
(P6104) (Q8487137)
(P7235) P
Q
\mathcal{X}
other details
aliases information divergence
information gain
relative entropy
KL divergence
KLIC
description measurement of how one probability distribution is different from a second, reference probability distribution

External Links