Some general divergence measures for probability distributions (Q2368582)
From MaRDI portal
scientific article
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | Some general divergence measures for probability distributions |
scientific article |
Statements
Some general divergence measures for probability distributions (English)
0 references
27 June 2006
0 references
Let \((X,\mathcal{A})\) be a measurable space, \(\mu\) a \(\sigma\)-finite measure on \((X,\mathcal{A})\), \(P\) and \(Q\) probability measures on \((X,\mathcal{A})\) absolutely continuous with respect to \(\mu\). Denote, respectively, by \(p\) and \(q\) the Radon-Nikodým derivatives of \(P\) and \(Q\) with respect to \(\mu\). Let \(f:[0,+\infty)\longrightarrow(-\infty,+\infty]\) be a convex function which is continuous at \(0\). The \(f\)-divergence of \(Q\) and \(P\) is defined by \[ I_f(Q,P)= \int_Xp(x)f \left(\frac{q(x)}{p(x)}\right)\,d\mu(x). \] The author considers more general divergence measures and investigates their properties. Connections with the \(f\)-divergence are explored.
0 references
\(f\)-divergence
0 references
convexity
0 references
divergence measures
0 references
monotone functions
0 references