Convexity and robustness of the Rényi entropy (Q2062461)
From MaRDI portal
scientific article
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | Convexity and robustness of the Rényi entropy |
scientific article |
Statements
Convexity and robustness of the Rényi entropy (English)
0 references
27 December 2021
0 references
The authors first study the convexity of the Rényi entropy \(H_{\alpha}\) as a function of \(\alpha\in\,]0,+\infty[\). In studying the robustness of \(H_{\alpha}\) over finite alphabets they show that the rate of convergence depends on the initial alphabet, see Theorems 2 (\(\alpha=1\)), 3 (~\(\alpha<1\)), 4 (\(\alpha>1)\). The disturbed entropy converges when the initial distribution is uniform but the number of events goes to \(\infty\). Finally the Rényi entropy of the binomial distribution tends to that of the Poisson distribution.
0 references
robustness
0 references
convexity
0 references
discrete distribution
0 references
Rényi entropy
0 references