Rényi Divergence and Kullback-Leibler Divergence
From MaRDI portal
Publication:2986250
DOI10.1109/TIT.2014.2320500zbMath1360.94180arXiv1206.2459OpenAlexW2026653933WikidataQ59408941 ScholiaQ59408941MaRDI QIDQ2986250
Tim van Erven, Peter Harremoës
Publication date: 16 May 2017
Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1206.2459
Related Items (only showing first 100 items - show all)
ALESQP: An Augmented Lagrangian Equality-Constrained SQP Method for Optimization with General Constraints ⋮ Operator-valued Schatten spaces and quantum entropies ⋮ On dynamic pricing under model uncertainty ⋮ Information aware max-norm Dirichlet networks for predictive uncertainty estimation ⋮ Divergence-based tests for the bivariate gamma distribution applied to polarimetric synthetic aperture radar ⋮ Hierarchical micro-macro acceleration for moment models of kinetic equations ⋮ Log-mean distribution: applications to medical data, survival regression, Bayesian and non-Bayesian discussion with MCMC algorithm ⋮ Communication-efficient and privacy-preserving large-scale federated learning counteracting heterogeneity ⋮ Conformal mirror descent with logarithmic divergences ⋮ Decay of convolved densities via Laplace transform ⋮ The Kullback-Leibler divergence between lattice Gaussian distributions ⋮ The right complexity measure in locally private estimation: it is not the Fisher information ⋮ Stressing dynamic loss models ⋮ Optimal control of probabilistic Boolean control networks: A scalable infinite horizon approach ⋮ Bit security as computational cost for winning games with high probability ⋮ Relations between dissipated work in non-equilibrium process and the family of Rényi divergences ⋮ Unnamed Item ⋮ Quantum scalar field theory based on an extended least action principle ⋮ Asymptotics for Strassen's optimal transport problem ⋮ Differential privacy: getting more for less ⋮ Learning models with uniform performance via distributionally robust optimization ⋮ Limits on the Efficiency of (Ring) LWE Based Non-interactive Key Exchange ⋮ INFORMATION FRACTAL DIMENSION OF MASS FUNCTION ⋮ Swiveled Rényi entropies ⋮ Convergence rates of deep ReLU networks for multiclass classification ⋮ Fault-Tolerant Fusion Using α-Rényi Divergence for Autonomous Vehicle Localization ⋮ Conditions for the existence of a generalization of Rényi divergence ⋮ Infomax strategies for an optimal balance between exploration and exploitation ⋮ Concentrated Differential Privacy: Simplifications, Extensions, and Lower Bounds ⋮ Characterization of time series via Rényi complexity-entropy curves ⋮ Rényi divergence minimization based co-regularized multiview clustering ⋮ Fast near collision attack on the Grain v1 stream cipher ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Bayesian Brains and the Rényi Divergence ⋮ Sensitivity analysis for rare events based on Rényi divergence ⋮ The computational asymptotics of Gaussian variational inference and the Laplace approximation ⋮ Almost perfect quantum state transfer on isotropic and anisotropic Heisenberg spin chains with tailored site dependent exchange couplings ⋮ Framework based on communicability to measure the similarity of nodes in complex networks ⋮ Concentrated differentially private average consensus algorithm for a discrete-time network with heterogeneous dynamics ⋮ The information-theoretic treatment of spinless particles with the assorted diatomic molecular potential ⋮ Rényi relative entropies of quantum Gaussian states ⋮ On the equivalence of statistical distances for isotropic convex measures ⋮ Consistency and convergence rate of phylogenetic inference via regularization ⋮ Holographic second laws of black hole thermodynamics ⋮ Ordering on the Probability Simplex of Endmembers for Hyperspectral Morphological Image Processing ⋮ Entropy based risk measures ⋮ On variational expressions for quantum relative entropies ⋮ Scalable information inequalities for uncertainty quantification ⋮ On the hardness of module learning with errors with short distributions ⋮ The Augustin capacity and center ⋮ On the maximum values of \(f\)-divergence and Rényi divergence under a given variational distance ⋮ State convertibility in the von Neumann algebra framework ⋮ \(\alpha\)-variational inference with statistical guarantees ⋮ Concentration of tempered posteriors and of their variational approximations ⋮ Generative model of autoencoders self-learning on images represented by count samples ⋮ Towards classical hardness of module-LWE: the linear rank case ⋮ Poisson approximation in \(\chi^2\) distance by the Stein-Chen approach ⋮ Optimal insurance under maxmin expected utility ⋮ Conditionally structured variational Gaussian approximation with importance weights ⋮ The sphere packing bound for memoryless channels ⋮ Logarithmic divergences from optimal transport and Rényi geometry ⋮ Convergence rates of variational posterior distributions ⋮ A Geometric Variational Approach to Bayesian Inference ⋮ Label distribution learning by regularized sample self-representation ⋮ Wasserstein-divergence transportation inequalities and polynomial concentration inequalities ⋮ Measuring diversity in heterogeneous information networks ⋮ Bayesian fractional posteriors ⋮ Rényi divergence and the central limit theorem ⋮ Contagion in Financial Systems: A Bayesian Network Approach ⋮ Uniqueness and characterization theorems for generalized entropies ⋮ Robust mean variance optimization problem under Rényi divergence information ⋮ Chain Rule Optimal Transport ⋮ FL-MAC-RDP: federated learning over multiple access channels with Rényi differential privacy ⋮ Zipf-Mandelbrot law, \(f\)-divergences and the Jensen-type interpolating inequalities ⋮ On stochastic comparisons of finite \(\alpha \)-mixture models ⋮ Variational Representations and Neural Network Estimation of Rényi Divergences ⋮ Improved security proofs in lattice-based cryptography: using the Rényi divergence rather than the statistical distance ⋮ Sub-domain adaptation learning methodology ⋮ A Variational Formula for Risk-Sensitive Reward ⋮ Cramér-Rao lower bounds arising from generalized Csiszár divergences ⋮ A joint Shannon cipher and privacy amplification approach to attaining exponentially decaying information leakage ⋮ Consistency of variational Bayes inference for estimation and model selection in mixtures ⋮ On the Hardness of Learning with Rounding over Small Modulus ⋮ Distance-based tests for planar shape ⋮ Multiple-source adaptation theory and algorithms ⋮ The alpha-mixture of survival functions ⋮ Holographic Rényi relative divergence in JT gravity ⋮ On the convergence of the maximum likelihood estimator for the transition rate under a 2-state symmetric model ⋮ A simple derivation of the refined sphere packing bound under certain symmetry hypotheses ⋮ Infinite-dimensional gradient-based descent for alpha-divergence minimisation ⋮ Nonuniform bounds in the Poisson approximation with applications to informational distances. II ⋮ Unnamed Item ⋮ Price probabilities: a class of Bayesian and non-Bayesian prediction rules ⋮ Convexity and robustness of the Rényi entropy ⋮ On some optimization problems for the Rényi divergence ⋮ Sandwiched Rényi relative entropy on density operators ⋮ Rényi's divergence as a chemical similarity criterion ⋮ Data-driven priors and their posterior concentration rates ⋮ Rényi divergences from Euclidean quenches
This page was built for publication: Rényi Divergence and Kullback-Leibler Divergence
