Statistical Problem Classes and Their Links to Information Theory

DOI10.1080/07474938.2013.807190zbMath1491.62011OpenAlexW1980904396MaRDI QIDQ5080449

Chi Wai Yu, Bertrand S. Clarke, Jennifer Lynn Clarke

Publication date: 31 May 2022

Published in: Econometric Reviews (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1080/07474938.2013.807190

zbMATH Keywords

predictionentropyrelative entropymodel selectionmutual informationinformation theoryBayesianrate distortion\(M\)-closed\(M\)-complete\(M\)-opencodelength

Mathematics Subject Classification ID

Bayesian inference (62F15) Information theory (general) (94A15) Statistical aspects of information-theoretic topics (62B10)

Related Items (1)

Comparison, utility, and partition of dependence under absolutely continuous and singular distributions

Cites Work

• Bagging predictors
• A Mathematical Theory of Communication
• Information optimality and Bayesian modelling
• On the sample information about parameter and prediction
• Multivariate maximum entropy identification, transformation, and dependence
• Asymptotic mean efficiency of a selection of regression variables
• Universal sequential coding of single messages
• Asymptotically efficient selection of the order of the model for estimating parameters of a linear process
• A Bayesian analysis of the minimum AIC procedure
• Likelihood of a model and information criteria
• Estimating the dimension of a model
• On Bayes methods for on-line Boolean prediction
• Bayesian model averaging: A tutorial. (with comments and a rejoinder).
• Manifest characterization and testing for certain latent properties
• Approximations and consistency of Bayes factors as model dimension grows
• A consistency property of the AIC for multivariate linear models when the dimension and the sample size are large
• Universality of Bayesian predictions
• On a Measure of the Information Provided by an Experiment
• Information-theoretic asymptotics of Bayes methods
• Bayes Estimate and Inference for Entropy and Information Index of Fit
• Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation
• Bayesian Estimation and Prediction Using Asymmetric Loss Functions
• An optimal selection of regression variables
• Minimum complexity density estimation
• On the computation of rate-distortion functions (Corresp.)
• Goodness of prediction fit
• Information Criteria for Discriminating Among Alternative Regression Models
• Catching up Faster by Switching Sooner: A Predictive Approach to Adaptive Estimation with an Application to the AIC–BIC Dilemma
• Bayesian Measures of Model Complexity and Fit
• An information criterion for likelihood selection
• Information Distinguishability with Application to Analysis of Failure Data
• Bayes Factors
• Fisher information and stochastic complexity
• Lower bounds on expected redundancy for nonparametric classes
• Information Theoretic Learning
• Prediction, Learning, and Games
• An algorithm for computing the capacity of arbitrary discrete memoryless channels
• Computation of channel capacity and rate-distortion functions
• Note on the Consistency of the Maximum Likelihood Estimate
• On Information and Sufficiency
• Certain Inequalities in Information Theory and the Cramer-Rao Inequality
• Introduction to nonparametric estimation
• Deviance information criteria for missing data models
• A new look at the statistical model identification
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Statistical Problem Classes and Their Links to Information Theory