The minimum description length principle in coding and modeling
From MaRDI portal
Publication:4701208
DOI10.1109/18.720554zbMath0933.94013OpenAlexW2102098892WikidataQ105584743 ScholiaQ105584743MaRDI QIDQ4701208
Bin Yu, Jorma Rissanen, Andrew R. Barron
Publication date: 21 November 1999
Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1109/18.720554
estimationstatistical inferenceminimum description lengthuniversal codingstochastic complexitysource codingGaussian linear regressioncontext treeShannonuniversal modeling
Research exposition (monographs, survey articles) pertaining to information and communication theory (94-02) Statistical aspects of information-theoretic topics (62B10) Coding theorems (Shannon theory) (94A24) Source coding (94A29)
Related Items
Information optimality and Bayesian modelling, The Whole and the Parts: The Minimum Description Length Principle and the A-Contrario Framework, Application of the evidence procedure to the estimation of wireless channels, A linear-time algorithm for computing the multinomial stochastic complexity, Maximum L\(q\)-likelihood estimation, Bayesian Ying-Yang Harmony Learning for Local Factor Analysis: A Comparative Investigation, Suboptimal behavior of Bayes and MDL in classification under misspecification, A comparative investigation on model selection in independent factor analysis, VoCSK: verb-oriented commonsense knowledge mining with taxonomy-guided induction, Divergence rates of Markov order estimators and their application to statistical estimation of stationary ergodic processes, Consistent estimation of the number of regimes in Markov-switching autoregressive models, Schwarz, Wallace, and Rissanen: Intertwining Themes in Theories of Model Selection, Bayesian definition of random sequences with respect to conditional probabilities, Predicting a binary sequence almost as well as the optimal biased coin, Minimax rates for conditional density estimation via empirical entropy, Optimal shrinkage estimation of predictive densities under \(\alpha\)-divergences, User-friendly Introduction to PAC-Bayes Bounds, Minimum description length for selection of models of musical rhythm, Algorithmic randomness and monotone complexity on product space, Game-theoretic statistics and safe anytime-valid inference, Spline local basis methods for nonparametric density estimation, Selecting amongst multinomial models: an apologia for normalized maximum likelihood, Optional stopping with Bayes factors: a categorization and extension of folklore results, with an application to invariant situations, Empirical Bayes predictive densities for high-dimensional normal models, Exemplar-based low-rank matrix decomposition for data clustering, Chentsov's theorem for exponential families, Textual data compression in computational biology: algorithmic techniques, Catching up Faster by Switching Sooner: A Predictive Approach to Adaptive Estimation with an Application to the AIC–BIC Dilemma, A study of regularized Gaussian classifier in high-dimension small sample set case based on MDL principle with application to spectrum recognition, Consistency of discrete Bayesian learning, A Locally Optimal Algorithm for Estimating a Generating Partition from an Observed Time Series and Its Application to Anomaly Detection, Unnamed Item, GARCH model selection criteria, Unnamed Item, Relevant states and memory in Markov chain bootstrapping and simulation, A COMPARATIVE STUDY OF INFORMATION CRITERIA FOR MODEL SELECTION, Jeffreys versus Shtarkov distributions associated with some natural exponential families, A comparative investigation on subspace dimension determination, A Computationally Efficient Method for Nonparametric Modeling of Neural Spiking Activity with Point Processes, Explanatory and creative alternatives to the MDL principle, Model selection by sequentially normalized least squares, Nonlinear system identification via Laguerre network based fuzzy systems, Finding large average submatrices in high dimensional data, Automatically finding clusters in normalized cuts, Sparse regularization for semi-supervised classification, Context tree selection: a unifying view, Compact representations as a search strategy: compression EDAs, Accumulative prediction error and the selection of time series models, Model selection by normalized maximum likelihood, An empirical study of minimum description length model selection with infinite parametric complexity, Model selection for the rate problem: a comparison of significance testing, Bayesian and minimum description length statistical inference, Between order and chaos: The quest for meaningful information, A minimum description length approach to hidden Markov models with Poisson and Gaussian emissions. Application to order identification, Uncertainty quantification for principal component regression, Structural changes estimation for strongly dependent processes, Choosing a Model Selection Strategy, On some properties of the NML estimator for Bernoulli strings, Computable Bayesian Compression for Uniformly Discretizable Statistical Models, NOISY SIGNAL COMPRESSION BY WAVELET TRANSFORM WITH OPTIMAL DOWNSAMPLING, Minimum description length revisited, Consistency of the BIC order estimator, Applying MDL to learn best model granularity, The consistency of the BIC Markov order estimator., Joint Determination of the State Dimension and Autoregressive Order for Models with Markov Regime Switching
