scientific article

Publication date: 17 September 1992

Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.

entropy relative entropy mutual information conditional entropy discrimination sources coding theorems channels conditional information probability information measures Shannon's mathematical theory of communication

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Information theory (general) (94A15) Statistical aspects of information-theoretic topics (62B10) Channel models (including quantum) in information and communication theory (94A40) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to information and communication theory (94-01) Coding theorems (Shannon theory) (94A24) Source coding (94A29)

Related Items

The Markov approximation of the sequences of \(N\)-valued random variables and a class of small deviation theorems., Statistical mechanics of choice: MaxEnt estimation of population heterogeneity, On information gain, Kullback-Leibler divergence, entropy production and the involution kernel, A Dynamical Point of View of Quantum Information: Entropy and Pressure, Asymptotics of input-constrained binary symmetric channel capacity, On Shannon’s Duality of a Source and a Channel and Nonanticipative Communication and Communication for Control, An inexact accelerated proximal gradient method and a dual Newton-CG method for the maximal entropy problem, Measuring synchronization in coupled model systems: a comparison of different approaches, Pricing strategy versus heterogeneous shopping behavior under market price dispersion, Variational characterization of the critical curve for pinning of random polymers, A sufficient condition for a unique invariant distribution of a higher-order Markov chain, Compressibility analysis of asymptotically mean stationary processes, Shannon information and power law analysis of the chromosome code, Calculation of the anisotropic norm of the descriptor system, Anisotropy-based robust performance analysis of finite horizon linear discrete time varying systems, Solution of the stochastic \(H_{\infty }\)-optimization problem for discrete time linear systems under parametric uncertainty, Information dependency: strong consistency of Darbellay-Vajda partition estimators, Computational mechanics of input-output processes: structured transformations and the \(\epsilon\)-transducer, Stochastic models for plant microtubule self-organization and structure, Shannon's Entropy and Its Generalisations Towards Statistical Inference in Last Seven Decades, Complexities of information sources, Shannon information entropy for a quantum nonlinear oscillator on a space of non-constant curvature, Information-theoretic approach to the problem of automatic image recognition, Robustness to Incorrect System Models in Stochastic Control, On the convergence of Shannon differential entropy, and its connections with density and entropy estimation, The equality of Kolmogorov-Sinai entropy and metric permutation entropy generalized, Some estimations of the Jensen difference and applications, Decomposition of Kullback-Leibler risk and unbiasedness for parameter-free estimators, Fractional derivatives and negative probabilities, Dynamics of Bayesian updating with dependent data and misspecified models, Automatic human gait imitation and recognition in 3D from monocular video with an uncalibrated camera, A multidimensional scaling analysis of musical sounds based on pseudo phase plane, The resampling of entropies with the application of biodiversity, Application of wavelet entropy to predict atrial fibrillation progression from the surface ECG, Approximation of stationary processes by hidden Markov models, A strong limit theorem for functions of continuous random variables and an extension of the Shannon-McMillan theorem, Annealing and the normalized \(N\)-cut, Monitoring threshold functions over distributed data streams with node dependent constraints, Gelfand-Yaglom-Perez theorem for generalized relative entropy functionals, Robustness to Approximations and Model Learning in MDPs and POMDPs, Simple one-shot bounds for various source coding problems using smooth Rényi quantities, Some Shannon-McMillan approximation theorems for Markov chain field on the generalized Bethe tree, Varying \(c\) and particle horizons, Distance, correlation and mutual information among portraits of organisms based on complete genomes, Random fractional generalized Airy differential equations: a probabilistic analysis using mean square calculus, Euclidean forward-reverse Brascamp-Lieb inequalities: finiteness, structure, and extremals, Information divergence estimation based on data-dependent partitions, Evolution of altruism in spatial prisoner's dilemma: intra- and inter-cellular interactions, Multiphase flow modeling with density functional method, Recall and reasoning -- an information theoretical model of cognitive processes, The permutation entropy rate equals the metric entropy rate for ergodic information sources and ergodic dynamical systems, Minimax Optimal Procedures for Locally Private Estimation, Redundancies in the Earth's climatological time series, On the tightness of linear policies for stabilization of linear systems over Gaussian networks, Double variational principle for mean dimension with potential, Noise-induced chaos and phase space flux, Multiscale fractional-order approximate entropy analysis of financial time series based on the cumulative distribution matrix, Multiconcept classification of diagnostic knowledge to manufacturing systems: Analysis of incomplete data with continuous-valued attributes, Ergodicity Conditions for Controlled Stochastic Nonlinear Systems under Information Constraints: A Volume Growth Approach, Asymptotic stability of beneš filters, A note on the information content of a consistent pairwise comparison judgment matrix of an AHP decision maker, Generalized twin Gaussian processes using Sharma-Mittal divergence, Optimal data compression algorithm, Stationary and Ergodic Properties of Stochastic NonLinear Systems Controlled over Communication Channels, On signal representations within the Bayes decision framework, Robustness to Incorrect Priors in Partially Observed Stochastic Control, Unnamed Item, Double variational principle for mean dimension, Counting distinctions: on the conceptual foundations of Shannon's information theory, Variational Bayesian identification and prediction of stochastic nonlinear dynamic causal models, Design of Information Channels for Optimization and Stabilization in Networked Control, Algebraic and Shannon entropies of commutative hypergroups and their connection with information and permutation entropies and with calculation of entropy for chemical algebras, Analysis of time series through complexity-entropy curves based on generalized fractional entropy, Symbolic dynamics in mean dimension theory, Privacy Aware Learning, Lumpings of Markov chains, entropy rate preservation, and higher-order lumpability, Applying Shannon’s information theory to the measurement and analysis of financial statements, A Short Note on Almost Sure Convergence of Bayes Factors in the General Set-Up, Robustness to incorrect models and data-driven learning in average-cost optimal stochastic control