A generalized class of certainty and information measures
type: Item
instance of: scholarly article
title: A generalized class of certainty and information measures
zbMATH Open document ID: 0553.94005
DOI: 10.1016/0020-0255(84)90034-3
author: J. C. A. van der Lubbe
author: Y. Boxma
author: D. E. Boekee
published in: Information Sciences
publication date: 1984-01-01T00:00:00Z
review text: The objective of the paper is to introduce a generalized probabilistic theory of discrete information measures. Within this framework, information measures are developed with the help of certainty measures. The authors give a definition of a generalized measure of average certainty. In the characterization theorem, the property of multiplicativity (for independent stochastic experiments) plays an important role. Other properties of the certainty measure are also studied. As a special case, the quadratic certainty measure (information energy) is obtained: \(\sum^{n}_{i=1}p^ 2_ i\), for \(p_ i\geq 0\), \(i=1,...,n,\) \(\sum^{n}_{i=1}p_ i=1.\) Another section of the paper deals with the relation between certainty and information, and discusses the various methods in order to obtain measures of information based on the certainty measure. The characterization theorem for the information measures H(X) makes use of the following axiom: for stochastically independent experiments X, Y it holds that \(H(XY)=H(X)+H(Y)+cH(X)H(Y),\) \(c\in {\mathbb{R}}\). This axiom (pseudoadditivity) is a direct consequence of the multiplicativity property of the certainty measure. Properties of the general classes of information measures are also studied. As special cases, there may be obtained most of the presently known information measures.
Mathematics Subject Classification ID: 94A17
zbMATH DE Number: 3882334
zbMATH Keywords: generalized probabilistic theory of discrete information measures
zbMATH Keywords: certainty measures
zbMATH Keywords: information energy
reviewed by: R. Andonie
MaRDI profile type: Publication
full work available at URL: 0020-0255(84)90034-3
OpenAlex ID: W1975409008
cites work: Q5611520
cites work: Information-theoretical considerations on estimation problems
cites work: On the Existence of Absolute Primes
cites work: Some aspects of error bounds in feature selection
cites work: The R-norm information measure
cites work: On information and distance measures, error bounds, and feature selection
cites work: Q4186205
cites work: Generalized information functions
cites work: Q4159303
cites work: Q4039929
cites work: Q5564905
cites work: Entropy, inaccuracy and information
cites work: Q5519673
cites work: Q5675177
cites work: Generalized entropies in coding theory
cites work: Q3292859
cites work: A Mathematical Theory of Communication
cites work: On amount of information of type-\(\beta\) and other measures
cites work: Q4149663
cites work: Order preserving measures of information
cites work: Measurement of Diversity
cites work: An axiomatic theory of heterogeneity and homogeneity
cites work: Q5606390
description: scientific article; zbMATH DE number 3882334