Relations between entropy and error probability

DOI10.1109/18.272494zbMath0802.94004OpenAlexW2099294566MaRDI QIDQ4307306

Neri Merhav, Meir Feder

Publication date: 4 October 1994

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL: https://semanticscholar.org/paper/3c0e6c724fcd9f76182efae5d2b1fd0de6f1bd44

zbMATH Keywords

entropyupper boundconditional entropypredictabilityequivocationdiscrete memoryless channelschannel coding theoremminimal error probability

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Error probability in coding theory (94B70)

Related Items

Unnamed Item ⋮ Using entropy for quantitative measurement of operational complexity of supplier-customer system: case studies ⋮ Joint Markov blankets in feature sets extracted from wavelet packet decompositions ⋮ Increasing and decreasing returns and losses in mutual information feature subset selection ⋮ Quantifying Stimulus Discriminability: A Comparison of Information Theory and Ideal Observer Analysis ⋮ A fast separability-based feature-selection method for high-dimensional remotely sensed image classification ⋮ Using a VOM model for reconstructing potential coding regions in EST sequences ⋮ Unnamed Item ⋮ Measuring the efficiency of the intraday Forex market with a universal data compression algorithm ⋮ Unnamed Item ⋮ Further results on generalized conditional entropies ⋮ Information diagrams in the study of entanglement in symmetric multi-qudit systems and applications to quantum phase transitions in Lipkin-Meshkov-Glick \(D\)-level atom models ⋮ Identification and Prediction