Elements of Information Theory

DOI10.1002/047174882XzbMath1140.94001MaRDI QIDQ5490912

Thomas M. Cover, Joy A. Thomas

Publication date: 4 October 2006

zbMATH Keywords

spectral estimationdata compressionhypothesis testingthermodynamicslaw of large numbersKolmogorov complexityFisher informationGaussian channelmaximum entropyinformation theoryTuring machinehalting problemprobability theoryuniversal codingerror probabilitychannel capacityside informationHamming codesasymptotic equipartition propertylarge deviation theorymultiple access channelChernoff boundKraft inequalityrate distortion theorycorrelated sourcesSlepian-Wolf theorembroadcast channelFano's inequalitycoding theoremnetwork information theorymethod of typeschannel coding theoremmulti-user information theoryrelay channelCramer Rao inequalityinference channelNeyman Pearson lammaShannon-Fano-Elias codingsource codestwo way channel

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Information theory (general) (94A15) Statistical aspects of information-theoretic topics (62B10) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to information and communication theory (94-01) Rate-distortion theory in information and communication theory (94A34)