Electrical and Comp Engineerng
EECE 7337: Information Theory
Lecture - 4 credits
ND
EI
IC
FQ
SI
AD
DD
ER
WF
WD
WI
EX
CE
- Discusses basic properties of entropy and mutual information, Shannon's fundamental theorems on data compression and data transmission in the single-user case, binning, and covering lemmas.
- Topics include rate distortion theory, feedback in one-way channels, Slepian-Wolf coding of correlated information sources, source coding with side information at the receiver, multiple access channel and its capacity region, and the capacity region of the Gaussian multiple access channel.
- Also covers broadcast channels, superposition coding, and the capacity region of the degraded broadcast channel; performance and comparison of TDMA, FDMA, and CDMA systems from a theoretical point of view; capacity issues for time-varying channels and channels with memory; relation between information theory and statistics; Stein's lemma; and large deviation theory.
Discusses basic properties of entropy and mutual information, Shannon's fundamental theorems on data compression and data transmission in the single-user case, binning, and covering lemmas. Show more.
Pre-requisites