The course covers the fundamental concepts of information theory, error-correcting codes and communication complexity.
Last update: IUUK (27.01.2015)
Přednáška pokrývá základy teorie informace, samoopravných kódů a komunikační složitosti.
Předpokládají se znalosti na úrovni předmětu Pravděpodobnostní techniky.
Literature -
Last update: IUUK (27.01.2015)
· T.M. Cover, J.A. Thomas, Elements of Information Theory. John Wiley & Sons, 2nd edition, 2006.
· F.J. MacWilliams, N.J.A. Sloane, The theory of error correcting codes. North-Holland, Amsterdam, 1981.
· E. Kushilevitz, N. Nisan, Communication Complexity. Cambridge University Press, 1997.
· J.H. van Lint, Introduction to coding theory. Springer, 3rd edition, 1998.
Last update: IUUK (27.01.2015)
· T.M. Cover, J.A. Thomas, Elements of Information Theory. John Wiley & Sons, 2nd edition, 2006.
· F.J. MacWilliams, N.J.A. Sloane, The theory of error correcting codes. North-Holland, Amsterdam, 1981.
· E. Kushilevitz, N. Nisan, Communication Complexity. Cambridge University Press, 1997.
· J.H. van Lint, Introduction to coding theory. Springer, 3rd edition, 1998.
Syllabus -
Last update: IUUK (27.04.2015)
Information Theory
· Information, entropy, mutual information
· Relative information and its properties
· Data compression - Shannon-Fano code, Huffman code
· Kolmogorov complexity, Kolmogorov information, symmetry of Kolmogorov information
Error-Correcting Codes
· Data transmission over a noisy channel, channel capacity, Shannon's theorems
