SubjectsSubjects(version: 945)
Course, academic year 2016/2017
   Login via CAS
Entropy and data compression - NALG110
Title: Entropie a komprese dat
Guaranteed by: Department of Algebra (32-KA)
Faculty: Faculty of Mathematics and Physics
Actual: from 2010 to 2017
Semester: winter
E-Credits: 3
Hours per week, examination: winter s.:2/0, Ex [HT]
Capacity: unlimited
Min. number of students: unlimited
4EU+: no
Virtual mobility / capacity: no
State of the course: not taught
Language: Czech
Teaching methods: full-time
Teaching methods: full-time
Guarantor: prof. RNDr. Petr Kůrka, CSc.
Classification: Informatics > Discrete Mathematics
Mathematics > Mathematics, Algebra, Differential Equations, Potential Theory, Didactics of Mathematics, Discrete Mathematics, Math. Econ. and Econometrics, External Subjects, Financial and Insurance Math., Functional Analysis, Geometry, General Subjects, , Real and Complex Analysis, Mathematics General, Mathematical Modeling in Physics, Numerical Analysis, Optimization, Probability and Statistics, Topology and Category
Annotation -
Last update: T_KA (22.04.2008)
Information and entropy of a random variable, conditional information and entropy, entropy of stationary processes, Markov processes, Markov approximations, Shannon entropy theorem, typical set, the asymptotic equipartition property, compresssion codes, block codes, Kraft inequality, Huffmann code, universal codes, frequency code, recurrence Ziv-Lempel codes, algorithmic complexity.
Literature -
Last update: T_KA (24.04.2008)

T.A.Cover, J.A.Thomas: Elements of Information Theory. Wiley, New York 1991.

Syllabus -
Last update: T_KA (22.04.2008)

Information and entropy of a random variable, conditional information and entropy, entropy of stationary processes, Markov processes, Markov approximations, Shannon entropy theorem, typical set, the asymptotic equipartition property, compresssion codes, block codes, Kraft inequality, Huffmann code, universal codes, frequency code, recurrence Ziv-Lempel codes, algorithmic complexity.

 
Charles University | Information system of Charles University | http://www.cuni.cz/UKEN-329.html