SubjectsSubjects(version: 945)
Course, academic year 2016/2017
   Login via CAS
Statistics and Information Theory - NEVF143
Title: Statistika a teorie informace
Guaranteed by: Department of Surface and Plasma Science (32-KFPP)
Faculty: Faculty of Mathematics and Physics
Actual: from 2005 to 2016
Semester: winter
E-Credits: 3
Hours per week, examination: winter s.:2/0, Ex [HT]
Capacity: unlimited
Min. number of students: unlimited
4EU+: no
Virtual mobility / capacity: no
State of the course: taught
Language: Czech
Teaching methods: full-time
Teaching methods: full-time
Guarantor: prof. RNDr. Ivan Ošťádal, CSc.
doc. RNDr. Pavel Kocán, Ph.D.
Annotation -
Last update: T_KEVF (09.05.2005)
Stochastic processes and quantities, statistical characteristics, Wiener-Khinchin theorem, cumulative statistical systems, dispersion theorem. Evolution of concepts for studying fluctuations, Brownian motion, Langevin equation, noise. Introduction into information theory, uncertainty and entropy, distorted signal, information loss, rate of transmission, Gabor's theorem, signal sampling, signal to noise ratio.
Literature - Czech
Last update: T_KEVF (09.05.2005)

J. Prchal, Signály a soustavy, SNTL, Praha, 1987.

V. Matiáš, Měření, analýza a vytváření náhodných procesů, SNTL, Praha, 1976.

D.A. Bell, Teorie informace a její použití v technice, TKI, SNTL, Praha, 1961.

A. van der Ziel, History of Noise Research, Advances in Electronics, 50 (1980) 351-409.

C. E. Shannon, A mathematical theory of communication, The Bell Systém Tech. J. 27 (1948) 379-423, 623-656.

Syllabus -
Last update: T_KEVF (15.05.2005)
1. Introduction into probability theory and statistics.
Random processes, ergodic processes, distribution function, probability density fuction. Characteristic function, statistical moments, correlation function, power spectrum, spectral density function, Wiener - Khinchin theorem, characteristics of stochastic processes - errors of estimation. Composed statistical systems, dispersion theorem.

2. Using random processes for system identification - principles.
Methods for measurements of statistical characteristics. Fluctuations in physics, electrical noise. Evolution of concepts for studying fluctuations, Brownian motion, Langevin equation. Physical quantities for description of a fluctuating system. Types of noise in physical systems. Dynamics of a system and power spectral density.

3. Introduction into information theory.
Uncertainty and entropy, entropy of source, channel capacity, noiseless channel, channel with noise, information loss, rate of transmission, signal sampling, Gabor's theorem, information content of a signal, signal to noise ratio.

 
Charles University | Information system of Charles University | http://www.cuni.cz/UKEN-329.html