entropy and mutual information, the asymptotic equipartition principle, entropy for stochastic processes (entropy rate), introduction to data compression and source coding, channel capacity and coding for noisy channels, capacity for different channel models (with emphasis on discrete memoryless channels and Gaussian channels), finite field theory, design and analysis of error correcting codes (with a focus on linear block codes), introduction to network information theory
FEO3210 Information Theory 12.0 credits
Information for research students about course offerings
Given in period 4 every odd year.
Course offerings are missing for current or upcoming semesters.
Headings with content from the Course syllabus FEO3210 (Spring 2019–) are denoted with an asterisk ( )
Content and learning outcomes
Course contents
Intended learning outcomes
After the course, the student should be able to:
- describe the general principles of information theory
- explain fundamental concepts such as entropy, mutal information, capacity, compression, coding theorem, coding and codes, basic algebraic coding theory
- formulate and prove the most fundamental coding theorems
- design a linear code that meets given requirements on rate and minimum distance
- explain how information theory and coding contributes to modern communications technology
- solve advanced problems in the area
- do research using tools from information theory
Literature and preparations
Specific prerequisites
Mandatory Prerequisites
· Signals and systems corresponding to EQ1100 “Signaler och System”
· Stochastic processes and signal theory corresponding to EQ1220 “Signalteori”
Recommended
· Digital communications corresponding to EQ2310 “Digital Communications”
Recommended prerequisites
Mandatory Prerequisites
· Signals and systems corresponding to EQ1100 “Signaler och System”
· Stochastic processes and signal theory corresponding to EQ1220 “Signalteori”
Recommended
· Digital communications corresponding to EQ2310 “Digital Communications”
Equipment
No information inserted
Literature
No information inserted
Examination and completion
If the course is discontinued, students may request to be examined during the following two academic years.
Grading scale
P, F
Examination
- EXA1 - Examination, 12.0 credits, grading scale: P, F
Based on recommendation from KTH’s coordinator for disabilities, the examiner will decide how to adapt an examination for students with documented disability.
The examiner may apply another examination format when re-examining individual students.
Other requirements for final grade
The main focus is on homework problems. Each assignment (set of homework problems) will be graded according to (thresholds given are approximate):
-1: less than 5% of assignment solved correctly
0: between 5% and 40% of assignment solved correctly
1: between 40% and 80% of assignment solved correctly
2: more than 80% of assignment solved correctly
There are 11 assignments in total, and the threshold for receiving grade ”Pass” is 15 points. An additional requirement to receive grade ”Pass” is to review and present a journal paper in the field.
Opportunity to complete the requirements via supplementary examination
No information inserted
Opportunity to raise an approved grade via renewed examination
No information inserted
Examiner
Ethical approach
- All members of a group are responsible for the group's work.
- In any assessment, every student shall honestly disclose any help received and sources used.
- In an oral assessment, every student shall be able to present and answer questions about the entire assignment and solution.
Further information
Course room in Canvas
Registered students find further information about the implementation of the course in the course room in Canvas. A link to the course room can be found under the tab Studies in the Personal menu at the start of the course.
Offered by
Main field of study
This course does not belong to any Main field of study.
Education cycle
Third cycle
Add-on studies
No information inserted
Contact
Mikael Skoglund