EEEN3017J Information theory & coding

Academic Year 2021/2022

Information theory is the mathematical theory that deals with the fundamental aspects of communication systems.
Its goal is not to deliver practical solutions to communications problems, but rather to place fundamental limits (upper bounds essentially) on the achievable communication data rates for a given channel.
In the context of this module "coding" is the study of operations & procedures applied to the source data so as to realize reliable communications - the hope is that the achieved rate for a particular coding scheme approaches that suggested by information theory.
Together Information Theory and Coding can be considered the foundations of almost all modern communication systems.

Show/hide contentOpenClose All

Curricular information is subject to change

Learning Outcomes:

The basics of Information Theory
Channel capacities of various channels
Exposure to some modern code, e.g. RS and LDPC codes
Techniques for encoding and decoding
Simulation of communication systems including channel, coding and decoders

Indicative Module Content:

1. A review of Probability & Statistics
2. Entropy & Mutual information
3. Brief discussion of source coding / data compression including Huffman coding
4. Wireless channel descriptions (AWGN, Rayleigh, MIMO)
5. Shannon's famous theory: Capacity of an AWGN channel
6. Extension to more complex channels
7. Convolutional codes & the Viterbi algorithm
8. Block codes & decoding techniques

Student Effort Hours: 
Student Effort Type Hours
Lectures

36

Laboratories

16

Total

52

Approaches to Teaching and Learning:
Lectures where material is explained coupled with Matlab based assignments where the students see first had the principles of information theory and coding.
 
Requirements, Exclusions and Recommendations

Not applicable to this module.


Module Requisites and Incompatibles
Required:
BDIC1034J - College English 1, BDIC1035J - College English 2, BDIC1036J - College English 3, BDIC1037J - College English 4, BDIC1047J - English for Uni Studies BDIC, BDIC1048J - English Gen Acad Purposes BDIC, BDIC2007J - English for Spec Acad Purposes, BDIC2015J - Acad Wrt & Comm Skills


 
Assessment Strategy  
Description Timing Open Book Exam Component Scale Must Pass Component % of Final Grade
Examination: End of term exam 2 hour End of Trimester Exam No Alternative linear conversion grade scale 40% No

70

Continuous Assessment: MATLAB based assignments Throughout the Trimester n/a Alternative linear conversion grade scale 40% No

30


Carry forward of passed components
Yes
 
Remediation Type Remediation Timing
In-Module Resit Prior to relevant Programme Exam Board
Please see Student Jargon Buster for more information about remediation types and timing. 
Feedback Strategy/Strategies

• Group/class feedback, post-assessment

How will my Feedback be Delivered?

Not yet recorded.

Name Role
Dr Barry Cardiff Lecturer / Co-Lecturer
Mr Vaibhav Kumar Lecturer / Co-Lecturer
Dr Anshu Mukherjee Lecturer / Co-Lecturer
Dr Avishek Nag Lecturer / Co-Lecturer
Dr Pasika Ranaweera Lecturer / Co-Lecturer
Dr Xiping Wu Lecturer / Co-Lecturer