Elements of Information Theory (UESTC) UESTCHN3010

  • Academic Session: 2023-24
  • School: School of Engineering
  • Credits: 8
  • Level: Level 3 (SCQF level 9)
  • Typically Offered: Semester 1
  • Available to Visiting Students: No

Short Description

This course introduces basic theories and analytical methods for communication system, including the concept of information, entropy of discrete information source, lossless source coding, channel capacity and channel coding.

Timetable

Course will be delivered continuously in the traditional manner at UESTC.

Requirements of Entry

Mandatory Entry Requirements

None

Recommended Entry Requirements

None

Excluded Courses

None

Co-requisites

None

Assessment

Assessment

Total  Coursework15%+Project Output10%+ Final Examination75%

Reassessment

In accordance with the University's Code of Assessment reassessments are normally set for all courses which do not contribute to the honours classifications. For non honours courses, students are offered reassessment in all or any of the components of assessment if the satisfactory (threshold) grade for the overall course is not achieved at the first attempt. This is normally grade D3 for undergraduate students, and grade C3 for postgraduate students. Exceptionally it may not be possible to offer reassessment of some coursework items, in which case the mark achieved at the first attempt will be counted towards the final course grade. Any such exceptions are listed below in this box.

 

Due to the nature of the coursework and sequencing of courses, it is not possible to reassess the coursework laboratory and/or projects.

Main Assessment In: December

Are reassessment opportunities available for all summative assessments? No

Reassessments are normally available for all courses, except those which contribute to the Honours classification. For non-Honours courses, students are offered reassessment in all or any of the components of assessment if the satisfactory (threshold) grade for the overall course is not achieved at the first attempt. This is normally grade D3 for undergraduate students and grade C3 for postgraduate students. Exceptionally it may not be possible to offer reassessment of some coursework items, in which case the mark achieved at the first attempt will be counted towards the final course grade. Any such exceptions for this course are described below. 

 

Due to the nature of the coursework and sequencing of courses, it is not possible to reassess the coursework laboratory and/or project.

 

The initial grade on coursework laboratories will be used when calculating the resit grade.

 

Reassessment is offered only to meet the special requirement that all courses must be passed for graduation in this programme.

Course Aims

This course aims to instill the concepts of information and their application to communication to develop a foundation for the analysis of engineering systems.

Intended Learning Outcomes of Course

By the end of this course students will be able to:

■ Explain the entropy, and it' s properties for various of discrete information source. 

■ Generalize the idea of average mutual information to explain channel capacity of discrete and continuous channel, and apply the Shannon capacity formula to typical continuous channel.

■ Recognise the characteristics of lossless source coding and channel coding and linear block codes based on Shannon coding theorem.

■ Explain the rate distortion theory for single/multiple-symbol information source with Shannon's Third theorem.

Minimum Requirement for Award of Credits

Students must submit at least 75% by weight of the components (including examinations) of the course's summative assessment. In addition students must submit work for assessment for the course project or a grade of credit withheld will be given.

 

Note that these are minimum requirements: good students will achieve far higher participation/submission rates. Any student who misses an assessment or a significant number of classes because of illness or other good cause should report this by completing a MyCampus absence report.