COMP6261
Information Theory
- Credit
- 6 units
- Catalogue year
- 2027
- Recorded offerings
- Second Semester
Course information
Information theory studies the fundamental limits of the representation and transmission of information. This course provides an introduction to information theory, studying fundamental concepts such as probability, information, and entropy and examining their applications in the areas of data compression, coding, communications, pattern recognition and probabilistic inference.
Requisite and Incompatibility
You cannot enrol in this course if you have completed COMP2610 or ENGN8534.
Learning Outcomes
Upon successful completion, students will have the knowledge and skills to:
Understand and apply fundamental concepts in information theory such as probability, entropy, information content and their inter-relationships.
Understand the principles of data compression.
Compute entropy and mutual information of random variables.
Implement and analyse basic coding and compression algorithms.
Understand the relationship of information theoretical principles and Bayesian inference in data modelling and pattern recognition.
Understand some key theorems and inequalities that quantify essential limitations on compression, communication and inference.
Know the basic concepts regarding communications over noisy channels.
Saved ANU Programs & Courses information, 2027. Future offerings are indicative. Checks use the saved requirements and your fictional academic record.
Saved requirements encoded for automatic checks. See your requirement checks for what can be decided.
Course library: sources, offering dates and related entries
Read the full published course information ↗
Who reviews permission requests?
Dr Leo Brandt is the fictional reviewer assigned to COMP6261 in this prototype. The selected course determines where a request goes.
Make this part of your semester
Sign in to check your fictional academic record, save this offering, and request permission if needed.
Sign in