COMP8650

Advanced Topics in Machine Learning

Credit
6 units
Catalogue year
2027
Recorded offerings
First Semester

Course information

This course explores a selected area relevant to statistical machine learning in depth, and will be taught by an SML staff member of internationally recognised standing and research interest in that area. Based on current SML staffing, this will be one of:kernel methodsstructured probabilistic modelsreinforcement learningconvex analysis and optimisationtopics in information theorydecision theorydeep learning differentiable optimisation in deep learningOver the past several years the content has alternated between “convex analysis and optimisation” and “differentiable optimisation in deep learning". Students should contact the course convenor to find out what topic is planned for the coming semester.

Requisite and Incompatibility

To enrol in this course you must have completed COMP6670 Introduction to Machine Learning or COMP8600 Statistical Machine Learning. Additional Prerequisite courses for the Advanced Topic will be listed on the SoCo website (Special Topics in Computing page ) when the course topic is announced. Students who meet the pre-requisites can request a permission code following the instructions for Enrolling in CECC courses.

Learning Outcomes

Upon successful completion, students will have the knowledge and skills to:

Distinguish definitions of key concepts in convex analysis, including convexity of sets and functions, subgradients, and the convex dual

Produce a formal optimization problem from a high-level description and determine whether the problem is convex

Recognize standard convex optimization problems such as linear programs and quadratic programs

Derive results about convex functions such as Jensen’s inequality

Derive the standard (dual) quadratic program for support vector machines and understand the extension to max-margin methods for structured prediction

Implement and analyse gradient descent algorithms such as stochastic gradient descent and mirror descent

Understanding advanced concepts in deep learning and relate them to principles from convex optimisation

Implement a simple algorithms and differentiable models using a common deep learning framework (such as PyTorch)

Saved ANU Programs & Courses information, 2027. Future offerings are indicative. Checks use the saved requirements and your fictional academic record.

Some conditions may need additional evidence or clarification. See your requirement checks for what can be decided.

Course library: sources, offering dates and related entries

Read the full published course information ↗

Who reviews permission requests?

Dr Mara Quinn is the fictional reviewer assigned to COMP8650 in this prototype. The selected course determines where a request goes.

Make this part of your semester

Sign in to check your fictional academic record, save this offering, and request permission if needed.

Sign in