ACM41020 Maths of Machine Learning

Academic Year 2023/2024

The aim of this course is to introduce the concepts in Numerical Linear Algebra and Optimisation on which Machine Learning is based.

Show/hide contentOpenClose All

Curricular information is subject to change

Learning Outcomes:

By the end of the module the student should be able to:
- Describe the problem of machine learning from the point of view of function approximation, optimisation, linear algebra, and statistics.
- Identify the most suitable approach for a given machine learning problem.
- Analyse the performance of various machine learning algorithms from the point of view of computational complexity and statistical accuracy.
- Implement a simple neural network architecture and apply it to a pattern recognition task.

Indicative Module Content:

Material will cover the following mathematical topics relevant to Machine Learning:

Highlights from Linear Algebra
- Matrix multiplication
- The four fundamental subspaces
- Types of Matrix
- Matrix factorisation
- Eigenvalues and eigenvectors
- Symmetric, positive definite matrices
- Singular values and singular value decomposition
- Vector and matrix norms

Understanding data
- Linear regression
- Principal component analysis

Support vector machines
- Introduction to support vector machines
- Optimisation
- Lagrange multipliers
- Limitations
- Soft margins
- Kernel trick
- Multiple classes

Neural networks
- Introduction to neural networks
- Activation functions
- Architecture of a neural network
- Training a neural network
- Calculus on computational graphs
- Efficient matrix multiplication
- Backpropagation
- Universal approximation theorem
- Cross-entropy cost function

- Introduction to optimisation
- Gradient descent
- Newton's method
- Momentum
- Stochastic gradient descent
- Adaptive methods

Student Effort Hours: 
Student Effort Type Hours
Specified Learning Activities


Autonomous Student Learning






Approaches to Teaching and Learning:
Lectures, Problem Classes, Assignments 
Requirements, Exclusions and Recommendations

Not applicable to this module.

Module Requisites and Incompatibles
Not applicable to this module.
Assessment Strategy  
Description Timing Open Book Exam Component Scale Must Pass Component % of Final Grade In Module Component Repeat Offered
Multiple Choice Questionnaire (Short): Weekly short MCQs Throughout the Trimester n/a Standard conversion grade scale 40% No


Practical Examination: Computer-based coding exam Week 12 n/a Standard conversion grade scale 40% No


Examination: 2 hour End of Trimester Exam 2 hour End of Trimester Exam No Standard conversion grade scale 40% No


Continuous Assessment: Assignments Varies over the Trimester n/a Standard conversion grade scale 40% No



Carry forward of passed components
Resit In Terminal Exam
Spring Yes - 2 Hour
Please see Student Jargon Buster for more information about remediation types and timing. 
Feedback Strategy/Strategies

• Feedback individually to students, post-assessment
• Group/class feedback, post-assessment
• Online automated feedback

How will my Feedback be Delivered?

Not yet recorded.