Overview

This is an introductory grad course on machine learning. Machine learning is a set of techniques that allow machines to learn from data and experience, rather than requiring humans to specify the desired behavior by hand. Over the past two decades, machine learning techniques have become increasingly central both in AI as an academic field, and in the technology industry. This course provides a broad introduction to some of the most commonly used ML algorithms.

The first half of the course focuses on supervised learning. We begin with nearest neighbours, decision trees, and ensembles. Then we introduce parametric models, including linear regression, logistic and softmax regression, and neural networks. We then move on to unsupervised learning, focusing in particular on probabilistic models, but also principal components analysis and K-means. Finally, we cover the basics of reinforcement learning.

We will have a single section, taught on Thursdays from 10‐12 EST. Lectures will be delivered online synchronously and students will have the opportunity to ask questions and participate. Recordings for those unable to attend will be posted internally on MyMedia. The tutorials of this course will be the flipped classroom model, students are to follow the self-study guide here before each tutorial and tutorials will be Q/A office hours delivered online synchronously. Tutorials will be held at Tuesdays 10pm and Fridays 10am EST so that it'll work for every time zone. You only need to attend one of the two each week.

Students will be required to attend two course meeting times for synchronous assessments, including the midterm and the final project presentation. The midterm is on Oct 22th (detailed time TBD) and the final project presentation will be during lecture time on week 13 Dec 10th 10am-12am EST.

Where and When

Lecture and tutorials will be held online. A link will be provided

Lecture Time Tutorial Time Lecture/Tutorial "Room" Start End
Thursday, 10am-12am EST Tuesday 10pm & Friday 10am EST Online, find details on Quercus Sept. 10 Dec. 3

Contact

Policies

Prerequisites (an undergrad course in each is sufficient):

Marking Scheme.

Collaboration policy. You are expected to work on the homeworks by yourself. You should not discuss them with anyone except the TAs or the instructor. A team of two is allowed for the final project.

Academic Integrity. By this point in your studies, you've heard this lots of times, so we'll keep it brief: avoid academic offenses (i.e. cheating). All graded work in this course is individual work.

Lateness. Homeworks will be accepted up to 3 days late, but 10% will be deducted for each day late, rounded up to the nearest day.

Remarks. Remark requests for homeworks should be made through MarkUS, and will be considered by the same TA who marked the assignment. The deadline for requesting a remark is typically one week after the marked assignments are returned. Remark requests for exams will be handled by the instructor; details to be announced later.

Exceptions. Exceptions to the course policies such as late homeworks or missed tests require permission of the instructor. For medical excuses, you should obtain an official Student Medical Certificate.

Auditing. This year due to the pandemic everything is moved online and access is only granted to enrolled students, so unfortunately this year we are not allowing auditing. However anyone is welcome to follow the self-study guide in the tutorial tab.

Computing Resources

For the homework assignments, we will use Python, and libraries such as NumPy, SciPy, and scikit-learn. We will use Python 3. You have two options:

Website template. Any feedback is very appreciated, please reach out to: Sheldon, email: huang at cs dot toronto dot edu