This is an introductory grad course on machine learning. Machine learning is a set of techniques that allow machines to learn from data and experience, rather than requiring humans to specify the desired behavior by hand. Over the past two decades, machine learning techniques have become increasingly central both in AI as an academic field, and in the technology industry. This course provides a broad introduction to some of the most commonly used ML algorithms.
The first half of the course focuses on supervised learning. We begin with nearest neighbours, decision trees, and ensembles. Then we introduce parametric models, including linear regression, logistic and softmax regression, and neural networks. We then move on to unsupervised learning, focusing in particular on probabilistic models, but also principal components analysis and K-means. Finally, we cover the basics of reinforcement learning.
We will have a single section, taught on Thursdays from 10‐12 EST. Lectures will be delivered online synchronously and students will have the opportunity to ask questions and participate. Recordings for those unable to attend will be posted internally on MyMedia. The tutorials of this course will be the flipped classroom model, students are to follow the self-study guide here before each tutorial and tutorials will be Q/A office hours delivered online synchronously. Tutorials will be held at Tuesdays 10pm and Fridays 10am EST so that it'll work for every time zone. You only need to attend one of the two each week.
Students will be required to attend two course meeting times for synchronous assessments, including the midterm and the final project presentation. The midterm is on Oct 22th (detailed time TBD) and the final project presentation will be during lecture time on week 13 Dec 10th 10am-12am EST.
Lecture and tutorials will be held online. A link will be provided
Lecture Time | Tutorial Time | Lecture/Tutorial "Room" | Start | End |
Thursday, 10am-12am EST | Tuesday 10pm & Friday 10am EST | Online, find details on Quercus | Sept. 10 | Dec. 3 |
Prerequisites (an undergrad course in each is sufficient):
Marking Scheme.
Collaboration policy. You are expected to work on the homeworks by yourself. You should not discuss them with anyone except the TAs or the instructor. A team of two is allowed for the final project.
Academic Integrity. By this point in your studies, you've heard this lots of times, so we'll keep it brief: avoid academic offenses (i.e. cheating). All graded work in this course is individual work.
Lateness. Homeworks will be accepted up to 3 days late, but 10% will be deducted for each day late, rounded up to the nearest day.
Remarks. Remark requests for homeworks should be made through MarkUS, and will be considered by the same TA who marked the assignment. The deadline for requesting a remark is typically one week after the marked assignments are returned. Remark requests for exams will be handled by the instructor; details to be announced later.
Exceptions. Exceptions to the course policies such as late homeworks or missed tests require permission of the instructor. For medical excuses, you should obtain an official Student Medical Certificate.
Auditing. This year due to the pandemic everything is moved online and access is only granted to enrolled students, so unfortunately this year we are not allowing auditing. However anyone is welcome to follow the self-study guide in the tutorial tab.
The easiest option is probably to install everything yourself on your own machine.
If you don't already have python 3, install it.
We recommend some version of Anaconda (Miniconda, a nice lightweight conda, is probably your best bet). You can also install python directly if you know how.
Optionally, create a virtual environment for this class and step into it. If you have a conda distribution run the following commands:
conda create --name csc2515 source activate csc2515
Use pip
to install the required packages
pip install scipy numpy autograd matplotlib jupyter sklearn
All the required packages are already installed on the Teaching Labs machines. You access those machines remotely using SSH. There's a tool called "screen" that allows you to detach from your ssh session so that you can resume the session later even if after shutting down your machine, so that you can leave the job running overnight. Here is a useful script that you can put under your root directory and (you need to name the script as .screenrc) to make your screen more powerful. This is a detailed tutorial on how to use screen.
Website template. Any feedback is very appreciated, please reach out to: Sheldon, email: huang at cs dot toronto dot edu