CSC 487/2503, Fall 2009
Foundations of Computer Vision

General Information

Instructors Prof. Allan Jepson, Prof. David Fleet.
Email jepson/fleet at cs dot utoronto dot ca
Office Hour Thurs. 3-4pm, D.L. Pratt 283D or 391
Additional Office Hours David Fleet will be available, in Pratt 396A, 3pm-5pm, Mon. Dec 7.
Additional Office Hours Allan Jepson will be available, in Pratt 283D, 1pm-4pm, Tues. Dec 8.
Or by appointment.
Lectures FALL 2009 Thurs. 1-3, Bahen, Room B024 Lectures start Sept. 10.
Tutorials FALL 2009 Mon. 12-1, Bahen B024. No tutorial on Monday Sept. 7, tutorials start Sept. 14.
Course Information Sheet Handout
Course Bulletin Board https://csc.cdf.toronto.edu/bb/YaBB.pl?board=CSC487-2503H1F
Email-Newsgroup Policy There may be no response from 24 hours before an assignment is due, up to the actual time it is due.
Final Exam The Faculty of Arts and Science will schedule the exam sometime in October. Look up the time and place on the Examinations page, where it will be listed as CSC487.

Marking

4 Assignments 60%  
Final Exam 40% Previous years' exams

Late Policy

Assignments are due at the beginning of the tutorial or lecture on the due date (i.e. Mon. at 12:10, or Thurs. at 1:10).

The penalties for lateness are:

Hard copies of late assignments should be handed into the AI Office, Pratt 283, during business hours. The date and time should be marked, and it needs to be signed for by someone in the office.

Assignments

Links to assignments and related information are provided here.

If you are new to Matlab, first read the Matlab primer and try running the code described there. Then, if you wish to set up your home machine, see the matlab/README file unpacked from the matlabVisTools.zip file (see below).


Assignment
Description		 Percent Posting Date Due Date Links
Asgn #1 15% Sept.21 12:10pm, Oct. 5
at tutorial. 		A1handout.zip
utvisToolbox bug fix
Asgn #2
15% Oct. 8 12:10pm, Oct. 26 A2handout.zip
Asgn #3 15% Oct. 28 12:10pm, Nov. 16
(at the beginning of the tutorial) 		pigeonTrack.zip Contains starter Matlab code.
The image sequence is at pigeon.zip. DO NOT DOWNLOAD the image sequence to CDF. The sequence is already on CDF in /u/jepson/pub/pigeon/.
Asgn #4
typos 		15% Nov. 21 4:00pm, Dec. 4
(electronically and any hardcopy taken to profs' offices) 		A4Handout.zip Contains starter Matlab code and test images.
If you are running Matlab version 6, use the following *.mat files:
trainSet6.mat
testSet6.mat

CDF Information

By registering in this course you should have a CDF account. For information on CDF see http://www.cdf.toronto.edu/. Before going to a CDF lab, or to the course bulletin board, you need to look-up your CDF account.

Lecture and Tutorial Materials

Links to some of the lecture/tutorial notes are provided below.

Matlab tutorials are also provided to illustrate many of the concepts introduced in this course. The tutorials are installed on the CDF lab machines, and also on CS-Lab. After logging onto a CDF (or CS-Lab) machine, cd ~jepson/pub/matlab and read the README file. This file tells you how to set up matlab so that it will run the tutorials. The tutorials are located in two directories:

We indicate which toolbox to look in below.

The Matlab toolboxes we use in this course are also available for download to your home computer (assuming you have Matlab at home) from the matlabVisTools.zip file (60MB). After unzipping this file, see the matlab/README file for instructions on how to set your matlab path. A second zip file containing two image sequences is needed for the motion tutorial, namely matlabVisToolsSeq.zip file (75MB). Unpack this zip file in the same directory as the previous one. It should form a new subdirectory matlab/images/seq/.

Date Topic Matlab Tutorial / Eye Candy
Sept. 10, 09 Lecture Notes: Suggested Readings: Getting started with images in Matlab: See the introImageTutorial.m in the ISE toolbox
(See above for directions to ISE)
Extra material: Matlab M-files for Phong shading: phongDemo.m phongShade.m
The generated images: ambient light, metal spheres, shiny spheres, matte spheres
Notes on Phong shading and the peppersc.jpg image discussed there:
Sept. 17 Lecture Notes: Suggested Readings:
UTVIS: colourTutorial.m
ISE: linSysTutorial.m, samplingTutorial.m, imageTutorial.m
(See above for directions to UTVIS and ISE toolboxes)
Matlab demo: upSample.zip
Sept. 21 Tutorial Notes: Matlab demo: warpDemo.zip
Sept. 24 Image Pyramids
Matlab Tutorial: ISE: pyramidTutorial.m
Oct. 1 Lecture Notes:
See the following m-files in utvisToolbox/tutorials/eigenTut/
  • trainEigenEyes.m
  • detectEigenEyes.m
And in utvisToolbox/tutorials/ see
  • cannyTutorial.m
 
Oct. 8 Robust Estimation
See the following m-files in utvisToolbox/tutorials/lineTut/
  • oTensorDemo.m
  • houghDemo.m
  • robustDemo.m
  • robustLineScript.m
To run these, set your matlab path to include: 		 
 
 addpath([matlabVisRoot '/utvisToolbox/edge']);
 addpath([matlabVisRoot '/utvisToolbox/tutorials/lineTut']);
 addpath([matlabVisRoot '/utvisToolbox/tutorials/lineTut/localUtil']);
Oct. 15 Optical Flow Lecture Notes
Optical Flow Book Chapter
Lecture Notes on Mixture Models
See the following m-files in utvisToolbox/tutorials/motionTut/
  • introMotionTut.m
  • motionTutorial.m
 
Oct. 22 Tracking.

Oct. 29 Local image features (Notes).
Local image features (Slides).
Epipolar geometry.
See the following m-files in utvisToolbox/tutorials/
  • SIFTtutorial/tutorial.m
  • 3Drecon/grappleFmatrix.m (update grapple.zip)
All the relevant facts about the F-matrix are in Daniel Wedge's music video

Forensic vision in the press. 		 
 
 
Nov. 5 Lecture notes for multiframe factorization.
FYI: I will not have class time to lecture on projective factorization (pp. 15-25 of the above pdf notes). There may be questions on orthographic factorization, but not projective factorization, in a subsequent assignment and/or on the final exam. 		UTVIS: Orthographic Factorization and Projective Factorization Demos in tutorials/3Drecon/orthographic/ and tutorials/3Drecon/projective/.
Nov. 12 No lecture, fall break.  
Nov. 19 Object Recognition: Brief History
Object Recognition Notes
Object Recognition: Next?

Additional Readings:
S. Dickinson, The Evolution of Object Categorization and the Challenge of Image Abstraction

J. Mundy, Object Recognition in the Geometric Era: A Retrospective 		 
Nov. 26 Image Segmentation
     
Mon. Nov 30 Tutorial Cancelled.  
Dec. 3 Informal exam review. (No new material covered.)
Bring your questions or, avoid the commute.