Date | Topic | Reading (legend) | Student Presentation | Assignments |
1. Aug 22 | Basics: Introduction / overview | | | |
2. Aug 24 | Basics: camera models and calibration | FP: I 1.1-1.2 or S Ch. 2, 6.2-6.3.1 | | |
3. Aug 29 / Aug 31 | Basics: linear filters, feature detection and matching | FP II.4, II.5 or S 3.2, 4.1, and Lowe 2004 (esp Sect 3-6) | | |
4. Sept 5 | Basics: stereo / epipolar geometry | Epipolar geometry notes by George Bebis or S 11.1, also S 11.3, 11.4, blog | | |
5. Sept 7 | Basics: structure from motion (presented from Photo Tourism slides 1-30) | S 7.1-7.2, 7.4 or FP 8.1 | | |
6. Sept 12 | Basics: Simultaneous Localization and Mapping (SLAM), Intro neural nets | Lie Groups tutorial, 1-2.2, 3.1, 4.1, 5.1, 6.1, LSD-SLAM, GBC 6-6.2 | | |
7. Sept 14 | Basics: deep learning of visual representations (CNNs) | GBC 8-8.3 | | |
8. Sept 19 | Basics: deep learning of visual representations (CNNs) | GBC 9-9.4, MVCNN | | |
9. Sept 21 | 3D: dense correspondence and depth estimation | [1], [2], [3], [4]
| | |
10. Sept 26 | 3D: shape datasets | ModelNet, ShapeNet, ScanNet | | |
11. Sept 28 | 3D: shape analysis | O-CNN, [2], OctNet, PointNet
| | |
12. Oct 5 | 3D: shape segmentation, shape synthesis | [1], SyncSpecCNN, [3], [4]
| | Assignment 1 due (MVCNN) |
Reading day (no class): Tues Oct 3 | | | | |
13. Oct 10 | 3D: scene reconstruction I | [1], BundleFusion, Tanks and Temples | | |
14. Oct 12 | 3D: scene reconstruction II | 3DMatch, Virtual Rephotography, [3] | | |
15. Oct 17 | 3D: dynamic shape reconstruction | DynamicFusion, VolumeDeform, KillingFusion (video) | | |
16. Oct 19 | 3D: object detection and tracking | [1], [2] (video), deep sliding shapes
| | |
17. Oct 24 | Graphics: view interpolation | [1], [2], [3] | | |
18. Oct 26 | Graphics: reconstruction of geometry, materials, and lighting | MonoFVV, SA-Net, Wang et al. 2016 | | |
19. Oct 31 | Final project proposal presentations | | | |
20. Nov 2 | Humans: pose estimation | VNect, [2], Gesture3D | | |
21. Nov 7 | Humans: clothing, and animal shape estimation | ClothCap, 3D Menagerie | | Assignment 2 due (VR) |
22. Nov 9 | VR/AR: Augmented reality, face shape estimation | [1], [2], [3] | | |
23. Nov 14 | VR/AR: Face shape estimation, segmentation, transfer | [1], [2], [3] | | |
24. Nov 16 | VR/AR: Hand pose estimation | [1], [2], [3]
| | |
25. Nov 21 | Robotics: Autonomous driving | [1] (video), [2], [3], [4]
| | |
Thanksgiving (no class): Thurs Nov 23 | | | | |
27. Nov 28 | Robotics: UAVs, robotic reconstruction | [1], Horus, [3]
| | |
28. Nov 30 | Final project presentations I | | | |
29. Dec 5 | Final project presentations II | | | |