EEC 693/793 Applied Computer Vision with Depth Cameras

advertisement
Cleveland State University
Department of Electrical Engineering and Computer Science
EEC 693/793 Applied Computer Vision with
Depth Cameras
Spring Semester 2014
Course Objectives:
Depth cameras are one of the most exciting new developments in the field of computer
vision. This course covers the technology behind the most well-known depth camera on
the market - Microsoft Kinect. The Kinect technology enables human-computer
interaction via natural interfaces, such as via gestures and speech-based commands.
Topics covered include the handling of Kinect color frames, depth frames, and skeleton
frames; gesture recognition; face tracking; and 3D game development with Unity3D for
Kinect, OpenCV with Kinect. If time allows, we also introduces the technology behind
the Leap Motion device, which tracks only fingers.
Prerequisite:
Approval of instructor and academic adviser
Textbooks:
Kinect for Windows SDK Programming Guide, by Abhijit Jana, PACKT publishing,
2012
Kinect Hacks, by Jared St. Jean, O’Reilly, 2013
Hacking the Kinect, by Jeff Kramer et al., Apress, 2012.
Instructors:
Dr. Wenbing Zhao
Office: SH434
Phone: (216) 523-7480
Fax: (216) 687-5405
E-mail: wenbing@ieee.org
Lecture time: M W 2:00-3:50pm
Office hours: M 6-8pm, W noon-2pm
Tentative Schedule:
Week
1
(Jan 13 – 15)
Topics
Jan 13:
 Lecture #1 – Overview of the course; syllabus; policies
(notes)
Jan 15:

2
(Jan 20 – 22)
3
(Jan 27 – 29)
4
(Feb 3 – 5)
5
(Feb 10 – 12)
6
(Feb 17 – 19)
7
(Feb 24 – 26)
8
(Mar 3 – 5)
9
(Mar 10 – 12)
10
(Mar 17 – 19)
11
(Mar 24 – 26)
12
(Mar 31 - Apr 2)
Lecture #2 – Kinect application development environment
(notes)
Jan 20:
 Martin Luther King Day (no class)
Jan 22:
 Lecture #3 – C# primer (notes)
Jan 27:
 Lecture #4 – Kinect Color Image Stream (part I) (notes)
Jan 29:
 Lecture #5 – Kinect Color Image Stream (part II) (notes)
Feb 3:
 Lecture #6 – Windows WPF programming primer (notes)
Feb 5:
 Lecture #7 – Kinect Color Image Stream (part III) (notes)
Feb 10:
 Lecture #8 – Kinect Depth Image Stream (part I) (notes)
Feb 12:
 Lecture #9 – Kinect Depth Image Stream (part II) (notes)
Feb 17:
 President’s Day, no class
Feb 19:
 Catchup session
Feb 24:
 Lecture #10 – Kinect Skeleton Tracking (part I) (notes)
Feb 26:
 Lecture #11 – Kinect Skeleton Tracking (part II) (notes)
Mar 3:
 Lecture #12 – Kinect Skeleton Tracking (part III) (notes)
Mar 5:
 Lecture #13 – Gesture (part I) (notes)

Spring break, no class
Mar 17:
 Project Proposal Presentation
Mar 19:
 Project Proposal Presentation
Mar 24:
 Lecture #14 – Gesture (part II) (notes)
Mar 26:
 Lecture #15 – Gesture (part III) (notes)
Mar 31:
 Lecture #16 – Gesture (part IV) (notes)

13
(Apr 7 – 9)
14
(Apr 14 – 16)
15
(Apr 21 – 23)
16
(Apr 28 – 30)
17
(May 5 – 7)
Apr 2:
 Catchup session
Apr 7:
 Lecture #17 – Kinects 3D Game Development with
Unity3D (part I) (notes)
Apr 9:
 Lecture #18 – 3D Game Development with Unity3D (part
II) (notes)
Apr 14:
 Lecture #19 – OpenCV with Kinect (part I) (notes)
Apr 16:
 Lecture #20 – OpenCV with Kinect (part II) (notes)
Apr 21:
 Lecture #21 – OpenCV with Kinect (part III) (notes)
Apr 23:
 Lecture #22 – Leap Motion (notes)
Apr 28:
 Project presentation
Apr 30:
 Project presentation
May 5:
 Project presentation
Class Participation
60% of the course credit is allocated to encourage student class participation. A roll call
may be carried out in the beginning of each class to determine the attendance. Any absent
session without prior-approval will lead to credit reduction.
Grading
−
−
Class participation 60%
Projects 40%
The final grading is based on your accumulated effort in this course. Your final grade is
determined approximately based on the following schedule:
A: 90-100%
A-: 85-89%
B+: 80-84%
B: 70-79%
B-: 60-69%
C: 50-59%
D: 40-49% (undergraduate only)
F: (<50% for graduate students; <40% for undergraduate students)
Download