Cleveland State University Department of Electrical Engineering and Computer Science EEC 693/793 Applied Computer Vision with Depth Cameras Spring Semester 2014 Course Objectives: Depth cameras are one of the most exciting new developments in the field of computer vision. This course covers the technology behind the most well-known depth camera on the market - Microsoft Kinect. The Kinect technology enables human-computer interaction via natural interfaces, such as via gestures and speech-based commands. Topics covered include the handling of Kinect color frames, depth frames, and skeleton frames; gesture recognition; face tracking; and 3D game development with Unity3D for Kinect, OpenCV with Kinect. If time allows, we also introduces the technology behind the Leap Motion device, which tracks only fingers. Prerequisite: Approval of instructor and academic adviser Textbooks: Kinect for Windows SDK Programming Guide, by Abhijit Jana, PACKT publishing, 2012 Kinect Hacks, by Jared St. Jean, O’Reilly, 2013 Hacking the Kinect, by Jeff Kramer et al., Apress, 2012. Instructors: Dr. Wenbing Zhao Office: SH434 Phone: (216) 523-7480 Fax: (216) 687-5405 E-mail: wenbing@ieee.org Lecture time: M W 2:00-3:50pm Office hours: M 6-8pm, W noon-2pm Tentative Schedule: Week 1 (Jan 13 – 15) Topics Jan 13: Lecture #1 – Overview of the course; syllabus; policies (notes) Jan 15: 2 (Jan 20 – 22) 3 (Jan 27 – 29) 4 (Feb 3 – 5) 5 (Feb 10 – 12) 6 (Feb 17 – 19) 7 (Feb 24 – 26) 8 (Mar 3 – 5) 9 (Mar 10 – 12) 10 (Mar 17 – 19) 11 (Mar 24 – 26) 12 (Mar 31 - Apr 2) Lecture #2 – Kinect application development environment (notes) Jan 20: Martin Luther King Day (no class) Jan 22: Lecture #3 – C# primer (notes) Jan 27: Lecture #4 – Kinect Color Image Stream (part I) (notes) Jan 29: Lecture #5 – Kinect Color Image Stream (part II) (notes) Feb 3: Lecture #6 – Windows WPF programming primer (notes) Feb 5: Lecture #7 – Kinect Color Image Stream (part III) (notes) Feb 10: Lecture #8 – Kinect Depth Image Stream (part I) (notes) Feb 12: Lecture #9 – Kinect Depth Image Stream (part II) (notes) Feb 17: President’s Day, no class Feb 19: Catchup session Feb 24: Lecture #10 – Kinect Skeleton Tracking (part I) (notes) Feb 26: Lecture #11 – Kinect Skeleton Tracking (part II) (notes) Mar 3: Lecture #12 – Kinect Skeleton Tracking (part III) (notes) Mar 5: Lecture #13 – Gesture (part I) (notes) Spring break, no class Mar 17: Project Proposal Presentation Mar 19: Project Proposal Presentation Mar 24: Lecture #14 – Gesture (part II) (notes) Mar 26: Lecture #15 – Gesture (part III) (notes) Mar 31: Lecture #16 – Gesture (part IV) (notes) 13 (Apr 7 – 9) 14 (Apr 14 – 16) 15 (Apr 21 – 23) 16 (Apr 28 – 30) 17 (May 5 – 7) Apr 2: Catchup session Apr 7: Lecture #17 – Kinects 3D Game Development with Unity3D (part I) (notes) Apr 9: Lecture #18 – 3D Game Development with Unity3D (part II) (notes) Apr 14: Lecture #19 – OpenCV with Kinect (part I) (notes) Apr 16: Lecture #20 – OpenCV with Kinect (part II) (notes) Apr 21: Lecture #21 – OpenCV with Kinect (part III) (notes) Apr 23: Lecture #22 – Leap Motion (notes) Apr 28: Project presentation Apr 30: Project presentation May 5: Project presentation Class Participation 60% of the course credit is allocated to encourage student class participation. A roll call may be carried out in the beginning of each class to determine the attendance. Any absent session without prior-approval will lead to credit reduction. Grading − − Class participation 60% Projects 40% The final grading is based on your accumulated effort in this course. Your final grade is determined approximately based on the following schedule: A: 90-100% A-: 85-89% B+: 80-84% B: 70-79% B-: 60-69% C: 50-59% D: 40-49% (undergraduate only) F: (<50% for graduate students; <40% for undergraduate students)