Computer Vision Study Plan Prof. Dr. Aldo Díaz Institute of Informatics Federal University of Goias aldo.diaz@ufg.br Task1 – Work teams 1. Set work teams: TEAM1, TEAM2, TEAM3, TEAM4, TEAM5, ... 2. Choose a leader whose role is twofold: ✓Serves as a contact with the instructor ✓Guarantees the submission of tasks 3. Publish the team definitions at SIGAA -> Fóruns -> TEAMS: CLASS – UFG_ID – FULL NAME • Example: TEAM1 INFxyzA – 19401023 – Edson Arantes do Nascimento (leader) INFxyzB – 19601030 – Diego Armando Maradona INFxyzC – 19520616 – César Augusto Cueto Villa ❖Deadline: April 27th, 2023 CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 2 INF0417 Computer Vision Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> INF0417 … • How did you use your time on vacations? • Motivation • Life experiences: • • • • • • Projects (other one's projects) Pet projects (your projects) Startup and innovation Entrepreneurship Leadership Research CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 4 Agenda Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Agenda • Introduce the course goals and structure: • Methodology • Theory • Practice • Evaluations CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 6 Lecturer Aldo André Díaz Salazar Professor of AI for Robotics and Autonomous Systems Federal University of Goias (UFG, Brazil) aldo.diaz@ufg.br aldodiazsalazar PhD in Mechatronics (UNICAMP–Brazil, 2019) and Sensor Fusion (Linköping University–Sweden, 2019) MSc in Automation (UNICAMP–Brazil, 2015) BSc in Electrical Engineering (UPC–Peru, 2008) Researcher at the Centre of Excellence in Artificial Intelligence (CEIA, Brazil) Senior Engineer in Information and Communication Technologies (Nokia Siemens Networks, Germany/Poland/Peru) Interests: CDIO, Sensor Fusion, Computer Vision, Robotics, Artificial Intelligence, Statistical Signal Processing, Audio Signal Processing, Precision Agriculture CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 7 Robotics 1. Teaching PEQUI MECÂNICO Computer Vision Artificial Intelligence 3. Community 2. Research CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 8 News npaufg NPA-UFG OBSAT CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 9 News npaufg NPA-UFG OBSAT CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 10 News npaufg NPA-UFG OBSAT youtu.be/FS7Jws9Tm-E CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 11 AI@UFG – Curriculum [S4] DSP [S5] Computer Vision ❖ Signals and systems ❖ Fourier analysis ❖ Image processing ❖ Applications ❖Cameras as sensors ❖Image information retrieval [S7] Robotics ❖ Localization ❖ Mapping ❖ SLAM [S4] Linear Algebra ❖ Matrix methods CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 12 Schedule CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 13 Questions? • Online: https://linktr.ee/alddiaz • Onsite: https://inf.ufg.br/p/39093-aldo-andre-diaz-salazar CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 14 Course goals Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Course goals • Describe problems and algorithms for basic computer vision and image processing tasks: • • • • • • • Detection, Matching and Tracking of visual features Estimation of optical flow Triangulation from stereo images Graphs, tree structures and other image representations Generative image models Segmentation of image regions Enhancement of images, debugging and visualization • … in other words, we will learn a brand new language! CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 16 Coursework • Examinations • Laboratories • Seminar • Course program • Unit 1 – Low-level vision (photometric) • Images as signals, feature extraction from images • Unit 2 – Mid-level vision (geometric) • Scale-space representation, segmentation, tracking in videos • Unit 3 – High-level vision (semantic) • Object recognition, applications CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 17 Coursework – Gameplay! CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 18 Coursework – Schedule CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 19 Coursework – A03 • Seminar • Work teams: Presentation + Q&A • Discuss: • • • • • What needs to be solved? How you will do that? Data collection Expected results VS reality What questions you plan to answer? ( may change as we move along with the class) Why do we care about the problem you plan to study? • Suggested topics: • Your own creative ideas (mostly preferred!) • Signals Processing for Computer Vision (image segmentation, autonomous systems, ...) • Advanced topics: Deep learning for Computer Vision, Image Processing, Pattern recognition, ... CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 20 Coursework – Book references (SZELISKI, 2010) CV (GONZALEZ; WOODS, 2018) Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 21 Coursework – Software • A proper student setup includes: ✓Programming: Python with OpenCV ✓Versioning: Git ✓Reporting: Jupyter Notebooks ✓OpenCV tutorials ✓ imgproc: Image processing functions ✓ calib3d: Camera calibration and 3D reconstruction ✓ feature2d: Feature detectors, descriptors and matching ✓ dnn: Deep Neural Networks ✓ cuda: GPU-Accelerated Computer Vision, utilizing power of video card to run CV algorithms ✓ Other tutorials – ml, objdetect, photo, stitching, video CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 22 OpenCV curriculum opencv.org CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 23 Interesting stuff Computerphile CV youtube.com/user/Computerphile Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 24 Summary Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Summary • Computer Vision is all about sensing the world through camera images ☺ • DSP is at the core of extracting information from data • Learning Computer Vision involves 100% hands-on experience • • • • • Motion estimation Localization & Mapping Detection Tracking Scene reconstruction CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 26 Summary CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 27 Summary CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 28 Summary CV Prof. Dr. Aldo Díaz <aldo.diaz@ufg.br> Semester 2023-1 29