CS437/CS5317/EE414/EE517 Deep Learning Murtaza Taj murtaza.taj@lums.edu.pk Lecture 1: Introduction Mon, 16th Jan 2023 Team ! Dr. Murtaza Taj (murtaza.taj@lums.edu.pk) - PhD Student ! ! ! Fezan Rasool (fezan.rasool@lums.edu.pk) - PhD Student ! ! Office Hours: Friday 5:00 pm to 6 pm Shayaan Jamil (23100208@lums.edu.pk) - Senior ! ! Office Hours 1: Tues 2:30 - 3:30pm Office Hours 1: Wed 3:30 - 4:30pm Office Hours: Tue/Thurs 11am to 12 mid-day Zohaib Khan (24100074@lums.edu.pk) - Junior ! Office Hours: Mon and Wed 11:30am-12:45pm Introduction ! Murtaza Taj (PhD) ! ! ! ! ! Phd - Queen Mary University of London in Dec 2009 Joined LUMS in Jan 2011 Faculty Director Technology for People Initiative (2016-2022) Director Computer Vision & Graphics Lab Research: 2D and 3D Scene Understanding, Image & Processing, Computer Graphics, Machine Learning tpi.lums.edu.pk cvlab.lums.edu.pk Computer Vision & Graphics Lab (CVG Lab) https://cvlab.lums.edu.pk ! Remote Sensing ! ! ! Digital Cultural Heritage ! ! ! 2D/3D Scene Understanding 3D Object Retrieval, Point cloud segmentation Medical Imaging ! ! ! Image matching Retrieval, classification, object detection Generative Adversarial Networks Image classification Others ! ! Self-driving cars (End-to-end, How well am I driving) Visual Question Generation (NLP), Pose Estimation Murtaza Taj Co-founder Groopic Inc. CA What is the core business of Google & Facebook? What is the core business of Google & Facebook? Murtaza Taj Co-founder Ingrain Media Inc. CA Course Outline Course Introduction ! Assignments and Readings ! ! Programming Environment ! ! Python (Pytorch, Colab) Late Submission Policy ! ! Written and programming assignments (approx 5) 5%/24 hrs, zero on 6th day Pre-req ! ! Intro to Programming Linear Algebra Instrument % Assignments x 5 30 Project & Paper 20 Quizzes (LMS, in-class) 10 Mid-term Exam 15 Final Exam 25 Course Outline ! Introduction to Machine Learning ! ! Neural Networks (WA1) ! ! ! Structured Pruning, Knowledge Distillation Object Detection (Project) ! ! Language Models, transformers Neural Network Compression (PA4) ! ! Autoencoder, Generative Adversarial Networks Recurrent Neural Networks (PA3) ! ! Convolution, Optimizer, Case Studies Representation Learning (PA2) ! ! Linear regression, Gradient Descent, Forward & Back propagation Convolutional Neural Networks (PA1) ! ! What, Why Yolo, SSD… Graph Neural Networks Reinforcement Learning Textbook ! Neural Networks and Deep Learning By Michael Nielsen ! ! http://neuralnetworksanddeeplearning.com/ "Deep Learning" by Yoshua Bengio, Ian Goodfellow, and Aaron Courville ! https://www.deeplearningbook.org/ Any Questions Past: Can AI ever achieve human level intelligence? Science Fiction Movie’s of 1980/90 Present: AI is superceding human intelligence Traditional Methods Deep Learning Methods Deep Fakes Present: AI is superceding human intelligence 2017 Present: AI is superceding human intelligence OpenAI GPT: Generative Pre-trained Transformer 3 language model that uses deep learning to produce human-like text. OpenAI Present: AI is superceding human intelligence Present: AI is superceding human intelligence 2 1 1 2 3 3 OpenAI Any Questions Any Questions References ! Deep Learning by Yann LeCun - NYU ! https://cds.nyu.edu/deep-learning/? fbclid=IwAR3o10bWoTouw0koWuhaFvH4InENkWJGfBitvGAs0UoYtJU_izORJ weuHLA
