Deep Learning Dr. Badri Narayan Subudhi Assistant Professor Department of Electrical Engineering Indian Institute of Technology Jammu Jammu & Kashmir, India AI:Today Source:Andrew N G AI:1956-2018 John McCarthy: Father ofAI (AI, LISP,Utility, Chess) Dartmouth Summer Workshop 1956: o Describe aspects of learning. o Let machines simulate them. o Make them use language, form abstractions and concepts. o Solve problems meant for humans. AI &Intelligence What is AI: Science & Engg. of making intelligent machines. What is intelligence: The ability to acquire and apply skills. Marvin Minsky: Cofounder, AI Labs @MIT “Intelligence is just a word people use to describe how our brains solve problems we call hard. But whenever you learn a new skill yourself, you are less impressed when other people do the same. This is why meaning of intelligence iselusive.“ Is AI intelligent? • What do you mean when you say someone is intelligent? Well informed. Makes good judgment. • Is today’s AI reallyintelligent? • Well informed, but not sound in judgment. Well Informed (Autonomous Driving) Good Judgment (Self Parking) Not a good judgment (An edgecase) Then what is AI? AI = Augmented Intelligence (Mydefinition) AI != Abstraction & Imagination (not yet) AI = TD + ML + HITL Augmented (ML) Pattern Recognition @Scale Process Automation @Scale Intelligence (Augmented) Goal Directedness (Leverage) Distillation (Context) Source for HITL: RobinBordoli AI Use Case (Healthcare) Early detection of cancer? WhichTreatment? Intelligence o Goal Directedness: Region of Interest o Distillation: Benign,Malignant Augmented o Pattern Recognition:Visible and Invisible Nodules o Process Automation:Alerts,Scheduling Vision is the leader among the 5 senses 50% of neural tissues of the brain are allotted to vision. 80% of data in the world is represented in pixels. Vision is the killer app of AI. Language and Speech are next best apps of AI. Deep Learning revolutionized Computer Vision. Source: FeiFei Deep Learning:AI’s Magic Wand What is Deep Learning? DL: Modeling high level abstractions in data through layered networks, inspired by neurons of human brain. Hand-designed & Rule Based (Explicit) IF (furry) A N D IF (has tail)A N D IF (has 4 legs)A N D IF (has pointy ears) A N D … DL: Data Driven (Give lots ofexamples) Linear and Non-linear Decision Boundary It’s raining cats and dogs. Circles are edge cases. Image source: kevinbinz.com DL Intuition (Attend an IPL match) Remember: Input times weights, add bias and activate Father of Deep Learning Geoffrey Hinton: Cognitive Psychologist,Computer Scientist, Researcher at Google. Breakthroughs 1986: Backpropagation 2002: Restricted Boltzmann Machines 2012:Alexnet 2017: Capsules (Pixels to Coordinates) If we knew what it was we were doing, it would not be called research, would it? AI: Hype Cycle2017 Feature Extraction is Intrinsic in DL DL Performance (Net, Sensors,Moore’s Law) Father of Convolutional Nets Yann LeCun: Computer Scientist. Heads FacebookAI Research (FAIR). Breakthroughs 1998: Convolutional Nets.(Mammals visually perceive the world using a layered architecture of neurons). His works helped process 20% of all checks in USA in 1990s. Deeper Nets (ImageNet) Deep Learning: Classification &Retrieval Deep Learning: Object Detection & Segmentation Deep Learning: Self-Driving Cars Deep Learning: PoseEstimation Deep Learning: ImageCaptioning Deep Learning: Cancer Detection Deep Learning: StyleTransfer Deep Learning: StyleTransfer DL: UseCases https://www.linkedin.com/pulse/leveraging-deep-learning-multilingual-sentimentparsa-ghaffari/ DL Use Case:Facebook https://www.linkedin.com/pulse/leveraging-deep-learning-multilingual-sentimentparsa-ghaffari/ DL Use Case:Siri DL Use Case: PredictiveEngagement COMPANY: BeautifulDestinations https://www.slideshare.net/ssusera0ffb0/rdl-presentation-short Deep Learning:Amazon Go Deep Learning Challenges • AI: Not Artificial Intelligence but SymbioticIntelligence. Intelligence: Not Intelligent, but intelligiblemachines. • Bias: Make people from every culture part of AI design. Corporte Mindset: From Automation toInnovation.
