Deep Learning
Dr. Badri Narayan Subudhi
Assistant Professor
Department of Electrical Engineering
Indian Institute of Technology Jammu
Jammu & Kashmir, India
AI:Today
Source:Andrew N G
AI:1956-2018
John McCarthy: Father ofAI (AI, LISP,Utility, Chess)
Dartmouth Summer Workshop 1956:
o Describe aspects of learning.
o Let machines simulate them.
o Make them use language, form abstractions
and concepts.
o Solve problems meant for humans.
AI &Intelligence
What is AI: Science & Engg. of making intelligent machines.
What is intelligence: The ability to acquire and apply skills.
Marvin Minsky: Cofounder, AI Labs @MIT
“Intelligence is just a word people use to describe
how our brains solve problems we call hard. But
whenever you learn a new skill yourself, you are
less impressed when other people do the same.
This is why meaning of intelligence iselusive.“
Is AI intelligent?
• What do you mean when you say someone is intelligent? Well
informed. Makes good judgment.
• Is today’s AI reallyintelligent?
• Well informed, but not sound in judgment.
Well Informed (Autonomous
Driving)
Good Judgment (Self Parking)
Not a good judgment (An edgecase)
Then what is
AI?
AI = Augmented Intelligence (Mydefinition)
AI != Abstraction & Imagination (not yet)
AI = TD + ML + HITL
Augmented (ML)
Pattern Recognition @Scale
Process Automation @Scale
Intelligence (Augmented)
Goal Directedness (Leverage)
Distillation (Context)
Source for HITL: RobinBordoli
AI Use Case (Healthcare)
Early detection of cancer? WhichTreatment?
Intelligence
o Goal Directedness: Region of Interest
o Distillation: Benign,Malignant
Augmented
o Pattern Recognition:Visible and Invisible Nodules
o Process Automation:Alerts,Scheduling
Vision is the leader among the 5 senses
50% of neural tissues of the brain are allotted to vision.
80% of data in the world is represented in pixels.
Vision is the killer app of AI.
Language and Speech are next best apps of AI.
Deep Learning revolutionized Computer Vision.
Source: FeiFei
Deep Learning:AI’s Magic
Wand
What is Deep Learning?
DL: Modeling high level abstractions in data through
layered networks, inspired by neurons of human brain.
Hand-designed & Rule Based (Explicit)
IF (furry) A N D
IF (has tail)A N D
IF (has 4 legs)A N D
IF (has pointy ears) A N D
…
DL: Data Driven (Give lots ofexamples)
Linear and Non-linear Decision
Boundary
It’s raining cats and dogs. Circles are edge cases.
Image source: kevinbinz.com
DL Intuition (Attend an IPL match)
Remember: Input times weights, add bias and activate
Father of Deep Learning
Geoffrey Hinton: Cognitive Psychologist,Computer
Scientist, Researcher at Google.
Breakthroughs
1986: Backpropagation
2002: Restricted Boltzmann Machines
2012:Alexnet
2017: Capsules (Pixels to Coordinates)
If we knew what it was we were doing, it would not be called research, would it?
AI: Hype Cycle2017
Feature Extraction is Intrinsic in DL
DL Performance (Net, Sensors,Moore’s Law)
Father of Convolutional Nets
Yann LeCun: Computer Scientist. Heads FacebookAI
Research (FAIR).
Breakthroughs
1998: Convolutional Nets.(Mammals
visually perceive the world using a
layered architecture of neurons).
His works helped process 20% of all
checks in USA in 1990s.
Deeper Nets
(ImageNet)
Deep Learning: Classification &Retrieval
Deep Learning: Object Detection & Segmentation
Deep Learning: Self-Driving Cars
Deep Learning: PoseEstimation
Deep Learning: ImageCaptioning
Deep Learning: Cancer Detection
Deep Learning: StyleTransfer
Deep Learning: StyleTransfer
DL: UseCases
https://www.linkedin.com/pulse/leveraging-deep-learning-multilingual-sentimentparsa-ghaffari/
DL Use Case:Facebook
https://www.linkedin.com/pulse/leveraging-deep-learning-multilingual-sentimentparsa-ghaffari/
DL Use Case:Siri
DL Use Case: PredictiveEngagement
COMPANY: BeautifulDestinations
https://www.slideshare.net/ssusera0ffb0/rdl-presentation-short
Deep Learning:Amazon
Go
Deep Learning Challenges
• AI: Not Artificial Intelligence but SymbioticIntelligence. Intelligence: Not
Intelligent, but intelligiblemachines.
• Bias: Make people from every culture part of AI design. Corporte
Mindset: From Automation toInnovation.