Introduction to CSAIL
Victor Zue (zue@csail.mit.edu)
MIT Computer Science and Artificial
Intelligence Laboratory
Cambridge, MA 02139, USA
Snapshot of MIT
• Mission: Education and research
• Some Statistics:
– 10.2K students (6K+ grad students,
2.1K from other countries)
– 983 faculty, ~3.5K full-time researchers
– 62 Nobel Laureates, 8 currently on
campus
– 25 academic departments, > 100
research labs, centers and programs.
– MIT R&D Budget: $529.5M (Govt.
80%, Industry 11%, Other 9%)
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
1
MIT = Labs + Departments
…
RLE
MTL
LIDS
CSAIL
…
aka “courses”
…
Mechanical Engineering (2)
Materials Science (3)
Chemistry (5)
EECS (6)
Physics (8)
Brain & Cog. Sci. (9)
Chemical Engineering (10)
Aero & Astro (16)
Math (18)
…
Faculty and grad students wear two hats: lab + department
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
What is CSAIL?
• Formed on July 1, 2003
– Merger of AI Lab and LCS
– Each with a 40-year history
• MIT’s largest interdepartmental
laboratory
• ~850 members
– 90+ principal investigators (PIs)
* 70+ active teaching faculty
(from 8 departments)
– ~110 research staff and affiliates
– ~470 graduate students
– ~60 undergraduates
– ~20 postdoctoral fellows
– ~45 technical and admin staff
– ~30 visitors
MIT Computer Science and Artificial Intelligence Laboratory
Our Home: The Stata Center
2008-02-29
2
CSAIL PIs
Barzilay Berners-Lee
Abelson
Adelson
Darrell
Davis
Durand
Glass
Golland
Grimson
Knight
Kaelbling
Katz
Arvind
Brooks
Collins
Fisher
Freeman
Gifford
Horn
Jaakkola
Kellis
Katabi
Lozano-Perez
Rudolph
Leonard
Long
Agarwal Amarasinghe AsanovicBalakrishnan Clark
Devadas Dennis
Ernst
Fano
Guttag
Liskov
Madden
Miller
Sollins Stonebraker Terman
Ward
Lampson
Systems
Massaquoi
Moses
O’Reilly
Poggio
Popovic
Rus
Roy
Seneff
Shrobe
Stultz
Demaine Edelman Garland Goemans
Sussman
Goldwasser Indyk
Szolovits Tedrake
Williams
Wisdom
Teller
Willsky
Tenenbaum
Winston
Tidor
Jackson Kaashoek
Morris
26
Richards
Berger
Karger
Lynch
Meyer
Shor
Sipser
Micali
Rivest
Rubinfeld
Zue
Artificial Intelligence
MIT Computer Science and Artificial Intelligence Laboratory
15
12
6
Leighton Leiserson
Weitzner
3
2
2
1
Sudan
Theory
Corbato
….
Rinard
NAS/NAE/IM
members
ACM Fellows
IEEE Fellows
MacArthur
Foundation
Genius Awards
Turing Awards
Japan Prizes
Nevanlinna Prizes
Millennium
Technology
Award
2008-02-29
What We Do Best
• Training the best students
• Long-term, fundamental research
– Extending the time horizon of our partners
– Working on relevant problems
• Proven track record of shorter-term payoffs
– Serendipity is key
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
3
CSAIL: A History of Innovation
• Early innovations in many areas
– Time sharing, dataflow, public-key encryption, bit-mapped displays,
workstations, symbolic algebra, computer vision, speech, robotics, …
• Standards setting
– TCP/IP, GNU, X-windows, Web standards, …
• Many spin-off companies
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
Lab-Wide Projects
• Past
– Peta Computing (NTT; 1998 – 2003)
– Oxygen (6 partners; 2000 – 2005) video
• Present
– T-Party (Quanta; 2005 – )
– Mobile Communication Ecosystem (Nokia: 2005 – )
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
4
Low-Cost, Universal Internet Access (Morris)
• Problem:
– High cost of infrastructure investment
• Idea:
– Allow people to share network resources
• Solution: Roof-net
– Roof-top antenna, 802.11 card, and PC
– Multi-hop internet access through a
single access point
• Status:
– Deployed in several locations in the US
– Commercial exploitation underway
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
What is CarTel?
• Distributed software system that makes it easy to:
–
–
–
–
collect,
process,
deliver,
visualize & analyze
data from mobile sensors
• Challenges:
–
–
–
–
Heterogeneous data
Lots of data (“media-rich” sensors)
Intermittent network connectivity + mobility
Programmability
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
5
CarTel (Madden & Balakrishnan)
• On-car, secure
computing platform
• Leaf nodes sense
status, detect
problems
– Also, OBD-II
• Opportunistic or
“mule-based” data
collection
• Apps (in increasing
complexity):
–
–
–
–
–
–
Traffic maps
“Pothole detection”
Real-time alerts
Correlative analysis
Peer-to-peer
Infrastructure control
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
CarTel (Madden & Balakrishnan)
Portal
• On-car, secure
computing platform
• Leaf nodes sense
status, detect
problems
– Also, OBD-II
• Opportunistic or
“mule-based” data
collection
• Apps (in increasing
complexity):
Traffic
maps
Embedded Linux: Pentium-class,–128MB
Ram,
1GB storage
–
–
–
–
–
MIT Computer Science and Artificial Intelligence Laboratory
“Pothole detection”
Real-time alerts
Correlative analysis
Peer-to-peer
Infrastructure control
2008-02-29
6
Computational Origami (Demaine)
• Paper folding is an
important aspect of
computational geometry
• Implications for:
–
–
–
–
Manufacturing
Air bags
Biology
….
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
Speech-based Interfaces (Glass & Seneff)
• Computers should interact with humans in the same ways
humans interact with humans
• Next-generation interfaces should be human centric:
– Carry on a conversation with the user
* Understand verbal input
* Verbalize response
* Engage in dialogue with a user during the interaction
– Combine speech, vision, gesture and sketching
– Permit multi-modal interactions
• Technical challenges
– Uni-modal Ö Multi-modal interactions
– PC and laptops Ö Information devices
– Monolingual Ö Multilingual systems
Multimodality video
Small Devices
video
In Car video
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
7
Audio-Visual Information Delivery
• New, data-driven approach can produce very natural and
intelligible synthetic speech
• We can now produce video-realistic animations
• These animated agents can speak and sing in different
languages
• We can combine speech synthesis and facial
animation to produce realistic avatars
Mary101-F video
Mary101-M video
Marilyn video
Mary101-sing-C video
Mary101-sing-J video
English Avatar video
Chinese Avatar video
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
Visual Interfaces (Darrell)
• Visual conversational cues
– Head pose, eye, and body tracking
– Integrating with speech for high SNR applications
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
8
Statistical Machine Translation (Collins)
• A statistical approach
– Use parallel bilingual corpus of example translations
– Induce a statistical model relating one language to another
– Currently most successful approach based on phrases
• Procedure
– Determine an alignment between each pair of sentences
– Use heuristics to induce phrase pairs from alignments
– Translate using greedy, left-to-right methods
English
Today we shall be debating the reopening of the Mont Blanc tunnel
German
Heute werden wir uber die Wiedereroffnung des Mont-Blanc-Tunnels diskutieren.
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
Example Translation: Chinese => English
今年前两月广东高新技术
今年前两月广东高新技术
产品出口３７．６亿美元
产品出口３７．６亿美元
新华社广州３月１６日电
新华社广州３月１６日电
（记者
（记者 陈冀）最新统计数
陈冀）最新统计数
字显示，今年１至２月，
字显示，今年１至２月，
广东省高新技术产品出口
广东省高新技术产品出口
３７．６亿美元，同比增
３７．６亿美元，同比增
长３４．８％，占全省出
长３４．８％，占全省出
口总值的２５．５％。
口总值的２５．５％。 高
高
新技术产品出口亮点频现
新技术产品出口亮点频现
，为广东对外贸易的增长
，为广东对外贸易的增长
做出了重要贡献。
做出了重要贡献。 …
…
MIT Computer Science and Artificial Intelligence Laboratory
The
The First
First Two
Two Months
Months Guangdong's
Guangdong's
Export
Export of
of High-tech
High-tech Products
Products 3760
3760 Million
Million
US
US Dollars
Dollars
Xinhua
Xinhua News
News Agency,
Agency, Guangzhou,
Guangzhou, March
March
16
16 (reporter
(reporter Chen
Chen Ji)
Ji) -- The
The latest
latest statistics
statistics
show
show that
that from
from January
January to
to February
February this
this
year,
year, Guangdong
Guangdong Province
Province high-tech
high-tech
exports
exports 3760
3760 million
million US
US dollars
dollars percent
percent
over
over the
the previous
previous year.
year. 34.8
34.8 %,
%, accounting
accounting
for
for the
the province's
province's total
total export
export value
value of
of 25.5
25.5
%.
%. The
The export
export of
of high-tech
high-tech products
products bright
bright
spots
spots frequently
frequently now,
now, the
the Guangdong
Guangdong
Provincial
Provincial Foreign
Foreign Trade
Trade Increases
Increases made
made
important
important contributions.
contributions. …
…
2008-02-29
9
Advanced Digital Photography (Durand)
• Contrast reduction: Prevent under- & over-exposure
Before
After
Demo
J (x ) =
1
∑ f ( x, ξ ) g ( I (ξ ) − I ( x)) I (ξ )
k ( x) ξ
• 3D model from a single photograph
– (~10hr of manual work)
– Photo editing capabilities, e.g. relighting
Input image
New viewpoint
Relighting
MIT Computer Science and Artificial Intelligence Laboratory
video
2008-02-29
Motional Magnification (Freeman & Torralba)
• A microscope for motion:
– Input: a video
– Output: that video re-rendered as it would have looked if the selected
motions were amplified
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
10
AquaNet: Underwater Sensor Network (Rus)
• Motivations
–
–
–
–
Marine biology research
Environment monitoring
Military use
Offshore oil industry
• Sensor network
– Static nodes
– Mobile nodes
• Communications
– Optic – high speed
– Acoustic – broadcast
• Mobility
– Deployment
– Maintenance
– Recovery
video
MIT Computer Science and Artificial Intelligence Laboratory
2008-02-29
11