Engineering & The World Dan Ellis Laboratory for Recognition and Organization of Speech and Audio Dept. Electrical Eng., Columbia Univ., NY USA dpwe@ee.columbia.edu http://labrosa.ee.columbia.edu/ 1. Science, Technology, Engineering, Math 2. Columbia Engineering 3. Sensors & Feedback TSCU Engineering - Dan Ellis 2012-01-18 1 /16 STEM: Science, Technology, Engineering, Math • “Scientists discover the world that exists; Engineers create the world that never was.” Theodore von Kármán ENGINEER SCIENTIST Technology The World Scientific Knowledge MATHEMATICIAN TSCU Engineering - Dan Ellis 2012-01-18 2 /16 Famous People • Scientists • Mathematicians • Engineers ENGINEER SCIENTIST Technology The World Scientific Knowledge MATHEMATICIAN TSCU Engineering - Dan Ellis 2012-01-18 3 /16 The Astrolabe (c. 600 CE) • What time is it? Istanbul, 1577 ENGINEER SCIENTIST Technology The World Scientific Knowledge MATHEMATICIAN TSCU Engineering - Dan Ellis Hipparchos, 190-120 BCE 2012-01-18 4 /16 The Sea Clock (1759) • But what time is it? • “When longitude at sea is lost, it cannot be found again by any watch.” Isaac Newton John Harrison, 1693-1776 ENGINEER SCIENTIST Technology The World Scientific Knowledge MATHEMATICIAN TSCU Engineering - Dan Ellis The cost of the first sea clocks was ~ ⅓ of the ship 2012-01-18 5 /16 The Brooklyn Bridge (1883) • Bridge building was the “hot technology” of the 1860s ENGINEER SCIENTIST Technology The World Scientific Knowledge MATHEMATICIAN TSCU Engineering - Dan Ellis Emily Roebling, 1843-1903 2012-01-18 6 /16 The Engineering Process • Analyze the problem What principles can be used to solve it? • Design a solution faster, better, cheaper • Test it out Does it behave as expected? Why not? • Refine & repeat again and again and ... TSCU Engineering - Dan Ellis 2012-01-18 7 /16 Teamwork • There’s only so much one person can do Large projects require collaboration How can teams work together efficiently? • Communication is critical to Engineering John Harrison had to wait until he was 80 to receive his prize • Documentation of what you’ve done for the team... for the future... TSCU Engineering - Dan Ellis 2012-01-18 8 /16 Are You an Engineer? • There are many different kinds of engineer... a successful team needs a range of talents But I believe I was born to be an engineer • Top signs: You are curious about how things work You like to take things apart (and put them back together) You really enjoy having an idea about something that might work, trying it out, and finding it does TSCU Engineering - Dan Ellis 2012-01-18 9 /16 Columbia Engineering • The Fu Foundation School of Engineering and Applied Science TSCU Engineering - Dan Ellis COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK 2012-01-18 10/16 LabROSA • The Laboratory for Recognition and Organization of Speech and Audio Information Extraction Music Recognition Environment Separation Machine Learning Retrieval Signal Processing Speech TSCU Engineering - Dan Ellis 2012-01-18 11/16 Environmental Sound Recognition • Computer learns sounds from examples Search Results Example Recordings Sound Features TSCU Engineering - Dan Ellis Clusters 2012-01-18 12/16 Mobile Audio Awareness • Recognize important sounds in real time as an aid for the hearing impaired TSCU Engineering - Dan Ellis 2012-01-18 13/16 Sensors • Technology is interesting only if it interacts with the world x(t) A to D ADC x[n] DSP y[n] Anti- Sample alias and filter hold Sensor TSCU Engineering - Dan Ellis D to A y(t) DAC Reconstruction filter WORLD Actuator 2012-01-18 14/16 Feedback control • A system that “acts” to correct errors Target value Sensor + WORLD Actuator • Challenge is in getting it damped “just right” http://www.youtube.com/watch?v=EAvtBQFQJw8 TSCU Engineering - Dan Ellis 2012-01-18 15/16 Summary • Science, Technology, Engineering, Mathematics (STEM) • The Engineering Process • The Laboratory for Recognition and Organization of Speech and Audio (LabROSA) • Feedback control TSCU Engineering - Dan Ellis 2012-01-18 16/16