University Digital Art Driven Innovation with Industry New Models for Art & Industry Collaboration UCLA Arrowhead Conference Center Lake Arrowhead, CA November 17, 2002 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD Lessons Learned from Fifteen Years of Art Driven Innovation with Industry • Three Classes of Industrial Partners – Near-Art (Render Houses, Movie Production, Gaming) – Infrastructure (Computers, Telecom, Software) – End Consumers (Biochem, Manufacturing, Medical) • World Class Facilities – Bleeding Edge – Multi-Function (VR, Rendering, Audio, Displays, Mixing) • Renaissance Teams – Permanent Academic Professionals – Art, Computer Science, Content Equal Members – Lots of Graduate Students • Showtime! – Demos at World Conferences (Siggraph, Supercomputing, iGrid) – Large Scale Projects – Use of New Tech to Create New Visual Metaphors on New Content Computing and Graphics Has Enabled Artists to Create Extended Reality 1987 Stefen Fangmeier Computer Graphics From NCSA to ILM 1993 2000 1996 http://access.ncsa.uiuc.edu/ http://movies.warnerbros.com/twister www.jurassicpark.com www.cinemenium.com/perfectstorm/ SIGGRAPH 89 Science by Satellite “What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers.” ― Larry Smarr, Director National Center for Supercomputing Applications, UIUC ATT & Sun “Using satellite technology…demo of What It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations.” ― Al Gore, Senator Chair, US Senate Subcommittee on Science, Technology and Space http://sunsite.lanet.lv/ftp/sun-info/sunflash/1989/Aug/08.21.89.tele.video SIGGRAPH 94 VROOM: Virtual Reality Room “It’s the real start of humans being able to immerse themselves inside the brains of computers―seeing what the computers are seeing.” ― Larry Smarr, Director, National Center for Supercomputing Applications, UIUC “See things you’ve never seen before.” ― Tom DeFanti, Director, Electronic Visualization Laboratory, UIC “Virtual prototyping of new products, from small to large.” Post-Euclidean Walkabout George Francis, NCSA, UIUC www.math.uiuc.edu/~gfrancis/ ― Rick Stevens, Director, Math and Computer Science Division, Argonne National Lab General Motors Research “Next year―SuperVROOM…Get rid of the Machine Farm and put gigabit networks in place to talk to computers at remote sites―a whole new level of interaction and communication.” ― Maxine Brown, Associate Director, Electronic Visualization Laboratory, UIC www.evl.uic.edu/EVL/VROOM/HTML/OTHER/HomePage.html UIC Source: Maxine Brown Supercomputing 95 I-WAY: Information Wide Area Year The Barriers: Time And Distance The Barrier-Shattering Prototype: I-WAY I-Way Featured: • • • • Networked Visualization Application Demonstrations OC-3 (155Mbps) Backbone Large-Scale Immersive Displays I-Soft Programming Environment Cellular Semiotics CitySpace http://archive.ncsa.uiuc.edu/General/Training/SC95/GII.HPCC.html UIC SIGGRAPH ’96 Cosmic Voyage First Scientific Data Driven IMAX Sequence Sponsored by Motorola for the Smithsonian • • • • • Star Render Algorithm From PIXAR Virtual Director in CAVE 1000 Hour SDSC Supercomputer Run to Generate Data Tens of Thousands of Hours of NCSA SGI Time to Render Data Cross-Country Transfer to IMAX Film of Massive Amounts of Data Colliding Galaxies (Smithsonian IMAX)-Donna Cox, Bob Patterson, NCSA-From “Cosmic Voyage”-Nominated for Academy Award 1997 Cyberfest ’97--Gesture and Body Movement Control Real Time Performance Art “Machine Child” Performed at Celebration of HAL’s Birth University of Illinois Robin Bargar, Insook Choi, Juhan Sonin, NCSA and UIUC Music Dept. Special Guests: Roger Ebert, Harry Lange, & Arthur C. Clarke Alliance 1997: Collaborative Video Production via Tele-Immersion and Virtual Director Alliance Project Linking CAVE, Immersadesk, Power Wall, and Workstation UIC Donna Cox, Bob Patterson, Stuart Levy, Glen Wheless www.ncsa.uiuc.edu/People/cox/ Corporations Use the Grid For Virtual Prototyping Real Time Linked Virtual Reality and Audio-Video Between NCSA, Peoria, Houston, and Germany Fall 1997 University of Illinois at Urbana-Champaign Caterpillar, NCSA iGrid 2002 September 24-26, 2002, Amsterdam, The Netherlands • Fifteen Countries/Locations Proposing 28 Demonstrations: Canada, CERN, France, Germany, Greece, Italy, Japan, The Netherlands, Singapore, Spain, Sweden, Taiwan, United Kingdom, United States • Applications Demonstrated: Art, Bioinformatics, Chemistry, Cosmology, Cultural Heritage, Education, High-Definition Media Streaming, Manufacturing, Medicine, Neuroscience, Physics, Tele-science • Grid Technologies: Grid Middleware, Data Management/ Replication Grids, Visualization Grids, Computational Grids, Access Grids, Grid Portal Sponsors: HP, IBM, Cisco, Philips, Level (3), Glimmerglass, etc. UIC www.startap.net/igrid2002 California Has Initiated Four New Institutes for Science and Innovation California Institute for Bioengineering, Biotechnology, and Quantitative Biomedical Research UCD UCSF Center for Information Technology Research in the Interest of Society UCM UCB California NanoSystems Institute UCSC UCSB UCLA UCI California Institute for Telecommunications and Information Technology UCSD www.ucop.edu/california-institutes New Media Arts--an Application Driver of Cal-(IT)2 From the Beginning 220 UC San Diego & UC Irvine Faculty Working in Multidisciplinary Teams With Students, Industry, and the Community The State’s $100 M Creates Unique Buildings, Equipment, and Laboratories www.calit2.net Two New Cal-(IT)2 Buildings Are Beginning Construction Bioengineering • Will Create New Laboratory Facilities UC Irvine – – – – Clean Rooms for Nanotech and BioMEMS Computer Arts Virtual Reality Wireless and Optical Networking Interdisciplinary Teams UC San Diego $100 Million for New Buildings From the State May 31, 2002 Major Opportunity/Challenge Design of Cal-(IT)2 Building Facilities Labs For Advanced Arts Production And Research • Exhibition Gallery • Immersive Visualization • 200 Seat, Tele-presence Auditorium • Spatialized Audio • 2000 sq. ft. Black Box • Tele-Performance • 3D Fabrication and Scanning Experimental Performance Space • Motion Capture • Digital Cinema Production • Haptic Interface Development Over Fifty Industrial Sponsors From a Broad Range of Industries Akamai Technologies Inc. AMCC Ampersand Ventures Arch Ventures The Boeing Company Broadcom Corporation CAIMIS, Inc. Conexant Systems, Inc. Connexion by Boeing Cox Communications Diamondhead Ventures Dupont Emulex Corporation Network Systems Enosys Markets Enterprise Partners Entropia, Inc. Ericsson ESRI Extreme Networks Global Photon Systems Graviton IBM Computers Communications Software Sensors Biomedical Startups Venture Capital IdeaEdge Ventures The Irvine Company Intersil Corporation Irvine Sensors Corporation JMI, Inc. Leap Wireless International Link, William J. (Versant Ventures) Litton Industries, Inc. MedExpert International Merck Microsoft Corporation Mission Ventures NCR Newport Corporation Oracle Orincon Industries Panoram Technologies Printronix QUALCOMM Quantum The R.W. Johnson Pharmaceutical Research Institute SAIC Samueli, Henry (Broadcom) SciFrame, Inc. Seagate Storage Products SGI Silicon Wave Sony STMicroelectronics, Inc. Sun Microsystems TeraBurst Networks Texas Instruments Time Domain UCSD Healthcare The Unwired Fund WebEx $140 Million in Industrial Matching Cal-(IT)2 Industrial Partners are Supporting Academic Research and Education • In the Last Six Months – Hosted Over 25 Seminars or Lectures – Hosted or Co-Sponsored Over Ten Workshops/Conferences • • • • • • Funding a Dozen Faculty Research Projects Supported 20 Summer Undergraduate Fellows Funds Over 42 Graduate Fellowships Hosts Distinguished Visitors Provides Equipment for Living Labs Created a Half Dozen Chaired Professorships Cal-(IT)2 New Media Arts Is Well Underway CSE 190 • UCSD/UCI Computer Gaming Initiative – Laboratory for Game Culture & Technology – CSE 190 Computer Gaming Course • Computing As Social Space • Planning for New Building Facilities • Humans Interacting with Virtual Realities UC San Diego UC Irvine Smoke and Mirrors Internet Linked Pianos Interacting Virtual Spaces Sheldon Brown’s “Mi Casa Es Tu Casa” Human-Robot Interactions Simon Penny’s Petit Mal And Under Development: Bedlam--a Multi-modal, Networked Robotic, Telematic Performance Between Irvine and Montreal www-art.cfa.cmu.edu/Penny/works/petitmal/petitcode.html Why Optical Networks Are Emerging as the 21st Century Driver Scientific American, January 2001 Metro Optically Linked Visualization Walls with Industrial Partners Set Stage for Federal Grant • Driven by SensorNets Data – – – – Real Time Seismic Environmental Monitoring Distributed Collaboration Emergency Response • Linked UCSD and SDSU – Dedication March 4, 2002 Linking Control Rooms UCSD SDSU 44 Miles of Cox Fiber Cox, Panoram, SAIC, SGI, IBM, TeraBurst Networks SD Telecom Council The OptIPuter Will Radically Alter The UCSD OptIPuter Deployment Remote Interaction with Large Data Objects To Other OptIPuter Sites Phase I, Fall 02 Phase II, 2003 Collocation point SDSC SDSC SDSC SDSC Annex Annex JSOE Engineering CRCA Arts SOM Medicine Chemistry Phys. Sci Keck Preuss High School 6th Undergrad College College Node M Collocation SIO Earth Sciences ½ Mile NSF ITR Award $13.5 Million With Six Campuses PI—Larry Smarr CENIC and CISI Plan to Create a Dark Fiber Experimental and Research Network The SoCal Component From Telephone Conference Calls to Access Grid International Video Meetings Can We Modify This Technology To Create Global Performance Spaces? Access Grid Lead-Argonne NSF STARTAP Lead-UIC’s Elec. Vis. Lab Soft Cinema The Future Of Cinema, Television & Computer Multimedia • "Algorithmic Cinema" – Software Controls Both – The Layout Of The Screen – The Sequences Of Media Elements Which Appear In These Frames • "Database Cinema" – The Media Elements Are Selected From A Large Database – Construct a Potentially Unlimited Number Of Different Narrative Films • "Macro-Cinema" – How Moving Images May Look When The Net Will Mature, – Unlimited Bandwidth & Very High Resolution Displays • "Multimedia Cinema" – Video, 2D Animation, Motion Graphics, 3D Scenes, Diagrams, Etc. www.manovich.net/cinema_future/toc.htm The Emergent Cyber-Civilizations • Shared Virtual Worlds www.everquest.com – Persistent and Growing Cyber Constructions • Interacting Avatars – Hiro is approaching the Street. It is the Broadway, the Champs Elysees of the Metaverse... It does not really exist. But right now, millions of people are walking up and down it.-- Neal Stephenson’s Snowcrash • Artificial Intelligence “Gods” – Lord of the Rings—the Movie – Computing Actions of Large Groups of Cyber Entities – What Will Be Possible When This is Real Time? – William Gibson Metaphysics – Neuromancer, Count Zero, Mona Lisa Overdrive – AIs Interacting with Humans and Each Other