Conservatorio G. Tartini Trieste LOLA Together, on demand! A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK MUSICAL PERFORMANCES AND INTERACTION Massimo Parovel, Paolo Pachini, Nicola Buso, Carlo Drioli Claudio Allocchio www.conservatorio.trieste.it LOw LAtency Audio Visual Streaming System The LOLA team LOLA in 10 minutes… The Dream… …a viola Masterclass with New World Symphony, at the GARR Conference 2005, in Pisa... “To perform together, from distant locations... as if distance has vanished in a click of a computer mouse” 14:00 www.conservatorio.trieste.it http://www.garr.it/eventiGARR/conf_05/ram/Violista.ram The LOLA team LOLA in 10 minutes… To play together you need… Audio Latency (RTT) below ~40-75ms (depends on music Eye Contact to synchronize Spatial Sound immersion for expression Room Reverbering Continuous Presence of all musicians Non distracting environment and art! style) www.conservatorio.trieste.it • • • • • • • The LOLA team LOLA in 10 minutes… Audio/Video tools before LOLA… Conference XP DVTS Skype www.conservatorio.trieste.it H.323/SIP The LOLA team LOLA in 10 minutes… Audio/Video tools before LOLA… Latency: 400ms Echo H.323/SIP DVTS Latency: 350ms Echo Latency: > 300ms Audio for voice Auto echo cancellation Conference XP Skype www.conservatorio.trieste.it Latency: 200ms Audio for voice Auto echo cancellation The LOLA team LOLA in 10 minutes… But… we wanted… • • • • • To satisfy all requirements, in all involved remote sites, also without a skilled conductor, and to play J. S. Bach, with a piano! www.conservatorio.trieste.it The LOLA team LOLA in 10 minutes… LOLA Latency: 5ms Audio for music No echo 100 Mbps 500 Mbps 30 fps 60 fps 2 ch 8 ch http://www.conts.it/artistica/lola-project/introducing-lola-workshop/ www.conservatorio.trieste.it Very Fast reliable networks Hi-Speed cameras Machine Vision Grabbers Good PC (i5/i7) … New programming approach! The LOLA team LOLA in 10 minutes… LOLA Motivations and Goals • Target applications: • Network interactive musical tasks • musical rehearsing and performances • music education and training • Network interactive on stage performances • dance performances • drama performances • performing arts education and training • and beyond… • surgery, real time control… www.conservatorio.trieste.it ... but also... The LOLA team LOLA in 10 minutes… Discoveries with LOLA 10ms Latency: •~25ms (one way) is the confort limit for most instruments 15ms 20ms 25ms 30ms Sound rendering: • mixing different ambients; • reproducing acoustic instruments; www.conservatorio.trieste.it Courtesy of Nathan Brock, UCSD The LOLA team LOLA in 10 minutes… LOLA public Events Network Performing Arts Production Workshop: 23.11.2010 Tartini (Trieste) – IRCAM (Paris) 1300Km. Internet2 Fall Members Meeting: 04.10.2011 NIU (Chicago, IL) – Congress Center (Raleigh, NC) 1850km. Network Performing Arts Production Workshop : 05.03.2012 NIU (Chicago, IL) – NWS (Miami, FL) 2400km. www.conservatorio.trieste.it Network Performing Arts Production Workshop: 15.06.2011 Tartini (Trieste) – Gran Teatre del Liceu (Barcelona) 2700Km. The LOLA team LOLA in 10 minutes… LOLA First public Concert AEC Annual Meeting for International Coordinators: 15.09.2012 Tartini (Trieste) – SS. Marcellino & Festo (Naples) 1200Km. www.conservatorio.trieste.it The LOLA team LOLA in 10 minutes… Comments by LOLA users “We are in a new unexplored world: how can we adapt interpretation/composition to two different Concert Hall acoustic environment at the same time?” “Your horizon expands from a city to a continent” “We won the CODECs challenge! ... the challenge is for the network now!” “A powerful tool to analyze and refine your performance” www.conservatorio.trieste.it “You can talk, listen, make examples BUT ALSO you can PLAY TOGETHER” The LOLA team LOLA in 10 minutes… LOLA: the community Contact us at lola-project@conts.it, get a free license for non commercial academic use, build you own PC and join the community! Northern Illinois University School of Music - DeKalb, IL, USA CESNET - Czech Republic Research and Education Network - Praha, CZ New World Symphony - America's Orchestral Academy – Miami, FL, USA Internet2 networking consortium - Washington, DC, USA Università degli Studi di Cassino e del Lazio Meridionale - Cassino, IT JAnet - UK Education and Research Network - Oxford, Didcot, UK Universidade de São Paulo - CMU, Departamento de Música - São Paulo, Brasil Rensselaer Polytechnic Institute - Department of the Arts - Troy, NY, USA MAGPI - Mid-Atlantic Gigapop - Multimedia Service - Philadelphia, PA, USA Edinburgh Napier University, School of Arts and Creative Industries, Music dept. UK University of North Carolina, School of Music, Greensboro, NC, USA University of Virginia, School of Arts, Charlottesville, VA, USA Royal Academy of Music, Aarhus, DK www.conservatorio.trieste.it • • • • • • • • • • • • • The LOLA team LOLA in 10 minutes… London-Edinburgh ~400miles www.conservatorio.trieste.it The LOLA team LOLA in 10 minutes… Questions? http://www.conts.it/artistica/lola-project lola-project@conts.it www.conservatorio.trieste.it The LOLA team LOLA in 10 minutes…