Digital Video over Next Generation Internet Hyun-chul Kim hckim@cosmos.kaist.ac.kr Korea Advanced Institute of Science and Technology 2003.1.22(Wed) Table Of Contents The Networks Advanced Applications Digital Video : Future Killer Application ? Digital Video Technologies What are people doing with these technologies? Challenges and Opportunities Digital Video over Next Generation Internet APAN-KR Digital Video Network Concluding Remarks References The Networks APAN : Objectives [Chon 01B] Advanced Networking for Asia-Pacific Research & Development for Advanced Applications and Services Advanced Networking Environment for Research Community International Collaboration Asia-Pacific Advanced Network [Chon 01B] Europe Korea Japan STAR TAP (USA) China Hong Kong Thailand Malaysia Sri Lanka Vietnam Singapore Current status 2001(plan) Philippines Indonesia Australia KOREN Advanced Applications ? Applications [Chon 01A] Basic Service EMail File Transfer Telnet News WWW Advanced Service Transaction Video/Audio What’s the Killer Application for APAN/KOREN and Internet2 ? “VisiCalc” electronic spreadsheets on PCs “Mosaic” World Wide Web “Napster” Peer-to-Peer Computing “Digital Video in some form” expected to change …. How we teach, learn, collaborate, and conduct research in Higher education [Hanss 01] Digital Video : The Situation [Hanss 01B] Equipment is getting cheaper (production to delivery) Hardware and software are getting easier to use Video quality is improving IP-based delivery focus (versus ATM) Many standards are still being resolved Best practices are emerging Range of options means there’s no one solution Significant international cooperation Uses for Digital Video Videoconferencing Streaming video Live, Scheduled or On-demand 1-to-1 or 1-to-N Digital Video Technologies Technologies H.323 VRVS MPEG1, MPEG2, MPEG4 MJPEG IEEE1394 DV/Firewire Access Grid VIC/VAT/RAT H.323 Recommended for audio, video over best-effort packet switched networks Emerged from the telecommunications industry Point-to-Point and Multipoint videoconferences Enables collaboration - shared whiteboard, etc TCP for control, UDP for audio, video, status VRVS (Virtual Rooms Videoconferencing System) General Observations Client agnostic video conference system Vic/rat, existing H.323 clients, Minerva MPEG2 Developed and started to be deployed in Physics community (CERN, Caltech, …) Comparison to H.323 Uses same video/audio codecs (at initial phase) Software reflector versus hardware gatekeeper Windows, Unix clients available, Mac receivers Easily extensible (open source code) VRVS : example MPEG-1 General Observations 1-2 Mbps, free streaming clients available for broadcast & VODs from various vendors Many PCs have built-in MPEG1 decoding capabilities Appliances available Comparison to H.323 Video quality better than H.323, worse than VHS quality video Cost per sending station usually more than H.323 Some interoperability between products but no standards govern transport like H.323 Screen Shot(1): MPEG1 Live Broadcast and VOD MPEG1 Traffic Measurement Measured at SA Lab. Gateway (gw.kaist.kr.apan.net) ‘Daily’ Graph (2001.10.24) MPEG1 Multicast Traffic 1.5Mbps • ‘Weekly’ Graph (2001.10.17~2001.10.24) MPEG1 Multicast Traffic 1.5Mbps MPEG-2 General Observations Broadcast quality video with audio for high-quality video and digital television 3-15 Mbps (@ Main Level) No free streaming clients Expensive Hardware ($10-$25K per node) Interoperability between vendors non-existent Comparisons Better than VHS quality Camera Quality is VERY IMPORTANT with MPEG2 It’s wonderful when it works MPEG-2 Traveling Node (Internet2) 10Mbps MPEG2 Traffic Measurement • Measured at SA Lab. GW (gw.kaist.kr.apan.net) • ‘Daily’ Graph (2001.10.25) MPEG2 Multicast Traffic 10Mbps • ‘Weekly’ Graph (2001.10.18~2001.10.25) MPEG2 Multicast Traffic 10Mbps MPEG1 Multicast Traffic 1.5Mbps 6Mbps MPEG2 Traffic measurement KAIST MRTG graph Daily Graph (10.31~11.1) Weekly Graph (10.25~11.1) MPEG-4 Goal: to make low-bit rate multimedia data Good quality video/audio with lower bandwidth Near-DVD quality at 700K~2 Mbps Began July 1993 / Release February 2000 Apple Quicktime 6 and WMT 9 : based on MPEG4 Screen shot : APAN-KR TV multicasting, 2002.11.20 (Korea vs Brazil Soccer A match) • 640X480X30 fps, at 1.5Mbps, using (MPEG4-based WMT) + CastBox Overlay Multicast system • 300~400 clients for a few hours MJPEG General Observations 5-10 Mbps, video quality similar to MPEG2 Cheap Hardware : but you gotta roll your own Both software & hardware decoding clients are currently available from Berkeley http://www.openmash.org http://bmrc.berkeley.edu/~delco/rtpvb (RTPtv) Comparisons Great video, inexpensive, multipoint support Deployed today at Berkeley to support teaching Still work-in-progress, requires bandwidth IEEE1394 (Firewire) DV General Observations Uses IEEE1394(Firewire) device interface 30Mbps, video quality better than MPEG2 No encoding/decoding delays at PCs SDTV-quality interactive DV system http://www.sfc.wide.ad.jp/DVTS Promise of inexpensive high quality nodes COTS(commercial off-the-shelf) : DV camera, player, firewire boarded PCs/Notebooks Cheap Hardware, available on FreeBSD, NetBSD, Linux, MacOS X, and Windows Multicasting ? Manual/Adaptive Frame Rate control? (full/half/quarter, depending on available bandwidth) Equipments for Firewire DV[Jung 01] 1394 card(FireBird EZ) 1394 cable(4-6 pin) 노트북 1394 port DV Transport System [Ogawa 01] Consumer DV Camera Consumer DV Deck IEEE1394 Cable IEEE1394 Cable Internet DV→Internet PC Internet →DV PC DV Transport System Consumer DV Camera Consumer DV Deck IEEE1394 Cable IEEE1394 Cable Internet DV→Internet PC Internet →DV PC DV Transport System Consumer DV Camera Consumer DV Deck IEEE1394 Cable IEEE1394 Cable Internet DV→Internet PC Internet →DV PC DV/Firewire Experiments [Jung 01] IPv4 unicast test between Chonnam Univ. (Gwang-ju, about 250KM away from Daejeon) and KAIST(Daejeon) – 2001. 5 CNU DVTS sender -> KAIST receiver # dvsend –h 192.249.24.39 –I ohci0 # dvrecv DV/Firewire on Windows [Sul 01] Firewire DV Traffic measurement KAIST MRTG graph Access Grid [Hanss 01C] General Observations Group to group collaboration, persistent electronic presence, “Internet Café” 4 Video inputs per node, virtual rooms Multicast required!! (10-20 Mbps for a meeting) COTS technology - @ $40K for a node Comparisons Video/Audio quality about same as or better than H.323 Continuous, Multipoint presence is useful!! Mobile Access Grid Node Source: Argonne National Laboratory Access Grid “Look and Feel” Source: Argonne National Laboratory Access Grid “Look and Feel” Source: Argonne National Laboratory An Access Grid Room Considerations include room size; projector, microphone, speakers, and camera placement; ambient noise Presenter mic Presenter camera Ambient mic (tabletop) Audience camera Source: Argonne National Laboratory An Access Grid Room: Components Digital Video NETWORK RGB Video Display Computer Digital Video Video Capture NTSC Video Computer Audio Analog Audio Digital Audio Capture Computer Mixer Control Computer Echo Canceller Source: Argonne National Laboratory Access Grid “Look and Feel” Source: Argonne National Laboratory Internet HDTV Why Studio-quality HDTV over Internet? “Because We Can! ;-)” Gbps-level High bandwidth application Studio-quality compressed HDTV stream : 270Mbps (122GB/hour) Fully Uncompressed HDTV stream : 1.5Gbps (675GB/hour) no encoding/decoding delays (interactive applications) Jointly developed by Tektronix, http://www.researchchannel.org/tech/ihdtv.asp USC ISI, and UW. 270 Mbps Internet HDTV Demo. between Stanford and University of Washington (1999.9.22) Digital Video : Technologies and Products H.323 MPEG-1 MJPEG, MPEG4 MPEG2 1394 DV (Typical) Resolution 352X288 352X240 640X480(VGA) 720X480(SDTV) 720X480(SDTV) Bandwidth 128Kbps~1Mbps 1~2Mbps 2~15Mbps 30 Mbps Appliances Polycom, RadVision, VCON, Zydracon, .. ($2,000~$15,000) Provided by MPEG-2 products Or in-between Minerva, CAMVision-2, REIMAY BOX ($20,000~$60,000) * 150~300ms Delay N/A Servers Multiple Control Unit ($15,000~$100,000) Provided by MPEG-2 products Or in-between IBM VideoCharger CISCO IP/TV •3~10 sec. Delay •$2,000(S/W only) ~ $200,000 (+H/W) PC + DV Camera or DV Recorder Deck $2,000~$5,000 For PCs USB-based PC Cameras ($20~$1,000) , Free MS NetMeeting Provided by MPEG-2 products Or in-between Optibase cards ($5,000~$20,000), Reimay + SDK ($10,000~, no delay) No encoding cards, no delays (no compression) So, What Are People Doing with These Technologies? Digital Video Applications Video Conferencing and Streaming Remote Lecture/Seminar Music Teaching (Master Class) Virtual Concert (Halloween Concert) Virtual Conference (Megaconference) Remote Instrument Observation and Control (telescope, microscope, …) High-quality Internet TV/Video Portal Research Channel C-SPAN Broadcasting APAN-KR TV and Video Archive Visual History Foundation Animations and Immersive Environments Telecubicle (Office of the Future?) And A LOT more….. APAN-KR Digital Video Network Goal Experiment, Evaluate and Deploy Advanced Digital Video Technologies and Applications on Next Generation Internet in Korea/Asia-Pacific. As a basis for Research/Engineering Cooperation/Collaboration among APAN(-KR) members Technology/Knowledge Transfer Fill-up and make congestions on current high-bandwidth network!! to justify and request higher-capacity domestic network backbone, as well as international links,…. Say, “We need more bandwidth!!” ;-) APAN-KR Digital Video Network : Major Appllications Video Conferencing Network Tools testing, evaluation and deployment H.323-based clients and MCU VRVS clients and reflector Others (Mbone tools, Isabelle, …) backbone and Gbps Access Network Let’s move to Firewire DV, rather than H.323 from now on. 40Gbps Distance Education MPEG-1/MPEG-2/Firewire DV Remote Seminar/Workshop/Class Experiments (2001 Fall~) Now considering/evaluating MPEG-4 Video Archive MPEG-1/MPEG-2/RealVideo Others (being formed and proposed) “Cyber Performance Project”, Internet TV, … Remote Lecture/Seminar KAIST CS540 Network Architecture MPEG1 Live Web Presentation Virtual Classroom experiment (KAIST CS540 Network Architecture) Live Broadcasting Interactive Q&A H.323-based tools (Microsoft NetMeeting, …) 100ms < Delay < 500ms Mbone tools (vic, rat, wb, …) and VRVS Presentation Material CISCO IP/TV, MPEG-1 (1Mbps) or MPEG-2 (10Mbps) 4~5 seconds of delay Upload at course homepage before lecture begins and let audience access it remotely. VOD Archive Low-bandwidth (200Kbps) : Real Video Server High-bandwidth (with CISCO IP/TV) 1.5 Mbps MPEG1 : 600MB/Hour 10Mbps MPEG2 : 5GB/Hour 400GB = 80 X 1-hour MPEG2 movies CS540 Class Live Broadcast System … Thrunet CIRC GSR12012 1G 1G GNG CISCO IP/TV Viewer CISCO IP/TV Viewer KAIST Network (Chonnam Univ.) 1G 1G 1G EE Dept. C6509 KOREN CS540 Lecture Room 1G EE Dept. Network Admin. Building C6509 CISCO IP/TV Server 1G CD Dept. Network CISCO IP/TV Viewer (Encode and Unicast Live 1G CS Dept. C6509 155M Video feed ) SA Lab. GW SAL Network 100M CISCO IP/TV Content Manager CISCO IP/TV Viewer 100M Unicast Multicast CISCO IP/TV Viewer CISCO IP/TV Server ( VOD + Multicast Server) APAN-KR TV multicasting, 2002.11.20 (Korea vs Brazil A match) • 640X480X30 fps, at 1.5Mbps, using (MPEG4-based) WMT + CastBox Overlay Multicast system • 300~400 clients for a few hours APAN-KR TV Multicasting Network (http://tv.kr.apan.net) Encoder WMT Server & Web Server IPTV Server (?) Source Network KAIST SALAB Commodity Internet CastBox Relay KOREN CastBox Relay Encoder KJIST CastBox Relay CastBox Relay Encoder Zooin Net CastBoxCombo (Relay+ Manager) CastBox Relay Encoder Encoder Chonnam Univ. Encoder Chungnam Univ. APAN-KR TV homepage “Cyber Performance Project (being formed and proposed)” Joint Project between APANKR Overlay Multicast WG and Ewha Womans University’s Dance Performance Group. SDTV/HDTV quality real-time multicasting on KOREN. MPEG4-based SDTV quality (for lower-bandwidth users) Firewire DV (no delay, higher bandwidth) HDTV (option) Demonstration at APAN Busan Meetings? (2003 Aug.) Neul-hwee dance performance group, Ewha Womans Univ. Digital Video over Next Generation Internet [Hanss 01A] Advanced networks like APAN and Internet2 provide testbeds for these innovative uses of digital video. Colleges and universities are taking advantage of this opportunity by making significant investments in digital video applications. Research, teaching, and learning can all benefit from the uses of digital video in both collaboration and information dissemination. Although we cannot expect the technology to fully stabilize anytime soon, wise investments will lead to a better understanding of the future potential of video-based applications. Concluding Remarks Great Environment for exploring the future Performance Collaboration Education Opportunities for both content providers and hardware /software vendors. Cooperation/Collaboration between Universities, Internet Service Providers, Content Providers and Digital Video Product Providers Domestic (APAN-KR) as well as International (APAN/Internet2) cooperation/collaboration is compelling!! As the bandwidth of International links have increased to multi-Gbps level. Let’s Fill-up them and request more bandwidth proudly!! References [Hanss 01 A] Ted Hanss, “Internet2 Digital Video”, VIDOS Advisory Committee, Oxford University, Oxford, England, 2001.1.16 [Hanss 01 B] Ted Hanss, “Internet2 Killer App or Dilbert’s Nightmare?”, in EDUCAUSE Review Volume 36, Number 3, May/June 2001. [Hanss 01 C] Ted Hanss, “Introduction to Access Grid”, in EDUCAUSE 2001, Indianapolis, IN, 2001.10.29 [Riddle 01] Bob Riddle, “Looking over the H.323 Hill”, 2001.5.9 [Chon 01 A] Kilnam Chon, “Internet : Next Steps”, KRNET 2001, 2001.6.27 [Chon 01 B] Kilnam Chon, “Asia-Pacific International Connections Updates”, CCIRN 2001, 2001.6.8-9 [Ogawa 01] Akimichi Ogawa and Katsushi Kobayashi, “DV over IP”, APAN/NLANR/I2 Joint Tech Workshop, 2001. Jan. [Jung 01] Kugsang Jung, “1394 Digital Video Reports”, APAN-KR 2001 Fall Meetings, 2001. 9.20 [Sul 01] Hong-ki Sul, “1394 DV on Windows”, APAN-KR 2001 Fall Meetings, 2001.9.20. [Ahn 03] Sang-joon Ahn, “Cyber Performance Project”, Cyber performance project kickoff meeting, 2003.1.16. References ViDe http://www.vide.net SURA http://www.sura.org ResearchChannel http://www.researchchannel.com VRVS http://www.vrvs.org NLANR http://www.nlanr.net DVTS http://www.sfc.wide.ad.jp/DVTS/ Internet2 DVI http://dv.internet2.edu DV over NGI http://cosmos.kaist.ac.kr/salab/project/hdtv APAN-KR Internet TV (Overlay Multicast WG) http://tv.kr.apan..net APAN-KR http://kr.apan.net For more information on APAN-KR Overlay Multicast WG and Internet TV network, please attend Multicast BoF (Thursday 14:00~15:30, Room A) or contact WG chair, Joonbock Lee (jblee@cosmos.kaist.ac.kr)