V O P Voice over Packet Yaakov (J) Stein Chief Scientist RAD Data Communications YJS Y(J) Stein VoP1 1 V O Voice over Packet What is this course all about? P NOT course on Voice over IP (although we may use VoIP as an example) Voice means “telephony voice” (not high-quality or communications-quality) Packet means any cell or packet-based data network (FR,ATM,IP,etc) Most of the course is about the over all the mechanisms needed to carry voice on a packet network Everything in common to VoIP, VoATM, VoFR, VoDSL, VoCATV, etc YJS Y(J) Stein VoP1 2 TOC V Course Outline -1- O P Introduction – – – – Digital Voice Processing – – – – YJS PSTN Review history and terminology Packet networks IP, FR, ATM The case for VoP PSTN Emulation Speech production mechanisms pitch, formants, LPC, cepstrum Speech perception mechanisms hearing, psychophysics Simple Voice DSP gain, AGC, simple-VAD Complex Voice DSP correlation, pitch, U/V, LPC, LSP Speech Compression – Simple coders G.711, ADPCM – ABS CELP coders G.723.1, G.728, G.729 – Other coders MELP, MBE, STC, WI Y(J) Stein VoP1 3 TOC V Course Outline -2- O P Other features – Echo cancellation – Modem/fax relay Qos – Paying for QoS – Speech quality measurement PSQM, PESQ, E-model VoX – – – – – – – YJS VoIP VoFR VoATM VoDSL VoCATV TDMoIP VoCATV Y(J) Stein VoP1 4 V O P PSTN Review YJS Y(J) Stein VoP1 5 V O PSTN Review The PSTN circa 1900 P pair of copper wires “local loop” manual routing at local exchange office • Analog voltage travels over copper wire end-to-end • Voice signal arrives at destination severely attenuated and distorted • Routing performed manually at exchanges office(s) • Routing is expensive and lengthy operation • Route is maintained for duration of call YJS Y(J) Stein VoP1 6 V PSTN Review Multiplexing O 1900: 25% of telephony revenues went to copper mines standard was 18 gauge, long distance even heavier P two wires per loop to combat cross-talk needed method to place multiple conversations on a single trunk 1918: “Carrier system” (FDM) 5 conversations on single trunk later extended to 12 (group) still later supergroups, master groups, supermaster groups 1963: T-carrier system (TDM) YJS channels f timeslots T1 = 24 conversations per trunk later T3 = 28 T1s still later SDH rates with 1000s of conversations per trunk t Y(J) Stein VoP1 7 V PSTN Review PSTN Topology O P local loop Local Exchange subscriber line Local Exchange Long distance network Local Exchange trunk circuit Many local telephone exchanges had sprung up Bell Telephone acquired them and interconnected them for long distance YJS Y(J) Stein VoP1 8 V O P PSTN Review Switching / routing Originally All switching was manual All routing was unprincipled Both were expensive and performed once per call 1879 Connolly & McTigthe invent automatic switching 1888 Strowger invents dial telephone and automatic telephone exchange 1892 first public automatic exchange (La Porte, Indiana) 1902 first rotary dial phone 1917 Blauvelt invents large city numbering plan 1930 tandem crossbar switch 1953 centralized automatic message accounting (call billing) 1963 touch-tone dialing 1970 Erna Hoover invents computerized telephony switch YJS Y(J) Stein VoP1 9 V PSTN Review Old US PSTN O Regional centers Class 1 P Class 2 Class 3 Class 4 Class 3 Class 4 Sectional centers Class 2 Class 4 Class 3 Class 4 Primary centers Toll (tandem) offices circuits,trunks Class 5 Class 5 local loop Class 5 subscriber lines Class 5 Class 5 Central (end) offices last mile Class 5 switch is the sole interface to the subscriber lines YJS Y(J) Stein VoP1 10 V O PSTN Review Optimized Telephony Routing P Circuit switching (route is maintained for duration of call) Route “set-up” is an expensive operation, just as it was for manual switching Today, complex least cost routing algorithms are used Call duration consists of set-up, voice and tear-down phases YJS Y(J) Stein VoP1 11 V PSTN Review Signaling O P PSTN with automatic switching requires signaling The present PSTN has thousands of features and all require signaling support Examples: On-hook / off-hook Pulse / Tone dialing Receiver off-hook Call waiting Caller number identification Call forwarding Hook-flash YJS Fax transmission detect Inter-CO messaging Echo cancellation Voice mail Conference calls Coin-drop Billing Y(J) Stein VoP1 12 V PSTN Review Signaling Methods O P Signaling can be performed by several methods Analog voltage signaling In-band signaling Channel associated signaling (CAS) Common channel signaling (CCS) E&M, ground-start, loop-start DTMF, MFR1, MFR2 AB bits, ABCD bits SS7, QSIG – Trunk Associated CCS – Separate signaling network CCS YJS Y(J) Stein VoP1 13 V O PSTN Review The PSTN circa 1960 trunks P circuits local loop subscriber line automatic routing through universal telephone network • Analog voltages used throughout, but extensive Frequency Division Multiplexing • Voice signal arrives at destination after amplification and filtering to 4 KHz • Automatic routing • Universal dial-tone • Voltage and tone signaling • Circuit switching (route is maintained for duration of call) YJS Y(J) Stein VoP1 14 V PSTN Review The Digitalization of the PSTN O P Shannon (Bell Labs) proved Digital Analog is better than Communications Communications and the PSTN became digital Better means YJS More efficient use of resources (e.g. more channels on trunks) Higher voice quality (less noise, less distortion) Added features Y(J) Stein VoP1 15 V PSTN Review Timing O P YJS In addition to voice, the digital PSTN transports timing This timing information is essential because of – the universal use of TDM – the requirement of accurate playback (especially for fax/modem) Receiving switches can recover the clock of the transmitting switch Every telephony network has an accurate clock called “stratum 1” Clocks synchronized to it are called “stratum 2” Clocks synchronized to them are called “stratum 3” and so on Y(J) Stein VoP1 16 V PSTN Review The Present PSTN O core P backbone subscriber line PSTN Network • Analog voltages and copper wire used only in “last mile”, but core designed to mimic original situation • Voice signal filtered to 4 KHz at input to digital network • Time Division Multiplexing of digital signals in the network • Extensive use of fiber optic and wireless physical links • T1/E1, PDH and SONET/SDH “synchronous” protocols • Signaling can be channel/trunk associated or via separate network (SS7) • Automatic routing • Circuit switching (route is maintained for duration of call) • Complex routing optimization algorithms (LP, Karmarkar, etc) YJS Y(J) Stein VoP1 17 V O PSTN Review Nonvoice services The PSTN can even be used to transport non-voice signals P such as FAX or DATA VoP course PSTN These services disguise themselves as voice by using a modem Proper timing is essential Special signaling is required – turn off LEC – turn off call waiting – service recognition YJS – capabilities negotiation – mutual identification – end of page/document – modem recognition – modem training – data compression Y(J) Stein VoP1 18 V O P PSTN Review Digital Loop Carrier Pushes the digital PSTN closer to customer “pair-gain” AT&T SLC-40, SLC-96, Nortel DMS P-phone, TR-08 Mode 1 pair-gain: Replace 96 pairs with 5 T1s Access Network CLASS 5 (one spare for “span protection”) UTP/coax/fiber Street FTTB/FTTC cabinet CPE 96 – 10 = 86 TR-08 Mode 2 pair-gain: Replace 96 pairs with 2 T1s pedestal (without “span protection”) UTP 96 – 4 = 92 TR-08 multiplex 96 lines on: Mode 1: 4 T1s Mode 2: 2 T1s (2:1 concentration) GR303/V5.1/V5.2 multiplex up to 2048 lines YJS Y(J) Stein VoP1 19 V O P Packet Networks YJS Y(J) Stein VoP1 20 V O P Packet Networks Earliest Data Comm Earliest data communications were serial bit streams Basic data unit is the character (5, 6, 7, or 8 bits) Start-stop protocol delineates individual characters Rate limited to thousands of characters per second Initially range limited to tens of meters … later modems extended range Terminal – computer and computer – computer used the same protocol RS 232 YJS Y(J) Stein VoP1 21 V O P Packet Networks Data in Packets Problems with serial communications protocols Large overhead (encapsulation per character) Dedicated resources 1961 Kleinrock article on packet switching network 1962 ARPA computer program begins 1967 first use of word “packet” 1969 ARPANET becomes operational (UCLA, SRI, UCSB, Utah) 1972 first email YJS Y(J) Stein VoP1 22 V Packet Networks Packet Switched Networks O P YJS US DOD project to design a data communications network Design goal was reliability under attack Advanced switch technology enabled routing-on-the-fly Design produced Internet Protocol – Data stream divided in variable-length packets – Each packet routed individually (connectionless) • Perhaps less optimal, but it’s only for one packet! • Consecutive packets may take different paths – Best-effort packet delivery – No inherent timing, QoS or traffic-engineering mechanisms – Packets can • be corrupted or lost • arrive out-of-order • be duplicated Y(J) Stein VoP1 23 V O P Packet Networks Different PSNs Many different Packet Switched Networks Internet Protocol TCP, UDP, SCTP, RTP Frame Relay ATM MPLS Ethernet LAN, GbE, EFM DSL HDSL, SHDSL, ADSL, VDSL L2TP L2TP/UDP, L2TPv3 YJS Y(J) Stein VoP1 24 V Commonality O P Layered structure not always OSI 7-layer model Headers more prevalent Use of headers, trailers and payload OSI uses only headers header Payload may be adapted Successive SDU -> PDU header YJS payload header payload trailer Service Data Unit Protocol Data Unit trailer trailer Y(J) Stein VoP1 25 V Packet Networks IP O designed to robustly interconnect data terminals P protocol suite for intranets and internets defines all layers except physical (layer 1) Eth, ATM, SONET variable length packets best effort packet delivery, no QoS guarantees connectionless, virtual connection TCP, SCTP unreliable UDP, reliable TCP, highly reliable SCTP RT support RTP, RTCP, RTSP tunneling support PPP, L2TP standards body: IETF YJS Y(J) Stein VoP1 26 V Packet Networks IP O ver len TOS ID P TTL total len flgs prot frag offs hdr chksum src IP add dest IP add options padding TCP UDP src port dest port src port seq num length dest port chksum ack num offs res flags chksum options window urgent ptr padding payload YJS Y(J) Stein VoP1 27 V Packet Networks Frame Relay (FR) O P YJS designed as WAN to connect LANs over low-speed link low overhead and simple processing defines layers 1 (physical) and 2 (data-link) variable length packets best effort packet delivery, no QoS guarantees connection oriented unreliable, but committed info rate standards bodies: ITU-T, FRF Y(J) Stein VoP1 28 V Packet Networks Frame Relay (FR) O P flag payload FR header 8 flag 16 8 8 DLCI C/R EA 6 YJS FCS 1 1 DLCI 4 F E C N1 B E C N1 DE EA 1 1 Y(J) Stein VoP1 29 V Packet Networks ATM O P YJS Asynchronous Transfer Mode designed as wideband ISDN fast switching defines layers 1-4 (physical, data-link, network, transport) small constant length packets (cells) 53=5+48 cell tax multiservice (data, CBR/VBR voice/video) QoS levels and guarantees connection oriented standards bodies: ITU-T, ATMF Y(J) Stein VoP1 30 V Packet Networks ATM O 5-byte header P 48 byte payload AAL1 connection oriented CBR (GFC) VPI VCI PTI CLP HEC AAL2 connection oriented VBR AAL5 connectionless data packets GFC General Flow Control VPI Virtual Path Indentifier VCI Virtual Channel Indentifier PTI Payload Type Identifier CLP Cell Loss Priority HEC Header Error Control YJS VC VC VP Y(J) Stein VoP1 31 V DSL O P YJS designed to reuse subscriber lines for broadband layer 1 (physical) protocol (modem) many varieties HDSL, SHDSL, ADSL, VDSL FDM of data with POTS synchronous but transports packet data cVoDSL for synchronous voice standards bodies : ITU-T, ETSI TM6, T1E1.4, DSLF Y(J) Stein VoP1 32 V O P Packet Networks TDM / PDH / SDH The PSTN is not a PSN ! T1 …S 1 2 3 4 Same data rate even when no data! … 23 24 S 1 2 3 … 31 32 1 2 … frame 193b E1 … 1 2 3 4 32 B YJS … Frame every 125 msec frame STM-1 3 … … frame 9 * 270 B Y(J) Stein VoP1 33 V O P The Case for VoP YJS Y(J) Stein VoP1 34 V VoP Case Voice over PSN O P We saw that data transported over voice network Should we “turn the tables” and transport voice over data networks? Economics PSTN keeps circuit open for call duration packet networks use only resources truly needed Convergence we need only maintain a single network Added value enables new applications (video, white-boards, ftp, presence, voice browsing, etc.) YJS Y(J) Stein VoP1 35 V VoP Case Voice over PSN O P There are a few problems … YJS Voice has to be “packetized” (what size packets?, preprocessing?) Not a synchronous stream; no timing distribution Packets arrive after random delays Packets may arrive out-of-order Packets may be lost Reliability Y(J) Stein VoP1 36 V VoP Case PSTN Accessibility O P The PSTN has 560 Million subscriber lines worldwide (156 M in US) Total traffic CAGR 5% 100 Million fax machines (45 M in US) Fax traffic CAGR 12% >1.5 Billion people with access to fax Is there any business reason to transport voice otherwise? YJS Y(J) Stein VoP1 37 V O P VoP Case Data Traffic Growth Relative Capacity 250 200 150 100 50 0 1996 1997 1998 1999 2000 2001 Data traffic growing much faster than voice (already more) Internet capacity increasing by factor of 10 each year YJS Y(J) Stein VoP1 38 V VoP Case Revenue Breakdown O P AT&T 1998 figures 51% switched (long distance) voice (incl. fax) service 45.3% leased line service 1.6% FR 1.5% IP 0.7% ATM So data traffic is increasing fast because it’s cheap! The killer-app from revenue point of view is voice YJS Y(J) Stein VoP1 39 V VoP Case Typical VoP Applications O P YJS PC – PC communications (VoIP,VoDSL) Integrated Access Devices (VoATM,VoIP) Enterprise/campus convergence (VoFR,VoATM) Toll-bypass (VoFR, TDMoIP) Access networks (VoDSL, VoATM, VoCATV) Y(J) Stein VoP1 40 V O P PSTN Emulation YJS Y(J) Stein VoP1 41 V O PSTN Emulation Encapsulation We would like to use the standard PSN technique P header TDM payload trailer but TDM payloads have no natural size packet ! The header will typically contain YJS addresses identifiers status, alarms sequence number timestamp control information Y(J) Stein VoP1 42 V PSTN Emulation Sequence Numbers O P Packet numbering is needed to detect packet loss (mainly for timing - RT systems do not retransmit) 135 YJS 138 139 correct for misordering 135 136 137 136 138 supply timing when source is synchronous Y(J) Stein VoP1 43 V O P YJS PSTN Emulation Timing PSNs introduce delay variation (jitter) How does PSTN emulation replicate timing? Station clock Clock distribution Adaptive clock Y(J) Stein VoP1 44 V O PSTN Emulation RTP with IP/UDP P IP header (5 dwords) UDP header (2 dwords) RTP header (> 3 dwords) PAYLOAD YJS Y(J) Stein VoP1 45 V O P PSTN Emulation RTP Header (RFC 1889) 0 1 2 3 01234567890123456789 012345678901 V P X CSRC M PAYLD TYPE SEQUENCE NUMBER TIMESTAMP SSRC ID YJS V version number CSRC contributing source P padding indicator M marker bit X extension indicator SSRC sync source identifier Y(J) Stein VoP1 46 V O P PSTN Emulation Types of PSTN Emulation Call (session) emulation – Emulates single call – Voice and end-user signaling Loop emulation – Emulates trunk composed of individual loops – Only transports active loops (timeslots) Circuit emulation – Emulates entire circuit (trunk) – Does not deal with individual timeslots YJS Y(J) Stein VoP1 47 V PSTN Emulation Payload Types O Call emulation Leased line emulation header H.225 … 31 32 CES (AAL1) header N voice samples P 1 2 3 4 1 2 3 4 … 31 32 1 2 ptr 3 4 … 31 32 1 … 31 32 1 2 2 … LES (AAL2) TS1 YJS header 4 TS2 TS3 … TSn Y(J) Stein VoP1 48 V O P PSTN Emulation Extent of Emulation End-to-end emulation Edge-to-edge emulation Link emulation core switches edge switch YJS edge switch Y(J) Stein VoP1 49 V PSTN Emulation Emulation Elements O P YJS PSTN emulations may have the following elements End-points phone, user agent (UAC,UAS), Gateways IWF, SoftSwitch Intermediaries – Proxies, Redirectors – Mixers Address and location servers gatekeeper, registrar terminal PSN PSTN GW Y(J) Stein VoP1 50 V O P PSTN Emulation Decomposed GWs Voice GWs need to handle both voice and signaling Scalability increased by separating this functions Media GW MG handles all voice (DSP) functions Media GW controller MGC handles all signaling “intelligence” Optionally there may be a signaling GW SG MGC (master) can control multiple MGs MG (slave) is stateless and is unaware of call status MGC-MG : Megaco/H.248, MGCP MGC-SG : SCTP MGC-MGC : SIP, H.323, SDP MG-MG : RTP, AAL1, AAL2 YJS Y(J) Stein VoP1 51 V PSTN Emulation Switching/routing emulation? O Emulation relies on switching/routing P of the underlying PSN Need to convert PSTN address to PSN address Often put PSN address in header Need virtual connection for duration of the call Call phases – Setup – media transfer – Tear down YJS Y(J) Stein VoP1 52 V PSTN Emulation Signaling emulation? O P Only “in-band” signaling is automatically transported For other methods there are two options Transparent Signaling – Carry CAS bits (e.g. TDMoIP) – Trunk associated SS7 Signaling Translation – H.323 translates some PSTN signaling to H.225/H.245/H.450 – Problem: there are thousands of features! YJS Y(J) Stein VoP1 53 V PSTN Emulation PSTNoPSN O P Fax PSN GW PBX GW PSTN YJS Y(J) Stein VoP1 54