06.April 2006 Introduction to UMTS Radio KPI 3G network planning introduce www.huawei www.huawei.com .com Huawei Northwest Africa Region RNP Solution Manage: William.chen William.chen@huawei.com HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Agenda n UMTS Radio KPI overview n 3G Network Optimization n Case Study of KPI Optimization HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 2 3G KPIs Principle: S.M.A.R.T Specific Measurable Attainable Relevant Time-bound the KPI has clear and complete definition and formula, include check point and procedure. KPIs are measurable by given condition, measurement equipment and procedure. all the KPIs should be reachable, it is refer to the commercial network. the KPI can show the subscriber experience the KPI target should be on the base of time-bound HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 3 3G KPIs : Specific Complete KPI definition include the formula combine with the check point or procedure. The example: RRC Connection Successful Rate n formula RRCS_SRService = RRCConnectionSuccessservice ×100% RRCConnectionAttempt service n Check point The number of “RRC Connection Attempt” is A1 or A2? A2 represent the effective number of “RRC Connection Attempt”. HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 4 3G KPIs : Measurable – Drive Test n Field Test -> Drive Test Evaluate the overall network performance, usually on the network pre-launch phase and initial stage of commercial launch. Test platform Multiple test model UEs can perform different tests. Data analysis Probe & Assistant is used for analyzing test data HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 5 Driver test route is based on cluster, it is involved about 20 sites in one cluster usually. 3G KPIs : Measurable – Stationary test System KPI is suggested to be test by stationary: n Field Test ->stationary Test Evaluate the system / equipment performance. n Throughput KPI n Delay KPI n Quality KPI Core Network Stationary test condition is fixed, and usually used in indoor test scenario. NodeB RNC NodeB System performance nEquipment ability nTransmission nNetwork construct n…. Radio Network performance nRadio network planning nSpecial environment condition HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 6 Radio Network KPI test is suggested to be test by drive test n Call drop rate n Handover successful rate 3G KPIs : Measurable – Statistic test n Statistic Test Nastar server Monitoring & analysis center Recommended for security Essential Optimization team OM system Pre-Condition for Statistic Test Subscriber care center Local networks HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com There must be enough statistic sample, that Terminal: ordinary PC or laptop, no distance mean network traffic should be reach high limitation level. Any corresponding dept. Page 7 Huawei KPI test platform comprehensive analysis of the performance, configuration, alarm GENEX Nastar 3G iManagerTM M2000 obtaining test data op para tim me iza tion ter fil au es to de matic l ive sharing of ry Node B analysis results RNC v GENEX Probe GENEX Assistant 3G v AGILENT Node B v QUALCOMM v HUAWEI RNC HLR/AC multiple test data Node B RNS wireless test data GENEX Probe WCDMA R NC te d a ta s t MSC/SSP/ VLR Node B RNC GMSC/SSP CN GENEX UNet Node B Node B network pre-planning/planning HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 8 RNS PSTN PLMN ISDN 3G KPIs: Relevant Examples of User Experience (QoE) completion of a download file End-to-end response is fast The voice and video is Clare Voice, Video Phone, MMS, WAP, Email, FTP, HTTP… Service Performance Radio Network KPI AMR12.2, CS64k,PS64k/128k/384k, HSDPA/HSUPA Accessibility Retainability Integrity Mobility Utilization Statistic / Measurement data HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 9 Availability Huawei 3G KPIs Architecture 3G KPIs Accessability Retainability • Call Setup Success Rate (Voice/VP) • Call Drop Rate (Voice/VP) • PDP Context Activation Success Rate • PDP Context Drop Rate Service Integrity • PS Throughput PDF created with pdfFactory Pro trial version www.pdffactory.com • SHO Success Rate • Hard Handover Success Rate • SMS/MMS Success Rate HUAWEI TECHNOLOGIES CO., LTD. Mobility • Inter-RAT Handover Success Rate Page 10 Delay/Latency Availability • Call Setup Delay (Voice/VP) • Worst Cell Rate • PDP Context Activation Time • RTT 3G KPIs: It is not only a value 3G KPI is not only a value, but a system, for example of CDR (Call Drop Rate) Network Planning Network Construct optimization Root cause drop-call Coverage Hand over 59.45% Transmission 10.02% Pilot pollution 7.29% Neighbor cell 2G Transport problem Interference Scramble congestionresource 4.56% HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com 0.68% Page 11 0.68% 3% 2.28% Others 11.94% Call drop cause 3G KPIs: Attainable 3G KPI is output of combination with investment include technology, HR, cost, competition strategy etc. Cost Huawei KPI comply principle: n Huawei will be responsibility for every complied KPI; Reasonable n Cooperate with Mobilis to work out a Competitive KPIKPI; target n Use the experience from other commercial network; Competition Attainable Common target for Mobilis and Huawei HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 12 Technical 3G KPIs: Time-bound nMature Network nOngoing Optimization 100 100 90 90 80 80 70 70 60 60 50 4050 3040 2030 1020 010 0 0 0 3 3 6 6 9 9 12 12 15 15 18 18 21 21 24 24 27 27 30 30 33 33 36 36 39 39 42 42 45 45 48 48 ü Drive Test KPIs ü Stationary test KPIs ü Network Statistics Number of Sites Number of Sites ü Network Statistics ü Benchmark test nCommercial Launch Nastar Probe & Assistant Probe & Assistant n Pre-Launch KPI Acceptance Ea lif c h K ed P ur I h at a s io n Probe & Assistant ü Drive Test KPIs ü Stationary test KPIs nNetwork construct HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 13 ü Site verification Recommend test methodology Pre-launch Acceptance On-going Optimization RRC connection success rate Drive Test - Call setup success rate Drive Test Statistic Test PDP activation success rate Drive Test Statistic Test CS Call drop rate Drive Test Statistic Test PS Call drop rate Drive Test Statistic Test CS Call complete rate - Statistic Test PS Call Complete rate - Statistic Test HSPA Call drop rate Stationary Stationary R99 PS Throughput Stationary Stationary HSPA Throughput Stationary Stationary Soft handover success rate Drive Test Statistic Test Inter-RAT handover success Drive Test Statistic Test Test Methodology rate HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 14 Contents • UMTS Radio KPI overview • 3G Radio Network Optimization • Case Study of KPI Optimization HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 15 Optimization throughout Life Cycle Subs. Number • RF adjustment Drop call • Para. adjustment Congestion • Maintenance and upgrade Poor quality • Contingency planning Access failure …… • Network expansion Pr ob an lem dr a es nal y olu s tio is n Pre-launch optimization Single site verification • ……. Customized and differentiated services Billing strategies Investment RF plan review Construction phase Troubleshooting DT & CQT Commercia l launch HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com KPI analysis Complaints Booming phase Optimizing Page 16 Return Mature phase Balancing Time Network Optimization Phases Optimization preparation RF optimization Service test and parameter optimization New site integrated Routine drive test and stats. analysis Single site verification N 80% sites in the cluster ready? N Y Acceptance criteria satisfied? Y Acceptance HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 17 RF Optimization Target n To optimize coverage n To minimize pilot pollution n To optimize cell dominance n To optimize neighbor cell list n To resolve RF-related drop calls HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 18 RF Parameters Optimization n Engineering parameters adjustment To adjust antenna down tilt To adjust antenna azimuth To adjust antenna location To adjust antenna height To replace antenna To replace site To add new cell n Radio part parameters adjustment To optimize neighbor cell list HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 19 Pilot Pollution Minimization Pilot pollution definition: Pilot pollution will result in: (1) low signal quality (2) decreased system capacity (3) Call drops easier n SHO candidates (A) n Active set size (B) n If A>B, pilot pollution exists -60 RSCP (dBm) -65 Margin -70 -75 -62 -64 -80 -66 -68 Ways to optimize: (1) Antenna adjustment (e.g. azimuth or down tilt) (2) Pilot power optimization -69 -85 -81 -90 SC1 SC2 Active Set SC3 SC4 SC5 Pilot Pollution HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com SC6 Not Pilot Pollution Page 20 Pilot Pollution: Example HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 21 RF-related Drop Calls Appearance Problems n Poor coverage Poor RSCP & Ec/Io n High interference Poor Ec/Io or RTWP n Poor UL coverage UE max Tx power n Poor dominance many SHO events n Pilot pollution many cells present n Missing neighbors Fast change of RF conditions usually causes drop calls, e.g. turning a corner. HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 22 Para. Optimization Target n To reduce access failures n To reduce drop calls Para. optimization is an important step after RF optimization n To enhance service quality Service quality and network resources utilization will be improved after para. optimization HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 23 Parameters to be Optimized n CCCH power allocation para. n RL maximum power para. Seldom adjusted n Cell re-selection para. n Intra-freq. handover para. An effective way to reduce drop calls n Inter-RAT handover para. n Power control para. n Access power para. The influence caused by the cell parameters adjustment should be analyzed carefully. n Other related para. HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 24 Intra-freq. Re-selection Para. Optimize Treselection, Qhysts and Sintrasearch so as to have minimum ping-pong and minimum camped onto wrong cell Qhyst2 CPICH_Ec/Io The black dotted line is the serving cells. CPICH_Ec/Io Qhyst2 Qhyst2 Qhyst2 Qhyst2 The black dotted line is the serving cells. UE doesn’t camp onto the best cells. Sintrasearch Qqualmin UE doesn’t camp onto the best cells. Qqualmin Treselection Treselection Treselection Treselection Treselection Treselection, Qhyst2, Sintrasearch = 0 HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Treselection Treselection, Qhyst2, Sintrasearch != 0 Page 25 Time Contents • UMTS Radio KPI overview • 3G Radio Network Optimization • Case Study of KPI Optimization HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 26 Case study from commercial projects • Example of Accessibility KPI analysis • Example of Call Drop KPI issue & solution • Example of Throughput KPI issue analysis HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 27 Example of accessibility KPIs issue Trouble-shooting of RRC setup and RAB assignment problems: • STEP1: Identify the counter with the highest number Breakdown of CS RAB failure (Counters) VS.RAB.FailEstCS.I UB.Band • STEP2: Identify the Top 10 cells with the same problem VS.RAB.FailEstabCS. Other.Cell Breakdown of CS RRC failure (Counters) VS.RRC.Rej.R VS.RRC.Rej.Cod Definition of Counters L.Fail e.Cong l VS.RAB.FailEstPs.IUB.Band: The number of RABs unsuccessfully established in a cell due to IUB resource congestion causes. • VS.RAB.FailEstabCS.Other.Cell: Pre-admission control module reports a resource congestion. HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com VS.RAB.FailEstPS. RIPFail Page 28 VS.RRC.Rej.UL.C RRC.FailConnEstab. E.Cong NoReply • VS.RRC.Rej.UL.CE.Cong: RRC setup failure due to lack of UL CE resources Analysis The “worst” sites (cells) that have been found to have both IUB and CE congestion issues: n0109TO (cell id 578/579/580) n0111TO (3882/3883/3884) n0070TO (18641/18642/18643) UL CE Occupation Rate NodeB Name 2007-02-19 2007-02-20 2007-02-21 2007-02-22 0070TO 120.83% 132.29% 132.29% 171.88% 0109TO 142.71% 175.00% 175.00% 180.21% 0111TO 158.33% 132.29% 132.29% 148.96% HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 29 Suggested solution A comparative analysis shows that, if excluding the problematic sites, the KPI would improve substantially, say, AMR RAB assignment success rate from 97.79% to 98.09%: RRC Connection Setup Success Rate (CS)(>98%) AMR RAB Assignment Success Rate(>98%) Video Call RAB Assignment Success Rate(>98%) PS64 RAB Assignment Success Rate(>97%) PS128 RAB Assignment Success Rate(>97%) PS384 RAB Assignment Success Rate(>97%) KPIs (including IUB KPIs (without IUB Congestion sites) Congestion sites) 99.17%(313992/316615) 99.35%(256449/258126) 97.79%(294499/301169) 98.09%(241127/245815) Suggested action plan: • CE/IUB expansion 98.31%(3314/3371) 98.67%(2891/2930) 84.93%(2462/2899) 83.10%(1981/2384) 98.48%(16674/16932) 98.80%(13638/13803) 97.53%(58114/59584) 97.81%(48854/49946) HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 30 • Perform regular neighbour list check to further tune the performance Case study from commercial projects • Example of Accessibility KPI analysis • Example of Call Drop KPI issue & solution • Example of Throughput KPI issue analysis HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 31 Example of Call drop rate issues Drop Call Rate Voice(3G) Drop Call Rate Video(3G) Drop Call Rate (2G) AMR12.2 Call Drop Rate 3.5% Voice call drop rate changes over a threemonth optimization period 3.0% 2.5% 2.0% 1.5% 1.0% 0.5% Zone1 Solving Voice call drop rate problems in Top 3 zones HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com 2006-03-19 2006-03-17 2006-03-15 2006-03-13 2006-03-11 2006-03-09 2006-03-07 2006-03-05 2006-03-03 2006-03-01 2006-02-27 2006-02-25 2006-02-23 2006-02-21 2006-02-19 2006-02-17 2006-02-15 2006-02-13 2006-02-11 2006-02-09 2006-02-07 2006-02-05 2006-02-03 2006-02-01 2006-01-30 2006-01-28 2006-01-26 2006-01-24 2006-01-22 2006-01-20 2006-01-18 2006-01-16 0.0% Zone2 Zone3 Page 32 What measures were taken to solve the call drop problems? Zone Action time Call drop rate reduction Optimization measures Zone 1 Feb. 14-17 1.57%->1.27% Zone 2 Feb. 23-25 1.38%->1.21% Zone 3 Mar.2-6 1.34%->1.10% ü Scrambling code planning adjustment ü System/handover parameter tuning ü Neighbour list optimization ü RF optimization, etc. HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 33 Case study from commercial projects • Example of Accessibility KPI analysis • Example of Call Drop KPI issue & solution • Example of Throughput issue analysis HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 34 Example of throughput KPI issues 45 Huawei sites provide coverage for DT route (Madrid South East) Group Service FTP application throughput I/B PS UL:384 DL:384 Minimum application throughput DL HSDPA Target Valid calls Successful KPI UL > 300 kbps DL > 361 kbps 118 (UL) 87 (DL) 118 (UL) 87 (DL) 319 (UL) 293 (DL) > 384 Kbit/s 87 87 280 HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 35 Analysis: coverage problems RNC 123 RNC 122 Areas that lack dominant pilot Drive test route involves 3 Huawei RNCs and 1 Nortel RNC RNC 121 HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 36 The impact of missing neighbours • DL R99 throughput has been impacted by the interference generated by missing neighbors, mostly concerning the new sites that had been recently put on air • Areas with low throughput corresponds to bad Ec/Io figures and HHO to 2G Low throughput UE handover to GSM HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com Page 37 Other causes In addition to coverage and missing neighbour causes, the HSDPA minimum throughput problem is due to: • • DT route crosses the IUR area where HSDPA calls are reconfigured to DCH (H2D) UE moves from a non-hotspot to a hotspot site in HSDPA connected mode RNC 122 RNC 123 RNC 122 RNC 123 RNC 121 HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com RNC 121 Page 38 06.April 2006 Thank You www.huawei.com www.huawei .com HUAWEI TECHNOLOGIES CO., LTD. PDF created with pdfFactory Pro trial version www.pdffactory.com