Huawei eRAN KPI introduction (eRAN 6.0) www.DigiTrainee.com Company Confidential Contents 1. KPI System Overview 2. KPI Detail Description 3. Recommended KPIs www.DigiTrainee.com Company Confidential 1. KPI System Overview www.DigiTrainee.com Company Confidential KPI System Overview Radio Network KPI : Service KPI : Focus on the radio network performance Focus on the user experience LTE KPIs Accessability Retainability Mobility Availability Utilization Traffic Latency Integrity •RRC SETUP SR •HHO SR ( Intra/Inter Frequency ) •Radio Network Unavailabi lity Rate •UL/DL RB Utility Rate •Cell UL/DL Traffic Volume •Access Latency •Service UL/DL Throughput •ERAB Setup SR (VoIP/ALL) •Call Setup SR (VoIP/ALL) •Call Drop Rate (VoIP/ALL) •Call Setup Complete Rate (VoIP/ALL) •HO in SR •Inter-RAT HHO SR www.DigiTrainee.com •Radio Bearer Number •Service Latency •Interrupt Latency Company Confidential KPI Attained Approach o In general, there are two approaches to define/attain KPIs: By statistics /Counter: Most of KPIs are attained by this approach, such as RRC Success Rate, HHO Success Rate… By drive test / Stationary test: Some KPIs should be attained by drive test, such as Attach Latency, Handover late cy… www.DigiTrainee.com Company Confidential Measurement Object for Counter o Each measurement result is related to a specific measurement object. o Counters are organized by Measurement Unit/Family. Measurement Object Measurement Family 1 Measurement Measurement Unit 1 Unit 2 Counter 1 Counter 2 Counter 3 Counter 4 …… Measurement …… Family 2 Counter 5 Counter 6 Counter 7 www.DigiTrainee.com …… …… Company Confidential Collection Method and Reporting Period o Collection methods (TS 32.403) CC (Cumulative Counter), for example, Attempted RRC connection establishments; GAUGE (dynamic variable), used when data being measured can vary up or down during the period of measurement, for example, Maximum E-RAB Setup time; DER (Discrete Event Registration), when data related to a particular event are captured every nth event is registered, where n can be 1 or larger, for example, o Cell Unavailable Time, Mean E-RAB Setup time; SI (Status Inspection), for example, Average Number of simultaneous E-RABs; Reporting period The measurement results are collected in a pre-defined reporting period, and this reporting period, in general, is configurable at EMS, for example, 15mins, 60 i s… www.DigiTrainee.com Company Confidential 2. KPI Detail Description www.DigiTrainee.com Company Confidential KPI Detail Description o Accessibility o Retainability o Mobility o Availability o Utilization o Traffic o Integrity o Latency www.DigiTrainee.com Company Confidential Accessibility (1) – RRC Setup Success Rate o RRC Setup Success Rate (service) The RRC setup procedure is trigged by different reasons as identified by the establishmentCause field in the RRCConnctionRequest message: emergency, highPriorityAccess, mt-Access, mo-Signaling, mo-Data, delayTolerantAccess-v1020. The UE sets the establishmentCause and received by eNodeB. Causes except moSignaling are categorized as service related ones, and the cause of mo-Signaling is categorized as signal related ones. This KPI evaluates the RRC setup success rate with service related causes in a cell or cluster. RRC _ SSRService o RRC _ Connection Success service 100% RRC _ Connection Attempt service RRC Setup Success Rate (Signal) This KPI evaluates the RRC setup success rate with signal related causes (mo-Signalling) in a cell or cluster. RRC _ SSRSignal RRC _ Connection Success Signal RRC _ Connection Attempt Signal www.DigiTrainee.com 100% Company Confidential Accessibility (2) – Counter Mapping for RRC SSR L.RRC.ConnReq.Att… L.RRC.ConnReq.Succ … www.DigiTrainee.com Company Confidential Accessibility (3) – QCI Definition o LTE-SAE QoS Class Identifier There are 9 QCIs defined in 3GPP TS 23.203. Each of QCI has its QoS requirements, and each E-RAB will has the attribute of QCI. www.DigiTrainee.com Company Confidential Accessibility (4) – ERAB Setup Success Rate o VoIP ERAB Setup Success Rate This KPI can be used to evaluate the ERAB setup success rate of VoIP service (QCI 1 service) in a cell or cluster. VoIP _ ERAB _ SSR o VoIP _ ERAB _ SetupSuccess 100% VoIP _ ERAB _ SetupAttempt ERAB Setup Success Rate (All) This KPI can be used to evaluate the ERAB setup success rate of all services including the VoIP service in a cell or a cluster. ERAB _ SSR( ALL) ERAB _ SetupSuccess 100% ERAB _ SetupAttempt www.DigiTrainee.com Company Confidential Accessibility (5) – Counter Mapping for ERAB SSR ERAB Setup Attempt Counters ERAB Setup Attempt Counters ERAB Setup Success Counters ERAB Setup Success Counters www.DigiTrainee.com Company Confidential Accessibility (6) – Call Setup Success Rate o VoIP Call Setup Success Rate (VoIP CSSR) This KPI evaluates the success rate of the whole setup procedure for VoIP service (QCI 1 service) in a cell or cluster, which mainly includes three phases : RRC setup phase, S1 Signaling connection establishment phase and VoIP E-RAB setup phase: VoIP _ CSSR o RRC _ ConnectionSuccessService S1SIGConnectionEstablishSuccess VoIP _ ERAB _ SetupSuccess 100% * * RRC _ ConnectionAttemptService S1SIGConnectionEstablishAttempt VoIP _ ERAB _ SetupAttempt Call Setup Success Rate (ALL) This KPI can be used to evaluate the call setup success rate of all services including the VoIP service in a cell or a cluster. This KPI mainly includes three phases : RRC setup phase, S1 Signaling connection establishment phase and service E-RAB setup phase: CSSR( ALL) RRC _ ConnectionSuccessService S1SIGConnectionEstablishSuccess ERAB _ SetupSuccess * * 100% RRC _ ConnectionAttemptService S1SIGConnectionEstablishAttempt ERAB _ SetupAttempt www.DigiTrainee.com Company Confidential Accessibility (7) – Counter Mapping for CSSR www.DigiTrainee.com Company Confidential Retainability (1) – Call Drop Rate o VoIP Call Drop Rate This KPI can be used to evaluate the call drop rate of VoIP service (QCI 1 service) in a cell or cluster, the call drops happen when eNode initiate active ERAB (with data in buffer) release process by E-RAB Release Indication or UE Context Release Request message with Cause field with abnormal reasons (the cause other than : Normal Release, Detach,User Inactivity, cs fallback triggered, UE Not Available For PS Service,or Inter-RAT redirection), and all of the other E-RAB releases are consider as normal E-RAB release. VoIP _ CDR VoIP _ ERAB _ Abnormal Re lease 100% VoIP _ ERAB _ Re lease www.DigiTrainee.com Company Confidential Retainability (1) – Call Drop Rate o Call Drop Rate(ALL) This KPI can be used to evaluate the call drop rate of all services in a cell or a cluster, including VoIP service. CDR( ALL) o ERAB _ Abnormal Re lease 100% ERAB _ Re lease Call Drop Rate(Always Online) This KPI can be used to evaluate the call drop rate of all the services, including the VoIP services, when the always online state is active. In always online state, the E-RAB number of UE entering the un-synchronous state from synchronous state will be considered for the KPI calculating. AlwaysOnline _ CDR ERABAbnormalReleaseOfAlwaysOnline 100% ERAB Re leaseOfAlwaysOnline www.DigiTrainee.com Company Confidential Retainability (2) – Counter Mapping for Call Drop Rate Normal and Abnormal release Counters based on the cause Normal and Abnormal release Counters based on the cause www.DigiTrainee.com Company Confidential Retainability (3) - Call Setup Complete Rate o VoIP Call Setup Complete Rate (VoIP CSTR) This KPI evaluates the call Setup Complete Rate for VoIP service (QCI 1 service) in a cell or cluster, which means the rate of the VoIP service can be normally terminated once user do the attempt to setup the service. And it can include 4 phases: RRC setup phase, S1 Signaling connection establishment phase, VoIP E-RAB setup phase and VoIP service E-RAB release phase; VoIP _ CSTR o RRC _ ConnectionSuccessService S1SIGConnectionEstablishSuccess VoIP _ ERAB _ SetupSuccess VoIP _ ERAB _ Normal Re lease 100% * * * RRC _ ConnectionAttemptService S1SIGConnectionEstablishAttempt VoIP _ ERAB _ SetupAttempt VoIP _ ERAB _ Re lease Call Setup Complete Rate (ALL) The similar as upper KPI, this KPI will evaluate the success rate in totally for 4 phases: RRC setup phase, S1 Signaling connection establishment phase, service E-RAB setup phase and service E-RAB release phase; CSTR( ALL) RRC _ ConnectionSuccessService S1SIGConnectionEstablishSuccess ERAB _ SetupSuccess ERAB _ Normal Re lease * * * 100% RRC _ ConnectionAttemptService S1SIGConnectionEstablishAttempt ERAB _ SetupAttempt ERAB _ Re lease www.DigiTrainee.com Company Confidential Retainability (3) - Call Setup Complete Rate o Call Setup Complete Rate (Always Online) The similar as upper KPI, this KPI will evaluate the success rate in totally for 4 phases: RRC setup phase, S1 Signaling connection establishment phase, service E-RAB setup phase and service E-RAB release phase (when the always online state is active); CSTR( AlwaysOnline) RRC _ ConnectionSuccessService S1SIGConnectionEstablishSuccess ERAB _ SetupSuccess ERABAbnormalReleaseOfAlwaysOnline * * * 100% RRC _ ConnectionAttemptService S1SIGConnectionEstablishAttempt ERAB _ SetupAttempt ERAB Re leaseOfAlwaysOnline www.DigiTrainee.com Company Confidential Retainability (4) - Counter Mapping for CSCR www.DigiTrainee.com Company Confidential Mobility (1) – Intra-LTE Handover (Out) Success Rate o Intra-frequency Handover Out Success Rate This KPI can be used to evaluate the intra-frequency handover out success rate in a cell or cluster. IntraF _ HOOut _ SR o IntraF _ HOOutSuccess 100% IntraF _ HOOutAttem pt Inter-frequency Handover Out Success Rate This KPI can be used to evaluate the inter-frequency handover out success rate in a cell or cluster. InterF _ HOOut _ SR InterF _ HOOutSuccess 100% InterF _ HOOutAttem pt www.DigiTrainee.com Company Confidential Mobility (2) – Counter Mapping for Intra-LTE HO SR Handover Attempt Counters Handover Success Counters www.DigiTrainee.com Company Confidential Mobility (3) - Intra-LTE Handover In Success Rate o Handover In Success Rate This KPI can be used to evaluate the handover in success rate in a cell or cluster. HOIn _ SR HOInSuccess 100% HOInAttempt www.DigiTrainee.com Company Confidential Mobility (4) - Counter Mapping for Intra-LTE HO In SR HO in Attempt Counters HO in Success Counters www.DigiTrainee.com Company Confidential Mobility (5) – Inter-RAT Handover Success Rate Inter-RAT Handover Success Rate (LTE to WCDMA) o This KPI can be used to evaluate the inter-RAT handover success rate from LTE to WCDMA in a cluster. IRATHO _ L2W _ SRout o IRATHO _ L2W _ SuccessOut 100% IRATHO _ L2W _ AttemptOut Inter-RAT Handover Success Rate (LTE to GERAN) This KPI can be used to evaluate the inter-RAT handover success rate from LTE to GERAN in a cluster. IRATHO _ L2G _ SRout IRATHO _ L2G _ SuccessOut 100% IRATHO _ L2G _ AttemptOut www.DigiTrainee.com Company Confidential Mobility (6) – Inter-RAT Handover Success Rate o Inter-RAT Handover Success Rate (LTE to CDMA2000) This KPI can be used to evaluate the inter-RAT handover success rate from LTE to CDMA2000 in a cluster. IRATHO _ L2C _ SRout IRATHO _ L2C _ SuccessOut 100% IRATHO _ L2C _ AttemptOut www.DigiTrainee.com Company Confidential Mobility (7) – Counter Mapping for Inter-RAT HO SR B point , HO attempt, and distinguish the target system by a ele e t targetRAT-Type i the message C point, HO Success www.DigiTrainee.com Company Confidential Availability (1) - Radio Network Unavailability Rate o Radio Network Unavailability Rate This KPI provides the percentage of time that a cell is unavailable in order to evaluate the degradation of the network performance caused by the unavailable cells. It is calculated based on the time of all cell unavailability in the radio network (cluster). Where the {SP} denotes the reports period of counters, and the unit is minutes. www.DigiTrainee.com Company Confidential Availability (2) – Counter Mapping for RAN Unavailability Rate www.DigiTrainee.com Company Confidential Utilization (1) – DL/UL RB Utility Rate o Downlink Resource Block Utility Rate This KPI evaluates the DL RB (Resource Block) utility rate of a cell or cluster. DLRB _ UtilityRat e o DLRB _ Used 100% DLRB _ Available Uplink Resource Block Utility Rate This KPI evaluates the UL RB (Resource Block) utility rate of a cell or cluster. ULRB _ UtilityRat e ULRB _ Used 100% ULRB _ Available The ULRB_Available and DLRB_Available are fix values, which can be calculated by system bandwidth. www.DigiTrainee.com Company Confidential Utilization (2) – Counter Mapping for RB Utility Rate www.DigiTrainee.com Company Confidential Utilization (3) – Average CPU Load o Average CPU Load This KPI is used to evaluate the CPU usage in busy hours. It indicates the system loading. The CPU load is calculated by averaging the CPU usage ratio in the measurement period. MeanCPUUtility www.DigiTrainee.com Company Confidential Utilization (4) – Counter Mapping for Average CPU Load www.DigiTrainee.com Company Confidential Traffic (1) – Active Users o Active Users This group of KPIs consist of 6 KPIs, which are used to evaluate the user numbers which has the RRC connection in the cell, the user numbers with uplink data in the buffer or with downlink data in the buffer, and also give the average user number and maximum user number in a cell or cluster. AvgUserNumber MaxUserNumber AvgUserNumber _ DLData MaxUserNumber _ DLData AvgUserNumber _ ULData MaxUserNumber _ ULData www.DigiTrainee.com Company Confidential Traffic (2) – Counter Mapping for Active Users www.DigiTrainee.com Company Confidential Traffic (3) – Counter Mapping for Active Users www.DigiTrainee.com Company Confidential Traffic (4) – Counter Mapping for Active Users www.DigiTrainee.com Company Confidential Traffic (5) – Radio Bearers o Radio Bearers The radio bearers KPIs consist of ten sub-KPIs, one is for the total of radio bearers and the other nine are for nine QCIs. This set of KPIs can be used to evaluate the average radio bearers in a cell or a cluster. The radio bearer for each QCI is based on the number of active RRC connections for each QCI according to the QCI defined in the QoS information. RadioBearers RadioBeare rs _ QCI _ 1 …… RadioBeare rs _ QCI _ 9 www.DigiTrainee.com Company Confidential Traffic (6) – Counter Mapping for Radio Bearers www.DigiTrainee.com Company Confidential Traffic (7) - Traffic Volume Downlink Traffic Volume o Similar to the radio bearers KPIs, the downlink traffic volume KPIs consist of ten subKPIs, one is for the total of traffic volume for DRBs and the other nine are for nine QCIs. This group of KPIs can be used to evaluate the DL traffic volume in a cell, which is measured at the PDCP layer excluding the PDCP header DLTrafficVolume o DLTrafficVolume _ QCI _1 …… DLTrafficVolume _ QCI _ 9 Uplink Traffic Volume Similar to the downlink traffic volume KPIs, the uplink traffic volume KPIs consist of ten sub-KPIs, one is for the total of traffic volume for DRBs and the other nine are for nine QCIs. This group of KPIs can be used to evaluate the uplink traffic volume in a cell. The KPIs are measured at the PDCP layer excluding the PDCP header. ULTrafficVolume ULTrafficVolume _ QCI _ 1 www.DigiTrainee.com …… ULTrafficVolume _ QCI _ 9 Company Confidential Traffic (8) - Counter Mapping for Traffic Volume www.DigiTrainee.com Company Confidential Traffic (9) - Counter Mapping for Traffic Volume www.DigiTrainee.com Company Confidential Service Integrity (1) – Service Average Throughput o Service Downlink Average Throughput This KPI consist of nine sub-KPIs mapped into nine QCIs (QCI 1~9), they evaluate the downlink throughput of a service with a specific QCI per user in each cell, it reflects the end-user experience. DLAverageThroughput _ QCI _ 1 …… DLAverageThroughput _ QCI _ 9 The total downlink traffic volume at PDCP layer of each QCI and total duration for transmitting them are measured within a measurement period. Then the average throughput of each QCI is obtained at the end of the measurement period. o Service Uplink Average Throughput Same with the service downlink average throughput, this set of KPIs consist of nine sub-KPIs mapped into nine QCIs (QCI 1~9), and the meaning is also similar with it. ULAverageThroughput _ QCI _ 1 …… ULAverageThroughput _ QCI _ 9 www.DigiTrainee.com Company Confidential Service Integrity (2) – Cell Average Throughput o Cell Downlink Average Throughput This KPI evaluates the cell downlink average throughput when there are data transferring at downlink. It reflects the cell capacity. The total downlink traffic volume at PDCP layer of cell and total duration for transmitting which is measured within a measurement period. Then the average throughput of cell is obtained at the end of the measurement period. CellDLAveThp o CellDLTrafficVolume CellDLTransferTime Cell Uplink Average Throughput Same with the cell downlink average throughput, this set of KPI reflects the cell capacity, and the meaning is also similar with it. CellULAveThp CellULTrafficVolume CellULTransferTime www.DigiTrainee.com Company Confidential Service Integrity (3) – Cell Maximum Throughput o Cell Downlink Maximum Throughput This KPI evaluates the cell downlink maximum throughput when there are data transferring at downlink. It reflects the cell capacity. It is calculated based on maximum value of downlink traffic volume which are transferred at each second. CellDLMaxThp o CellDLMaxTrafficVolumeforEach1s(bit ) 1000(ms) Cell Uplink Maximum Throughput Same with the cell downlink maximum throughput. It is calculated based on maximum value of downlink traffic volume which are transferred at each second. CellULMaxThp CellULMaxTrafficVolumeforEach1s(bit ) 1000(ms) www.DigiTrainee.com Company Confidential Service Integrity (4) – Counter Mapping for Service Average Throughput www.DigiTrainee.com Company Confidential Service Integrity (5) – Measurement Principle for Throughput Refer to TS 32.450 www.DigiTrainee.com Company Confidential Service Integrity (6) – Counter Mapping for Service Average Throughput www.DigiTrainee.com Company Confidential Service Integrity (7) – Counter Mapping for Cell Average Throughput www.DigiTrainee.com Company Confidential Service Integrity (8) – Counter Mapping for Cell Maximum Throughput www.DigiTrainee.com Company Confidential Latency (1) o Access Latency This grouped KPI can be used to evaluate the latency of access phase. o AccessLatency_Attach Defined as the duration from the time the UE send AttachRequest message to the time the UE send AttachComplete message message o AccessLatency_Idle2Active Defined as the duration from (UE in idle mode) the time the UE send RRCConnectionRequest message to the time the UE send RRCConnectionReconfiguration message www.DigiTrainee.com Company Confidential Latency (2) o Service Latency This grouped KPI can be used to evaluate the latency of a particular service, we can distinguish them by different services, this KPI will be attained by drive test (or stationary test). ServiceLatency _ Ping _ 32bytes ServiceLatency _ Ping _ 1460bytes o Control Plane HO Interrupt Latency This grouped KPI can be used to evaluate the control plane interrupt latency during the handover, we can further distinguish them by different handover scenarios. This KPIs is measured through drive test. Defined as the duration from the time the UE receives the handover command(RRCConnectionReconfiguration after MeasurementReport) to the time the UE send the handover confirm message (RRCConectionReconfigurationComplete) . ControlPla ne _ Interrupt _ IntraLTE _ HO ControlPla ne _ Interrupt _ IRATHO _ L2C ControlPla ne _ Interrupt _ IRATHO _ L2W ControlPla ne _ Interrupt _ IRATHO _ L2G www.DigiTrainee.com Company Confidential Latency (3) o User Plane HO Interrupt Latency This grouped KPI can be used to evaluate the user plane interrupt latency during the handover, we can further distinguish them by different handover scenarios. The user plane interrupt latency is different when observed at different layers, for example, UserPlane _ Interrupt _ IntraLTE _ HO at IP layer or RLC layer or MAC layer. UserPlane _ Interrupt _ IRATHO _ L2C This KPIs is measured through drive test. UserPlane _ Interrupt _ IRATHO _ L2W Defined as the duration from the last RLC layer UserPlane _ Interrupt _ IRATHO _ L2G package received before the handover, to the first RLC layer package received after handover. It can be observed in Probe. www.DigiTrainee.com Company Confidential 3. Recommended KPI www.DigiTrainee.com Company Confidential Recommended KPIs o The recommended KPIs at this phase include: KPI Class KPI Name RRC Setup Success Rate (service) Accessibility RRC Setup Success Rate (Signal) ERAB Setup Success Rate (ALL) Retainability Call Drop Rate (ALL) Mobility Intra-frequency Handover Out Success Rate Radio Bearers for Total and QCI 1~9 Traffic Downlink Traffic Volume for Total and QCI 1~9 Uplink Traffic Volume for Total and QCI 1~9 Integrity Service Downlink Average Throughput for QCI 1~9 Service Downlink Average Throughput for QCI 1~9 www.DigiTrainee.com Company Confidential Performance Data Manager The PRS is a platform used to manage mobile network performance reports and analyze network performance. (iManager PRS V100R006 Product Description V1.1) www.DigiTrainee.com Company Confidential Customizing Reports (iManager PRS V100R006 Product Description V1.1) www.DigiTrainee.com Company Confidential Restrictions on Measurement Activations o The period of measurement on northbound interface should be for 15mconsist with southbound interface. So far, Huawei support 15minutes and 60minutes periods as default. o There is no restrictions on the number of NE objects, measurement objects minutes and 60 minutes measurement periods. M2000 can provide all measurement results of all managed NEs via northbound performance file interface. www.DigiTrainee.com Company Confidential www.DigiTrainee.com Company Confidential