ENB Health Check Table of Contents Descript ion Act ions Soft ware, Configurat ion Version and Upgrade Package st at us HW: ant ennas, port s, RUs, et c Licenses and Feat ure act ivat ion Node healt h check act ion Node At t ribut es EnodeBFunct ion set t ings Availabilit y of devices, cells and int erfaces Verify I P t ransport Disabled and degraded MOs Neighboring cells, HO and ANR EUt ranCellXDD set t ings Node sync st at us Com pare eNB param et ers wit h working eNB Node Perform ance Trace and Error Logfiles Hanging UE Cont ext References Description eNodeB healt h checks are divided int o cat egories and are split int o various check point s t hat are aut onom ous t o each ot her yet a part of a com plet e eNB healt h check. By execut ing t hese healt h check it em s, a fault point can be locat ed in t he eNB and re- direct ed t o t he correct syst em s care t aker. Most of t he healt h checks in t his docum ent are read- only and do not im pact perform ance of t he node, wit h t he except ion of eNB rest art which requires perm ission from node owners, m anagers et c. The page covers healt h checks regarding eNB H/ W, S/ W, feat ures, power relat ed param et ers, t ransport net work ( MMS, SGW) connect ivit y, I P int erface st at es, degraded m anaged obj ect s, EUTRANCELL set t ings, EUTRANRelat ion set t ings, com paring param et ers, node perform ance st at s and synch st at us. Actions Soft w a r e , Configu r a t ion Ve r sion an d Upgr ade Pa ck a ge st a t u s: Check upgrade package: eNb> pr upgrade Check SW and CV: eNb> cvcu Check st at us of all loaded m odules ( LM) on MP: eNb> lh m p sm a - all H W : an t enn a s, por t s, RUs, e t c: Print RF ( Ant enna) port s configurat ion and st at us: eNb> st rfport Print RI ( CPRI ) port s configurat ion and st at us: eNb> st riport Print Ant enna configurat ion: eNb> lpr ant ennaunit group Print all inst alled RU and configurat ion and st at us: eNb> cabx eNb> lst ru Check TX Power: eNb> get . power $ lh ru fui get vswr $ shell -f /d/usr/lhCmd32403 ======================================================================= ====================== $ lhsh BXP_0_1 fui get vswr BXP_0_1: vswr: 23.3[dB] ======================================================================= ====================== $ lhsh BXP_1_1 fui get vswr BXP_1_1: vswr: 23.4[dB] ======================================================================= ====================== $ lhsh BXP_2_1 fui get vswr BXP_2_1: vswr: 24.8[dB] ======================================================================= ====================== $ lhsh BXP_3_1 fui get vswr BXP_3_1: vswr: 24.6[dB] ======================================================================= ====================== $ lhsh BXP_4_1 fui get vswr BXP_4_1: vswr: 23.7[dB] ======================================================================= ====================== $ lhsh BXP_5_1 fui get vswr BXP_5_1: vswr: 26.4[dB] $ Check following eNB power param et ers: part OfRadioPower confOut put Power m axim um Transm issionPower Check t he VSWR values: eNb> lh ru fui get vswr Licen ses an d Fea t u r e a ct iva t ion: Print an invent ory of t he node, including a sum m ary of licenses inst alled: eNb> inv Show capacit y and feat ures: eNb> license key N ode h e a lt h che ck a ct ion : Run t he act ion st art Healt hCheck on MO ManagedElem ent Using MoShell: eNb> acc 0 st art Healt hCheck eNb> get 0 healt hCheckResult Alarm s will be generat ed if a fault is found, see t he alarm s in CPI : File Syst em Diagnost ic Error Configurat ion Version Corrupt Upgrade Package Corrupt healthCheckResult Struct{3} >>> 1.healthCheckResultCode = (99:INITIAL_VALUE, 0:OK, 1:NOT_OK, 2:ABORTED, 3:ABORTED_NOT_OK, 4:HEALTH_CHECK_ONGOING) >>> 2.message = >>> 3.startTime = Descript ion on alarm s can be found in t he Fault Managem ent docum ent s in t he CPI st ore. N ode At t r ibu t e s: Node specific set t ings on at t ribut es can be found in t he Sit e Engineering docum ent in CPI st ore. EnodeBFun ct ion se t t in gs: eNb> get enodebfunct ion Check towards Site Engineering doc: eNBId <value> eNodeBPlmnId >>> 1.mcc = <value> >>> 2.mnc = <value> >>> 3.mncLength = <value> Ava ilabilit y of de vice s, cells and in t e rfa ce s: eNb> st ru| dev| eut rancell| sect or| t erm Point ToMm e| t erm Point ToEnb Operat ional cells should be UNLOCKED and ENABLED. Operat ional S1 ( t erm Point ToMm e) connect ions should be UNLOCKED and ENABLED. Operat ional X2 ( t erm Point ToEnb) connect ions should be UNLOCKED and ENABLED. Exam ple: lienb0679> st dev|eutrancell|sector|termPointToMme|termPointToEnb 100810-19:14:12 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ============ Proxy Adm State Op. State MO ======================================================================= ============ 77 1 (ENABLED) Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=bb-1 78 1 (ENABLED) Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=bb1,CellDeviceSet=1 83 1 (ENABLED) Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,DeviceGroup=dul 100 1 (ENABLED) Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=du-1 101 1 (ENABLED) Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,SubDeviceGroup=du1,RicmDeviceSet=1 ... 135 1 (ENABLED) Equipment=1,RbsSubrack=1,RbsSlot=1,AuxPlugInUnit=rul,DeviceGroup=ru 139 1 (ENABLED) Equipment=1,RbsSubrack=1,RbsSlot=1,AuxPlugInUnit=rul,DeviceGroup=ru,TrD eviceSet=tr 146 1 (ENABLED) Equipment=1,RbsSubrack=1,RbsSlot=2,AuxPlugInUnit=rul,DeviceGroup=ru 150 1 (ENABLED) Equipment=1,RbsSubrack=1,RbsSlot=2,AuxPlugInUnit=rul,DeviceGroup=ru,TrD eviceSet=tr ... 520 0 (LOCKED) 0 (DISABLED) ENodeBFunction=1,EUtranCellFDD=3 525 1 (UNLOCKED) 1 (ENABLED) ENodeBFunction=1,EUtranCellFDD=1 534 0 (LOCKED) 0 (DISABLED) ENodeBFunction=1,EUtraNetwork=1,ExternalENodeBFunction=678,TermPointToE NB=678 539 1 (UNLOCKED) 1 (ENABLED) ENodeBFunction=1,TermPointToMme=MME010064193079 ... 556 1 (UNLOCKED) 1 (ENABLED) SectorEquipmentFunction=1 557 0 (LOCKED) 0 (DISABLED) SectorEquipmentFunction=3 Pr int ce ll st a t us cell list its celldata. - Prints all created cell(s) and cell data -cellId [cellId] specific cell. - Prints all available data about a See Cell for m ore info about com m and. Ve r ify I P t r an spor t : Find I P a ddr e ss of M M E eNb> st t erm point t om m e eNb> get < MO proxy # > Exam ple: lienb0679> st termpointtomme 100810-19:32:52 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ============ Proxy Adm State Op. State MO ======================================================================= ============ 539 1 (UNLOCKED) 1 (ENABLED) ENodeBFunction=1,TermPointToMme=MME010064193079 ======================================================================= ============ Total: 1 MOs lienb0679> get 539 100810-19:32:57 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ========================================== 539 ENodeBFunction=1,TermPointToMme=MME010064193079 ======================================================================= ========================================== ... >>> Struct[5] has 3 members: >>> 1.mcc = 0 >>> 2.mnc = 0 >>> 3.mncLength = 0 usedIpAddress 10.64.193.80 ======================================================================= ========================================== Total: 1 MOs Ping MME or SGW eNb> acc I pAccessHost Et ping Param et er 1 of 1, host ( st ring) : < ip address of MME or SGW> Find e N B I P configur a t ion S1 / X2 I P Ad dr e ss Exam ple: lienb0679> get ipaccesshostet 100810-19:45:18 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ========================================== 495 IpSystem=1,IpAccessHostEt=1 ======================================================================= ========================================== IpAccessHostEtId 1 administrativeState 1 (UNLOCKED) availabilityStatus 0 (NO_STATUS) ipAddress 10.75.16.161 ipDefaultTtl 64 ipInterfaceMoRef Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 ntpDscp 46 ntpServerMode 0 (DISABLED) operationalState 1 (ENABLED) reservedBy [1] = >>> reservedBy = IpSystem=1,IpAccessSctp=1 userLabel ======================================================================= ========================================== Total: 1 MOs I P I n t e r f a ce con f igu r a t ion ( I P a d dr e ss, Su bn e t , VLAN , QOS, e t c) t ow a r ds Cu st om e r Sit e Rou t e r eNb> get int erface eNb> get int erface m t u| ownI pAddressAct ive| subnet | t rafficType| vid| default Rout er0 eNb> st int erface Exam ple: lienb0679> get interface mtu|ownIpAddressActive|subnet|trafficType|vid|defaultRouter0 100810-20:19:19 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ========================================== MO Value Attribute ======================================================================= ========================================== Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=1 defaultRouter0 10.75.0.1 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=1 defaultRouter0State 1 (ENABLED) Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=1 mtu 1500 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=1 ownIpAddressActive 10.75.0.179 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=1 subnet 10.75.0.0 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=1 trafficType 8 (OPERATION_AND_MAINTENENCE) Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=1 vid 2001 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 defaultRouter0 10.75.16.1 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 defaultRouter0State 1 (ENABLED) Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 mtu 1500 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 ownIpAddressActive 10.75.16.161 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 subnet 10.75.16.0 Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 trafficType 7 (SIGNALING_AND_PAYLOAD_AND_SYNCHRONIZATION) Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitEthernet=gbe1,IpInterface=2 vid 2005 ======================================================================= ========================================== lienb0679> st interface 100810-20:17:52 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ============ Proxy Adm State Op. State MO ======================================================================= ============ 63 1 (ENABLED) Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitE thernet=gbe-1,IpInterface=1 64 1 (ENABLED) Equipment=1,Subrack=1,Slot=1,PlugInUnit=1,ExchangeTerminalIp=1,GigaBitE thernet=gbe-1,IpInterface=2 ======================================================================= ============ Check connect ivit y t owards Cust om er Sit e Rout er eNb> ping < default Rout er0> Find Ta r ge t e N B I P a ddr e ss eNb> st t erm Point ToEnb eNb> get < proxy # > Exam ple: lienb0679> st termPointToEnb 100810-19:49:55 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ============ Proxy Adm State Op. State MO ======================================================================= ============ 534 0 (LOCKED) 0 (DISABLED) ENodeBFunction=1,EUtraNetwork=1,ExternalENodeBFunction=678,TermPointToE NB=678 ======================================================================= ============ Total: 1 MOs lienb0679> get 534 100810-19:50:01 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ========================================== 534 ENodeBFunction=1,EUtraNetwork=1,ExternalENodeBFunction=678,TermPointToE NB=678 ======================================================================= ========================================== TermPointToENBId 678 administrativeState 0 (LOCKED) anrCreated false availabilityStatus 0 (NO_STATUS) ctrlMode 0 (MANUAL) domainName ipAddress 10.75.16.163 operationalState 0 (DISABLED) timeOfAnrCreation timeOfAnrModification ======================================================================= ========================================== Total: 1 MOs Ping eNB eNb> acc I pAccessHost Et ping Param et er 1 of 1, host ( st ring) : < ip address of eNB> Vie w SCTP Configur a t ion a nd St a t us List s SCTP associat ion or endpoint info eNb> sct phost - assoc - all Print som e SCTP configurat ion dat a, st at ist ical inform at ion and list s associat ion or endpoint info eNb> sct phost - all D isabled an d degr a de d M Os To view all disabled MOs in Moshell: eNb> st all dis All MOs t hat are have a degraded operat ional st at e: eNb> get . availabilit y 64 All MOs t hat are have a FAI LED operat ional st at e: eNb> get . availabilit y 2 Use t he MOM t o det erm ine t he availabilit ySt at us values: eNb> m om Availabilit ySt at us Print locked or disabled MOs eNb> inv . L| 0 N eigh bor ing cells, H O an d AN R List all relat ions t o neighboring cells eNb> pr relat Check if HO feat ure is act ivat ed eNb> get int ralt e Exam ple: lienb0679> get intralte 100810-19:43:36 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ========================================== 22 SystemFunctions=1,Licensing=1,OptionalFeatures=1,IntraLTEHandover=1 ======================================================================= ========================================== IntraLTEHandoverId 1 featureStateIntraLTEHandover 1 (ACTIVATED) ... EUt r a nCellXD D se t t ings: Check t owards Sit e Engineering doc: eNb> get eut rancell t ac < value> Opt ional: ulChannelBandwidt h < value> dlChannelBandwidt h < value> Che ck Physica l Ce ll I D ( PCI ) Exam ple: get utrancellfdd=dfwe0600037 cellid 100727-16:52:40 10.26.4.174 8.0d ERBS_NODE_MODEL_A_9_2 stopfile=/tmp/18164 ======================================================================= ========================================== MO Value Attribute ======================================================================= ========================================== EUtranCellFDD=DFWe06000372 2 cellId EUtranCellFDD=DFWe06000372 physicalLayerCellIdGroup 145 EUtranCellFDD=DFWe06000372 physicalLayerSubCellId 2 EUtranCellFDD=DFWe06000373 3 cellId EUtranCellFDD=DFWe06000373 physicalLayerCellIdGroup 148 EUtranCellFDD=DFWe06000373 physicalLayerSubCellId 1 EUtranCellFDD=DFWe06000371 1 cellId EUtranCellFDD=DFWe06000371 physicalLayerCellIdGroup 143 EUtranCellFDD=DFWe06000371 physicalLayerSubCellId 0 ======================================================================= ========================================== Calculat e PCI : PCI sect or 2 = 145* 3 + 2 = 437 N ode syn c st a t us: eNb> get sync eNb> get Sync adm inist rat iveSt at e| operat ionalSt at e St at us should be UNLOCKED and ENABLED. Exam ple: lienb0679> get Sync administrativeState|operationalState 100810-20:52:42 10.75.0.179 8.0g ERBS_NODE_MODEL_A_9_2_COMPLETE stopfile=/tmp/6051 ======================================================================= ========================================== MO Value Attribute ======================================================================= ========================================== IpAccessHostEt=1,IpSyncRef=1 administrativeState 1 (UNLOCKED) IpAccessHostEt=1,IpSyncRef=1 operationalState 1 (ENABLED) ======================================================================= ========================================== Check for degradat ion fault on t he choosen synchronizat ion reference Com pa r e e N B pa r a m e t e r s w it h w or k in g e N B: dum p t he kget file from eNB: eNb> l+ < filenam e> eNb> kget all eNb> lKget file w ill be st ored in t he locat ion of current direct or y. Com pare t wo eNB param et ers Take kget dum p from eNB1, call it “ kget _eNB1.log” Moshell int o eNB2 eNb> diff . Kget _eNB1.log N ode Per form an ce : COLI com m and get st at t o provide dynam ic int ernal peg count er inform at ion. I ndicat ions on count ers relat ed t o ERAB set up, RRCConnect ionSet up S1I nit ialCont ext Set up et c. eNb> get st at A higher port ion of RRCConnSet upAt t em t vs low values on S1I nit ialCont ext Set upRequest , S1I nit ialCont ext Set upResponse and S1I nit ialUeMessage can indicat e problem on t he S1 int erface t owards t he MME. Refer t o GETSTAT Tr a ce an d Er r or List all non- default t race condit ions in all boards of t he node eNb> lh all ft e s Refer t o Trace and Error and HiCap. Logfiles: Refer t o Logs for m ore infor m at ion about different logs. Ala r m s To check for act ive alarm s, run: eNb> al For a hist ory of alarm s, run: eNb> lga Refer t o COLI Quick Reference for m ore opt ions. Colle ct ion of logfile s Fet ch dat a for TRs/ CSRs, according t o t he Dat a Collect ion Guidelines we use t he DCG com m and. Check LTE Dat a Collect ion Guideline for m ore inform at ion. H a nging UE Cont e x t : Check num ber of UE Cont ext s and bearers in t he RAC: $ ue print -admitted CellId 4 #UE:s 3 #Bearers 5 $ First colum n gives cellid. Second colum n shows num ber of UEs in t he cell. Third colum n shows num ber of DRBs in t he cell. You should expect t o see bet ween DRBs bet ween 2- 4 DRBs for each UE. Check num ber of UE Cont ext s in t he BB: moshell> mtd debug -ta bbUeMeBl -fun BBUEME_DEBUG_admittedUesInBBM() -dest RTS_WAIT Ok SessId[23] [0x9C1A714] BBUEME_DEBUG_cellContextS [0x9C1A714] U32 cellId1 = 3 [0x9C1A718] S16 noOfUesInCell1 = 5 [0x9C1A71A] S16 noOfRadioBearersInCell1 = 25 [0x9C1A71C] U32 cellId2 = 2 [0x9C1A720] S16 noOfUesInCell2 = 3 [0x9C1A722] S16 noOfRadioBearersInCell2 = 14 [0x9C1A724] U32 cellId3 = 1 [0x9C1A728] S16 noOfUesInCell3 = 6 [0x9C1A72A] S16 noOfRadioBearersInCell3 = 25 [0x9C1A72C] S16 noOfUesInBBM = 14 [0x9C1A72E] S16 noOfRadioBearersInBBM = 64 Unlike num ber of RBs in RAC print out , noOfRadioBearersI nCell1 print out s includes SRB0 and SRB1 + DRBs for each UE. I f you have very large num ber of UEs t hat are not being released or a very big discrepancy bet ween num ber of UEs and DRBs t hen you should suspect hanging UE Cont ext in eit her RAC or BB. $ ue print -ue -allcell CellId RacUeRef BbUeRef {traceRef,interfaces,traceDepth,ipAddress} TypeOfActiveTrace SetByColi CTSess 4 CRUT 33556488 67109120 false 2 X 4 CRUT 33556489 67109152 false 3 X 4 CRUT 33556490 67109184 false 4 X $ $ ue print -bearer CellId RacUeRef ServiceType GbrDl BbUeRef E-RAB S-RAB GbrUl ARP 4 0 33556488 0 67109120 5 10 4 0 33556488 0 67109120 X 0 6 9 0 X 0 QCI ROHCenabled 5 6 0 4 X 33556488 X 67109120 4 X 33556488 X 67109120 4 0 33556489 0 67109152 4 0 33556489 0 67109152 4 X 33556489 X 67109152 4 X 33556489 X 67109152 4 0 33556490 0 67109184 4 X 33556490 X 67109184 4 X 33556490 X 67109184 $ X 1 X X X 2 X X 5 X 10 X 7 1 X 2 X X 10 1 X X X 2 X 9 0 X X X X 0 X X X X 5 8 0 X X 9 0 0 X X X 0 6 X X X X X