M i Maximum Efficiency Effi i & Maximum Protection UPS Topologies Alan French Manager Technical Relations Manager, Emerson Network Power Liebert AC Power March 25, 2014 1 Agenda Data Center Surveys □ Maximum Protection and Maximum Efficiency Architectures Maximum Protection UPS Systems □ Liebert NXL UPS Systems □ Efficiency, Energy Savings Modes, Parallel Systems Configurations Maximum Efficiency UPS Systems □ Liebert eXL and Liebert NX UPS Systems □ Efficiency, y Energy gy Savings g Modes, Parallel System y Configurations g Emerging High Density Distribution g Availability y Data Center Power Architectures High UPS DC Energy Storage Technology Update Rapid Deployment Solutions 2 National Survey on Data Center Outages Have you experienced an unplanned data g in the past p center outage 24 months? Ponemon Institute Research Report Sponsored by Emerson Network Power Top root causes of unplanned outages: Average cost was $690,204 for the 67 data centers analyzed. Average of 86 minutes off partial ti l or total t t l shutdown. Extrapolated frequency of data centerges over two years: 3 DCUG Fall Fall--2013 Survey Results What are your top facility and network concerns? 0% 10% 20% 30% 40% 44% Energy (energy Efficiency (energy & equip)… Energy efficiency costs & equipment Adequate monitoring / data center… Heat density (cooling) Po er density Power densit Space constraints / growth Security (physical or virtual) Technology changes / change management Data storage Regulatory compliance Other O e Fall 2013 60% 48% 43% 46% 41% 46% Availability (uptime) Data center consolidations 50% 27% 24% 15% 19% 23% 17% 17% 16% 21% 14% 10% 9% 7% 2% 4% 36% 35% 34% Energy Efficiency without Compromising Availability: y A High Priority Concern Fall 2012 4 The Current UPS Market Market… AVAILABILITY Expectations / Demands: Protect against anything that could interrupt p p power to the critical load Burn-to-the-ground performance – Sacrifice itself to keep power on Highest reliability / Mean Time Between Failure (MTBF) and easy to maintain with fast Mean Time To Repair (MTTR) High Short Circuit Current Ratings (SCCR), withstand and bracing, yielding High Amps Interrupt Current rating (AIC) Rugged output short circuit / bolted fault capability, and the ability to start a PDU from inverter Complete and total electrical topology and battery isolation (input/output isolation transformers) Maximum Protection EFFICIENCY Expectations / Demands: Lowest possible first cost Highest possible dual-conversion efficiency and energy savings modes (AC-to-AC) Smallest footprint with high power density Scalable Architecture / Capacity on Demand Add redundancy to the system architecture to offset vulnerabilities Maximum Efficiency 5 Emerson Network Power Max Protection and Max Efficiency UPS 500, 625, 750 750, 800 800, 1100kVA 500 625 Liebert NXL 250, 300, 400kVA SMS, 1+N, N+1 Eco-Mode, Intelligent Paralleling Maximum Protection 400, 500, 600kVA Liebert NX 225, 250, 300kVA SMS, 1+N Eco-Mode, Capacity on Demand (Softscale) Maximum Efficiency Liebert eXL 625, 750, 800 kVA SMS Eco-Mode, Capacity on Demand (Softscale) 3phase In / 3phase Out 200 800 1200 Capacity, kVA 6 Liebert NXL Enterprise--Scale UPS Protection for Medium/Large Data Centers Enterprise 250kVA/225kW 300kVA/270kW 400kVA/360kW 500kVA/450kW 625kVA/625kW 800kVA/800kW 750kVA/675kW 800kVA/800kW 900kVA/900kW 1100kVA/1100kW 1125kVA/1125kW G t than th 1,348 1 348 units it under d warranty t Greater and service contract, 24,683,136Hrs. MTBF = 6,170,784 Hrs. 1125kVA/1125kW MTBF = Operating Hrs #Failures +1 #F il Units in Blue provide DC isolation 7 Anatomy of the NXL 1100kVA/kW 8 Liebert NXL Single Module System One One--Line, Line 12 12--pulse rectifier Aic ratings 100 kaic with internal breakers 150 kaic with external breakers 9 http://www.youtube.com/watch?v=N40MzIRx2zA Liebert NXL DC Faults – NXL takes it! Package http://www.youtube.com/watch?v=hom2pG9ppvE&feature=youtu.be Package “Since when is taking th load the l d to t bypass b on a battery ground fault robust?” High Availability 10 UPS High Efficiency Modes of Operation “Intelligent Intelligent Paralleling Paralleling” 11 High Efficiency Modes of Operation Done Right, “Active Active Inverter Intelligent EcoMode EcoMode” Double Conversion Operation Active Inverter te ge t EcoMode co ode Intelligent – Increases efficiency Bypass AC Input by running the bypass in parallel with the inverter. – If poor quality AC detected switches to detected, full dual conversion mode Static Switch Inverter Rectifier Rectifier AC Input B tt Battery Active Inverter Intelligent EcoMode Bypass AC Input Static Switch Inverter Rectifier Rectifier AC Input Battery • • • • Bypass source is monitored Inverter matches bypass Load harmonics profiled Efficiency gain 12 Source Outage Outage Source while in in Dual Active Inverter Intelligent EcoMode while Conversion Mode Within 1% Input p Utility y Loss @ 100% Load Seamless transfer to battery 50.00% 41.4% 37 1% 37.1% 40.00% 30.00% 20.00% 17.1% 10 00% 10.00% 4 3% 4.3% T Transfer f 0.00% Dual Intelligent Eco- Standard Ecoconversion Mode Mode onlyy Series1 Series2 Series3 Intelligent paralleling Outage g Series4 13 Liebert NXL 800kVA/kW, 1100kVA/kW Effi i Efficiency Curves C 100.00% 99.00% 98.00% 96.50% 97.00% 96.00% 94.30% ciency %Effic 93.30% 94.00% 98.30% 93.70% 94.00% 94.10% 94.10% 94.00% 93.70% 92.30% 93.00% 91.00% 97 50% 97.50% 98.10% 95.60% 95.00% 92 00% 92.00% 97.10% 97.80% 91.60% 90.20% 90.00% 89 00% 89.00% AC-AC (UPS Dual Conversion) 88.00% Intelligent EcoMode 87.00% 86 00% 86.00% 85.00% 84.40% 83.9% 84.00% 10.00% 20.00% 30.00% 40.00% 50.00% 60.00% 70.00% 80.00% 90.00% 100.00% %Load 14 Liebert NXL Field Demonstrated MTBF, Centralized vs Distributed Bypass Static Switch UPS UPS UPS MMU MMU MMU 750kVA 750kVA 750kVA Static Switch UPS UPS UPS SMS 750kVA SMS 750kVA SMS 750kVA SS SS SS Centralized Static Switch Distributed Static Switch Reliable and Fault Tolerant Reliable Enterprise space Small/medium business space Field Demonstrated MTBF vs Configuration Multimodule UPS Systems w/ Central Static Switch in Switchgear, 100% Rated Distribued Static Swich in each UPS Module, 100% rated per module Operating Hours System MTBF Number Critical Bus of units Availability 5,230,056 5,230,056 382 0.9999977 5,221,512 5,221,512 368 0.9999977 No Critical Bus Outages to date! 15 Reliability Block Diagram MTBF Analysis, Centralized vs Distributed Bypass Static Switch Centralized Static Switch Distributed Static Switch 16 Maximum Efficiency UPS Systems World Class large Transformer-free UPS – Small footprint/light p g weight g – Modular construction Liebert NX 225-600 Ratings g up p to 600kW Capacity on demand “Softscale Technology” High Efficiency – 95 95+% %D Duall C Conversion i – 98+% Intelligent Eco mode Liebert eXL 800kVA/800kW Capacity on demand “Softscale technology” Highest Efficiency – 96+% Dual Conversion – 98+% Active Inverter Intelligent Eco mode 17 Liebert NX, Large TransformerTransformer-Free UPS System 225kVA/225kW 480V ((Fixed Capacity p y or SoftScale to 300 kVA/kW)) 250kVA/250kW 480V (Fixed Capacity or SoftScale to 300 kVA/kW) 300 300kVA/300kW /300 480V 80 (Fixed Capacity ) 400kVA/400kW 480V (Fixed Capacity or SoftScale to 600 kVA/kW) 500kVA/500kW 480V (Fixed Capacity or SoftScale to 600 kVA/kW) 600kVA/600kW 480V (Fixed Capacity ) Operating Hrs MTBF = #F il #Failures +1 Greater than 193 units under warranty and service contract, 753,384Hrs. MTBF = 753,384 Hrs. Greater than 8500 units shipped globally since 2007 MTBF = 1,121,280 Hrs. 18 Liebert NX UPS Efficiency 300kVA/kW & 600kVA/kW Efficiency Curves 100.0% 95.7% 95.0% % Efficiency 93.3% 96.9% 94.3% 97.5% 97 9% 97.9% 98 1% 98.1% 98 3% 98.3% 98.4% 95.0% 95.2% 95.3% 95.3% 95.3% 98.5% 95.2% 98 4% 98.4% 95.0% 91.7% 90.0% 89.7% 85.0% NX 300kVA/kW (Dual Conversion) 80.0% NX 300kVA/kW Intelligent Ecomode y Efficiency 75.0% 10.0% % 20.0% % 30.0% % 40.0% % 50.0% % 60.0% % 70.0% % 80.0% % 90.0% % 100.0% % % Load 19 Anatomy of the NX 225225-600 kVA Input Jumpers Bypass Input Rectifier Input System Output Battery Connections Fully Rated, Continuous-Duty Static Switch Input Fuses Optional CB1 Backfeed Breaker (Std.) PFC IGBT Rectifier Subassemblies Inverter Subassemblies DC-DC Booster Subassemblies Connectivity C ti it Panel 20 Liebert NX, 300kW & 600kW Layout Top and Bottom Cable Entry 1350 mm 300kVA/300kW 53” Wide X 53 33.5” Deep 2300 mm Single Static Switch p per UPS module 600kVA/600kW 90 6” Wide X 90.6 33.5” Deep 21 Liebert NX 225225-600 kVA Basic One Line - Single Module System R Removable jumper for dual‐input bl j f d li Fully‐rated, Continuous‐Duty Static Switch for higher reliability and necessary for Eco‐Mode Operation li bilit d f E M d O ti NX600 starting 800kVA PDU NX600 3phase bolted fault without damage to unit 22 Capacity on Demand Softscalable Modules Softscale technology allows your system to efficiently grow with IT operations without adding to the system footprint – 225 & 250 upgrade to 300 kVA/kW – 400 and 500 upgrade to 600 kVA/kW – Minimal operational disruption during upgrade Fixed Capacity Modules Match feeders and di t ib ti tto fifixed distribution d rating ti UPS Breakers sized to capacity as purchased 23 Liebert NX 225225-600 kVA Basic One Line - Multi Multi--Module System Fully‐rated, Continuous‐Duty Static Switch in each Module each Module Bypass cable lengths need matched for full performance Simple 1+N paralleling provides low initial cost and reduced leadtime Parallel up to 6 systems for capacity or redundancy 24 Liebert eXL 800kVA/800kW – Unity Power Factor (kW=kVA) – World Class large transformer-free UPS – High Efficiency 96 5% in Dual • 96.5% Conversion • 98-99% in Active Inverter Intelligent Eco mode 25 What What’s s New in Liebert eXL Highest Power Density Largest Transformer-Free UPS Building Block Highest g Efficiency y Large g UPS Module – 6th Generation IGBT’s – 33-level level Active IGBT Rectifier, Rectifier Inverter, Inverter and DC-DC DC DC Converter/Charger – Low switchingg and conduction losses Superior Waveform Fidelity – Output: Can handle 0.7 0 7 leading to 0 0.7 7 lagging power factor (pf) loads and high harmonic loads – Input Current: 0.99pf with < 5% input current THD 26 UPS System Efficiencies 100.0% Liebert eXL Active Inverter Ecomode, Active Inverter Maximum Efficiency UPS Intelligent EcoMode Efficiency 95.0% Liebert eXL Maximum Efficiency UPS Dual Conversion 90.0% 85.0% 80.0% 10% 20% 30% 40% 50% 60% Load 70% 80% 90% 100% 27 Liebert eXL 800kW SMS Dimensions 28 Liebert eXL Construction Input Cabinet (Top Control Wiring or Bottom Feed) Drawer Cores Output/Bypass Cabinet (Top or Bottom Feed) BFB Core Detail HMI Static Switch CB1 Cells CB2 Cell 800kVA/800kW UPS Transformer-free 124”wide x 34”deep Weight: 5735 lbs 29 Liebert eXL Power Utilization and Delivery 1200A 100% Rated kW IN 996A @ 480 V @ 1.0 PF = 827 kW = = ≈ 98.4% Efficient Active IGBT Rectifier w/ High Input Power Factor Pulls Maximum kVA from given source with minimum current and low harmonics and provides Maximum kW to the DC Bus and Inverter Max Efficiency 3-level rectifier and inverter are precisely controlled to minimize losses and deliver more of the available input power to the load, reducing PUE while minimizing installation d operating ti expense. costt and ≈ 98.4% Efficient = = ≈ 98.5% Efficient kW OUT 962A @ 480 V @ 1.0 PF ≈ 800 kW Total AC-AC Efficiency (98.4% X 98.4%) ≈ 96.8% Efficiency Transformer-Free IGBT Inverter with Unity Output Power Factor Provides all the kW required for any load within the kVA limit of the UPS, from 0.7 leading to 0.7 lagging — without de rating! de-rating! 30 Liebert eXL UPS Source Considerations Liebert eXL can be fed from SEPARATE sources Liebert eXL can be used with HRG (High Resistance Ground) systems 31 eXL Configurations System Level Static Switch and Controls I R BB Single g Module System y ((SMS)) SS R I BB SS R I BB Distributed Bypass (1+N) I BB R I BB R I BB R I Highes H st MTBF Design R SS Cost E C Effectiv ve Des sign Currrent Industrry Offe ering SS BB C t li d Static Centralized St ti Switch S it h (N+1) 32 Emerging High Density Power Distribution Running out of capacity before pole space – 50A and greater panel board breakers – 125A and 150A branch breakers 400A & 600A – 42, 54, 72 or 84 pole panelboards – 80% & 100% rated t d mains i 600V – 42, 66 or 84 pole panelboards Configurable solutions Load distribution monitoring, LDM, becoming a requirement Touch safe panelboards p Larger PDUs – 430kVA, 500kVA, 800kVA Busway distribution Rack distribution instead of power strips 33 Data Center Power Architecture Med-V xfmr f Gen Utility Gen // Sgr S Med-V S Sgr ATS ATS UPS In UPS U P S Cooling Cooling Equipment Equipment STS UPS Out CRAC CRACs RDC Racks R a Servers c Servers k Servers P D Servers U PDU R a c k P D U Chiller PDU PDUs RDC Racks STS STSs ATS Rack P PDU U P S Mech Sgr M Mechanical Building g non-Critical UPS S Sgr Service Entrance & Gen CRAC Cooling Tower 34 Data Center Architecture, 2N Electrical, Electrical Tier 3 2 Utility Utility Service Entrance UPS In U P S UPS Out STS STSs PDU PDUs Gen Mechanical Building non-Critical U P S Gen P Service Entrance Mechanical ATS ATS ATS ATS Cooling Cooling Equipment Equipment Cooling Cooling Equipment Equipment A CRAC CRACs RDC Gen A Racks R Servers a S c Servers k Servers P D Servers U R a c k P D U Building non-Critical UPS In U P S P CRAC CRACs RDC U P S UPS Out STS STSs PDU PDUs Performance: Concurrent Maintenance – Every system/comp can be taken offline Fault tolerant UPS UPS, mechanical and downstream distribution Typical Characteristics: 2N Utility, 2N UPS and 2N Distribution Redundant Generator(s) N+x Cooling ATS and d STS used d for f enhanced reliability and improved maintenance IT equip dual powered 35 Value of STS Configuration: MTBF Reliability Dual bus, dual input with the STS2 Dual bus, Dual Input without STS2 Fault here is isolated. Alternate bus and other loads not affected. 3M hours 37.2M hours Load Calculated MTBF 321B Hours *MTBF assumes routine maintenance 3M hours 14M hours 13 x Increase I System MTBF Increase 37.2M hours Load Calculated MTBF 4298B Hours 36 Utilization Strategies g to Improve p Utilization UPS UPS* UPS UPS* 2 x 2N Dual Bus Data Center ~50 % Utilization Rate UPS* UPS UPS Reserve Bus Data Center ~75 % Utilization Rate Enterprise traditionally utilizes high availability dual bus architecture Business models that demand higher utilization rates and can accept lower availability are turning to reserve (“ t h ”) architectures (“catcher”) hit t Helps you move up the efficiency curve. 37 ST TS 60 00A ST TS 60 00A ST TS 60 00A ST TS 60 00A ST TS 60 00A ST TS 60 00A ST TS 60 00A ST TS 60 00A 300A A EA Racks Racks PDU PDU PDU PDU PDU PDU PDU PDU Dist Dist Dist Dist Dist Dist Dist Dist Racks Racks Tier 3, Ti 3 16 Meg Data Center ST TS 60 00A ST TS 60 00A ST TS 60 00A ST TS 60 00A ST TS 60 00A 2Meg g 2400A ST TS 60 00A 4Meg Redundant Reserve K1 K1 (Catcher) 2Meg System System #1 UPS 1000kVA Module Multi-M UPS 1000kVA Module Multi-M SS 5000A #1 Racks 34.5kV Utility #1 KR (NO) U1 K8 480V Racks SS 2500A #8 PDU PDU PDU PDU PDU PDU PDU PDU Dist Dist Dist Dist Dist Dist Dist Dist Racks (ATS to Reserve) K8 Mech Loa ads System 8 K7 UPS S 1000kVA Multi-Module K6 UPS S 1000kVA Multi-Module K5 (ATS to Systems s) Reserve Me ech Loads 1-8 K4 ST TS 60 00A SS 2500A K3 ST TS 60 00A 480V K2 UPS 10 000kVA Multi-M Module K1 UPS 10 000kVA Multi-M Module KR (NC) 300A A EA U2 (ATS to Reserv ve) 12.47kV Mech Loa ads System 1 U1 UPS S 1000kVA Mullti-Module UPS S 1000kVA Mullti-Module Reserve/Catcher Bus Utility #2 34.5kV 12.47kV U2 K8 2Meg System #8 2Meg g 2400A Racks 38 UPS DC Systems y 39 Liebert Battery Cabinet Bus rated for max currentt off 750 kVA 12V or 16V Top Access For Alber Monitoring Cabinet to Cabinet Cables. Strap Plates For Cabinet to Cabinet System Short bus on stand alone cabinet Integrated Alber Battery Monitoring Systems include one side panel and bus splices Cabinets include two side panels and no plates 56” wide for top terminal Conduit Landing Up to 400kVA Narrow (16”) junction box added for 750 kVA on last cabinet for stand alone 63” 63 ” wide for front terminal 16v 40 Thin Plate Pure Lead Battery In Liebert NXL Battery Cabinet EnerSys Genesis – High-temp High temp VLRA AGM – 0oC to > 45oC operation Aerospace & Defense – fighter jets, submarine propulsion, tanks – Aircraft use in 777 777, B B-1, 1 F-16, F-18, Osprey Other companies include S Sears, AT&T AT&T, Dell, D ll V Verizon, i Nokia, Ericsson and others Five year warranty at over 5min. – Two year at under 5min. Fits in standard Liebert cabinet 56” wide for top terminal battery 41 Climate Controlled Battery Cabinets, Ducted and Air Conditioned Cabinets AC Unit Provides 3000 6000 BTU/Hr 3000-6000 Max Room 104oF 40”wide x 29.5”deep p 42 Ensuring Availability Deploy StateState-of of--the the--Art Battery Monitoring Battery Monitoring Key g Technologies – DC Resistance technology provides repeatable readings g of the load on the regardless battery – Power the monitor external to the battery string to avoid over/under charging • Battery monitors installed across a breaker or disconnect can cause catastrophic ca as op c failures a u es – Monitor the entire battery system: Root Causes of D Downtime ti Liebert Services Remote Monitoring – Millions of hours of operation – ZERO O failures f due to bad battery inter-tier and inter-cell connectors, breakers Only Alber Battery Monitoring has all of these k ttechnologies! key h l i ! 43 State-ofStateof-the the--Art Battery Monitoring, The Difference – Early Detection of Failures Typically, yp y, internal resistance values increase slowly over time. Resistance Trend Earlier detection will permit proper p p resource scheduling g for maintenance, battery replacements, budgeting, etc. Impedance Trend 44 Rapid Deployment Data lar Centers Mod Modular po power er systems s stems Integrated packages, built and p etested in factory pretested acto y e environment o e t Simplified configuration and greater scalability S t Systems right-sized i ht i d d during i design phase Simplify and increase speed of deployment Most can be deployed in 14-16 weeks Skidded Condensers Enclosures Power Skids 45 46