380V DC Eco-system Development Present Status and Future Challenges David E. Geary, Universal Electric Corporation / StarLine DC Solutions, Canonsburg, PA - USA David P. Mohr, HP, Houston, TX - USA David Owen, Juniper Networks, Sunnyvale, CA - USA Maurizio Salato, Vicor Corporation, Andover, MA - USA BJ Sonnenberg, Emerson Network Power, Warrenville, IL – USA INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Reported 380VDC Distribution Advantages CapEx Reductions •Elimination of Inverters in UPS and PFC correction in PS • Reduced copper in distribution OpEx Reductions • Conversion efficiency gains of 5-10% • Lower operational and maintenance cost, 33% • Reduced distribution losses of 2% • Reduced heat dissipated on the data center floor • Increased reliability, 200% plus increase Space Reductions • Reduced power conversion volume at compute node by 50% • Reduced data center footprint, 25-33% savings Power Quality Improvements • Eliminates phase balance issues from single phase equipment • Harmonics controlled at the DC conversion • Ease of interconnect to alternative energy sources • Ease of connection to back up sources INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Up to 15% Savings Up to 35% Savings Up to 25% Savings Some of the World-wide DC Deployments IBM 380V DC Validus (ABB) 380V DC Nextek Syracuse University 380V DC UPN AB. 350V/380V DC Netpower Labs AB (several sites) 350V/380V DC Green.Ch 380V DC France Telecom 380V DC 380V DC SAP 380V DC Korea 380V DC Intel 380V DC NTT Group (several sites) 380V/400V DC Univ. California 380V DC Other Japan Demos 300V/350V DC Clustered Systems 380V DC China Mobile I/O 380V DC 380V DC China Telecom Duke Energy 380V DC 240V/380V DC North American Telecom 380V DC Sizes vary from 15 kW to 1MW North America • Proof of concept - 9 • Production - 4 European Telecom 380V DC IBM Singapore 380V DC Europe • Proof of concept - 2 • Production >20 Taiwan IT 380V New Zealand Telecom 380V Asia • Proof of concept – 11+ • Production - >350 (majority 240VDC in China) Introduction • • • Review commercial availability of equipment supporting 380VDC distribution for practical immediate implementation at the time of this presentation Examine future paths for improvement in terms of performance It is assumed that the powered loads meet voltage ranges specified in ETSI EN300-132-3-1 , ITU-T L1200 and Emerge Alliance Data/Telecom Center Standard Chip to Grid Perspective INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach 380V Eco-system Availability Summary Bus way Rack PDU Connector Rack-mount Power Supply ABB Starline ServerTech Anderson Emerson ABB Carling PDI API Tech Hubbel Delta Delta Schneider Eaton Delta AcBel Netpower Labs Nader Rong Feng / Delta DC Power System DC Breaker Emerson Eltek Chinese vendors Japanese vendors Rectifier Technologies Ltd (Australia) Siemens Fujitsu Comp. Echola Fujitsu Components Others Power Components Vicor ICT Load HP major platforms available IBM some X and Z series available Juniper products in final evaluation NEI Commercial products available NEC Commercial products available Supermicro 2 trial servers available INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Juniper 380VDC Networking Product Plans 1st half 2013 Power Supply Q4 2013 Juniper 850W HVDC Power Supply • 94% efficiency • Wide input range – 240V to 380VDC • APP Saf-D-Grid Connector • cTUVus listed Platforms Juniper Data Center Platforms • Top of Rack (TOR) • EX4550 960 G-bits, 48 dual-speed GbE/10GbE ports with Virtual Chassis • QFX3500 960M-bits, 48x10GbE, 4x40GbE, FCoE, iSCSI support QFX3600 1.28T-bits, 64x10GbE or 16x40GbE, FCoE, iSCSI support • 1H 2014 Juniper 850W HVDC Power Supply • 94% efficiency • Wide input range – 240V to 380VDC • APP Saf-D-Grid Connector QFX3600-I micro-Fabric (5.12T-bits) • Interconnects QFX3600s to support 16 racks of servers and storage • QFX3600-I 1.28T-bits, 64x10GbE or 16x40GbE, FCoE, iSCSI support INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach HP 380VDC Product Support Plans 1st half 2013 Power Supply Platforms 1H 2013 HP 1200W Common Slot HVDC Power Supply • 94% efficiency • Wide-input range – 240V to 380VDC • APP Saf-D-Grid Connector • UL/CE listed HP Common Slot compatible platforms • HP ProLiant DL, ML, SL • HP BladeSystem c3000 • HP Storage (~20 platforms) • HP Networking 2H 2013 HP 2400W HVDC Power Supply • 94% efficiency • Wide input range – 240V to 380VDC HP blade-based platforms • HP BladeSystem c7000 • HP Integrity Superdome 2 INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Power system trend & 380VDC Bus Converter In-system density: 0.5-3W/cm3 Peak efficiency: 80-85% In-system density: 2-9W/cm3 Peak efficiency: 94-97% In-system density: >20W/cm3 Peak efficiency: 97-98% 2000 2010 1990 Time 1200W Converter housed in a package (6123 ChiP) - 63.13 x 22.80 x 7.26mm (2.485 x 0.898 x 0.286 inch) • Input voltage range: 260-410VDC • Output voltage = 1/8 or 1/32 of input voltage • Up to 1200W continuous output power • 1800W/in3 (110W/cm3) power density • 98% peak Efficiency • 4242 VDC isolation (input to output), UL listed • Can be paralleled to create multi-kW arrays • OV, OC, UV, short circuit and thermal protection • Micro-Controller providing telemetry and supervisory functions INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach 380VDC Bus Converter examples: Bus way Drop box placement Rack Power Strip placement Rack Mid-plane placement The power component methodology concept…. A set of proven high efficiency (> 97%) high density (> 1.5kW/inch3) thermally-adept (planar interface, single- or double-side cooling) Scalable (positive temperature coefficient, easy paralleling) building blocks that support power distribution architectures tailored to the application’s requirements … perfectly fits higher voltage DC distribution systems INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Connectors and Line Cords • • • • • • APP Saf-D-Grid connector uses sacrificial contact area to mitigate arc damage Meets All Applicable Standards IEC 61984 “Connectors – Safety requirements and tests” UL 1977 “Component Connectors for Use in Data, Signal, Control and Power Applications” IEC 60590 & UL 1950 “Information technology equipment – Safety” IEC 60644 “Insulation coordination for equipment within low-voltage systems” Hubbell IEC Platform APP Connector Receptacle Plug Inlet INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Rack Distribution – Power Strips INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach 380V DC CIRCUIT PROTECTION Tmax Molded Case Emax DC 380VDC FUSES 20-100 Amp, 700 V dc 22 X 58 MM INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Distribution Products UL/CE Listed 400A Bus Way • • • • 400A BUSWAY DISTRIBUTION COMPARISON 208V AC @ 400A = 144kVA/130kW (0.9pf) 415V AC @ 400A = 287kVA/258kW (0.9pf) 380V DC @ 400A = 152kVA X 2 = 304kVA/Kw (1.0pf) Metering Devices INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Emerson Network Power 380VDC Systems Roadmap st half NOW (IN PRODUCTION) 1AVAILABLE 2013q1 2013 98% 96% 94% 92% 90% 88% 86% 84% Q1 2014 H2 2014 15KW R400-15000e rectifier efficiency •Isolated topology •Supports multiple grounding schemes •Hot pluggable 0% 20% 40% 60% 80% 100% INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach ABB 380 VDC Architecture Gen II, pictured on ABB USA factory floor Transformer isolated AC/DC conversion DC/DC converter for output bus regulation and short circuit control 250kW modular, scalable design Mid-point grounding, +/- 190VDC output Future Architecture, 2014 and beyond Active power factor correction on input Independently operating active rectifier power modules Modular and scalable in increments of 250Kw Regulated, narrow band output voltage Mid-point grounding, +/- 190VDC output INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Present and Future Challenges and Opportunities • Further enhancement of rectifier efficiency – New topologies – New components (GaN , SIC) • Grounding and ground fault detection and location • Advances in circuit protection and control • Battery / Energy storage advances, including storage located at or near the loads • Natural gas as a primary power source • Alternative energy integration – dc micro-grids • DC powered lighting and HVAC INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Compliance Status • Applicable General Standards - Voltages – – – European Telecommunications Standards Institute (ETSI) EN 300 132-3-0 International Telecommunication Union (ITU) L.1200 EMerge Alliance Data/Telecom Center Standard • YD/T 2378-2011 – 240V Direct Current Power Supply System for Telecommunication – Planned update for 336V (380VDC) mid to late 2014 • Equipment Safety Standards Exist – Power systems – UL60950-1,EN60950 – Distribution system components – various UL and CE standards – Power supplies – various UL and CE standards INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Conclusions • Eco system for 400VDC distribution is rapidly expanding • UL listed and CE marked system components are available or under advanced development in each category – ready for deployment now • Many vendors participating • Expect accelerated shipments starting Q1 2014 INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach Contributors • David E. Geary, Universal Electric Corporation / StarLine DC Solutions, Canonsburg, PA – USA – • David P. Mohr, HP, Houston, TX – USA – • dowen@juniper.net Maurizio Salato, Vicor Corporation, Andover, MA – USA – • David.mpohr@hp.com David Owen, Juniper Networks, Sunnyvale, CA – USA – • dgeary@uecorp.com MSalato@vicr.com BJ Sonnenberg, Emerson Network Power, Warrenville, IL – USA – BJ.Sonnenberg@Emerson.com INTELEC(r) 2013 • 13. - 17. October 2013, Hamburg - © VDE VERLAG GMBH • Berlin • Offenbach