Jon Inaba
Director, Power Management Solutions
Raritan
A Strong Reputation for Innovation…
Recent, major data center builds have selected
Raritan for best-of-breed Rack PDUs. etc…
…by Consistently Solving Practical Client
Problems
The rack PDU occupies a critical and strategic position in the power chain: a “best-of-breed” strategy provides opportunities to significantly improve data center operations in practical and economical ways.
• Increase Rack Density (Servers / Cabinet)
• Safely deploy 400v/3ph distribution to the cabinet;
• Sought industry expertise on practical matters @ 400V/3ph;
• Reduce # whips required per cabinet for high density;
• Six L6-30R [208V / 1ph] from one 208V / 3ph whip;
• Required breadth of 17.3kVA configurations
[208V / 3ph / 60A input on IEC 460R]
…by Consistently Solving Practical Client
Problems
The rack PDU occupies a critical and strategic position in the power chain: a “best-of-breed” strategy provides opportunities to significantly improve data center operations in practical and economical ways.
• Reduce high-density (17kVA+) costs with
UL Listed power strips utilizing conduit input;
• Develop solution for 50kW cabinet;
• Increase quality / reduce MTBF in rack PDUs;
• Enforce best-practices for load-balancing: o blade chassis + other high-power devices; o on high-power PDUs (208V / 3ph / 60a);
Twitter: Increase Rack Capacity with Confidence
Challenge
• Client standard = ~35 servers / rack. Power believed stranded / under-utilized;
• Required rack power strip that:
• provided enough outlets to accommodate more servers (42+)
• ensured no power faults due to overloading [monitoring accuracy];
• fits in same exact form factor as incumbent;
Raritan Solution
NEMA L21-30P
208v / 3ph / 30A
8.6kVA
48xC13 and 3x NEMA 5-20R in 2.1” wide chassis
Twitter: Increase Rack Capacity with Confidence
+/- 1% Metering per Breaker Assures Fault Prevention & Detection…
… at same price as competitor’s 36-outlet model
Disney: Deploy 400v/3ph Power to Rack Safely
Challenge
• New datacenter in Kings Mountain, NC;
• Client wished to harness cost savings / electrical of 400v/3ph to the rack;
• Still relatively new in North American market;
Raritan Solution
• Leading pioneer of 400v/3ph rack
PDUs
in North America;
• Largest install base of relatively “exotic”
emerging standard [“European”];
• At client’s request, fabricated chassis to
match UPS color scheme [blue, green,
magenta, and yellow];
400V / 3ph to the Cabinet? Makes sense >12.6kVA
Reduced transmission loss
(Ohm’s Law V=IR)
Reduced step-down transformation loss
Less copper, more power
Already in widespread deployment worldwide
AC Power Cable Cross-Section @ ~17.5kW
17.3kW
@208V
18kW
@400V
3P 4W, 4# (48A)
32mm (1.26
” ) OD
4P 5W, 8# (24A)
27.3mm (1.08
” ) OD
Source: General Cable SOOW Spec Sheet
…Delivering More Power at Same Ampacity
208v / 1ph / 30a 208v / 3ph / 30a 400v / 3ph / 30a
Phase
Input Voltage
Output Voltage
Single phase
208V
208V
Three phase Delta
208V, 3-phase
208V
Three phase Wye
400V, 3-phase
230V
5.0 kVA 8.6 kVA 16.6 kVA Apparent power
1U servers supported*
2u servers supported*
Blade chassis supported*
24
24
1
41
41
1-2
80
80
3-4
*HP Proliant DL360G6 1U server, 206 watts at 80% load on SPECpower_ssj2008
HP Proliant DL380G6 2U server, 208 watts at 80% load on SPECpower_ssj2008
HP Proliant C7000, ProLiant BL2x220c G6, 4860 watts at 80% load on SPECpower_ssj2008
…but 400v/3ph Power Requires Unique Expertise
Until very recently, 400v/3ph power distribution considered “European”.
True, practical expertise at this standard is rare in North America
Arc Flash Hazard.
Unlike status quo, 400v/3ph technically poses an arc flash hazard.
Special care required in design and specification of power strip;
Product Selection.
Other vendors lack the install base, and therefore the breadth of product selection, in the 400v/3ph electrical specification.
Input Plug Preference. Relatively new to North America, confusion abounds regarding the correct input plug to utilize:
• NEMA L22? or NEMA L7?
• IEC 60309 (“Pin-and-Sleeve”)? If so…
−
Ground pin at 6HR (415v max) : red plug? typically considered a European plug, can it pass UL?
−
Ground pin at 7HR (480v max) : blue plug? typically considered a North American plug, but 480v?
Harmonics. Line-to-Neutral wiring can induce harmonics / current on the neutral line, if load is not properly balanced.
Cisco: Reduce #Whips for High-Density Cabinet
Challenge
• Common problem for certain blade servers, and many Cisco devices
[e.g. Nexus 7000 series]
• Power supplies hardwired with L6-30P power supplies;
• Customers assume rack PDUs cannot be used, run 6x whips;
Raritan Solution
• Design rack PDU with 30A breakers and NEMA L6-30R outputs;
Cisco Example: Exadata Cabinets
BEFORE
12 x Single phase
30A
Circuits
Floor
PDU / RPP
Floor
PDU / RPP
Cisco Example: Exadata Cabinets
AFTER
2x Three-Phase, 50A circuits
Floor
PDU / RPP
Floor
PDU / RPP
Cisco: Electrical Equivalence with Fewer Whips
In concept, a remote “Branch Panel”… metered + monitored for fault prevention
Intuit: Maximize Deployment Flexibility @60A/3ph
Challenge
• Very small selection of rack PDU options above 12.6kVA from most vendors;
• Need a 3ph / 60a solution flexible to accommodate blades OR 1U/2U/storage;
• Most vendors assume blades; or 1U/2U/storage – not flexible;
Raritan Solution
• 17.3kVA (208v / 3ph / 60a)
• 12x C19’s allow deployment of up to 4x blade servers;
• 24x C13’s allow deployment of ~20x 2U servers + switches;
• Six circuit breakers protect load against bad power supplies;
• Cable exits on end of PDU to simplify cable management of very large SO cord;
• Each “bank” of outlets alternates phases to enable easier blade server deployment ( see LinkedIn case study, later in this slide deck )
Intuit: Maximize Deployment Flexibility @60A/3ph
Expert Consultation: 60A / 3ph Plug Selection
• 208v / 60A / 3ph power strip requires 4-conductor / #4 AWG input cable;
• SOOW UL rated cable is 1.26” in diameter, and weighs 11.5 pounds*!!
• Appropriate plug selection required to ensure reliable connection;
SOME VENDORS
(cheaper)
IEC 60309 3-Pole 4-Wire **
“Pin-and-Sleeve / CEEform”
IP44 (“Splashproof”)
“460C9 or 460R9”
RARITAN STANDARD
(secure locking ring)
IEC 60309 3-Pole 4-Wire
“Pin-and-Sleeve / CEEform”
IP67 (“Watertight”)
“460C9W or 460R9W ”
CLIENT’S CUSTOM CHOICE
(physically smallest)
NEMA 15-60P
IP44 (“Splashproof”)
* assumes 10ft input cable
** photo shows 2P3W
eBay: Reduce High-Density Cost w/ Conduit
Challenge
• Client regularly deploys cabinets exceeding 20kW;
• Above 16.2kVA (208v / 3ph / 45a), SOOW cord and plug becomes very expensive;
Raritan Solution
• Design rack PDU option for “hard-wiring” to user-accessible terminal block;
• Worked with certification authorities to attain UL Listing;
• Worked with StarLine (Universal Electric) to provide appropriate tap box;
• Deployed SealTite flexible conduit at 1”
Trade Size;
eBay: Reduce High-Density Cost w/ Conduit
SealTite flexible conduit
@ 1” Trade Size
Standard conduit fittings mate to punchout on PDU
Savings (at ~17kVA)
Part
PDU Cord
Spec
10’ SOOW
#4 AWG
IEC 60309 PDU Plug
Tap Box
Connector
Tap Box Cord
Tap Box
Strain Relief
IEC 60309
2’ SOOW
#4 AWG
Kellems Mesh
Grip, 1.5” O.D.
~$1000 per rack
Price
$88
$173
$205
$17
$48
Electrician- accessible terminal block
New design far cheaper :
• ~1hr of electrician time (max);
• “Bare” wire conductors;
• Inexpensive condaauit;
• “Permanent” installation;
Comcast: Improve Reliability of Rack PDUs
Challenge
• Previous rack PDU vendor = boutique North American company; inconsistent manufacturing quality
• Largest rack PDU vendor only employs production sample tests;
• Rack PDU quality failures highly disruptive, and costly to change;
Raritan Solution
• ISO 9001 manufacturing: flexibility of small company, reliability of multinational;
• Load-testing on 100% of production units;
• Quality from design through manufacturing;
Quality
Manufacturing
Processes
Quality
Components
Quality
Design
Comcast: Improve Reliability of Rack PDUs
Quality Components = A Raritan Core Competence e.g. CPU.
Raritan supplies the exact same CPU as found on our power strips, to the world’s most-demanding, Tier 1, server manufacturers.
Our CPU must pass the most stringent heat, manufacturing, quality, and stress tests / audits. e.g. Power Chain Components (Inlet Power Cord. Terminal Block. etc.) Raritan rack
PDUs are UL Listed at a higher ambient temperature than all competitors, due to the use of better components throughout the entire power chain.
LinkedIn: Eliminate Stranded Capacity by Design
Challenge
• Due to weight and exhaust heat, users typically place high-power equipment (e.g. blade servers) toward the bottom of the rack;
• Client deploys 3-phase power;
• Results in overutilization of one electrical phase [outlets closest to bottom of rack]; and underutilization of other two phases = Stranded capacity.
Raritan Solution
Phase 3
(L3/L1)
Phase 2
(L2/L3)
Phase 1
(L1/L2)
Every Outlet
Every Breaker
Clearly labeled
Phase 3
(L3/L1)
Phase 2
(L2/L3)
Phase 1
(L1/L2)
When design / planning data center projects,
Raritan’s unique expertise, install base, industry innovation can dramatically improve data center operations.
High Power Experience and Product Portfolio.
• Largest selection of Rack PDUs above 12.6kVA;
• Largest selection and install base of N. American
Rack PDUs at 400v/3ph;
“Perfect Fit” Custom Options w/o Price Premium.
• Small differences make very large operational impact;
• e.g. Cord length; Outlet options; Mechanical options;
Quality: 100% Testing; ISO 9001 Manufacturing;
Highest Ambient Temps
Rack Power Monitoring at Large Scale. Our IT capabilities + industry’s largest deployed customer installations provide unique expertise implementing functional an valuable rack power monitoring.