How do you recognize an energy-efficient data center? High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Rümlang, May 2012 Table of Contents Company Profile & Data Center Zurich 1 (ZRH1) Containment Solutions - Smart Aisle Containment Company Overview e-shelter designs, builds and operates data centers to house mission-critical IT systems design build operate data center infrastructure Physical security Facility management Provision of highly resilient power and cooling e-shelter is the leading full-service provider for data center infrastructure in Germany providing the highest standard in physical security and operational reliability. 5 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Currently e-shelter operates more than 85,000 sqm of data center space, three additional locations are under development Overview locations Data Center Campus Frankfurt 60,000 sqm area 24/7 Service & Control centre Headquarters Data Center Campus Berlin 13,000 sqm area Hamburg London Data Center Campus Zurich 7,000 sqm area in operation, additional 6,000 planned Berlin Frankfurt/ Main Colocation Centers Frankfurt (1,900 sqm) Munich (1,960 sqm) Hamburg (1,230 sqm) New locations London Munich II Frankfurt III 6 May 2012 Munich e-shelter Datacentre location e-shelter Datacentre location planned High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Zurich e-shelter planning and design implements highest standards in energy efficiency and latest developments in technical progress Energy efficiency and sustainability Research & Development In order to develop best-practice approaches for energy efficient operation of data centers e-shelter is actively engaged in different workshops and organisations e.g. “the green grid“ and “Uptime Institute.” e-shelter works with large suppliers of cooling technology to explore and test new cooling techniques, and has developed a sophisticated measuring system to continuously monitor energy utilization (e.g. cooling requirements in different zones). Operational excellence e-shelter designs and operates its data centers to be highly efficient and applies state-of-the-art technology to achieve an optimal utilization of energy. Hereby e-shelter is able to achieve highly competitive power utilization efficiency factors for its data centers (PUE factor). 7 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Data Center Zurich 1 (ZRH1) e-shelter‘s first datacenter in Switzerland is located in the north of Zurich, approx. 8 km from the city center Location 9 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center The largest purpose-built data center in Switzerland Building The freestanding building is designed and built solely for the purpose of housing IT infrastructure. All external and internal building features are constructed with high quality materials and meet or exceed industry standards. The first stage of construction provides 7’000 sqm of net data center space and 1’000 sqm of office space The facility meets the LEED (Leadership in Energy and Environmental Design) Platinum pre-certification 10 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Carrier Connectivity Redundant Carrier Connectivity Site Connectivity Carrier Other providers single redundant own fiber 12 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Security Structural, technical and organizational separation of the security zones Security Systems The security concept includes having all safety-sensitive areas situated in the core of the building to the extent where this is feasible so that the security zones beyond the core serve as buffers. All security zones are structurally, technically and organizationally separated from one another All security zones are monitored by way of synchronized technical safety measures This way it is ensured that the cumulative safety function for creating the necessary penetration resistance/ resistant time value 14 May 2012 7 Security Command and Control centre (SCC) 6 Carrier rooms 5 Datacentre areas 4 Technical areas 3 Circulation area for tenants 2 Circulation area building(s) 1 Circulation area Datacentre site High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Power and Cooling Systems The redundant power supply guarantees maximum availability Power supply Power is distributed on an A & B feed up to the rack The critical components of the power supply are designed in an 2N+1 configuration State-of-the-art static UPS systems with a high degree of scalability and reliability incl. isolating transformers On-site back-up power (diesel generators) in an N+2 configuration 72h diesel-fuel storage on site. 16 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Air conditioning and cooling systems designed to meet all requirements of a high-availability system Cooling Redundant cooling and air conditioning systems Separate chiller- and free-cooling systems for maximum efficiency Adiabatic cooling Individual cooling solutions available (rack-housing, high-density-racks) 17 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Containment Solutions - Smart Aisle Containment Short Historie Review 2006: Start of CAC - SmartAisle 2% 7% 8% 2% IT Load Power Cooling Power Light Electrical Losses 11% PUE = 1,35 Power Fans 80% 3% IT Load 12% Power Cooling 50% PUE = 2,0 Power Light Electrical Losses 25% Power Fans Containment Solution - EMERSON/ Knürr from 2,0 to 1,35 … and it gets even better! 19 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center SmartAisle Containment Containment Solution SmartAisle Containment Solution 20 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center SmartAisle Containment vs. Pressure compensation Containment Solution p 1 Pa SmartAisle Containment Solution p 20 Pa Pressure Compensation Solution 21 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center SmartAisle Containment vs. Pressure compensation For Example: 240 kW IT-Usage Heat diagram - Containment Solution 22 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Results SmartAisle Containment vs. Pressure compensation Electricity for powering of drives No arrangement (3 ULKs) Pressure compensation Fan speed 100% 17,04 kW Mode “full load” (3 ULKs) Fan speed 91% 12,90 kW Fan speed 71% 5,94 kW Mode “normal operation” (4 ULKs) Fan speed 70% 7,76 kW Fan speed 54% 3,52 kW Mode “efficient operation” (6 ULKs) Fan speed 49% 4,08 kW Fan speed 37% 1,68 kW Mode “high efficient operation” (8 ULKs) Fan speed 38% 2,72 kW Fan speed 30% 1,28 kW Source: Emerson Network Power White Paper 2012 23 SmartAisle Containment May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Energy saving via speed control The mothers of energy efficiency Continuous cold / warm separation Dynamic regulation the entire system High standard temperature, free cooling EC Ventilators - Speed control 9,00 8,00 7,00 6,00 Speed control results in great energy savings "sweet spot" 5,00 4,00 1/2 speed 1/8 power consumption 3,00 2,00 % speed or airflow 24 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center 100% 75% 50% 33% 1,00 0,00 power consumption [kW] Cooling requirements of IT Equipment Temperature and humidy on the suction side ASHRAE TC 9.9 Thermal Guidelines 2008 / modified 2011 for Class A1 *) Recommended: Allowable: Entry temperature 25 5,5°C DP - 60% RH and 15°C DP 20% RH - 80% RH (Class A1) 20% RH - 80% RH (Class A2) Component / consumption Exit temperature Consumption 25°C T 7K 32°C 470 m³/h per kW 25°C T 15K 40°C 220 m³/h per kW 25°C Source: 18 - 27°C, 15 - 32°C, 10 - 35°C, T 25K 50°C 130 m³/h per kW 2011 Thermal Guidelines for Data Center Processing Environments - Expanded Data Center Classes and Usage Guidance May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Server power consumption vs. suction temperature Power 1,20 kW 1,15 kW 1,10 kW approx. + 12% 1,05 kW 1,00 kW 15 °C Source: 26 20 °C 25 °C 30 °C 35 °C 2011 Thermal Guidelines for Data Center Processing Environments - Expanded Data Center Classes and Usage Guidance May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Aspirated air flow vs. suction temperature Power 2,60 m³ 2,20 m³ 1,80 m³ approx. + 55% 1,40 m³ 1,00 m³ 15 °C Source: 27 20 °C 25 °C 30 °C 35 °C 2011 Thermal Guidelines for Data Center Processing Environments - Expanded Data Center Classes and Usage Guidance May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Case 1: Is it worth the higher temperature? Power Other 2 % Other 2 % Other 2% Other 2% Electricity 8% Electricity ? 8% Cooling Cooling 14 % ULK ULK 1% IT IT 100 % PUE = 1,35 Suction Temperatur : 28 May 2012 14 % 1% 100 % PUE = ? 25 °C 35 °C High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center History review to future outlook It becomes hotter! Thermography hot aisle From 35°C to 50°C … and it rise up! 29 May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center Water cooled rack-solutions - EMERSON/ Knürr Case 2: 40 - 50 in the data center - is it possible/ useful/ efficient? Exit temperature-range for Blade Server (example) 50°C 45°C 40°C Full load 35°C Idle speed/ no-load 32°C 30°C 27°C Allowed envelope 25°C 20°C Recommended envelope 18°C 15°C Future temperature range 10°C Class A1 Source: 30 Class A2 2011 Thermal Guidelines for Data Center Processing Environments - Expanded Data Center Classes and Usage Guidance May 2012 High Density - High Efficiency - High Temperature in the Data Center Efficiency trap in the Data Center How do you recognize an energy-efficient data center? Olivier Honold Sales Manager Switzerland e-shelter facility services (Schweiz) AG Hofwisenstrasse 56 CH-8153 Rümlang Telephone: Fax: Mobile: E-Mail: +41 (44) 817-6560 +41 (44) 817-6539 +41 (79) 402 6139 olivier.honold@e-shelter.ch Thank You. www.e-shelter.ch