Best Practice Guide for Data Centres - a UH
Perspective
Steve Bowes-Phipps, Data Centres Manager
University of Hertfordshire
http://rare‐idc.herts.ac.uk
Best Practice Guide for Data Centres
RARE IDC
RARE-IDC
Overview
“Reduction And Re-use of Energy
gy in Institutional Data
•
•
•
•
•
Centres”
Constraints and Design
B kd
Breakdown
off T
Typical
i lE
Energy R
Requirements
i
t
Best Practices
Results
Successful Outcomes
• Q&A
Best Practice Guide for Data Centres
Constraints
• Pillars
• Riser
• Capacity
• Contamination from work areas
• Overhead bulkhead
• Lack of under floor capacity
(only 250mm)
• Legacy
g y incorrect ((and
dangerous) power cabling
• Limited plant space
• Restricted external build space
• “Meet-Me”
“M t M ” point
i t for
f allll network
t
k
cabling
• No external walls
Best Practice Guide for Data Centres
New Data Centre Design
Best Practice Guide for Data Centres
Breakdown of Typical Energy Requirements
Best Practice Guide for Data Centres
Room Layout
Practice
•
Hot Aisle / Cold Aisle
•
Containment
•
Blanking panels
•
No shelf mounted equipment
•
Route
oute cables
cab es a
away
ay from
o fans
a s
•
Raised floor
•
Tile g
grommets
•
Position of cold aisle relative to CRAH
•
Dust mat
•
Cable trays
Impact
•
Separate hot and cold air
streams
•
Increase efficiency of CRAH /
CRAC
•
Reduce / remove “hot spots”
•
I
Improve
air
i circulation
i l ti / flflow
•
Prevent fan failure / filter
ineffectiveness
Best Practices
Hot Aisle / Cold Aisle Configurations
Example CLDC Layout
Example dHDC Layout
CRAH
CRAH
CRAH
Best Practices
Room Layout
Practice
•
Hot Aisle / Cold Aisle
•
Containment
•
Blanking panels
•
No shelf mounted equipment
•
Route
oute cables
cab es a
away
ay from
o fans
a s
•
Raised floor
•
Tile g
grommets
•
Position of cold aisle relative to CRAH
•
Dust mat
•
Cable trays
Impact
•
Separate hot and cold air
streams
•
Increase efficiency of CRAH /
CRAC
•
Reduce / remove “hot spots”
•
I
Improve
air
i circulation
i l ti / flflow
•
Prevent fan failure / filter
ineffectiveness
Best Practices
Blanking Panel Effectiveness
32oC
26oC
27oC
23oC
35oC
23oC
28oC
23oC
22oC
22oC
21oC
21oC
Best Practices
Room Layout
Practice
•
Hot Aisle / Cold Aisle
•
Containment
•
Blanking panels
•
No shelf mounted equipment
•
Route
oute cables
cab es a
away
ay from
o fans
a s
•
Raised floor
•
Tile g
grommets
•
Position of cold aisle relative to CRAH
•
Dust mat
•
Cable trays
Impact
•
Separate hot and cold air
streams
•
Increase efficiency of CRAH /
CRAC
•
Reduce / remove “hot spots”
•
I
Improve
air
i circulation
i l ti / flflow
•
Prevent fan failure / filter
ineffectiveness
Best Practices
Furniture & Fittings
Practices
Impact
•
T8 Low
Low-energy
energy lighting
•
Reduce lighting requirements
•
PIR
•
Reduced facility power cost
•
Colour of racks
•
•
Provision for additional
capacity but don’t build it!
Power and cool only where
needed
Best Practices
Electrical configuration
Practices
•
Parallel UPSs
Impact
•
Clean mains supply
•
On-line Interactive
•
Redundancy of supply
•
Dual Conversion
•
Stability of supply
•
Multiple Power Distribution
Boards (PDBs)
•
Continuity of supply
•
Power Factor
•
TNSS Filters
•
Phase balancing
•
Generator
Best Practices
Cooling Effectiveness
Practices
•
free air
air”
“free
•
Direct Free Air
•
Indirect Free Air
•
Direct Water Free
•
Indirect
d ect Water
ate Free
ee
•
Sorption cooling
(absorption / adsorption)
•
Variable speed fans
•
Humidifiers
•
Waste heat recycling
Impact
•
Use ambient air to extract
cooling
•
Don’t dump all waste heat into
environment
i
t
•
Reduced cost of cooling
•
Reduced
R
d
d operating
ti costt off
LRC
Best Practices
Environment
Practices
Impact
•
Dust free
•
Reduced fan/filter failure
•
Dry bulb inlet temp of 25-26oC
•
Reduced cost of facility
•
Relative humidity of target 50%
+/- 20%
•
Reduced cost of cooling
•
Cooling appropriate to
equipment
•
Turn off unused servers /
consolidation
lid ti / virtualisation
i t li ti
•
“Lights Out” – lighting only
where needed and when
needed
•
Separate UPS plant area
Best Practices
Four “M”s of Data Centre Management
Practices
•
Meter
•
Monitor
•
Maintain
•
Manage
Impact
•
Understand your Data Centre
“profile”
•
Reduced cost of cooling
•
Improved reliability of
components and infrastructure
•
Early
E
l and
d easier
i di
diagnosis
i off
issues leading to speedier
resolutions
Best Practices
Change Management
•
The Data Centre cannot be considered a constant
•
Change can wreak untold damage on efficiency and effectiveness
•
Plan for change
g and understand the impact
p
Data Centre Best Practices
Results
Energy Consumed Per H
Hour B f
Before: Aft
After:
Total IT Load 120kW 120kW Total Facility Load
Total Facility Load
264kW
264kW 146kW
Electricity used per Year 2,312,640KWh 1,282,464kWh Annual Carbon Footprint 1,394 Tons 773 Tons CO2 Emissions Equivalent to 1 Year 621 Tons 117 Fewer Cars
5 Years 3,106 Tons 586 Fewer Cars
10 Years
10 Years 6 212 Tons
6,212 Tons 1 172 Fewer Cars
1,172 Fewer Cars
Reduction in Best Practice Guide for Data Centres
Successful Outcomes
•
Capability of project to act an exemplar to the wider market in relation to the issues of
the micro-data centre
9
Refurbishment not new Build
9
Re-use of some Equipment
9
Our savings equate to a 55% reduction in the carbon footprint of the Data Centre
9
Operational cost savings of £30,000 up to a target of £34,000 per annum
9
Using a contained Hot Aisle configuration
configuration, waste heat is recycled into the building’s
building s hot water
supply
9
Our pathfinder project enables others to follow our success and apply the lessons we’ve
learned along the way
9
The first and only University in Europe to achieve compliance against the EU Code of
Conduct for Data Centres
9
Working with JISC to further EC-wide knowledge-sharing through the e-infranet project
9
Project Blog still active – disseminating learning post-project (http://rare-idc.blogs.herts.ac.uk/)
Best Practice Guide for Data Centres
Successful Outcomes
•
Data Centre Leaders Award Winner 2010
9 “Innovation
Innovation in a Micro-Data
Micro Data Centre”
Centre
Thank You
Any Questions?