Project GreenLight
Presentation for the 7th ITU Symposium on
ICTs, the Environment and Climate Change
Greening ICT Infrastructures Session
5/30/12
Dr. Gregory Hidley
California Institute for Telecommunications and Information Technology,
University of California at San Diego (UCSD)
ICT is a Key Sector
in the Fight Against Climate Change
Applications of ICT
could enable emissions reductions
of 7.8 Gt CO2e in 2020,
or 15% of business as usual emissions.
But it must keep its own growing footprint in check
and overcome a number of hurdles
if it expects to deliver on this potential.
www.smart2020.org
Application of ICT Can Lead to a 5-Fold Greater
Decrease in GHGs Than its Own Carbon Footprint
“While the sector plans to significantly step up
the energy efficiency of its products and services,
ICT’s largest influence will be by enabling
energy efficiencies in other sectors, an opportunity
that could deliver carbon savings five times larger than
the total emissions from the entire ICT sector in 2020.”
--Smart 2020 Report
Major Opportunities for the United States*
– Smart Electrical Grids
– Smart Transportation Systems
– Smart Buildings
– Virtual Meetings
* Smart 2020 United States Report Addendum
www.smart2020.org
Project GreenLight Motivation:
The CyberInfrastructure (CI) Problem
•
Compute energy/rack : 2 kW (2000) to 30kW+ in 2012
•
Cooling and power issues were becoming a major factor in CI design
•
IT industry is “greening” huge data centers … but today every $1 spent on local
IT equipment will cost $2 more in power and overhead
•
Academic CI is often space constrained at departmental scale
•
Energy use of growing departmental facilities is creating campus crises of
space, power, and cooling
•
Unfortunately, little was known about how to make shared virtual clusters energy
efficient, since there has been no campus financial motivation to do so
•
Challenge: how to make data available on energy efficient deployments of rack
scale hardware and components?
The NSF-Funded GreenLight Project
Giving Users Greener Compute and Storage Options
•
•
PI is Dr. Thomas A. DeFanti
$2.6M over 3 Years to construct GreenLight Instrument
– Start with instrumented Sun Modular Data Centers
•
•
•
•
•
– Add additional power monitoring at every receptacle
– Add web and VR interfaces to access measurement data
Populate with a variety of computing clusters and architectures
–
–
–
–
•
•
Sun Has Shown up to 40% Reduction in Energy
Measures Temperature at 5 Levels in 8 Racks
Measures power Utilization in Each of the 8 Racks
Chilled Water Cooling input and output temperatures
Traditional compute and storage servers
GP GPU arrays and specialized FPGA based coprocessor systems
DC powered servers
SSD equipped systems
Turn over to investigators in various disciplines
Measure, Monitor and Collect Energy Usage data
– With the goal of maximizing work/watt
The GreenLight Project:
Instrumenting the Energy Cost of Computational Science
•
Focus on 5 Communities with At-Scale Computing Needs:
–
–
–
–
–
•
Metagenomics
Ocean Observing
Microscopy
Bioinformatics
Digital Media
Measure, Monitor, & Web Publish
Real-Time Environmental Sensor Output
– Via Service-oriented Architectures
– Allow Researchers Anywhere To Study Computing Energy Cost
– Enable Scientists To Explore Tactics For Maximizing Work/Watt
•
Develop Middleware that Automates Optimal Choice
of Compute/RAM Power Strategies for Desired Greenness
•
Teach future engineers who must scale from an education in Computer Science to a
deeper understanding in engineering physics
Source: Tom DeFanti, Calit2; GreenLight PI
GreenLight Research activities
Leading to Greener CI Deployments
• Computer Architecture – FPGA, GP GPU systems
– Rajesh Gupta/CSE
• Software Architecture – Virtualization, memory management,
networking and modeling
– Amin Vahdat, Ingolf Kruger/CSE
• CineGrid Exchange – mixed media storage, streaming, and
management
– Tom DeFanti/Calit2
• Visualization – Using 2D and 3D modeling on display walls and CAVEs
– Falko Kuster/Structural Engineering, Jurgen Schulze/Calit2
• Power and Thermal Management
– Tajana Rosing/CSE
• DC Power Distribution
– Greg Hidley/Calit2
http://greenlight.calit2.net
Monitoring, Modeling and
Management
GLIMPSE
http://glimpse.calit2.net
Calit2/UCSD [http://greenlight.calit2.net]
Situational Awareness
Dashboard
interface
“Tap”
for details
Power
utilization
Enterprise
reach
Multiple
perspectives
Calit2/UCSD [http://greenlight.calit2.net]
9
Datacenter vitals
Input/Output
sampling
Live/average
Fan speeds
Live/Average
data
Live
Temperature
Environmentals
2010.08.20
Heat Exchangers
Calit2/UCSD [http://greenlight.calit2.net]
10
Domain specific views
Control
elements
Real-time
heatmap
Realistic
models
2010.08.20
Calit2/UCSD [http://greenlight.calit2.net]
11
Airflow dynamics
Live
fan speeds
Airflow
dynamics
2010.08.20
Calit2/UCSD [http://greenlight.calit2.net]
12
Heat distribution
Combined
heat + fans
Realistic
correlation
2010.08.20
Calit2/UCSD [http://greenlight.calit2.net]
13
Heat Trends
Heat
exchangers
Hotspot
identification
Trends over
past 24h
Calit2/UCSD [http://greenlight.calit2.net]
14
Past changes in airflow
Fan slices
rpm
Heat
distribution
changes
Potential for
failures
Trends over
past 24h
Calit2/UCSD [http://greenlight.calit2.net]
15
Power spikes
IT assets
Computation
zone
Unused asset
Average load
Peak
computation
1 minute
resolution
Calit2/UCSD
[http://greenlight.calit2.net]
16
Zoom-in Analysis
History over several days.
Zoom on desired time range.
Hint on each sample point.
Automatic average area.
Multiple sensors per asset
with up to 1 min sampling
resolution.
Calit2/UCSD
[http://greenlight.calit2.net]
17
DC Power: UCSD is Installing
Solar and Fuel Cell DC Electricity Generators
San Diego’s Point Loma Wastewater Treatment
Plant Produces Waste Methane
UCSD 2.8 Megawatt
Fuel Cell Power Plant
Uses Methane
2 Megawatts of
Solar Power Cells at
UCSD, 1 MW to be
Installed off campus