Group 25
Sumin Mohanan, Zoheb .H Borbora
3/8/2011

TPC (Transaction Processing Performance Council)
◦ Founded in 1988 to define transaction processing and database
benchmarks

Obsolete standards
◦
◦
◦
◦
◦
◦

TPC-A
TPC-App
TPC – B
TPC- D
TPC – R
TPC – W
Current standards
◦ TPC- C
◦ TPC- E
◦ TPC – H

: update – intensive database environments
: Application server and web services benchmark
: Measured throughput as transactions / second
: Decision support applications (long running queries)
: Business reporting / Decision support benchmark
: Transactional web e-commerce bench mark
: OLTP benchmark
: OLTP benchmark that simulates the workload of a brokerage firm
: Ad hoc decision support benchmark
Add-ons
◦ TPC- PR
◦ TPC- Energy
: A single pricing specification to be consistent across benchmarks
: Augments TPC Benchmarks with Energy Metrics
2


As of 2006, electricity used by servers and data centers in USA is
equal to the amount of electricity used by the entire U.S
transportation manufacturing industry (US Census Bureau 2006, US
DOE 2005)
In 2006, More than one-third of the electricity use in USA IT space
attributable to enterprise-class data centers.
http://www.energystar.gov/ia/partners/prod_development/downloads/EPA_
Datacenter_Report_Congress_Final1.pdf
3
Ref :Energy Cost , The Key Challenge of Today's Data Centers : A power
consumption analysis of TPC-C Results , ACM 2008
4

Much of this poor efficiency is caused by a historical lack of
attention to power efficiency not by inherent limitations imposed
by physics
Ref : L. A. Barroso, U. Hölzle, The Datacenter as a Computer:An Introduction to the Design of
Warehouse-Scale Machines, 2009
5

TPC, SPEC, SPC
◦ Prominent industry consortia for performance measurements



2007 - TPC formed a committee to add energy
metrics to all its benchmarks
Wherein TPC performance metrics correspond to the
amount of work completed per unit of time, TPC Energy metric measures the energy consumption
corresponding to the amount of work
Metric plainly represented as Watts/Performance
Ref: http://www.tpc.org/tpc_energy/Presentations/EnergyBenchmarks.pdf
6

Comprehensive metric that takes into account
◦ all the components including database server, middle tier,
storage subsystem and connectivity devices
◦ Work load characteristics (time based vs task based)

Overall power
◦ Pi = Power consumption in interval i
◦ Ti = Performance measurement (tpmC, tpsC) in interval i
◦ Si = weight corresponding to duration of the interval i
7


Performance comparison for the TPC-E benchmark
with and without energy metric
TPC- Energy
included
No. of
results
Min (tpsE)
Max (tpsE)
Mean
(tpsE)
No
10
1,493.42
3,800.00
2270.17
Yes
3
1,268.30*
2,001.12
1556.52
Best Watts/tpsE results – 0.93
◦ Fujitsu Primergy RX300* – results submitted 2/14/11
◦ Great improvement over the HP Proliant system (Watts/tpsE
= 5.84)
Ref: http://www.tpc.org/tpce/default.asp
8

Data center best practices
◦
◦
◦
◦
◦
◦

Measure Power Usage Effectiveness (PUE)
Manage air flow
Adjust the thermostat.
Use free cooling.
Optimize power distribution.
Buy efficient servers.
Warehouse-scale computer
◦ Holistic approach to the design and development of various
components of the modern data center
Ref: http://www.google.com/corporate/datacenter/best-practices.html
9








http://www.tpc.org/information/press/tpcpress20100707.asp
Energy Cost , The Key Challenge of Today's Data Centers : A power
consumption analysis of TPC-C Results , Poess et al., ACM 2008
www.energystar.gov/ia/partners/prod_development/downloads/EPA_Datace
nter_Report_Congress_Final1.pdf
http://www.tpc.org/tpc_energy/Presentations/EnergyBenchmarks.pdf
http://en.wikipedia.org/wiki/Transaction_Processing_Performance_Council
http://www.tpc.org/tpce/default.asp
http://www.google.com/corporate/datacenter/best-practices.html
L. A. Barroso, U. Hölzle, The Datacenter as a Computer:An Introduction to the
Design of Warehouse-Scale Machines, 2009
10