Centre for E-Governance (CEG), Karnataka
KARNATAKA STATE DATACENTER
Rack Elevation plan
TATA CONSULTANCY SERVICES
<SOP >
Centre for e-Governance, Karnataka
Table of Index
1.0 Introduction ................................................................................................................................................................ 4
Understanding KSDC capacity .................................................................................................................................. 4
2. Storage Rack Elevation and distribution plan ............................................................................................ 5
3. Server Rack Elevation and Distribution plan .............................................................................................. 5
3.1. Maximum Power consumption of each server in fully loaded configuration. ....................... 5
3.2. Present day power consumption of the box with current configuration. ................................ 5
3.3 COOLING requirements of a server, hence distributing servers to avoid hot spots in the
server farm area. .............................................................................................................................................................. 6
3.4. Rack space requirement of each server...................................................................................................... 6
3.5 Distribution of redundant servers to different racks. ......................................................................... 6
3.6. Ease of maintenance. ............................................................................................................................................. 6
3.7. Segregation of non IT hardware from IT hardware ............................................................................. 6
3.8 Segregation of Production, Test and development environments .............................................. 6
4. Non IT infrastructure rack – ISP rack .............................................................................................................. 6
Tata Consultancy Services LTD
Page 2
<SOP >
Centre for e-Governance, Karnataka
Document Details
Prepared By
Organization
Project
Release Date
Release Version
TCS implementation team
Tata Consultancy Services Ltd.
Karnataka State Data Center
29/2/2012
V 1.0
Document Reviewed By
Reviewed By
Designation
Organization
Review Date
<Name>
Centre of e-Governance, Karnataka
<Date>
Document Approved By
Approved By
Designation
Organization
Approved Date
<Name>
Centre of e-Governance, Karnataka
<Date>
Post Release Revision History
Document
Version
Revision Date
Tata Consultancy Services LTD
Revised By
Reviewed By
Approved By
Page 3
<SOP >
Centre for e-Governance, Karnataka
1.0 INTRODUCTION
This document is trying to describe the considerations given while preparing the rack elevation
and distribution plan for KSDC server farm area. It is also trying to lay down guidelines for future
utilization of rack space in KSDC.
UNDERSTANDING KSDC CAPACITY
As per the KSDC design approved by CEG and implemented by TCS, there are 46 rack positions
available at KSDC. They are arranged in 5 different rows.
Based on the RFP requirements, available racks are classified into high density and low density
racks. Low density racks are provisioned with 5KVA of Power. Whereas the High density racks are
provisioned to use 10KVA power. A separate area is designated for the high density positions,
where active tiles will be deployed to provide enhanced cooling. The following table shows the
power availability for each rack.
Category
Number of racks
Power details
Power details
Low density racks
26
5KVA per rack
230V, 32A, single
phase
High density racks
10
10 KVA per rack
230V, 63A, single
phase
High density racks
10
10 KVA per rack
415V, 32A, 3 phase
Rack elevation and distribution plan for KSDC
KSDC rack requirements are classified into the following different categories for easiness of
planning.
1.
2.
3.
4.
Network racks
Storage racks
Server racks
Non IT infrastructure racks
1. Network Rack Elevation and distribution plan
As part of the RFP, CEG has bought 2 network racks. To meet the cabling requirements of KSDC,
TCS has provisioned 2 additional network racks. All four of these racks are of the same
specifications and Dimensions.(600 X 800, 42U)
Though only 8 server racks are procured for KSDC and around 10+ racks are expected to be
shifted from existing SDC, TCS has provisioned rack cabling for all the 46 server rack positions.
Tata Consultancy Services LTD
Page 4
<SOP >
Centre for e-Governance, Karnataka
The elevation diagram is prepared in such a way to accommodate all the active devices into two
racks ( Rack 11 and 12) and all the L2 switches and their respective jack panels are loaded into two
separate racks ( Racks 1 and 2).
Network rack elevation and rack distribution plan is attached below.
KSDC network rack
elevationV.3.xlsx
2. STORAGE RACK ELEVATION AND DISTRIBUTION PLAN
Current KSDC rack elevation and distribution approach provides a dedicated rack position to the
SAN solution. Rack number 21, 22, 23 are designated for the SAN solution. High density power is
provisioned to meet the power requirements due to future expansion of SAN solution.
This location is at the center of the server farm area, providing easiness in SAN cabling and
reducing the FC cable requirements. Also it is giving a dedicated area for SAN where cooling is also
optimal due to the proximity to multiple PAC units.
3. SERVER RACK ELEVATION AND DISTRIBUTION PLAN
KSDC has 8 Server racks as of now. While distributing servers into these racks the following factors
are considered.
3.1. MAXIMUM POWER CONSUMPTION OF EACH SERVER IN FULLY LOADED CONFIGURATION.
This need to be considered to ensure that in case of hardware upgrades, the total power
consumption of the rack is not exceeding the power provisioned for it. This is a best practice to
avoid unexpected outages to servers due to hardware upgrades without following process for
power requirement analysis.
3.2. PRESENT DAY POWER CONSUMPTION OF THE BOX WITH CURRENT CONFIGURATION.
Though the maximum power consumption is the standard for filling racks, this will result in rack
space wastage by provisioning for the future. By following strict process for the loading new
hardware into each rack, this can be overcome. This will mandate a change management process
which will ensure a power usage and availability analysis before loading any server into a rack
which is already being used. It need to be noted that the power consumption will be higher when
equipments starting. This buffer need to be considered in calculating the power requirements
based on the readings recorded in the normal running conditions. An analysis of each rack current
power consumption and remaining power and rack space is detailed in the rack elevation plan
attached below.
Tata Consultancy Services LTD
Page 5
<SOP >
Centre for e-Governance, Karnataka
Through this approach we are able to load more servers into each of the racks available in KSDC
resulting in optimum utilization of server farm and rack space available.
3.3 COOLING REQUIREMENTS OF A SERVER, HENCE DISTRIBUTING SERVERS TO AVOID HOT SPOTS IN
THE SERVER FARM AREA.
Based on the cooling requirements of each server, we need to ensure no rack is over populated with
high density servers. Proper distribution of such servers in the server farm area will avoid creation
of hot spots in the server farm area. Another factor is proximity of such racks from the redundant
PAC units. The location of such racks should be selected to ensure proper cooling.
3.4. RACK SPACE REQUIREMENT OF EACH SERVER.
Each server data sheet should be provided to the KSDC team upfront to plan for the rack space
availability before the servers can be actually brought to the DC. Server spacific requirements of
leaving additional free space above or below the equipments need to be specified by the OEM
vendor based on best practices.
3.5 DISTRIBUTION OF REDUNDANT SERVERS TO DIFFERENT RACKS.
It is a good practice to distribute redundant servers of same application to different racks,
whenever possible. This will provide rack level redundancy for power, cabling, PDU etc.
But in a shared data center approach, this will be sacrificed to restrict different department
infrastructure to same racks for security and maintenance purposes. ( where department may own
their racks and will be reserved for their future expansion).
3.6. EASE OF MAINTENANCE.
It is a good practice to bring racks which are used for same purposes/applications to nearby. This
will provide easiness in maintaining them and trouble shooting in case of issues.
3.7. SEGREGATION OF NON IT HARDWARE FROM IT HARDWARE
It is highly recommended to segregate non IT equipments from IT equipments for security and
maintenance purposes. Following this plan, KSDC rack elevation plan is providing, separate racks
for networking, SAN solution, Server loading.
3.8 SEGREGATION OF PRODUCTION, TEST AND DEVELOPMENT ENVIRONMENTS
It is a good practice to segregate the production infrastructure from the non production
infrastructure ( QA, Testing, Development and Training environments). It is highly recommended to
distribute servers based on their usage as described above.
4. NON IT INFRASTRUCTURE RACK – ISP RACK
As a best practice TCS recommends to use a separate rack for ISP equipment loading. This will ensure
that third party maintenance of ISP links/ WAN links etc will not interfere with the critical
networking or server infrastructure components of KSDC. Currently one server rack is sharing these
infrastructures too.
Tata Consultancy Services LTD
Page 6
<SOP >
Centre for e-Governance, Karnataka
Based on the above discussed points, the following server rack distribution and rack elevation plan
is adapted in KSDC.
KSDC Server Rack
Elevation v1.0.xlsx
Tata Consultancy Services LTD
Page 7