Northwestern University Information Technology Data Center Elements Research and Administrative Computing Committee Presented October 8, 2007 1 Evanston Data Center Physical Space Note: All areas shown have computer room raised floors 2 2 173: Research (950 ft ) Mailroom (2600 ft ) 2 172: Hosting (3850 ft ) 2 171: Operations/Printing (1950 ft ) Staff offices 2 Chicago Data Center Physical Space 2 234: Departmental Hosting 232: Hosting (1000 ft ) 2 (800 ft ) Note: Areas do not have computer room raised floors. 3 Data Center Tier Classification The Tier classifications were created to consistently describe the site-level infrastructure required to sustain data center operations, not the characteristics of individual systems or sub-systems. The requirements were established by the Uptime Institute, Inc. and are necessarily and intentionally very broad to allow innovation in achieving the desired level of site infrastructure performance, or uptime. The individual Tiers represent categories of site infrastructure topology that address increasingly sophisticated operating concepts, leading to increased site infrastructure availability. 4 Data Centers Tiers Tier I: Basic Site Infrastructure • • • Non-Redundant Capacity Components and Distribution paths. Any Capacity Component or Distribution Path failure will impact the computer systems. Planned work will require most or all of the systems to be shutdown. Tier II: Redundant Capacity Components Site Infrastructure • • • Redundant Capacity Components, but single Non-Redundant Distribution Paths serving the site’s computer equipment. Redundant UPS modules and engine generators are required. A distribution path failure will cause the computer equipment to shut down. Tier III: Concurrently Maintainable Site Infrastructure • • Redundant capacity components and multiple distribution paths serving the site’s computer equipment. Generally, only one distribution path serves the computer equipment at any time. Each and every capacity component and element of the distribution paths can be removed from service on a planned basis without causing any of the computer equipment to be shut down. Tier IV: Fault Tolerant Site Infrastructure • • • Redundant capacity systems and multiple distribution paths simultaneously serving the site’s computer equipment The site is not susceptible to disruption of service from a single unplanned worse-case event. Infrastructure maintenance may be performed by using redundant capacity components and distribution paths to safely work on the remaining equipment. 5 Tier Rating of NUIT Data Centers Northwestern University’s central IT data centers are Tier I facilities. Tier I: Basic Site Infrastructure • • • Non-Redundant Capacity Components and Distribution paths. Any Capacity Component or Distribution Path failure will impact the computer systems. Planned work will require most or all of the systems to be shutdown. Building Cost Comparison of Tier Facilities Construction Cost (+/- 30%) Raised Floor (per sq. ft.) Useable UPS Output (per kVA) Tier I Tier II Tier III Tier IV $220 $220 $220 $220 $10,000 $11,000 $20,000 $22,000 6 Electrical Infrastructures Evanston Data Center Room 172: Hosting • • • • Dual Power Feeds Two 150kVA UPS units running in parallel 750kVA Diesel Generator Single Distribution Path Room 173: Small Research Center • • • • Single Power Feed Single 160kVA UPS unit No Generator Single Distribution Path Chicago Data Center Rooms 232 and 234 • • • • Single Power Grid 350kVA UPS unit 375kVA Diesel Generator Single Distribution Path 7 Electrical Capacity for Evanston Data Center Hosting Rooms 171 and 172 • What is the protected load capacity? Safe Electrical Draw is 240kVA • What is today’s consumed load? Today’s Draw is 210kVA A power reduction plan is underway to shed load and bring the total draw down to 195kVA for these two rooms. Thus providing 45kVA of unused safe draw to utilize. Small Research Center Room 173 • What is the protected load capacity? Safe Electrical Draw is 128kVA • What is today’s consumed load? Today’s Draw is 20kVA 8 Electrical Capacity for Chicago Data Center Hosting Rooms 232 and 234 • • What is the protected load capacity? Safe Electrical Draw is 300kVA What is today’s consumed load? Today’s Draw is 300kVA A power co-generation project to bring additional power into this location has been cancelled by Facilities Management. Facilities Management is recommending the purchase of a larger diesel generator. 9 Cooling Capacity Mailroom Room 171 Room 172 Room 173 Mail Room 40 Tons supports up to 120kVA* 80 Tons supports up to 240kVA* 20 Tons supports up to 60kVA* 60 Tons supports up to 180kVA* 172: Hosting 20 tons • • • • 173: Research Evanston Data Center 40 tons of cooling 80 tons of cooling 171: Operations/Printing 40 tons of cooling *Aging units cause lower operating efficiencies causing a 25% inefficiency in cooling capacity. Staff offices A HVAC upgrade project is underway to replace aging units will be completed in June 2008. • Room 172 180 Tons supports up to 510kVA • Room 173 60 Tons supports up to 190kVA Chicago Data Center • Rooms 232/234 60 Tons supports up to 90kVA 234: Departmental Hosting 232: Hosting 60 tons of cooling 10 Fire Suppression Evanston Data Center • Pre-action sprinkler system • Fire Protection project is underway and upgrades will include FM200 protection in Rooms 171, 172 and 173 Chicago Data Center • Pre-action sprinkler system • FM200 fire suppression system 234: Departmental Hosting 11 232: Hosting Physical Security Evanston Data Center • • • • NetBotz DDC Sensors Marlok AI Phone Surveillance Monitoring System Environmental Monitoring System Access System Door Call Entry System Chicago Data Center • NetBotz • Marlok Monitoring System Access System 12 Network Connectivity and Security Evanston Data Center • Dual Fiber Connection to Evanston NUNet • Dual CISCO 6509 Switches • Redundant Netscreen Firewalls Chicago Data Center • Dual Fiber Connections to Chicago NUNet • Dual CISCO 6509 Switches • Redundant CISCO PIX Firewall Blades in 6509 switches 13 Storage Capacity Evanston Data Center Chicago Data Center • Storage Area Network • Dual Cisco 9509 Fiber Channel Directors • 57.2 TB Disk Storage • 700 TB Tape Storage • Disk Storage • IBM DS8100 Enterprise Disk Array • IBM DS4500 Disk Array • IBM DS4100 Disk Array • TAPE • IBM 3584 ATL • IBM Ultrium LTO1 and LTO2 tape Drives • Storage Area Network • Dual Cisco 9509 Fiber Channel Directors • 4.2 TB Disk Storage • 100 TB Tape Storage • Disk Storage • IBM DS4500 Disk Array • TAPE • IBM 3310 ATL • IBM Ultrium LTO3 tape Drives 14