Corporate Partner
Overview and Update
September 27, 2007
Gary Crane
SURA Director
IT Initiatives
SURAgrid Corporate Partnerships
• IBM p575 AIX offering
• IBM e1350 Linux offering
• Dell PowerEdge 1950 offering
• Significant product discounts
• Owned and operated by SURAgrid
participants
• Integrated into SURAgrid with 20% of
capacity available to SURAgrid
IBM Systems Offerings
p575 systems
BPA
16W
16W
16W
16W
16W
16W
16W
16W
Fed SW
8, 16W Nodes at 1.9 Ghz
128 Processors
BPA
2U
4U
0.97 TFlop Configuration
Federation Switch
16W
16W
16W
16W
16W
16W
16W
16W
16W
16W
16W
16W
16W
16W
2U
Fed SW
4U
256 GB or 128 GB System Memory
Storage Capacity: 2.35 TBytes
1.7 TFlop Configuration
14, 16W Nodes at 1.9 Ghz
224 Processors
Federation Switch
224 GB or 448 GB System Memory
Storage Capacity: 4.11 TBytes
p575 Software
• AIX 5.3
• General Parallel File System (GPFS) with WAN
Support
• LoadLeveler
• Cluster Systems Management (CSM)
• Compilers (XL/FORTRAN, XLC)
• Engineering and Scientific Subroutine Library
(ESSL)
• IBM’s Parallel Environment (PE)
• Simultaneous Multi-Threading (SMT) Support
• Virtualization, Micro-Partitioning, DLPAR
IBM e1350 Linux Cluster Offering
Announced at April 17 SURA BoT meeting
• IBM BladeCenter-H, HS21XM Blades and Intel
Quad-Core Processors
• 3 TFLOP Configuration
– One Rack solution with GigE interconnect
– 1GB/core
– Combination Management/User node with storage
• 6 TFLOP – Performance Focused Solution for HPC
–
–
–
–
Two Rack solution utilizing DDR Infiniband
2GB/core
Combination Management/User node with storage
Optional SAN supporting 4Gbs storage at 4.6Tbytes
 SMC 8-port 10Gb Ethernet Switch
 (2) 32-port Cyclades Terminal Servers
 RedHat ES 4 License and Media Kit (3 years update support)
 3 Year Onsite Warranty
2
1
 Shipping and Installation
Ser
PS4
IB
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
PS3
Fan 2
B
R F
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Blade Center2
39M2816
27
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
 5 Days onsite Consulting for configuration, skills transfer
 One 42U Enterpise Rack, all cables, PDU’s
Fan 1
PS2
29
28
11
10
9
8
7
6
5
4
3
 Console Manger, Pull-out console, keyboard, mouse
PS1
Blk.
x3650 Mgmt
Console Switch
No Kbd.
Force10 48 Port Switch
SMC Tiger IV 8 Port
1U Blank
Blade Center2
C
F R
Mgt
PS1
Fan 1
PS3
Ser
Blk.
PS2
Fan 2
PS4
IB
D
R F
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Blade Center2
Mgt
PS1
Fan 1
PS3
Ser
Blk.
PS2
Fan 2
PS4
IB
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Blade Center2
39M2818
 Force10 48-port GigE Switch with 2 10Gb Uplinks
A
F R
Mgt
39M2818
 x3650 2U Management/User Node
Dual Quad-Core 2.67 GHz Clovertown Processors
1 GB Memory per core
Myricom 10Gb NIC Card
RAID Controller with (6) 300GB 10K Hot-swap SAS Drives
Redundant power/fans
33
32
31
30
32 Terminal Server
32 Terminal Server
1U Blank
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
Dual Quad-Core 2.67 GHz Clovertown Processors
1 GB Memory per core
73 GB SAS Disk per blade
GigE Ethernet to Blade with 10Gbit Uplink
Serial Terminal Server connection to every blade
Redundant power/fans
3U Blank
39M2818
 34 HS21XM Blade Servers in 3 BladeCenter H Chassis
###
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
3 TFLOP e1350 Cluster -
U
42
41
40
39
38
37
36
35
34
6 TFLOP e1350 Cluster -
 RedHat ES 4 License and Media Kit (3 years update support)
 Console Manger, Pull-out console, keyboard, mouse
 One 42U Enterpise Rack, all cables, PDU’s
 Shipping and Installation
 10 Days onsite Consulting for configuration, skills transfer
 3 Year Onsite Warranty
7
6
5
4
3
2
1
Console Switch
1 2 3 4 5 6 7 8 9 10 11 12 13 14
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
1U InfiniBand Sw
1U InfiniBand Sw
1U IB Core
1U IB Core
1U IB Core
7
6
5
4
3
2
1
Kbd.
48 Terminal Server
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
C
F R
1 2 3 4 5 6 7 8 9 10 11 12 13 14
D
R F
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
3U Blank
3U Blank
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
A
F R
39M2818
x3650 Mgmt Node
1U GB Ethernet Sw
39M2816
39M2816
x3650 Storage Node
3U Blank
C
F R
1 2 3 4 5 6 7 8 9 10 11 12 13 14
48 Terminal Server
1U Blank
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
L
L
L
L
L
73.4
SF 73.4
SF 73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
SF 73.4
SF 73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
B
R F
36
35
34
33
32
31
30
29
28
27
EXP
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Blade Center Comp.
39M2818
 (3) 32-port Cyclades Terminal Servers
A
F R
U
42
41
40
39
38
37
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
Force10 48-port GigE Switch
DS4700
39M2818
 DDR Non-Blocking Infiniband Network
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
EXP810
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
 x3650 2U Management/User Node
Dual Quad-Core 2.67 GHz Clovertown Processors
1 GB Memory per core
Myricom 10Gb NIC Card
RAID Controller with (6) 300GB 10K Hot-swap SAS Drives
Redundant power/fans
36
35
34
33
32
31
30
29
28
27
No. MT/M or PN
3U Blank
39M2818
Dual Quad-Core 2.67 GHz Clovertown Processors
2 GB Memory per core
73 GB SAS Disk per blade
GigE Ethernet to Blade
DDR Non-Blocking Voltaire Infiniband Low Latency Network
Serial Terminal Server connection to every blade
Redundant power/fans
Main
1U Blank
1U Blank
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
 70 HS21XM Blade Servers in 5 BladeCenter H Chassis
U
42
41
40
39
38
37
1 2 3 4 5 6 7 8 9 10 11 12 13 14
1U
1U
1U
1U
InfiniBand
InfiniBand
InfiniBand
InfiniBand
Sw
Sw
Sw
Sw
7
6
5
4
3
2
1
Console Switch
1 2 3 4 5 6 7 8 9 10 11 12 13 14
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
1U InfiniBand Sw
1U InfiniBand Sw
1U IB Core
1U IB Core
1U IB Core
7
6
5
4
3
2
1
Kbd.
48 Terminal Server
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
C
F R
1 2 3 4 5 6 7 8 9 10 11 12 13 14
D
R F
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
3U Blank
3U Blank
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
A
F R
39M2818
x3650 Mgmt Node
1U GB Ethernet Sw
39M2816
39M2816
x3650 Storage Node
3U Blank
C
F R
1 2 3 4 5 6 7 8 9 10 11 12 13 14
48 Terminal Server
1U Blank
Blade Center Comp.
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
B
R F
36
35
34
33
32
31
30
29
28
27
EXP
1 2 3 4 5 6 7 8 9 10 11 12 13 14
Blade Center Comp.
39M2818
A
F R
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
DS4700
U
42
41
40
39
38
37
Mgt
PS1
Fan 1
PS3 GbE
Blk.
PS2
Fan 2
PS4
Ser
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
L
L
EXP810
73.4
SF 73.4
SF 73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
73.4
SF 73.4
SF 73.4
73.4
73.4
L
L
L
3U Blank
39M2818
 DS4700 Storage Subsystem
4 Gbps Performance (Fiber Channel)
EXP810 Expansion System
(32) 4 Gbps FC, 146.8 GB/15K
Enhanced Disk Drive Module (E-DDM)
Total 4.6 TB Storage Capacity
26
25
24
23
22
21
20
19
18
17
16
15
14
13
12
11
10
9
8
No. MT/M or PN
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
Dual Quad-Core 2.67 GHz Clovertown Processors
1 GB Memory per core
Myricom 10Gb NIC Card
(2) 3.5" 73GB 10k Hot Swap SAS Drive
(2) IBM 4-Gbps FC Dual-Port PCI-E HBA
Redundant power/fans
3 Year Onsite 24x7x4Hour On-site Warranty
36
35
34
33
32
31
30
29
28
27
Main
1U Blank
1U Blank
39M2818
 x3650 Storage Node
U
42
41
40
39
38
37
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
BladeServer
6 TFLOP e1350 Cluster
Storage Option -
1 2 3 4 5 6 7 8 9 10 11 12 13 14
1U
1U
1U
1U
InfiniBand
InfiniBand
InfiniBand
InfiniBand
Sw
Sw
Sw
Sw
Additional Interactions with IBM
• Provided technical assistance with
porting of SCOOP applications to AIX and
configuring LoadLeveler to allow job
suspension and pre-emption
• Provided SURA with booth space at SC06
and SC07
• Hosted SCOOP and SURAgrid
presentations at SC06 and SC07
• Plan to update offerings by end of
calendar year to include Power6 offering
and repricing of p575 and e1350 systems
SURA – Dell Partnership
• Dell Dell PowerEdge 1950 2TFlop High Performance Cluster
• SURAgrid Special Offer - $112,500
– Master Node – Dell PowerEdge 1950 (Qty = 1)
– Compute Nodes – Dell PowerEdge 1950 (Qty = 27)
– Gigabit Ethernet Interconnect
• Dell PowerConnect 6248 (Qty = 2)
– PowerEdge 4210, 42U Frame
– Platform Rocks – Cluster Management Software
• 3 year support agreement
– Complete Rack & Stack,
• including cabling, prior to delivery
– Complete Software Installation –
• Operating system, Cluster Management Software
– 2 Day on-site systems engineer
28 Node Dell PowerEdge 1950
•Dual 2.33GHz/2x4MB Cache, Quad Core Intel® Xeon E5345, 1333MHz
FSB Processors
• 12GB FBD 667MHz Memory
• 80GB 7.2K RPM SATA Hard Drive
• Red Hat Enterprise Linux WS v4 3Yr RHN Subscription, EM64T
• 24X CD-ROM
• 3 Years HPCC Next Business Day Parts and Labor On-Site Service
All SURA Partner Systems Available
Under SURA-Participant MOU
• Participants agree to
– join SURAgrid as a contributing member
– Purchase, install and operate systems
– Contribute 20% of purchased systems
to SURAgrid pool
• MOU is under revision with input from
the SGC
Future Partnerships
• Discussions currently underway with
MicroSoft
– Explore development of MS Compute
Cluster Server (CCS) gateway to
SURAgrid
– SURAgrid as a possible testbed
environment for this development
• Other partner suggestions - contacts
For More Information Regarding
IBM and Dell Discount Packages
Contact Gary Crane
315-597-1459
or
gcrane@sura.org