Scale-out Hardware with POWER8 Technology: Announcement Deep Dive 30 April 2014 Mark Olson olsonm@us.ibm.com © 2014 IBM Corporation Agenda PART 1 – General Deep Dive PART 2 – More Technical Deep Dive === Content flow – somewhat repeated in Part 1 and Part 2 === POWER8 chips Power Road map Scale-out Servers Specs/Layout Performance Models/structure Memory PCIe slots Storage Backplanes More New HMC OS support 28 April I/O 8 April Announcements © 2014 International Business Machines Corporation 3 Announce / Availability Plans Annc eConfig GA Power S814 28 Apr 28 Apr 10 Jun Power S822 28 Apr 28 Apr 10 Jun Power S824 28 Apr 28 Apr 10 Jun Power S822L 28 Apr 28 Apr 10 Jun Power S812L 28 Apr 27 May 29 Aug Add’l storage backplane option 28 Apr 17 July Sept SFF-3 146/139GB 15k & 300/283GB 10k HDD 28 Apr 27 May 25 July IBM i 5250 Enterprise Enablement features 28 Apr 27 May 10 Jun UPS ordered with Scale-out Servers 28 Apr 13 May 10 Jun Prevent higher wattage adapters in tower configs 28 Apr 10 June 10 Jun SPT availability for 4/28 announce content – planning 10 June and working to move into May IBM Confidential until announced Linux-only 4U 2H14 2H14 2H14 4-core Power S814 2H14 2H14 2H14 NEBS compliance 2U 4Q 4Q 4Q © 2014 International Business Machines Corporation 4 POWER8 Processor © 2014 International Business Machines Corporation 5 Power Processor Technology Roadmap POWER9 POWER8 POWER5/5+ 130/90 nm 2004 POWER6/6+ 65/65 nm 2007 © 2014 International Business Machines Corporation POWER7/7+ 45/32 nm 2010 2014 6 POWER8 Highlights Announced 2013 at Hot Chips Conference 12 Cores per Socket/Chip Significantly Strengthened Cores 8 threads per core (SMT8) Wider fetch / dispatch/issue of instructions (8 fetch / dispatch, 10 issue) Doubled highly utilized execution units Larger Caches per core/region L1: 64K data “D” Cache, 32K instruction “I” Cache per core L2: 512K private per core L3: 8M per core (up to 96MB per chip) L4: external to the chip 2 Integrated Memory Controllers w/ Improved Latency & BW ~ 25% memory latency improvement via on-chip fastpath interconnect 16MB mem cache / buffer chip Integrated SMP Interconnect w/ improved “Flatness” 2-Hop fabric topology Integrated IO Subsystem On Chip PCIe Controller Fine Grained Power Management On Chip Power Management Controller & Power gating © 2014 International Business Machines Corporation 7 Scale-out Systems - DCMs and POWER8 Chips 1S & 2S servers use DCM (Dual Chip Module) 1 DCM fills 1 socket 1 DCM has two Scale-out POWER8 chips 1 DCM can provide 6-core, 8-core, 10-core or 12-core sockets 6-core Processor Chip two 3-cores for 6-core DCM two 4-cores for 8-core DCM two 5-cores for 10-core DCM two 6-cores for 12-core DCM Core Core Core L2 L2 L2 L3 Cache & Chip Intercon MemCtrl L2 L2 L2 Core Core Core Max 8 Threads per Core Excellent I/O bandwidth per socket © 2014 International Business Machines Corporation 8 POWER8 Memory Buffer Chip DRAM Chips “L4 cache” Memory Buffer DDR Interfaces 16MB Intelligence Moved into Memory Scheduler & POWER8 Memory Management Cache Link • Previously on POWER7+ chip onto buffer Processor Interface • High speed interface Performance Value © 2014 International Business Machines Corporation 9 POWER8 Memory Organization DRAM Chips Memory Buffer 128 GB 16MB (Max Config shown) 16MB 128 GB POWER8 DCM 128 GB 16MB 16MB 128 GB 128 GB 16MB 16MB 128 GB 128 GB 16MB 16MB 128 GB Architecturally: Up to 1 TB / Socket First POWER8 Systems: 512 GB / Socket announced © 2014 International Business Machines Corporation 10 POWER8 Integrated PCI Gen 3 POWER8 POWER7 GX Bus PCIe Gen3 I/O Bridge PCIe Gen2 PCI Device PCI Devices © 2014 International Business Machines Corporation 11 POWER8 Multi-threading Options 4 SMT1: Largest unit of execution work SMT2: Smaller unit of work, but provides greater amount of execution work per cycle SMT4: Smaller unit of work, but provides greater amount of execution work per cycle SMT8: Smallest unit of work, but provides the maximum amount of execution work per cycle Can dynamical shift between modes as required: SMT1 / SMT2 / SMT4 / SMT8 Mixed SMT modes supported within same LPAR Requires use of “Resource Groups” 3.5 3 2.5 2 1.5 1 0.5 0 P7 P8 P8 P8 P8 SMT1 SMT1 SMT2 SMT4 SMT8 © 2014 International Business Machines Corporation 12 POWER8 Bandwidths © 2014 International Business Machines Corporation 14 IO Bandwidth POWER7+ POWER7 POWER6 0 10 20 30 40 50 60 GB/Sec © 2014 International Business Machines Corporation 15 IO Bandwidth POWER8 POWER7+ POWER7 POWER6 0 50 100 150 200 GB/Sec © 2014 International Business Machines Corporation 16 Memory Bandwidth per Socket POWER8 POWER7 POWER6 POWER5 0 10 20 30 40 50 60 70 GB/Sec © 2014 International Business Machines Corporation 17 Memory Bandwidth per Socket POWER8 POWER7 POWER6 POWER5 0 50 100 150 200 GB/Sec © 2014 International Business Machines Corporation 18 CAPI Stmt of Direction © 2014 International Business Machines Corporation 19 POWER8 CAPI (Coherent Accelerator Processor Interface) POWER8 Statement of direction as of April 2014 POWER8 Coherence Bus PCIe Gen3 Transport for encapsulated messages FPGA or ASIC Customizable Hardware / Application Accelerator • Specific system SW, middleware, or user application • Written to durable interface © 2014 International Business Machines Corporation 20 Possible Example: CAPI Attached Flash Optimization Application Read/Write Syscall FileSystem strategy() iodone() 20K Instructions LVM strategy() iodone() Disk & Adapter DD Pin buffers, Translate, Map DMA, Start I/O Interrupt, unmap, unpin,Iodone scheduling © 2014 International Business Machines Corporation 22 Possible Example: CAPI Attached Flash Optimization Application Attach flash memory to POWER8 via CAPI coherent Attach Read/Write Syscall FileSystem strategy() iodone() 20K Instructions LVM strategy() iodone() Disk & Adapter DD Pin buffers, Translate, Map DMA, Start I/O Interrupt, unmap, unpin,Iodone scheduling Application Posix Async I/O Style API aio_read() aio_write() User Library < 500 Instructions Shared Memory Work Queue Issues Read/Write Commands from applications to eliminate 97% of instruction path length CAPI Flash controller Operates in User Space Saves 10 Cores per 1M IOPs © 2014 International Business Machines Corporation 23 POWER8 Server Technology Roll Out © 2014 International Business Machines Corporation 24 Power System Roadmap 2013 2014 Enhanced HMC Management POWER8 KVM PowerVC PowerVP 4U Systems: 1-socket & 2-socket Power Linux Engines More servers rolling out Over the next year and beyond 2U System: 2-socket Enterprise Pools 2U Linux: 1-socket & 2-socket 25 Power April Announcements New Scale-out Servers with POWER8 technology 2U servers: 2 socket 4U servers: 1 socket and 2 socket (Not called “PowerLinux”) 2U servers: 1 socket & 2 sockets Linux-only server models New Virtualization Management IBM PowerKVM – Kernel Virtual Machine PowerKVM for Linux-only servers New HMC Functionality Performance Monitoring © 2014 International Business Machines Corporation 26 Power April Announcements New IBM i Releases IBM i 7.2 --- New Release (Annc 28 Apr) IBM i 7.1 --- New Technology Refresh, TR8 (Annc 8 Apr) Existing AIX Release supported AIX 6.1 (TL7, TL8, TL9), AIX 7.1 (TL1, TL2, TL3) POWER8 Hardware support IBM BLU Acceleration Solution - Power Systems Edition IBM PowerVP – Virtualization Performance IBM PowerSC – Security and Compliance IBM PowerVM IBM PowerVC © 2014 International Business Machines Corporation 27 1&2 Socket Servers New Scale-out Servers with POWER8 technology 1 socket : 2 socket: 4U 2U and 4U S814 S822 and S824 Linux-only Power Systems 1 socket: 2 socket: 2U 2U (Not called “PowerLinux”) S812L S822L Marketing name = “socket” then “number EIA/U” For example S8 2 4 But …… © 2014 International Business Machines Corporation 28 1&2 Socket Servers New Scale-out Servers with POWER8 technology 1 socket : 4U S814 Order number = “number EIA/U” then “socket” 2 socket: 2U and 4U S822 and S824 Linux-only Power Systems (Not called For example 8286 - 4 2 “PowerLinux”) A 1 socket: 2 socket: 2U 2U S812L S822L 1 Socket 1 Socket 2 Socket Option 1S S814 S812L S824 S822 S822L 8286-41A 8247-21L 8286-42A 8284-22A 8247-22L 4U 2U 4U 2U 2U © 2014 International Business Machines Corporation 2 Socket Option 1S 2 Socket 29 2U Server © 2014 International Business Machines Corporation 30 POWER8 2S2U Layout PCIe Gen3 x8 2X SAS Ports PCIe Gen3 x16 Memory USB-3 PCIe Gen3 x16 POWER8 Memory PCIe Gen3 x8 POWER8 Memory 2xHMC Serial USB-2 HMC Up to 12 SFF Bays USB-3 6 SSD Slots* * with backplane Slim DVD © 2014 International Business Machines Corporation 31 POWER8 2S2U Scale-out System Power S822 Single Socket populated Cores: 6 (3.8 GHz) or 10 (3.4 GHz) Memory: Up to 512 GB PCIe Slots: 6 PCIe Gen3 LP (Hotplug) Both Sockets populated Cores: 12 (3.8 GHz) or 20 (3.4 GHz) Memory: Up to 1 TB PCIe Slots: 9 PCIe Gen3 LP (Hotplug) 3 Yr Warranty Ethernet: Quad 1 Gbt / (in x8 slot) Integrated ports: USB (4), Serial (1), HMC (2) Internal Storage DVD 12 SFF Bays -- Split Backplane: 6 + 6 or 8 SFF Bays & 6 1.8” SSD Bays with Easy Tier with 7GB write cache Hypervisor: PowerVM OS: AIX, Linux (not IBM i) © 2014 International Business Machines Corporation 32 POWER8 Linux 2S2U Scale-out System Power S822L Dual Sockets Cores: 20 (3.4 GHz) or 24 (3.0 GHz) Memory: Up to 1 TB Slots: 9 PCIe Gen3 LP (Hotplug) Ethernet: Quad 1 Gbt / (in x8 slot) Integrated ports: USB (4), Serial (1), HMC (2) Internal Storage 3 Yr Warranty DVD 12 SFF Bays -- Split Backplane: 6 + 6 or 8 SFF Bays & 6 1.8” SSD Bays with Easy Tier with 7GB write cache Hypervisor: PowerVM or PowerKVM OS: Linux © 2014 International Business Machines Corporation 33 POWER8 Linux 1S2U Scale-out System Power S812L 1. Single Socket Cores: 10 (3.4 GHz) / 12 (3.0 GHz) Memory: Up to 512 GB Slots: 6 PCIe Gen3 LP (Hotplug) Ethernet: Quad 1 Gbt / (in x8 slot) Integrated ports: USB (4), Serial (1), HMC (2) Internal Storage 3 Yr Warranty DVD 12 SFF Bays -- Split Backplane: 6 + 6 or 8 SFF Bays with Easy Tier with 7GB write cache Hypervisor: PowerVM or PowerKVM OS: Linux © 2014 International Business Machines Corporation 34 POWER8 2S2U Scale-out Comparison - S822 Power 730 Power System S822 Processor Sockets Cores Maximum Memory Memory Cache Memory Bandwidth Memory DRAM Spare POWER7+ 2 8 / 12 / 16 512 GB @ 1066 MHz No 136 GB/sec No POWER8 1 (Upgradeable) / 2 6 / 10 or 12 / 20 256 / 512 GB @ 1600 MHz Yes 192 / 384 GB/sec Yes System unit PCIe slots 6 PCIe Gen2 LP 6 / 9 PCIe Gen3 LP CAPI (Capable slots) PCIe Hot Plug Support PCIe Expansion Drawers IO bandwidth Ethernet ports N/A No Optional PCIe Gen1 40 GB/sec Quad 1 Gbt in x4 slot Yes (one per socket) Yes SoD Gen3 192 GB/sec Quad 1 Gbt in x8 slot SAS bays in system unit 3 or 6 SFF-1 12 SFF-3 Or 8 SFF-3 + 6 SSD Integrated write cache Easy Tier Support Integrated split backplane Service Processor Optional 175MB No No Generation 1 Optional effectively 7GB Yes Yes ( 6 + 6 ) Generation 2 © 2014 International Business Machines Corporation 35 POWER8 2S2U Scale-out Comparison - S822L Power 730 Power System S822L Processor Sockets Cores Maximum Memory Memory Cache Memory Bandwidth Memory DRAM Spare POWER7+ 2 16 512 GB @ 1066 MHz No 136 GB/sec No POWER8 2 24 512 GB @ 1600 MHz Yes 384 GB/sec Yes System unit PCIe slots 6 PCIe Gen2 LP 9 PCIe Gen3 LP CAPI (Capable slots) PCIe Hot Plug Support PCIe Expansion Drawers IO bandwidth Ethernet ports N/A No Optional PCIe Gen1 40 GB/sec Quad 1 Gbt in x4 slot Yes (one per socket) Yes SoD Gen3 192 GB/sec Quad 1 Gbt in x8 slot SAS bays in system unit 3 or 6 SFF-1 12 SFF-3 Or 8 SFF-3 + 6 SSD Integrated write cache Easy Tier Support Integrated split backplane Service Processor Opt 175MB No No Generation 1 Opt effectively 7GB Yes Yes ( 6 + 6 ) Generation 2 © 2014 International Business Machines Corporation 36 POWER8 1S4U Layout PCIe Gen3 x8 4x 1Gbt Enet 2x SAS Ports PCIe Gen3 x16 2xUSB-3 Memory POWER8 Up to 18 SFF Bays Memory 2xHMC 1xSerial 2xUSB-2 2xUSB-3 Slim DVD © 2014 International Business Machines Corporation No SSD Cage 38 POWER8 2S4U Layout PCIe Gen3 x8 4x 1Gbt Enet 2x SAS Ports PCIe Gen3 x16 PCIe Gen3 x16 Memory 2xUSB-3 Memory PCIe Gen3 x8 POWER8 2xHMC 1xSerial 2xUSB-2 Memory POWER8 SSD Bays * Up to 18 SFF Bays 2xUSB-3 Slim DVD © 2014 International Business Machines Corporation * with backplane 39 POWER8 1S4U Scale-out System Power S814 Form Factor: 4U or Tower Single Socket Cores: 6 (3.0 GHz) or 8 (3.7 GHz) Memory: Up to 512 GB Slots: 7 PCIe Gen3 Full-high (Hotplug) Ethernet: Quad 1 Gbt in PCIe slot Integrated ports: USB (4/5), Serial (1), HMC (2) Internal Storage DVD 12 SFF Bays -- Split Backplane: 6 + 6 or 18 SFF Bays with Easy Tier with 7GB write cache Hypervisor: PowerVM OS: AIX, IBM i (P10 software tier), Linux 3 Yr Warranty © 2014 International Business Machines Corporation 40 POWER8 2S4U Scale-out System Power S824 Single Socket populated Cores: 6 (3.8 GHz) or 8 (4.1 GHz) Memory: Up to 512 GB Slots: 7 PCIe Gen3 full-high (Hotplug) Both Sockets populated Cores: 12 (3.8 GHz), 16 (4.1 GHz), or 24 (3.5 GHz) Memory: Up to 1 TB Slots: 11 PCIe Gen3 full-high (Hotplug) Ethernet: Quad 1 Gbt in PCIe slot 3 Integrated ports: USB (4/5), Serial (1), HMC (2) Internal Storage DVD 12 SFF Bays -- Split Backplane: 6 + 6 or 18 SFF bays & 8 SSD bays with Easy Tier with 7GB write cache Yr Warranty Hypervisor: PowerVM OS: AIX, IBM i (P20 software tier), Linux © 2014 International Business Machines Corporation 41 IBM Confidential 4-Core Power S814 Planned Nothing in April annc letters on this topic – This is not formally announced. Information shared for your sales planning purposes. Subject to change. Do not share information with client except under non-disclosure. IBM is finalizing plans for a POWER8-based four-core server for AIX, IBM i and Linux. Especially interesting to IBM i clients because of its P05 software tier Would use 3 GHz cores (like the 6-core S814) Like the POWER7 4-core offering – no feature code I/O drawers like #5887 and no future PCIe expansion drawer. (Fibre Channel attached drawers/SANs supported.) Like the POWER7 4-core -- Lower memory maximum than 6-core. POWER7 maximum is 64GB Lower max of SFF-3 drives in system unit -- POWER7 4-core maximum is eight Supporting 15k 139/146GB and 15k 283/300GB disk drives and supporting 387GB SSD. Not supporting other drive sizes. Currently evaluating Announce and GA of 3Q 2014 Announcing in April is the Power S814 6-core and 8-core systems, providing an IBM i P10 software tier offering with even higher value than previous POWER7 systems * IBM plans are subject to change or cancellation without notice. © 2014 International Business Machines Corporation 42 POWER8 4U Scale-out Comparison – S814 Power 720 Power System S814 Processor Sockets Cores Maximum Memory Memory Cache Memory Bandwidth POWER7+ 1 4/6/8 512 @ 1066 MHz No 136 GB/sec POWER8 1 6/8 512 GB @ 1600 MHz Yes 192 GB/sec Memory DRAM Spare No Yes CAPI (Capable slots) PCIe Hot Plug Support IO bandwidth 6 PCIe Gen2 FH Opt 4 PCIe Gen2 LP N/A No 40 GB/sec Ethernet ports Quad 1 Gbt (x4 slot) Quad 1 Gbt (x8 Slot) SAS bays in system unit 6 or 8 SFF-1 bays 12 SFF-3 bays Or 18 SFF-3 bays Integrated write cache Easy Tier Support Integrated split backplane Service Processor Optional 175 MB No Yes ( 3 + 3 ) Generation 1 Optional effectively 7GB Yes Yes ( 6 + 6 ) Generation 2 System unit PCIe slots © 2014 International Business Machines Corporation 7 PCIe Gen3 FH One Yes 96 GB/sec 43 POWER8 4U Scale-out Comparison – S824 Power 740 Power System S824 Processor Sockets Max Cores Maximum Memory Memory Cache Memory Bandwidth Memory DRAM Spare POWER7+ 1 (upgradeable) / 2 8 / 16 512GB / 1TB @ 1066 MHz No 136 GB/sec No POWER8 1 (upgradeable) / 2 8 / 24 512GB / 1TB @ 1600 MHz Yes 384 GB/sec Yes System unit PCIe slots 6 PCIe Gen2 FH Opt 4 PCIe Gen2 LP 7 / 11 PCIe Gen3 FH CAPI (Capable slots) PCIe Hot Plug Support IO bandwidth Ethernet ports N/A No 60 GB/sec Quad 1 Gbt (x4 slot) Two Yes 192 GB/sec Quad 1 Gbt (x8 Slot) SAS bays in system unit 6 or 8 SFF-1 12 SFF-3 bays Or 18 SFF-3 + 8 SSD bays Integrated write cache Easy Tier Support Integrated split backplane Service Processor Optional 175 MB No Yes ( 3 + 3 ) Generation 1 Optional effectively 7GB Yes Yes ( 6 + 6 ) Generation 2 © 2014 International Business Machines Corporation 44 Performance © 2014 International Business Machines Corporation 45 CPW S814 (1 socket) 6-core 8-core 3.0 GHz 3.7 GHz 59,500 85,500 Measured using SMT8 S824 (1 or 2 socket) 6-core 3.8 GHz 12-core 3.8 GHz 72,000 130,000 8-core 4.1 GHz 16-core 4.1 GHz 94,500 173,500 SMT4 would be somewhat lower 12-core 1-socket not offered 24-core 3.5 GHz 230,500 © 2014 International Business Machines Corporation 46 CPW 720 POWER7+ 4-core 6-core 8-core (1 socket) 3.6 GHz 3.6 GHz 3.6 GHz 740 POWER7+ 28,400 42,400 56,300 (1 or 2 socket) S814 (1 socket) 4-core 6-core 8-core S824 xxxxx 3.0 GHz 3.7 GHz xxxxxx 59,500 85,500 (1 or 2 socket) 6-core 4.2 GHz 12-core 4.2 GHz 49,000 91,700 6-core 3.8 GHz 12-core 3.8 GHz 72,000 130,000 8-core 3.6 GHz 16-core 3.6 GHz 56,300 106,500 8-core 4.1 GHz 16-core 4.1 GHz 94,500 173,500 8-core 16-core 64,500 120,000 12-core 1-socket not offered 24-core 3.5 GHz 230,500 4.2 GHz 4.2 GHz © 2014 International Business Machines Corporation 47 CPW 720 POWER7+ 4-core 6-core 8-core (1 socket) 3.6 GHz 3.6 GHz 3.6 GHz 740 POWER7+ 28,400 42,400 56,300 (1 or 2 socket) 6-core 4.2 GHz 12-core 4.2 GHz 49,000 91,700 8-core 3.6 GHz 16-core 3.6 GHz 56,300 106,500 8-core 16-core 64,500 120,000 4.2 GHz 4.2 GHz S814 (1 socket) 4-core xxxxx +40% 6-core 3.0 GHz 8-core 3.7 GHz +50% S824 xxxxxx 59,500 85,500 (1 or 2 socket) 6-core 3.8 GHz 72,000 12-core 3.8 GHz 130,000 +40% 8-core 4.1 GHz 94,500 16-core 4.1 GHz 173,500 +60% 12-core 1-socket not offered 24-core 3.5 GHz 230,500 +90% © 2014 International Business Machines Corporation 48 rPerf (with SMT8) S814 (1 socket) 6-core 8-core S824 3.0 GHz 3.7 GHz 97.5 143.9 (1 or 2 socket) 6-core 3.8 GHz 12-core 3.8 GHz 120.8 235.6 8-core 4.1 GHz 16-core 4.1 GHz 166.0 323.6 12-core 1-socket not offered 24-core 3.5 GHz 421.8 S822 (1 or 2 socket) 6-core 3.8 GHz 12-core 3.8 GHz 120.8 235.6 10-core 20-core 177.8 346.7 © 2014 International Business Machines Corporation 3.4 GHz 3.4 GHz 49 rPerf – Multiple SMT Levels SMT1 SMT2 SMT4 SMT8 6-core 3.0 GHz 48.3 70.1 91.1 97.5 8-core 3.7 GHz 71.4 103.5 134.5 143.9 6-core 3.8 GHz 59.9 86.9 112.9 120.8 12-core 3.8 GHz 116.8 169.4 220.2 235.6 8-core 4.1 GHz 82.3 119.3 155.1 166.0 16-core 4.1 GHz 160.4 232.7 302.4 323.6 24-core 3.5 GHz 209.1 303.2 394.2 421.8 6-core 3.8 GHz 59.9 86.9 112.9 120.8 12-core 3.8 GHz 116.8 169.4 220.2 235.6 10-core 3.4 GHz 88.2 127.8 166.2 177.8 20-core 3.4 GHz 171.9 249.3 324.0 346.7 Power S814 Power S824 Power S822 © 2014 International Business Machines Corporation 50 Power 740 / POWER8 S824 CPW Compares Performance Dual Socket Performance per Core 24 Core 16 Core 16 Core 740 P740+ S824 P740 © 2014 International Business Machines Corporation 16 Core P740+ S824 S824 51 Power 740+ / POWER8 S824 Performance per Core rPerf Comparisons Performance per Socket Performance per KW 18 27% Better 200 150 9 100 50 0 0 P740 P740+ P8 4U2S © 2014 International Business Machines Corporation P740 P740+ P8 4U2S P 740+ P8 4U2S 52 Power 750+ vs POWER8 4U2S Performance Total # Cores 1.2 Performance per $ TCA 3 3 2.5 2.5 2 2 1.5 1.5 1 1 0.5 0.5 0 0 32 1 0.8 24 0.6 16 0.4 8 0.2 0 0 P 750+ P8 4U2S POWER8 ≥ Performance P 750+ P8 4U2S Fewer cores means Lower Software Costs Does not reflect lower PVU savings © 2014 International Business Machines Corporation P 750+ P8 4U2S P 750+ P8 4U2S Lower investment costs Better performance per dollar spent 53 SAP Sales & Distribution 2-Tier ERP 6 Benchmarks IBM Power System S824 using DB2 10.5 vs. Competition Over 2 times better 24 core performance than nearest Intel competitive results Up to 2 times greater performance than previous Power generation 2X more users IBM Power S824 Fujitsu RX300 S8 Cisco UCS HP ProLiant C240 M3 BL460c IBM Power S824 IBM p270 IBM p260 (1.0) IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 192 threads, POWER8; 3.52GHz, 512 GB memory, 21,212 SD benchmark users, running AIX® 7.1 and DB2® 10.5, dialog response: 0.98 seconds, line items/hour: 2,317,330, dialog steps/hour: 6.952,000 SAPS: 115,870 database response time (dialog/update): 0.011 sec / 0.019sec, CPU utilization: 99%, Certification #: 2014016 Results valid as of 3/24/14. Source: http://www.sap.com/benchmark. (1.1) Fujitsu RX300 S8 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors / 24 cores / 48 threads. Intel Xeon E52697 processor 2.70 GHz, 256 GB memory, 10.240 SD benchmark users, running Windows Server 2012 SE and SQL Server 2012, Certification #: 2013024 (1.2) Cisco UCS c240 M3 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors / 24c ores / 48 threads. Intel Xeon E5-2697 processor 2.70 GHz, 256 GB memory, 10.045 SD benchmark users, running Windows Server 2012 DE and SQL Server 2012, Certification #: 2013038 (1.3) HP ProLiant BL460c Gen8 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors / 24 cores / 48 threads. Intel Xeon E5-2697 processor 2.70 GHz, 256 GB memory, 10.025 SD benchmark users, running Windows Server 2012 DE and SQL Server 2012, Certification #: 2013025 (2.1 IBM Flex System p270 Compute Node on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER7+; 3.4GHz, 256 GB memory, 12.528 SD benchmark users, running AIX® 7.1 and DB2® 10 .5 Certification #: 3012019 Source: http://www.sap.com/benchmark. (1.1)IBM Flex System p260 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors / 16 cores / 64 threads, POWER7+; 4.1GHz, 256 GB memory, 10,000 SD benchmark users, running AIX® 7.1 and DB2® 10, Certification #: 2012035 © 2014 International Business Machines Corporation 54 IBM Power System S824 delivers Best of Breed eBS 12.1.3 Payroll performance Over 2 times more performance per-core than Cisco result with higher overall through-put on few cores 2X ! IBM Power S824 12-core Cisco UCS C240 M3 24-core Oracle BL460c 16-core IBM Power S824 12-core Cisco UCS C240 M3 24-core Oracle BL460c 16-core All results use Oracle eBS 12.1.3 Payroll Batch Extra Large Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/apps-benchmark/results-166922.html © 2014 International Business Machines Corporation 56 IBM Power System S824 delivers New High-water Siebel CRM Release 8.1.1.4 performance Over 3 times the DB performance per-core than previous results Highest overall users supported on fewer cores! New #1 IBM Power S824 6-core Oracle SPRAC T4-2 16-core Cisco UCS B200 M3 16-core 3.3 X IBM Power S824 6-core Oracle SPRAC T4-2 16-core Cisco UCS B200 M3 16-core (1) All results use Siebel 8.1.1.4 PSPP Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/whitepapers/siebel-167484.html © 2014 International Business Machines Corporation 57 SPECjbb Details 50% Better 81% Better 40% Better Performance Performance per Core Price Performance DL380p S822L DL380p S822L DL380p S822L HP IBM HP IBM HP IBM © 2014 International Business Machines Corporation 58 POWER8 System Performance P8 S824 P5+ 595 P4 690 © 2014 International Business Machines Corporation 59 Ordering Processor Cards, Activations, Editions © 2014 International Business Machines Corporation 60 Editions/Vouchers/CBU/Factory Deconfiguration Unlike Power 710/720/730/740, no IBM editions, no IBM i editions, no AIX solution editions Simpler – no mix of priced & no-charge activations Simpler – no memory & I/O minimums to qualify for no-charge activations Voucher usage for non-solution editions similar to what used to be associated with above editions is still being defined as of 28 April 2014. Like Power 720 IBM i Solution editions offered Same structure/deal, same registration requirement, same edition feature codes (#4927), same website, same voucher However unlike Power 740, not offered for Power S824 CBU for IBM i yes … basically same as 720/740, however the “primary” server must be a POWER7 or later. #2319 Factory deconfiguration -- same rules as Power 7xx 5250 features for S824 (P20 tier) are the same as for the Power 740 (but delayed eConfig support) © 2014 International Business Machines Corporation 61 POWER8 Memory © 2014 International Business Machines Corporation 62 Memory Card Capacity: 16 GB / 32 GB / 64 GB 1600 MHz Memory Sparing - RAS improvement 8 Cards per socket (Scale-out Systems) Plugs into backplane (no riser card) © 2014 International Business Machines Corporation 63 Memory Features and Pricing 4U server S814, S824 List price Price per GB $1250 $78 16 GB 8286-41A, 8286-42A #EM8B 32 GB #EM8C $1700 $53 64 GB #EM8D $3400 $53 List price Price per GB $1250 $1700 $3400 $78 $53 $53 List price Price per GB $1250 $78 2U server 16 GB 32 GB 64 GB S821L, S822L 8247-21L, 8247-22L #EL3P #EL3Q #EL3R S822 2U server 16 GB 8284-22A #EM83 32 GB #EM84 $1700 $53 64 GB #EM85 $3400 $53 Lowest $/card Lower $/GB Lowest $/card Lower $/GB Lowest $/card Lower $/GB Prices are USA list prices and subject to change. Reseller prices may vary. © 2014 International Business Machines Corporation 64 POWER8/POWER7+ Memory Features and Pricing 4U server memory 16 GB 32 GB 64 GB 2U server memory 16 GB 32 GB 64 GB 2U server memory 16 GB 32 GB 64 GB S814, S824 8286-41A, 8286-42A #EM8B #EM8C #EM8D S822 8284-22A #EM83 #EM84 #EM85 S812L, S822L 8247-21L, 8247-22L #EL3P #EL3Q #EL3R List price Price per GB $1250 $1700 $3400 $78 $53 $53 List price Price per GB $1250 $1700 $3400 $78 $53 $53 List price Price per GB $1250 $1700 $3400 $78 $53 $53 720 8202-E4D EM4B EM4C EM4D 710 8231-E1D EM4B EM4C EM4D 7R1 8246-E EL2S EL2T EL2U List price Price per GB $ 850 $1700 $6400 $53 $53 $100 List price Price per GB $ 850 $1700 $6400 $53 $53 $100 List price Price per GB $ 399 $ 798 $2798 $25 $25 $44 Prices are USA list prices and subject to change. Reseller prices may vary. © 2014 International Business Machines Corporation 65 Active Memory Expansion True memory True memory True memory Expand memory Expand memory Expand memory True memory True memory True memory Expand memory Expand memory Expand memory Effectively more memory Like POWER7, provides POWER8 advantage Expand memory beyond physical limits More effective server consolidation Run more application workload / users per partition Run more partitions and more workload per server 60-day trial like Power 7xx AIX only Note expansion percentage is very workload dependent © 2014 International Business Machines Corporation 66 PCIe Slots © 2014 International Business Machines Corporation 67 PCIe Slots - Memorize This 4U 1S 4U 2U 2S 4U 1S 2U 2S 2U 7 11 6 9 Total PCIe slots All hot swap All Gen3 • Use 1 of the above slots for a LAN adapter • Use 1 of the above for expanded function backplane • There is no PCIe expansion drawer announced. There is an SOD. © 2014 International Business Machines Corporation 68 PCIe Gen3 Gen1 x8 Gen2 x8 Gen3 x8 2.5 GHz Though these cards physically look the same … and fit in the same slots Gen3 cards/slots have up to 2X more bandwidth than Gen2 cards/slots Gen3 cards/slots have up to 4X more bandwidth than Gen1 cards/slots More virtualization More consolidation saving PCI slots and I/O drawers More ports per adapter 18 16 14 12 Peak A Gen1 x8 PCIe adapter has a theoretical max (peak) bandwidth of 4 GB/sec. A Gen2 x8 adapter has a peak bandwidth of 8 GB/sec. A Gen3 x8 adapter has a peak bandwidth of 16 GB/sec. Sustained 10 8 6 4 2 0 Gen1 Gen2 Gen3 © 2014 International Business Machines Corporation 69 PCIe x8 and x16 POWER8 servers have x8 AND x16 PCIe slots Compared to POWER7+ PCIe Gen2 x8 slot, a POWER8 PCIe Gen3 x16 slot has a peak bandwidth of 4X (2X going Gen2 to Gen3 plus 2X going x8 to x16) x8 x1 x4 x8 x16 x16 x16 slot/card has more connections than a x8 slot/card “x16” or “x8” refers to the number of lanes. More lanes = more physical connections = more bandwidth A x8 card can be placed in a x16 slot, but only uses half the connections © 2014 International Business Machines Corporation 70 POWER8 PCIe Adapter Migration POWER7-supported PCIe adapters supported on POWER8 Initial GA: robust list Modest set of PCIe adapters not supported on POWER8 Scale-out Servers -- mostly elderly or low volume Remember, No PCI-X adapters on POWER8 This means no SCSI For IBM i, means no IOPs (no SDLC) © 2014 International Business Machines Corporation 71 Storage Backplanes © 2014 International Business Machines Corporation 72 Storage Backplanes 4U server example 12 SAS bays for either base or split backplanes Backplanes provide High performance integrated SAS controller(s) built on IBM industry leading PCIe Gen3 SAS adapter technology All include RAID 0, 1, 5, 6, 10. Plus hot spare capability Split backplane option with zero-write cache controllers Easy Tier® function* 8-18** SAS bays for 2.5-inch (SFF) HDD or SSD 6-8** SAS bays for 1.8-inch SSD* One DVD bay Op-panel Option for attaching one EXP24S drawer of HDD or SSD* DVD * With dual IOA, expanded function backplane with write cache ** number varies based on 2U/4U and backplane option selected © 2014 International Business Machines Corporation 73 Easy Tier Function Advantage Optional function with expanded-function, highperformance storage backplane HDD SSD Low cost per IOP Low cost per GB Easy Tier Automatically moves high activity (hot) data to SSD and low activity (cold) data to HDD Function handled totally by POWER8 integrated SAS controllers. No application coding. No SAN, just internal SAS drives. For AIX/Linux/VIOS. Just configure as a new type RAID array IBM i already has hot/cold function in OS for all SAS adapters Could use this function via VIOS (no performance data available at this time) IBM i less automated, but has more controls/options © 2014 International Business Machines Corporation 74 4U Storage Backplane Options Must select one Base 4U server Split Expanded Function * 12 SFF SAS bays 1 SAS controller No write cache 6+6 SFF SAS bays 2 SAS controllers No write cache 18 SFF SAS bays Dual SAS controllers 7.2**GB cache RAID-0,1,5,6,10 RAID-0,1,5,6,10 RAID-0,1,5,6,10 DVD bay DVD bay DVD bay 8-bay SSD cage*** External SAS ports Easy Tier function Availability plan: - eConfig 15 July - GA Sept * Uses one x8 PCIe slot ** 1.8GB physical write cache provides up to 7.2GB effectively with compression ***SSD cage not available on mdl 41A, Required on mdl 42A with expanded function © 2014 International Business Machines Corporation 75 Storage Backplane Pricing Must select one 4U server Base Split Expanded Function 12 SFF SAS bays 1 SAS controller 6+6 SFF SAS bays 2 SAS controllers 18 SFF SAS bays Dual SAS controllers $ 1000 $ 2000 $ 4000 * 12 SFF SAS bays 1 SAS controller 6+6 SFF SAS bays 2 SAS controllers 8 SFF SAS bays Dual SAS controllers $ 900 $ 1800 $ 3500 * 12 SFF SAS bays 1 SAS controller 6+6 SFF SAS bays 2 SAS controllers 8 SFF SAS bays Dual SAS controllers $ 678 $1356 $2750 * 2U server 2U server Linux only * plus cost of SSD cage or SAS ports © 2014 International Business Machines Corporation USA list prices. Subject to change without notice. Reseller prices may vary Prices do not include maintenance after warranty or include SAS drives or DVD. 77 Controller Write Cache Value Milliseconds Controller cache is • Up to 1.5 to 2.5X faster than SSD • Up to 80X faster than HDD average (Up to 115 X HDD max ) 9 8 7 6 5 4 3 2 1 0 Time/latency for Random Writes Max average 80X * Adapter Cache DRAM SSD eMLC3 HDD (15k) Value depends on the amount/percentage of Writes Valuable for SSD, even more valuable for HDD Can even improve “reads” if application using recently written data still sitting in cache Graph is a simplification. All performance discussions start with the words “it depends”. HDD 15k Max ms shows typical maximum rotational delay and arm movement. 10k HDD is about 1 ms slower. Non-random work will have better HDD measurements. Actual HDD performance varies from HDD to HDD. Adapter write cache can also speed reads, but value of write cache for reads is highly application dependent. The bottom line (*) of the SSD is obtained when the DRAM write cache integrated into SSD can handle the write and with a low queue depth. The higher SSD value is with a higher queue depth and/or when the SSD write cache is not able to keep up with a stream of writes and the write is occurring to the NAND flash memory. © 2014 International Business Machines Corporation 78 Controller Write Cache Value Milliseconds Controller cache is • Up to 1.5 to 2.5X faster than SSD 0.2 0.18 0.16 0.14 0.12 0.1 0.08 0.06 0.04 0.02 0 Time/latency for Random Writes * Adapter Cache DRAM SSD eMLC3 HDD Value depends on the amount/percentage of Writes Valuable for SSD, even more valuable for HDD Can even improve “reads” if application using recently written data still sitting in cache Graph is a simplification. All performance discussions start with the words “it depends”. HDD 15k Max ms shows typical maximum rotational delay and arm movement. 10k HDD is about 1 ms slower. Non-random work will have better HDD measurements. Actual HDD performance varies from HDD to HDD. Adapter write cache can also speed reads, but value of write cache for reads is highly application dependent. The bottom line (*) of the SSD is obtained when the DRAM write cache integrated into SSD can handle the write and with a low queue depth. The higher SSD value is with a higher queue depth and/or when the SSD write cache is not able to keep up with a stream of writes and the write is occurring to the NAND flash memory. © 2014 International Business Machines Corporation 79 Backplane Performance Considerations If you have applications with write-sensitive performance characteristics, be cautious about zero write cache configurations, especially for HDD Boot drives typically not a concern Zero write cache controllers support the use on RAID-5 and RAID-6 on POWER8 servers Very cost effective per GB HOWEVER, increases the number of writes significantly Note IBM i supports the use of all three backplane options whereas IBM i supports only backplanes with cache on prePOWER8 servers. Be VERY, VERY careful of HDD workloads on base and split backplanes for IBM i. © 2014 International Business Machines Corporation 80 SAS Bays for POWER8 Servers New SSF-3 SFF-3 used in 2U and 4U POWER8 servers 3rd generation carrier/tray on which 2.5-inch (SFF) is mounted Different tray/carrier than existing SFF-1 and SFF-2 SFF-1 in POWER6/POWER7 system unit or #5802 I/O drawer SFF-2 in EXP24S Storage drawer (#5887 or #EL1S) Can not put wrong tray/carrier in the wrong SAS bay For migrations to POWER8, conversions for SFF-1 to SFF-2 on POWER7/7+ servers. Protects client investment in HDD and SSD. Not a conversion to SFF-3, requires space in an EXP24S drawer to place converted SFF drives. “Re-trays” existing SFF-1 drives. © 2014 International Business Machines Corporation 81 Integrated Ports © 2014 International Business Machines Corporation 82 Integrated Ports on the System Unit No port feature codes (except 4U SAS ports) 4U 2U USB-3 with full client usage 2 front 2 rear 2 front, 2 rear USB-2 primarily IBM use, limited client use supported*. Ports off Service Processor card 2* rear 2 rear HMC ports - 1Gb Ethernet RJ45 2 rear 2 rear Serial / System port - RJ45 ** 1 rear 1 rear 2 rear 2 rear Mandatory #EJ0Z feature. Ports take a PCIe slot No feat code. Ports do not take a PCIe slot 2 SAS ports with high performance, dual IOA controller storage backplane on 2-socket servers – can attach one EXP24S drawer * For IBM i Unlike POWER7 or POWER6, IBM i communication to UPS is NOT via the serial port on POWER8 server. POWER8 connection to UPS for IBM i is over the USB-2 ports off the service processor card. A converter cable #ECCF should be used to convert USB port to 9-pin D-Shell connector which can be connected to the UPS cable. ** For AIX/Linux For attaching serial devices like a Async console which doesn’t have a RJ45 interface. Just like on POWER7/POWER7+, use #3930 converter cable to provide a 9-pin D-Shell connector. © 2014 International Business Machines Corporation 83 RAS © 2014 International Business Machines Corporation 84 ● Standard ◙ Optional ▬ Not Available RAS Feature Overview RAS Item Redundant / Hot Swap Fans & Blowers Hot Swap DASD & Media Hot Swap PCI Adapters Concurrent Firmware Update Redundant / Hot Swap Power Supplies Dual disk controllers (split backplane) Processor Instruction Retry Alternate Processor Recovery Storage Keys PowerVM™/Live Part. Mobility/Live App Mobility Dynamic Processor Sparing Redundant Service Processors Redundant System Clocks Hot GX Adapter Add and Cold Repair Dynamic Service Processor &System Clock Failover Enterprise Memory ( Memory Sparing ) Integrated TPMD Function Hot GX Adapter Repair Active Memory Mirroring for Hypervisor Power Pools Dynamic Processor Sparing © 2014 International Business Machines Corporation POWER7+ 710 / 730 POWER7+ 720 / 740 POWER8 models ● ● ● ● ● ● ▬ ▬ ● ● ● ● ● ● ● ▬ ◙ ◙ ● ● ● ● ● ● ● ● ● ◙ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ◙ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ▬ ◙ ▬ ▬ ▬ N/A ▬ ● ● N/A ▬ ▬ ▬ 85 Upgrades © 2014 International Business Machines Corporation 86 Upgrades No same-serial-number upgrades from Power 7xx to Power S8xx Could not pass financial/accounting rules to do so POWER6 520 POWER7 720 6/8-core POWER8 S8x4 Migrate to new serial number 2/4-core Note the Power 770/780 D models have an SOD for same-serial-number upgrades and another SOD covering mobile activations. © 2014 International Business Machines Corporation 87 OS Support © 2014 International Business Machines Corporation 88 AIX Support of Scale-out Servers 11 / 2012 AIX 6 TL7 SP6 AIX 6 TL8 SP1 2 / 2012 3 / 2013 5 / 2013 8 / 2013 SP7 SP2 AIX 6 TL9 9 / 2013 10 / 2013 12 / 2013 2Q / 2014 3Q / 2014 SP8 SP9 SP10 SP3 SP4 SP5 SP1 AIX 7 TL1 SP6 AIX 7 TL2 SP1 SP7 SP2 AIX 7 TL3 SP3 SP8 SP9 SP10 SP3 SP4 SP5 SP1 SP3 P7 or P6 Modes with Virtual I/O P7 or P6 Modes with Full I/O Support P8, P7 or P6 Modes with Full I/O Support © 2014 International Business Machines Corporation 89 IBM i Support for Scale-out Servers IBM i 7.1 TR8 POWER8 Supported – adds SMT8, more threads IBM i 7.2 POWER8 Supported -- adds SMT8, more cores/partition, more threads © 2014 International Business Machines Corporation 90 Linux for Scale-out Servers 1H / 2014 2H / 2014 RHEL6 RHEL 6.5 POWER7 Mode on POWER8 RHEL 6.6 POWER7 mode on POWER8 RHEL 7 RHEL 7.0 * SLES 11 SLES 11 + SP3 POWER7 Mode on POWER8 SLES 12 (LE) POWER8 Support SLES 12 Ubuntu (LE) 14.04.00/01 POWER8 Support 14.04.00/02 Debian LE Introduction POWER8 Support LE Update PowerVM 2.2.3.3 2.2.3.X * REH7 currently in Beta, RH and IBM working to support POWER8 © 2014 International Business Machines Corporation 91 Mobility © 2014 International Business Machines Corporation 92 POWER6 / POWER7 / POWER8 Partition Mobility AIX 7.1 AIX 7.1 AIX 6.1 AIX 6.1 AIX 7.1 AIX 7.1 AIX 7.1 AIX 7.1 AIX 6.1 AIX 6.1 AIX 6.1 AIX 6.1 AIX 5.3 AIX 5.3 AIX 5.3 IBM i 7.1 IBM i 7.1 * IBM i 7.2 IBM i 7.2 * Linux POWER6/6+ Linux Linux POWER7 Linux Linux POWER8 Leverage POWER6 / POWER7 Compatibility Modes LPAR Migrate between POWER6 / POWER7 / POWER8 Servers Can not move POWER8 Mode partitions to POWER6 or POWER7 systems. * final testing underway, not officially announced April 2014 © 2014 International Business Machines Corporation 93 HMC © 2014 International Business Machines Corporation 95 HMC Model 7042-CR8 7042-CR8 is System x model 7914 Ref3 Based on 7042-CR7 2GHz Ivy Bridge Intel Proc* 8GB DDR3 Mem (1x8GB DIMM) Dual 500GB HDD (RAID1) Quad GigE (First eth port can be shared IMM) Dedicated IMM port UEFI, IMM, DSA is similar to CR7 (same for all 7914) Planned GA with HMC: 2Q 2014 FW Level: 8R810 96 Enhanced HMC Management Capabilities Performance Monitoring 1.View System Performance Dashboard 2.View Resource Utilization Trends (Processor, Memory, Network, Storage) © 2014 International Business Machines Corporation 97 New I/O 28 April © 2014 International Business Machines Corporation 98 New POWER8 PCIe Adapters LAN 2-port 40GbE NIC & RoCE QSFP+ cables 2-port 10GbE RJ45 (10GBaseT) only $950 4-port 10GbE+1GbE Copper twinax & RJ45 only $1200 4-port 10GbE+1GbE SR optical & RJ45 only $1600 USB-3 4-port No NIM (old USB-2 not supported) SAS PCIe3 4-port Tape/DVD only $1000 Reprice 4-port zero cache HDD/SSD to $1000 Graphics adapter for future RHEL 7 (Planned June announce) PCIe3 FPGA Accelerator Adapter Prices are USA PRELIMINARY list prices for a Power S822 and are subject to change. Reseller prices may vary. © 2014 International Business Machines Corporation 99 New I/O Announced with Scale-out Servers SOD for PCIe3 expansion drawers SOD states will have PCIe Gen3 drawer in future Important planning consideration for clients with lots of I/O. Emphasize multi-port adapters available to virtualize Emphasize bandwidth of Gen3 PCIe slots to virtualize Disk/HDD New capacity - 600GB 15k rpm New 4k block drives SSD New 1.8-inch 387GB for POWER8 servers SSD cage Prices are USA list prices for a Power S822 and are subject to change. Reseller prices may vary. © 2014 International Business Machines Corporation 100 New I/O 8 April © 2014 International Business Machines Corporation 101 New I/O Announcing 8 April for POWER7/POWER+ PCIe Adapters SAS expandeded usage PCIe3 4-port zero cache on more models PCIe3 4-port huge cache on more models PCIe2 3-port large cache on more POWER7 models Easy Tier function for POWER7+ models with #EJ0L huge cache SAS adapter for AIX/Linux/VIOS IBM Flash Adapter 90 support on more models Prices are USA list prices for a Power 720 and are subject to change. Reseller prices may vary. © 2014 International Business Machines Corporation 102 The Most Powerful SAS RAID Adapters EVER Announced Jan 2014 for Power 795 Now (Apr/Jun) on a lot more models #EJ0L Huge cache #EJ0J / #EJ0M No cache First PCIe Gen3 adapters introduced by Power Systems Most powerful SAS adapters ever created by Power Systems * * IBM Development team not aware of a more powerful SAS adapter in the world Supports 2X more SSD devices than Gen2 SAS adapter Up to 10X more performance than Gen1 SAS Adapter 2X more performance than Gen2 SAS adapter #EJ0L effectively has 6X more write cache Better prices than predecessor Gen2 SAS adapters ©103 2014 International Business Machines Corporation 103 New I/O Announcing 8 April for POWER7/POWER+ New IMFC (#EN10/EN11) for Power 770/780 “C & D” model Integrated Multifunction Card … 4 ports Ethernet + USB + Serial ports #EN10/EN11 adds 10GBase-T and FCoE (CNA) capability #EN10/EN11 adds SR-IOV capability for “D” model with new firmware level NIC SR-IOV for POWER7+ 770/780 with Specific 10GE Ethernet adapters #EN0K and #EN0H in Gen2 slots Or with newest IMFC #EN10 and #EN11 Enhanced native (nonVIOS) IBM i support of existing adapters 16Gb Fibre Channel (Switch still required) SR-IOV where supported IBM i 7.1 TR8 or 7.2 Prices are USA list prices for a Power 720 and are subject to change. Reseller prices may vary. © 2014 International Business Machines Corporation 104 Availability Plans for 8 Apr Announce Annc eConfig PCIe3 12GB SAS RAID adapter #EJ0L on Power 770/780/ESE on Power 710/720/730/740/750/760 8 Apr 8 Apr PCIe3 0GB SAS RAID adapter #EJ0J/EJ0M on Power 770/780/ESE on Power 710/720/730/740/750/760 8 Apr PCIe2 3GB SAS RAID adapter #ESA3 8 Apr 8 Apr 18 Apr PCIe2 4-port Ethernet Adapter 10Gb + 1Gb, Copper Twinax #EN0K/EN0L 8 Apr 8 Apr 25 Apr Additional IMFC for 770/780 #EN10/EN11 8 Apr 8 Apr 18 Apr SR-IOV support on POWER7+ 770/780 8 Apr n/a 10 Jun Native IBM i TR8 support of 16Gb FC 8 Apr n/a 10 Jun Enterprise Pool – mobile enabled activations 8 Apr 8 Apr 25 Apr ©105 2014 International Business Machines Corporation GA 28 Apr 10 Jun 8 Apr 28 Apr 10 Jun 105 SR-IOV © 2014 International Business Machines Corporation 106 SR-IOV …. A Technology of Interest LPAR #1 LPAR #2 Single Root I/O Virtualization LPAR #3 Runs “closer to the silicon” potentially offering some performance efficiencies Doesn’t require VIOS as a pre-req and thus can do simple virtualization under PowerVM without VIOS …. BUT …. VIOS continues to offer many additional advanced functions Architecturally can virtualize a resource like an Ethenet adapter and allocate/provide a user-defined minimum level of bandwidth to a partition … Quality of Service (QoS) Ethernet NIC announced. FCoE and FC not announced. Can use VIOS & SR-IOV together © 2014 International Business Machines Corporation 107 SR-IOV (Single Root I/O Virtualization) for Ethernet NIC • Simple virtualization without VIOS • With quality of service controls LPAR #1 LPAR #2 QoS Min of y% Gen 2 * LPAR #3 LPAR #4 © 2014 International Business Machines Corporation • * For specific Gen2 Adapters with SR-IOV capable electronics In PCIe Gen2 (or later) slot • For specific Integrated Multifunction Cards with SR-IOV capable electronics • Under latest 7.8 firmware • With recent OS level software 108 SR-IOV (Single Root I/O Virtualization) for Ethernet NIC Virtualization with VIOS example • Redundant VIOS with one hardware resource • Minimum amount of bandwidth for Quality of Service (QoS) QoS VIOS - A LPAR #2 Min of y% Gen 2 * LPAR #3 VIOS - B © 2014 International Business Machines Corporation • * For specific Gen2 Adapters with SRIOVcapable electronics In PCIe Gen2 or later slot • For specific Integrated Multifunction Cards with SRIOV-capable electronics • Under latest 7.8 firmware • With recent OS level software 109 SR-IOV (Single Root I/O Virtualization) Dual VIOS • Redundant VIOS with redundant hardware resource • Minimum amount of bandwidth for Quality of Service (QoS) QoS QoS SRIOV virtualization + VIOS virtualization Gen 2 VIOS - A LPAR #2 SRIOV virtualization + VIOS virtualization Min of y% Gen 2 LPAR #3 VIOS - B © 2014 International Business Machines Corporation 110 SR-IOV and POWER8 Servers No announcement or SOD was issued for SR-IOV function in April 2014 However, this capability is being worked on by IBM development. No architectural problems are known. The only known challenge is working it into busy test schedules and ensuring things are tuned properly on the POWER8 PCIe Gen3 slots Note that SR-IOV requires an HMC © 2014 International Business Machines Corporation 111 Power Enterprise Pools © 2014 International Business Machines Corporation 112 New “Mobile-Enabled” Activations static mobile 8 April 2014 announcement for POWER7+ 770/780 and Power 795 New static processor core activations can save total cost Higher initial cost, but converts to mobile activations at no-charge when ready + MES conversion Original Static $$$$ $$$$ Mobile enabled Static + MES conversion $$$$$$ © 2014 International Business Machines Corporation 0 Mobile $$$$$$$$ Mobile $$$$$$ 113 28 April Statements of Direction (SODs) IBM plans to bring POWER8 capability to the full Power Systems portfolio, with the intent to deliver the most scalable, highest performing enterprise-class Power System with an advanced version of the POWER8 processor. These enterprise systems are designed to deliver the industry’s best per-core performance and will support AIX, Linux and IBM i applications, concurrently. The new system architecture incorporates the resiliency characteristics of IBM’s Power 795 with the intent to drive substantial improvements in energy efficiency and floor space utilization for mid-sized and large enterprises. These systems will use IBM's modular design to enable clients to leverage the innovations in POWER8 processor technology and the latest advancements in enterprise-class systems and Capacity on Demand, to help enable growth seamlessly and affordably. IBM also plans to provide upgrade paths from the current POWER7+ Power 770 and 780 servers to enterprise-class POWER8 processor-based servers. It is intended that clients with multiple systems can leverage PowerVM Live Partition Mobility to help maintain application availability during the upgrade process. IBM plans to preserve client investment in Power Systems by enabling POWER8 processor-based Power Systems to interoperate and share Mobile Capacity on Demand (COD) resources with POWER7 and POWER7+ processor-based Power Systems servers in a single Power Enterprise Pool, at no additional charge. IBM also plans to offer clients an option to permanently transfer their Mobile CoD processor and memory activation features from a Power 770, 780 or 795 to a designated POWER8 processorbased Power System within the same Power Enterprise Pool. IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. © 2014 International Business Machines Corporation 114 TSS © 2014 International Business Machines Corporation 115 TSS Enabling Technology to Enhance Client Experience Enabling Predictive and Proactive Support for reduced operations cost and improved IT Efficiency Technical Support Appliance Pre-emptive reports & recommendations for your servers, storage, and network to help avoid issues Available in US and Europe (Additional IOTs 2H2014) NEW: report the major.minor comparison for Linux RH, SLES, and Ubuntu on Power. Available: June 10, 2014 Quick Reference (QR) Codes Access critical information from mobile device ie., installation documents and CRU replacement videos) Target Availability: June 10, 2014 “Reports not only show my current levels, they include recommended levels. Very cool!” - Fortune 500 Financial Institution Technical Support Mobile App User convenient App for clients to connect with IBM Support Target Availability: March 31, 2014 Watson4TSS Provide a full-scale Watson technology to effectively and efficiently diagnose customer problems Pilot for Power 2Q2014, Target Global Availability June 15, 2014 Electronic Service Agent Currently available for Power Systems "It's also very proactive…if something starts to falter, it is picking that up before we know it. When it phones home, it has…everything that the customer representative needs to fix the problem.” – Wake Med © 2014 International Business Machines Corporation 116 ( Head’s Up Business Practices are changing …. You need to be aware (T’s & C’s are not changing) Impacts your client (and you) at the end of POWER8 server warranty (Opportunity to help sell maintenance contracts) Machine Code Entitlement © 2014 International Business Machines Corporation 118 Update Entitlement at Activation No change to Power S8xx clients on maintenance contracts following 3yr warranty. May impact clients who don’t have coverage. POWER8 (and later) servers require machine code “update entitlement at activation” - POWER8 and later servers contain an “update access key” (UAK) Machine code update entitlement is checked using the UAK at each activation / installation Entitlement check must pass before an update can proceed - Entitlement is checked based on existing terms and conditions - Security and safety fixes are exempt from the entitlement check Entitlement checking enables IBM’s continued innovation and protects client investment © 2014 International Business Machines Corporation 119 Scale-out Hardware with POWER8 Technology: Announcement Deep Dive 30 April 2014 Mark Olson olsonm@us.ibm.com © 2014 IBM Corporation POWER8 Memory Organization Up to 32 total DDR ports Up to 410 GB/s DRAM Chips Memory Buffer 128 GB 16MB 128 GB Up to 8 high speed channels, Up to 8 GB/s per channel 16MB 128 GB 16MB 16MB 128 GB 128 GB 16MB 16MB 128 GB 128 GB 16MB 16MB 128 GB (2 bytes read + 1 byte write -- per channel) Up to 192 GB/s sustained POWER8 DCM Up to 1 TB / Socket First POWER8 Systems: 512 GB /Socket © 2014 International Business Machines Corporation 129 POWER8 Integrated PCI Gen 3 POWER8 Native PCIe Gen 3 Support POWER7 • • • • DCM Direct processor integration Replaces proprietary GX/Bridge Low latency Gen3 x16 bandwidth (32 GB/s) Transport Layer for CAPI Protocol GX Bus • • PCIe Gen3 Coherently Attach Devices connect to processor via PCIe Protocol encapsulated in PCIe I/O Bridge x8 x8 x16 x16 PCIe Gen2 PCI Devices © 2014 International Business Machines Corporation PCI Devices 131 2U Server © 2014 International Business Machines Corporation 133 Linux-only 1S2U Planar Layout DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM POWER8 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM POWER8 DRAM SN DRAM DRAM DRAM DRAM DRAM Service Processor 2x1GbE HMC 1xSerial, 2xUSB-2 PCIe Gen3 x16 PCIe Gen3 x16 x8 x8 BP 12 x SFF Bays & DVD BP 8 x 2.5” Bays & DVD PCIe Gen3 x8 PEX PCIe Gen3 x8 PEX PCIe Gen3 x8 PCIe Gen3 x8 SAS #1 USB Dual Ext SAS © 2014 International Business Machines Corporation SAS #2 134 2S2U Planar Layout DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM POWER8 POWER8 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM POWER8 POWER8 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM SN SN DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM Service Processor 2x1GbE HMC 1xSerial, 2xUSB-2 PCIe Gen3 x16 PCIe Gen3 x16 x8 PCIe Gen3 x16 PCIe Gen3 x16 x8 PCIe Gen3 x8 BP 12 x SFF Bays & DVD BP 8 x 2.5” Bays & DVD 6 x 1.8” SSD PCIe Gen3 x8 PEX PCIe Gen3 x8 PEX PCIe Gen3 x8 PCIe Gen3 x8 SAS #1 4xUSB-3 Dual Ext SAS © 2014 International Business Machines Corporation SAS #2 135 4U Servers © 2014 International Business Machines Corporation 136 1S4U Planar Layout DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM POWER8 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM POWER8 DRAM SN DRAM DRAM DRAM DRAM DRAM Service Processor 2 x 1GbE HMC 1xSerial, 2xUSB-2 PCIe Gen3 x16 PCIe Gen3 x16 x8 x8 BP 12 x SFF Bays & DVD BP 1 8 x 2.5” Bays & DVD PCIe Gen3 x8 PEX PCIe Gen3 x8 PEX PCIe Gen3 x8 PCIe Gen3 x8 PCIe Gen3 x8 SAS #1 4xUSB-3 Dual Ext SAS © 2014 International Business Machines Corporation SAS #2 137 2S4U Planar Layout DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM POWER8 POWER8 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM POWER8 DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM SN SN DRAM DRAM DRAM DRAM POWER8 SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM SN DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM DRAM Service Processor 2x1GbE HMC 1xSerial, 2xUSB-2 PCIe Gen3 x16 PCIe Gen3 x16 x8 PCIe Gen3 x16 PCIe Gen3 x16 x8 PCIe Gen3 x8 PCIe Gen3 x8 BP 12 x SFF Bays & DVD BP 1 8 x 2.5” Bays & DVD 8 x 1.8” SSD PCIe Gen3 x8 PEX PCIe Gen3 x8 PEX PCIe Gen3 x8 PCIe Gen3 x8 PCIe Gen3 x8 SAS #1 4xUSB-3 Dual Ext SAS © 2014 International Business Machines Corporation SAS #2 138 Performance © 2014 International Business Machines Corporation 139 POWER8 “Turbo” 12 Core Sockets 1 0.5 0 Nominal • • • • • Configure via ASMI menu Potential increase in processor frequency: ~ 11+% Requires firmware 810 ( POWER8 support) CPW & rPerf measured using nominal Note fans run faster increasing noise level © 2014 International Business Machines Corporation Turbo This is not POWER7 Turbo-core 140 Ordering Processor Cards, Activations, Editions, © 2014 International Business Machines Corporation 141 Processor DCM Feature Codes Number Sockets Processor DCM Processor DCM S814 S824 S822 S812L S822L 8286-41A 8286-42A 8284-22A 8247-21L 8247-22L 1S 2S (Opt 1S) 2S (Opt 1S) 1S 2S #EPX0 6-core 3.02 GHz One or Two One or Two One #ELPD Two #ELPD #EPXE #EPX1 10-core 10-core 6-core 6-core 3.42 GHz 3.42 GHz 3.89 GHz 3.89 GHz #EPX6 8-core 3.72 GHz One or Two One or Two One #ELP3 Two #ELP4 #EPXF #EPXD 12-core 12-core 8-core 10-core 3.02 GHz 3.02 GHz 4.15 GHz 3.42 GHz Processor DCM © 2014 International Business Machines Corporation Two #EPXH 12-core 3.52 GHz 142 Processor Activation Features Processor DCM Charge activate No-charge activate Processor DCM Charge activate No-charge activate S814 S824 S822 S812L S822L 8286-41A 8286-42A 8284-22A 8247-21L 8247-22L #EPX0 6c 3.02 GHz #EPXE 6c 3.89 GHz #EPY0 #EPZ0 #EPYE - #EPX6 8c 3.72 GHZ #EPY6 #EPZ6 Processor DCM Charge activate No-charge activate #EPX1 #ELPD #ELPD 6c 3.89 GHz 10c 3.42 GHz 10c 3.42 GHz #EPY1 - -#ELAD -#ELAD #EPXF #EPXD #ELP3 #ELP4 8c 4.15 GHz 10c 3.42 GHz 12c 3.02 GHz 12c 3.02 GHz #EPYF - #EPYD - -#ELA3 -#ELA4 #EPXH 12c 3.52 GHz #EPYH - 100% of processor cores are activated. No-charge activations used with IBM i solution editions or with Linux-only models #2319 factory deconfiguration is supported. © 2014 International Business Machines Corporation 143 POWER8 Memory © 2014 International Business Machines Corporation 150 Memory slots & Memory DIMMs 4U Max number DIMMs Min number DIMMs Max GB memory • • • • • 2U 1S 4U 8 2S 4U 16 1S 2U 8 2S 2U 16 1 2 1 2 512GB 1TB 512GB 1TB Memory DIMMs are all DDR3 1.6GHz Memory is not hot plug 1 memory feature = 1 DIMM Memory plugged in pairs – 1S exception 2U & 4U server memory physically packaged differently Memory DIMMs 16 GB 32 GB 64 GB Activations: all memory 100% activated. CoD/CUoD not implemented. © 2014 International Business Machines Corporation 151 POWER8 Memory: Eight Slots per DCM Memory slot Memory slot Memory slot Memory slot POWER8 DCM Memory slot Memory slot Memory slot Memory slot © 2014 International Business Machines Corporation 152 PCIe Slots © 2014 International Business Machines Corporation 158 PCIe Slots - High Level 4U Total PCIe slots (all hot swap) Required* LAN adapter (available for client use) PCIe slots after required* LAN adapter However if use high performance, expanded function backplane PCIe slots after required* LAN and if using high performance backplane 1S 4U 2S 4U 2U 1S 2U 7 11 6 9 1 1 1 1 6 10 5 8 -1 -1 -1 -1 5 9 4 7 (no IBM i) 2S 2U * required for IBM Manufacturing • PCIe slots are all Gen3 slots • 2U are all low profile and 4U are all full high • There is no PCI expansion drawer announced. There is an SOD. © 2014 International Business Machines Corporation 159 PCIe Slots - More Detail -- x8 and x16 4U 2U S822L S822 S814 S824 S824 S812L 8286-41A 8286-42A 8286-42A 8247-21L 1S Only 1S in 2S box 2S 1S 8284-22A Only 1S in 2S box Total PCIe slots x16 x8 7 2 x16 5 x8 7 2 x16 5 x8 11 4 x16 7 x8 6 2 x16 4 x8 6 2 x16 4 x8 9 4 x16 5 x8 Required LAN adapter (available for client use) 1 x8 1 x8 1 x8 1 x8 1 x8 1 x8 PCIe slots after required LAN adapter 6 2 x16 4 x8 6 2 x16 4 x8 10 4 x16 6 x8 5 2 x16 3 x8 5 2 x16 3 x8 8 4 x16 4 x8 However if use high performance, expanded function backplane -1 x8 -1 x8 -1 x8 -1 x8 -1 x8 -1 x8 PCIe slots after required LAN and if using high performance backplane 5 2 x16 3 x8 5 2 x16 3 x8 9 4 x16 5 x8 4 2 x16 2 x8 4 2 x16 2 x8 7 4 x16 3 x8 S822 8247-22L 8284-22A 2S • PCIe slots are all Gen3 slots (Higher MHz used than Gen2 = 2x theoretical bandwidth) • Some slots are x16 and some are x8. (x16 have 2x theoretical bandwidth) • In 2014 can ignore which slots are x8 and which are x16 for most adapters … see more detail © 2014 International Business Machines Corporation 160 PCIe Slots - Way More Detail 4U Slot identifier C2 C3 C4 C5 C6 C7 C8 C9 C10 C11 C12 x8 x16 x8 x16 x16 x16 x8 x8 x8 x8 x8 Total PCIe slots 2U S822L S822 S814 S824 S824 8286-41A 8286-42A 8286-42A 1S Only 1S in 2S box 2S 1S n/a n/a n/a n/a Y Y Y Y Y * Y Y ** n/a n/a n/a n/a Y Y Y Y Y * Y Y ** Y Y Y Y Y Y Y Y Y * Y Y ** n/a n/a n/a n/a Y Y n/a Y *** Y * Y Y n/a n/a n/a n/a Y Y n/a Y *** Y * Y Y Y Y n/a Y Y Y n/a Y *** Y * Y Y 7 7 11 6 6 9 S812L 8284-21L S822 8284-22A Only 1S in 2S box 8247-22L 8284-22A 2S * C10 is where IBM manufacturing places the 4-port Ethernet card. ** Slot not usable by PCIe adapter with expanded function, dual-IOA backplane -- space taken by SAS ports & cabling *** Slot not usable by PCIe adapter with expanded function, dual-IOA backplane – space taken by power protection for write cache © 2014 International Business Machines Corporation 161 PCIe Slots - Way, Way More Detail 4U Slot identifier C2 x8 C3 x16 C4 x8 C5 x16 C6 x16 C7 x16 C8 x8 C9 x8 C10 x8 C11 x8 C12 x8 Total PCIe slots 2U S822 S822L S822 8284-22A 8247-22L 8284-22A 1S Only 1S in 2S box 2S direct direct direct direct direct direct PEX PEX PEX * PEX PEX ** n/a n/a n/a n/a direct direct n/a PEX *** PEX * PEX PEX n/a n/a n/a n/a direct direct n/a PEX *** PEX * PEX PEX direct direct n/a direct direct direct n/a PEX *** PEX * PEX PEX 11 6 6 9 S814 S824 S824 S812L 8286-41A 8286-42A 8286-42A 8247-21L 1S Only 1S in 2S box 2S n/a n/a n/a n/a direct direct PEX PEX PEX * PEX PEX ** n/a n/a n/a n/a direct direct PEX PEX PEX * PEX PEX ** 7 7 Direct --- straight to processor DCM, not shared bandwidth PEX --- shared bandwidth - PLX PEX8748 Switch – two PEX sets per system indicated by boxes Note, internal SAS controllers for system unit SAS bays & DVD attach to PEX – one controller per PEX Comment – compared to POWER7+ 710-740 with this is much better. There are no 7xx direct slots and PCIe slots share bandwith over GX++ and P7IOC I/O Controller Hub. POWER8 architecture has fewer PCI slots sharing and much bigger bandwidth to start with. * C10 is where IBM manufacturing places the 4-port Ethernet card. ** Slot not usable by PCIe adapter with high function, dual-IOA backplane -- space taken by SAS ports & cabling *** Slot not usable by PCIe adapter with high function, dual-IOA backplane – space taken by power protection for write cache © 2014 International Business Machines Corporation 162 PCIe x16 and x8 Slot Usage Considerations For most cards it doesn’t matter which slot used (read all chart) All low profile slots in 2U box, all full-high slots in 4U box All slots are Gen3 Bandwidth is so big on the Gen3 x8 there is no significant difference where the x16 will noticeably make a difference with existing adapters. No x16 cards announced as of Apr 2014. It does matter for these specific cards SOD future CAPI cards -- must use the x16 2-port 40Gb Ethernet and IB cards …. Nice to put on x16 … helps DMA capability (more TCEs) These older adapters* only supported in the x16 slots #5901/#5278(LP)/#EL10(LP) PCIe Dual-x4 SAS Adapter #5287(LP)/#5288 PCIe2 2-port 10GbE SR Adapter * Why these adapters: This is an idiosyncrasy of their then-existing standards interpretation/implementation as applied to today’s more “evolved/revised” PCIe standards © 2014 International Business Machines Corporation 163 PCIe Special Placement Considerations A few adapters have special placement needs IBM manufacturing will place an Ethernet adapter in C10 slot. These adapters need to be in specific slots: slots C6, C7, C11 on any 1-socket or 2-socket server or also in 2-socket servers slots C2, C3, C5 or also in 2S4U server C4 slot (nonPEX) #2893, 2894 PCIe 2-Line WAN w/Modem Adapter #5269, 5748 PCIe POWER GXT145 Graphics Accelerator #EN13, EN14 PCIe Bisync Adapter These adapters need to be in x16 PCIe slots #5901/#5278/EL10 PCIe Dual-x4 SAS Adapter #5287(LP)/#5288 PCIe2 2-port 10GbE SR Adapter #EJ12(FH)/#EJ13(LP) PCIe3 FPGA Adapter © 2014 International Business Machines Corporation 164 POWER8 PCIe Adapter Migration POWER7-supported PCIe adapters supported on POWER8 Initial GA: robust list Modest set of PCIe adapters not supported on POWER8 Scale-out Servers -- mostly elderly or low volume Remember, No PCI-X adapters on POWER8 This means no SCSI For IBM i, means no IOPs (no SDLC) © 2014 International Business Machines Corporation 165 Robust List PCIe Adapters Supported (page 1) Ethernet NIC Ethernet NIC Ethernet NIC & FCoE (CNA) Ethernet NIC Ethernet NIC Ethernet NIC & RoCE Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC & OpenOnload Ethernet NIC & RoCE 4-port 1GbE RJ45 2-port 10GbE 10GBase-T RJ45 4-port 10GbE+1GbE SR+RJ45 4-port 10GbE+1GbE SR optical 4-port 10GbE+1GbE Copper twinax 2-port 10GbE SR optical 2-port 10GbE SR optical iSCSI TOE 2-port 10GbE SR optical 1-port 10GbE LR optical (IBM i native) 2-port 10GbE Copper twinax 2-port 40GbE QSFP+ #5899, #5260 #EN0W, #EN0X, #EL3Z #EN0H, #EN0J, #EL3B #EN0S, #EN0T #EN0U, #EN0V #EC29, #EC30, #EL2Z #5744, #5280 #5284, #5287, #EL2P #5772 #EL39, #EC2J, #EC2G #EC3A, #EC3B Fibre Channel Fibre Channel Fibre Channel Fibre Channel 2-port 4-port 4-port 2-port #5735, #5273, #EL2N #5729 #EN0Y #EN0A, #EN0B Communications Communications Communications 2-port Async RS232 1-port Bisync (IBM i) 2-port Async/Bisync (support only) (IBM i) © 2014 International Business Machines Corporation 8Gb 8Gb (FH) 8Gb (LP) 16Gb NEW NEW NEW NEW #5289, #5290 #EN13, #EN14 #2893, #2894 166 Robust List PCIe Adapters Supported (page 2) SAS RAID SAS Tape/DVD SAS RAID SAS RAID/Tape/DVD 4-port no-cache PCIe3 for SSD/HDD 4-port tape/DVD PCIe3 4-port huge-cache PCIe3 for SSD/HDD 2-port no-cache PCIe1 for HDD #EJ0J, #EJ0M, #EL3B #EJ10, #EJ11, #EL60 #EJ0L #5901, #5278, #EL10 Infiniband (IB) 2-port QDR IB #5285, #5283 Graphics Graphics 2D graphics for general use 3D graphics for RHEL7 (RHEL7 in beta ) #5748, #5269 #EC42, #EC41 Encryption Crypto Coprocessor 4765-001 #4807 USB 4-port USB-3 #EC45, #EC46 Programmable FPGA PCIe3 FPGA Accelerator #EJ12, #EJ13 © 2014 International Business Machines Corporation SR optical NEW New soon* NEW NEW 167 PCIe Adapters NOT Supported: April 2014 Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC & FCoE Ethernet NIC & FCoE Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC & RoCE Fibre Channel Fibre Channel Communications SAS RAID SAS RAID SAS RAID USB SSD on PCIe card Flash on card 2-port 1GbE RJ45 2-port 1GbE SX optical 4-port 1Gbe RJ45 1-port 10GbE SR optical 2-port 10GbE SR optical 4-port 10GbE+1GbE Copper Twinax+RJ45 2-port 10GbE copper twinax 1-port 10GbE CX4 4-port 10GbE+1GbE Copper twinax+ RJ45 2-port 10GbE Copper twinax 2-port 10GbE Copper twinax 1-port 4Gb 2-port 4Gb 4-port Async RS232 2-port 380MB cache PCIe1 HDD/SSD 3-port large cache PCIe2 HDD/SSD 2-port zero cache PCIe2 SSD 4-port USB-2 4-slot 1.8-inch SSD on SAS adapter Flash Adapter 90 © 2014 International Business Machines Corporation #5767, #5281 #5768, #5274 #5717, #5271 #5769, #5275 #5708, #5270 #EN0K, #EN0L, #EL3C #5288, #5286 #5732, #5272 #5745, #5279 #EL3A, #EC2K, #EC2H #EC28, #EC27, #EL27 #5773 #5744, #5276, #EL09 #5785, #5277 #5805, #5903 #5913, #ESA3 #ESA1, #ESA2, #EL2K #2728, #2053, #2055, 2055 #ES09 Old, use 4-port Old, use 4-port RJ45 Old, use newer old Use newer Use SR optical old Old Old Use OpenOnload Use SR optical Old, use 8Gb Old, use 8Gb Old, use 2-port Use PCIe3 Use PCIe3 Use PCIe3 Old, use USB-3 Use controller in storage backplane 168 PCIe Adapters NOT Supported: April 2014 Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC & FCoE Ethernet NIC & FCoE Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC & RoCE Fibre Channel Fibre Channel Communications SAS RAID SAS RAID SAS RAID USB SSD on PCIe card Flash on card 2-port 1GbE RJ45 #5767, #5281 Old, use 4-port 2-port 1GbE SX optical #5768, #5274 Old, use 4-port RJ45 4-port 1Gbe RJ45 #5717, #5271 Old, use newer 1-port 10GbE SR optical #5769, #5275 old Important comment – do not assume all of the 2-port 10GbE SR optical #5708, #5270 Use newer 4-port 10GbE+1GbE Copper Twinax+RJ45 #EN0K, #EN0L, #EL3C adapters shown on this list as of April 2014 Use willSR optical 2-port 10GbE copper twinax #5286 servers. old If never be supported on the#5288, POWER8 1-port 10GbE CX4 do assume many #5732, supported, of#5272 these wouldOld never 4-port 10GbE+1GbE Copper twinax+ RJ45features #5745, #5279 Old be sold/ordered as new on a POWER8 2-port 10GbE Copper twinax #EL3A, #EC2K, #EC2H OpenOnload server, but supported if a client already had Use a card. 2-port 10GbE Copper twinax #EC28, #EC27, #EL27 Use SR optical 1-port 4Gb #5773 Old, use 8Gb Do assume the ones with a black star will probably 2-port 4Gb #5744, #5276, #EL09 Old, use 8Gb never be supported. (preliminary list) 4-port Async RS232 #5785, #5277 Old, use 2-port 2-port 380MB cache PCIe1 HDD/SSD #5805, #5903 Use PCIe3 3-port large cache PCIe2 HDD/SSD #5913, #ESA3 Use PCIe3 2-port zero cache PCIe2 SSD #ESA1, #ESA2, #EL2K Use PCIe3 4-port USB-2 #2728, Old, use USB-3 4-slot 1.8-inch SSD on SAS adapter #2053, #2055, 2055 Use controller in storage backplane Flash Adapter 90 #ES09 IBM Confidential until announced © 2014 International Business Machines Corporation 169 PCIe Adapters NOT Supported: April 2014 Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC & FCoE Ethernet NIC & FCoE Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC Ethernet NIC & RoCE Fibre Channel Fibre Channel Communications SAS RAID SAS RAID SAS RAID USB SSD on PCIe card Flash on card 2-port 1GbE RJ45 2-port 1GbE SX optical 4-port 1Gbe RJ45 1-port 10GbE SR optical 2-port 10GbE SR optical 4-port 10GbE+1GbE Copper Twinax+RJ45 2-port 10GbE copper twinax 1-port 10GbE CX4 4-port 10GbE+1GbE Copper twinax+ RJ45 2-port 10GbE Copper twinax 2-port 10GbE Copper twinax 1-port 4Gb 2-port 4Gb 4-port Async RS232 2-port 380MB cache PCIe1 HDD/SSD 3-port large cache PCIe2 HDD/SSD 2-port zero cache PCIe2 SSD 4-port USB-2 4-slot 1.8-inch SSD on SAS adapter Flash Adapter 90 © 2014 International Business Machines Corporation #5767, #5281 #5768, #5274 #5717, #5271 #5769, #5275 #5708, #5270 #EN0K, #EN0L, #EL3C #5288, #5286 #5732, #5272 #5745, #5279 #EL3A, #EC2K, #EC2H #EC28, #EC27, #EL27 #5773 #5744, #5276, #EL09 #5785, #5277 #5805, #5903 #5913, #ESA3 #ESA1, #ESA2, #EL2K #2728, #2053, #2055, 2055 #ES09 Old, use 4-port Old, use 4-port RJ45 Old, use newer old Use newer Use SR optical old Old Old Use OpenOnload Use SR optical Old, use 8Gb Old, use 8Gb Old, use 2-port Use PCIe3 Use PCIe3 Use PCIe3 Old, use USB-3 Use controller in storage backplane 170 Storage Backplanes © 2014 International Business Machines Corporation 173 4U Storage Backplane Options Must select one #EJ0N 12 SFF SAS bays 1 SAS controller No write cache DVD bay #EJ0N+EJ0S 6+6 SFF SAS bays 2 SAS controllers No write cache DVD bay #EJ0P * 18 SFF SAS bays Dual SAS controllers 7.2**GB cache DVD bay 8-bay SSD cage*** External SAS ports Note that no HH tape bay is provided – different than POWER7 720/740 AIX / IBM i / Linux Easy Tier Function JBOD RAID 0 RAID 10 RAID 5/6 Split backplane yes no yes yes yes Yes no yes no yes yes Yes Yes yes yes yes no yes yes yes no * Uses one x8 PCIe slot (space taken up by #EJ0Z SAS ports/cabling – EJ0Z is mandatory with EJ0P) ** 1.8GB physical write cache provides up to 7.2GB effectively with compression *** 8-bay 1.8-inch SSD cage #EJTM NOTE: Not available on mdl 41A, Required on mdl 42A with #EJ0P © 2014 International Business Machines Corporation 175 2U Storage Backplane Options Must select one #EJ0T 12 SFF SAS bays 1 SAS controller No write cache DVD bay AIX / IBM i / Linux Easy Tier Function JBOD RAID 0 RAID 10 RAID 5/6 Split backplane Yes no Yes Yes Yes Yes no #EJ0T+EJ0V 6+6 SFF SAS bays 2 SAS controllers No write cache DVD bay Yes no yes yes Yes Yes Yes #EJ0U * 8 SFF SAS bays Dual SAS controllers 7.2**GB cache DVD bay 6-bay SSD cage*** External SAS ports Yes Yes no yes yes yes no * Uses one x8 PCIe slot (space taken up by cache protection hardware) ** 1.8GB physical write cache provides up to 7.2GB effectively with compression *** 6-bay 1.8-inch SSD cage #EJTL --- required with #EJ0U on 8S22 © 2014 International Business Machines Corporation 177 2U Storage Backplane Options Must select one #EL3T 12 SFF SAS bays 1 SAS controller No write cache DVD bay Easy Tier Function JBOD RAID 0 RAID 10 RAID 5/6 Split backplane no Yes Yes Yes Yes no ( Linux only) #EL3T+EL3V 6+6 SFF SAS bays 2 SAS controllers No write cache DVD bay no yes yes Yes Yes Yes #EL3U * 8 SFF SAS bays Dual SAS controllers 7.2**GB cache DVD bay 6-bay SSD cage*** External SAS ports Yes no yes yes yes no * Uses one x8 PCIe slot (space taken up by cache protection hardware) ** 1.8GB physical write cache provides up to 7.2GB effectively with compression *** 6-bay 1.8-inch SSD cage #EJTL -- required feature with #EL3U on 8S22L, but not supported on 8S12L © 2014 International Business Machines Corporation 178 Easy Tier w/ Power SAS RAID Easy Tier Tiers of Hot and Cold data Adapter dynamically swaps data between SSD/HDD tiers Based on Read / Write statistics Hottest data moved to SSD Cool/Cold data moved to SFF 1 MB or 2MB bands of data moved Real-time updating (Seconds/minutes) AIX and Linux Support IBM i requires VIOS to use (i alternatively has built in OS function) Supports Boot and Hot Spares Function also support with #EJ0L SAS adapter in POWER7+ and POWER8 server Improves cost / performance tradeoff between HDDs/SSDs © 2014 International Business Machines Corporation 180 Easy Tier® Function Configuration Function available with expanded-function, high-performance backplane. (#EJ0P, #EJ0U, #EL3U) For AIX/Linux/VIOS Easy Tier AIX V7.1 TL3 SP3 or later or AIX V6.1 TL9 SP3 or later VIOS 2.2.3.3 or later Linux: RHEL 6.5 or later and SLES 11 SP3 or later IBM i essentially already has same hot/cold function in OS. Could also use function via VIOS. Not natively supported by IBM i. Configured as new RAID arrays: RAID-5T2 (2-tiered RAID-5), RAID-6T2 (2-tiered RAID-6), RAID-10T2 (2-tiered RAID-10) SSD located in SSF-3 bays and/or 1.8-inch SSD bays and/or EXP24S drawer attached to the SAS ports Must combine HDD/SSD in the same array HDD and SSD must be same block size … all 5xx or all 4k (No 4k SSD announced, thus use 512/528 block size) Can use different capacity HDD and SSD If multiple HDD capacities (example 300GB and 600GB) then only 300 GB of the 600GB drives will be used If multiple SSD capacities (example 387GB and 775GB) then only 387 GB of the 775GB drives will be used No capacity ignored in HDD or SSD if only one size capacity in HDD and one size capacity in SSD, for example 387GB SSD and 600GB HDD. © 2014 International Business Machines Corporation 181 SAS SFF-3 Options as of April 2014 SFF-3 HDD Block size Formatted with 512 or 4096 byte sectors Linux only with 512 or 4096 byte sectors Formatted with 528 or 4224 byte sectors 10k 5xx 300 GB #ESDR * 300 GB #ELDR 283 GB #ESDS * 10k 5xx 600 GB #ESD5 600 GB #ELD5 571 GB #ESD4 10k 5xx 1.2 TB #ESD9 1.2 TB #ELD9 1.1 TB 15k 5xx 146 GB #ESDT * 146 GB #ELDT 139 GB #ESDU * 15k 5xx 300 GB #ESDB 300 GB #ELDB 283 GB #ESDA #ESD8 15k 4k 300 GB #ESFB 300 GB #ELFB 283 GB #ESFA 15k 4k 600 GB #ESFF 600 GB #ELFF 571 GB #ESFE * Staged eConfig support (27 May) and GA (25 July) SFF-3 SSD AIX/Linux/VIOS (528 byte sectors) Linux only (528 byte sectors) IBM i formatted (528 byte sectors) eMLC Gen3 387 GB #ES0L 387 GB #EL14 387 GB #ES0M eMLC Gen3 775 GB #ES0N 775 GB #EL13 775 GB #ES0P The above features use SFF-3 or Gen3 carriers/trays and can be placed in the SFF SAS bays of the POWER8 servers © 2014 International Business Machines Corporation 182 512/528 (5xx) byte sectors vs 4k byte sectors Same performance based on early results and predictions Same price 4k is something the industry will be moving to over the next 5-10 years. It allows for bigger capacity disk drives. Can mix 4K and 5xx byte sector drives on the same SAS controller/adapter, but can NOT mix in the same array. Suggestion from a pessimist …. Don’t mix 300GB 4k and 5xx block SFF-3 on the same server. Chance of confusion in the future. “SFF-3” and “300GB” are key words in this statement. Same advice for EXP24S drawers …. Don’t mix 300GB 4k and 5xx block SFF-2 on the same server. © 2014 International Business Machines Corporation 183 SAS 1.8-Inch SSD for System Unit Cage SSD eMLC Gen3 AIX/Linux/VIOS Linux only IBM i formatted (528 byte sectors) 387 GB #ES16 (528 byte sectors) 387 GB #ES46 (528 byte sectors) 387 GB #ES17 #ES16 and #ES17 are identical, but have different feature codes to help IBM config tools properly configure the system. The above features placed in the SSD cage which is ordered with the dual IOA backplane feature on the 2U and the 2S4U server. The cage features are: For 2U: …. 6-bay cage #EJTL (Linux only #EL0H) For 4U S824 …. 8-bay cage #EJTM Note: cage not supported on 2U 1-Socket or on 4U 1-Socket server © 2014 International Business Machines Corporation 184 SSD Price Performance Analysis 1.8-inch and 2.5-inch (SFF) priced the same Performance very similar Run off the same integrated, expanded-function SAS controller Use which ever makes the most sense to configure to you – little difference unless can use 775GB SSD USA list price $ / GB 1.8-inch 387GB #ES16/ES17 $ 3588 $9.27 SFF-3 387GB #ES0L/ES0M $ 3588 $9.27 SFF-3 775GB #ES0N/ES0P $ 6200 $8.00 Prices are USA list prices and are subject to change. Reseller prices may vary. © 2014 International Business Machines Corporation 185 EXP24S Ports with Expanded Function Backplane Two SAS ports on rear of server with Expanded Function backplane Internal cabling connects ports to SAS expanders/controllers in the server. No separate feature code required to order internal cabling. 4U server uses #EJ0Z for communicating SAS ports to IBM Manufacturing. No feature code used for 2U server. Two YO cables (separately ordered) connect the two SAS ports to the EXP24S drawer. Drawer must be in mode 1 Drawer can hold up to 24 SSD or up to 24 HDD, but SSD and HDD can not be mixed in the drawer Expanded Function Backplane 18 SFF SAS bays Dual SAS controllers 7.2**GB cache RAID-0,1,5,6,10 DVD bay 8-bay SSD cage*** External SAS ports Easy Tier function Additional EXP24S drawers attached to SAS adapters in PCIe slots © 2014 International Business Machines Corporation 186 Max number of EXP24S drawers & disk/SSD 4U Max EXP24S supported Total SFF-2 disk drives supported in EXP24S Total SFF-2 SSD drives supported in EXP24S 2U 1S 4U 2S 4U 1S 2U 2S 2U 14 14 14 14 336 336 336 336 168 168 168 168 The above max calculated using SAS adapters which can attach up to 4 drawers per adapter (#EJ0J/#EJ0M/#EL3B) and then reducing it in consideration of limitation of SAS cables contained in cable management arm. Max of 14 includes both EXP24S attached via PCIe adapters and/or SAS ports on the rear of the server with expanded function backplane EXP24S ordered with #5887 for mdl 22A, 41A, 42A; ordered as #EL1S for mdl 22L © 2014 International Business Machines Corporation 187 DVD Reminder DVD support is like the Power 710/720/730/740 A SAS/SATA controller runs both DVD and HDD/SSD This has sharing and virtualization considerations This is not like POWER7+ 750/760/770/780 with a separate controller for DVD © 2014 International Business Machines Corporation 193 Physical Planning © 2014 International Business Machines Corporation 201 Physical Planning – Heat and Acoustic See the IBM Site and Hardware Planning document at http://www.ibm.com/support/knowledgecenter/POWER8/p8hd x/POWER8welcome.htm Note: As of 28 April, some testing/measuring still underway which may cause some changes to the early physical planning information shared in the announcement letters. In general, POWER8 run slightly warmer than POWER7+ servers “per box”, yet provide significantly better performance. POWER8 server acoustic properties are similar to POWER7+ servers. See next chart for adapters which can increase noise levels (like POWER7+). © 2014 International Business Machines Corporation 202 Physical Planning – Tower Acoustic Considerations S814 Tower considerations: The dB level of the tower meets general business standards and can be installed in an open business environment in addition to a machine room. It may be perceived as noisy to some clients who wish to seat people nearby. Also note that some PCIe adapters draw more power and require more cooling. The POWER8 server recognizes these adapters and speeds up fans to provide this cooling (airflow). Faster fans SIGNIFICANTLY increases the noise level. To avoid potential acoustic situations, these adapters are only supported in the S814 when it is in a rack configuration. Adapters as of April 2014 requiring more cooling: PCIe3 SAS adapters (#EJ0J, #EJ0M, #EL3B, #EJ0L) PCIe2 SAS adapters (#ESA1, #ESA2, #ESA3, and #5913) Note .. Initial eConfig logic misses this tower limitation © 2014 International Business Machines Corporation 203 HMC © 2014 International Business Machines Corporation 214 Performance Monitoring – Metrics & Dashboard Performance metric indicators & utilization dashboard Processor, memory & I/O Server & LPAR level information Basic trend data collection and visualization Identify bottlenecks Early problem detection REST based API to access: All platform (PHYP & VIOS) metrics for Tivoli Third Party tools 2 1 6 © 2014 International Business Machines Corporation 216 Performance Monitoring – Server Overview © 2014 International Business Machines Corporation 217 Performance Monitoring – Processor Utilization 2 1 8 © 2014 International Business Machines Corporation 218 Power Systems Management Requirements Minimum Requirement: HMC FW V8.R1.0 or Later HMC HW 7042-CR5 / 7042-C08 or Later HMC Memory Power HW PowerVM/VIOS © 2014 International Business Machines Corporation 2GB or More POWER6 and Later V2.2.3 219 New I/O 28 April © 2014 International Business Machines Corporation 220 PCIe3 SAS Tape/DVD Adapter LTO-5/LTO-6 SAS tape adapter DVD adapter #EJ10 (FH) / #EJ11 (LP) #EL60 (LP) Linux Supports full bandwidth of LTO-5/LTO-6 Supports DVD attachment PCIe Gen3 adapter Up to about 1.6 GB/sec transfer adapter 4 SAS ports (max about 1.6 GB/sec per port) CCIN 57B4 6 Gbps ports Other SAS tape drives not supported Physically is same card as #EJ0M/EL0J, but has different feat code to help IBM config tools like eConfig understand card’s use and appropriate cabling. eConfig does not know how to swap usage to disk/SSD. Use no-charge RPQ to adjust IBM feature records for any “re-purposing”. © 2014 International Business Machines Corporation Tape adapter always configured as single card and NOT optionally paired like disk/SSD SAS controllers Attaching both disk/ssd & attaching tape/dvd to the same adapter NOT supported 228 PCIe3 #EJ10/EJ11/#EL60 Adapter Support Models S812L S822L S822 S814 S824 POWER7 Models PowerLinux 7R1 PowerLinux 7R2 PowerLinux 7R4 Power 710 Power 720 Power 730 Power 740 Power 750 Power 760 Power 770 Power 780 Power 795 Power ESE © 2014 International Business Machines Corporation Yes Yes Yes Yes Yes “B” models No No No No No No No Yes - “C/” models No No No No No No Yes Yes - “D/T” models Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes 229 PCIe3 vs PCIe1 SAS Tape Adapters PCIe card technology SAS ports – quantity per card SAS ports – Gb/sec (per port) Max tape drives per card Max sustained GB per card SAS/SATA DVD supported LTO-2, LTO-3 (SCSI vs SAS) LTO-4 LTO-5, LTO-6 DAT160 Attach disk and tape on the same card at the same time If POWER8, placed only in x16 slot Feat code if re-purpose to disk USA List price on Power 720 #5901/5278 PCIe Gen1 2 3Gb 2 1.6 GB Y N Y Y, but max #EJ10/EJ11/EL60 PCIe Gen 3 4 6Gb 8 1.6 GB N N N Y, with full bandwidth bandwidth limited by SAS port of the SAS port Y Not supported N Not supported Yes – not in PCIe Place in any PCIe x8 slot #5901/5278 #EJ0J/EJ0M/EL3 B $749 $1,000 Prices shown are suggested USA IBM list prices and are subject to change without notice; reseller prices may vary © 2014 International Business Machines Corporation 230 PCIe3 SAS Tape Adapter Cabling SAS Mini-HD Narrow YE1 or AE1 cables AE1 (#ECBY) is 4 meter long YE1 (#ECBZ) is 3 meter long Up to one cable per port, Max four cables per adapter CCIN 57B4 One tape drive per AE1 cable Thus max 4 tape drives per card Up to two tapes per YE1 cable Thus max 8 tape drives per card Same SAS cables can also be ordered as feature codes of the 7226-1U3 Removable Media Drawer AE1 is #5507 or #9850 YE1 is #5509 © 2014 International Business Machines Corporation Tape adapter always configured as single card and NOT optionally paired like disk/SSD SAS controllers Attaching both disk & tape to the same adapter NOT supported 231 SOD for PCIe3 Expansion Drawers IBM Confidential The following information is not publically announced and is shared only for sales planning purposes. If sharing with clients, it needs to be under non-disclosure S8xx PCIe drawer is not planned for 2014 announce A drawer will connect to server using two x16 PCIe slots © 2014 International Business Machines Corporation 232 New I/O 8 April © 2014 International Business Machines Corporation 234 PCIe3 SAS Adapter Support – Huge Cache #EJ0L 8 April 2014 announcement Models PowerLinux 7R1 PowerLinux 7R2 PowerLinux 7R4 Power 710 Power 720 Power 730 Power 740 Power 750 Power 760 Power 770 Power 780 Power 795 Power ESE “B” models “C” models n/a * No No No No No No n/a * No n/a * No No No - Y © 2014 International Business Machines Corporation Apr 2014 Apr 2014 n/a * Apr 2014 Apr 2014 Apr 2014 Apr 2014 Apr 2014 Apr 2014 Apr 2014 Apr 2014 Apr 2014 - - Jan 2014 * 236 “D/T” models n/a * #EJ0L Apr 2014 physically impossible, no full high PCIe Slots 236 Newer SAS + VIOS + IBM i Performance Boost Requires latest fimware (7.8 or later) … Scale-out Servers, Power 795 and Power 770/780 (C/D models) Previously very careful about write workloads Now disk performance meeting expectations HDD+#xxxx+VIOS+ IBM i : Significant boost * As you would expect, native performance will outperform virtualized configurations, but is now expected to be similar performance to HDD+#xxx+IBM i+IBM i virtualization SSD+xxxx+VIOS +IBM i : Modest improvement * Continue to be careful about write workloads Xxxx = #5913, #ESA3, #EJ0L, EJ0J Architectural performance boost * Enhancement implemented across VIOS, IBM i, SAS adapter & firmware Applies to all PCIe2 SAS adapters Space efficiency bonus up to 10% more usable storage for IBM i * requires IBM i TR7 + VIOS 2.2.3.0 + properly formatted drives + latest firmware © 2014 International Business Machines Corporation 239 SR-IOV © 2014 International Business Machines Corporation 245 SR-IOV Config Details LPAR #1 LPAR #2 LPAR #3 • For Ethernet NIC protocols • For POWER7+ 770/780 (“D” models) wor Power ESE with latest firmware 7.8 • For specific hardware with SR-IOV capable electronics • Gen2 or later Adapters in PCIe Gen2 or later slot • #EN0H PCIe2 4-port (10Gb FCoE & 1GbE) SR&RJ4 • #EN0K PCIe2 4-port (10Gb FCoE & 1GbE) Copper&RJ4 • • • • • Integrated Multifunction Cards (IMFC): #EN10 or #EN11 All four Ethernet ports of the above adapter/IMFC are SR-IOV resource if configured. However can dedicate a port to one partition/VIOS if desired. Software prerequisite • AIX 7.1 TL3 SP2, or later • AIX 6.1 TL9 SP2, or later • IBM i 7.1 with TR8, or later • SUSE Linux Enterprise Server 11 SP3 • Red Hat Enterprise Linux 6.5 • VIOS 2.2.3.2, or later IBM Manufacturing does not have SR-IOV customization capability at this time. The client will need to configure hardware as SR-IOV if desired. HMC is required © 2014 International Business Machines Corporation 247 Thanks ! © 2014 International Business Machines Corporation 252 Special notices This document was developed for IBM offerings in the United States as of the date of publication. IBM may not make these offerings available in other countries, and the information is subject to change without notice. Consult your local IBM business contact for information on the IBM offerings available in your area. Information in this document concerning non-IBM products was obtained from the suppliers of these products or other public sources. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY 10504-1785 USA. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. The information contained in this document has not been submitted to any formal IBM test and is provided "AS IS" with no warranties or guarantees either expressed or implied. All examples cited or described in this document are presented as illustrations of the manner in which some IBM products can be used and the results that may be achieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations and conditions. IBM Global Financing offerings are provided through IBM Credit Corporation in the United States and other IBM subsidiaries and divisions worldwide to qualified commercial and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment type and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension or withdrawal without notice. IBM is not responsible for printing errors in this document that result in pricing or information inaccuracies. All prices shown are IBM's United States suggested list prices and are subject to change without notice; reseller prices may vary. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in this document may have been made on development-level systems. There is no guarantee these measurements will be the same on generallyavailable systems. Some measurements quoted in this document may have been estimated through extrapolation. Users of this document should verify the applicable data for their specific environment. © 2014 International Business Machines Corporation 253 Special notices (cont.) IBM, the IBM logo, ibm.com AIX, AIX (logo), AIX 6 (logo), AS/400, BladeCenter, Blue Gene, ClusterProven, DB2, ESCON, i5/OS, i5/OS (logo), IBM Business Partner (logo), IntelliStation, LoadLeveler, Lotus, Lotus Notes, Notes, Operating System/400, OS/400, PartnerLink, PartnerWorld, PowerPC, pSeries, Rational, RISC System/6000, RS/6000, THINK, Tivoli, Tivoli (logo), Tivoli Management Environment, WebSphere, xSeries, z/OS, zSeries, AIX 5L, Chiphopper, Chipkill, Cloudscape, DB2 Universal Database, DS4000, DS6000, DS8000, EnergyScale, Enterprise Workload Manager, General Purpose File System, , GPFS, HACMP, HACMP/6000, HASM, IBM Systems Director Active Energy Manager, iSeries, Micro-Partitioning, POWER, PowerExecutive, PowerVM, PowerVM (logo), PowerHA, Power Architecture, Power Everywhere, Power Family, POWER Hypervisor, Power Systems, Power Systems (logo), Power Systems Software, Power Systems Software (logo), POWER2, POWER3, POWER4, POWER4+, POWER5, POWER5+, POWER6, POWER6+, System i, System p, System p5, System Storage, System z, Tivoli Enterprise, TME 10, Workload Partitions Manager and X-Architecture are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml The Power Architecture and Power.org wordmarks and the Power and Power.org logos and related marks are trademarks and service marks licensed by Power.org. UNIX is a registered trademark of The Open Group in the United States, other countries or both. Linux is a registered trademark of Linus Torvalds in the United States, other countries or both. Microsoft, Windows and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other countries or both. Intel, Itanium, Pentium are registered trademarks and Xeon is a trademark of Intel Corporation or its subsidiaries in the United States, other countries or both. AMD Opteron is a trademark of Advanced Micro Devices, Inc. Java and all Java-based trademarks and logos are trademarks of Sun Microsystems, Inc. in the United States, other countries or both. TPC-C and TPC-H are trademarks of the Transaction Performance Processing Council (TPPC). SPECint, SPECfp, SPECjbb, SPECweb, SPECjAppServer, SPEC OMP, SPECviewperf, SPECapc, SPEChpc, SPECjvm, SPECmail, SPECimap and SPECsfs are trademarks of the Standard Performance Evaluation Corp (SPEC). NetBench is a registered trademark of Ziff Davis Media in the United States, other countries or both. AltiVec is a trademark of Freescale Semiconductor, Inc. Cell Broadband Engine is a trademark of Sony Computer Entertainment Inc. InfiniBand, InfiniBand Trade Association and the InfiniBand design marks are trademarks and/or service marks of the InfiniBand Trade Association. Other company, product and service names may be trademarks or service marks of others. © 2014 International Business Machines Corporation 254 Notes on benchmarks and values The IBM benchmarks results shown herein were derived using particular, well configured, development-level and generally-available computer systems. Buyers should consult other sources of information to evaluate the performance of systems they are considering buying and should consider conducting application oriented testing. For additional information about the benchmarks, values and systems tested, contact your local IBM office or IBM authorized reseller or access the Web site of the benchmark consortium or benchmark vendor. IBM benchmark results can be found in the IBM Power Systems Performance Report at http://www.ibm.com/systems/p/hardware/system_perf.html. All performance measurements were made with AIX or AIX 5L operating systems unless otherwise indicated to have used Linux. For new and upgraded systems, AIX Version 4.3, AIX 5L or AIX 6 were used. All other systems used previous versions of AIX. The SPEC CPU2006, SPEC2000, LINPACK, and Technical Computing benchmarks were compiled using IBM's high performance C, C++, and FORTRAN compilers for AIX 5L and Linux. For new and upgraded systems, the latest versions of these compilers were used: XL C Enterprise Edition V7.0 for AIX, XL C/C++ Enterprise Edition V7.0 for AIX, XL FORTRAN Enterprise Edition V9.1 for AIX, XL C/C++ Advanced Edition V7.0 for Linux, and XL FORTRAN Advanced Edition V9.1 for Linux. The SPEC CPU95 (retired in 2000) tests used preprocessors, KAP 3.2 for FORTRAN and KAP/C 1.4.2 from Kuck & Associates and VAST-2 v4.01X8 from Pacific-Sierra Research. The preprocessors were purchased separately from these vendors. Other software packages like IBM ESSL for AIX, MASS for AIX and Kazushige Goto’s BLAS Library for Linux were also used in some benchmarks. For a definition/explanation of each benchmark and the full list of detailed results, visit the Web site of the benchmark consortium or benchmark vendor. TPC http://www.tpc.org SPEC http://www.spec.org LINPACK http://www.netlib.org/benchmark/performance.pdf Pro/E http://www.proe.com GPC http://www.spec.org/gpc NotesBench http://www.notesbench.org VolanoMark http://www.volano.com STREAM http://www.cs.virginia.edu/stream/ SAP http://www.sap.com/benchmark/ Oracle Applications http://www.oracle.com/apps_benchmark/ PeopleSoft - To get information on PeopleSoft benchmarks, contact PeopleSoft directly Siebel http://www.siebel.com/crm/performance_benchmark/index.shtm Baan http://www.ssaglobal.com Microsoft Exchange http://www.microsoft.com/exchange/evaluation/performance/default.asp Veritest http://www.veritest.com/clients/reports Fluent http://www.fluent.com/software/fluent/index.htm TOP500 Supercomputers http://www.top500.org/ Ideas International http://www.ideasinternational.com/benchmark/bench.html Storage Performance Council http://www.storageperformance.org/results © 2014 International Business Machines Corporation Revised January 15, 2008 255 Notes on HPC benchmarks and values The IBM benchmarks results shown herein were derived using particular, well configured, development-level and generally-available computer systems. Buyers should consult other sources of information to evaluate the performance of systems they are considering buying and should consider conducting application oriented testing. For additional information about the benchmarks, values and systems tested, contact your local IBM office or IBM authorized reseller or access the Web site of the benchmark consortium or benchmark vendor. IBM benchmark results can be found in the IBM Power Systems Performance Report at http://www.ibm.com/systems/p/hardware/system_perf.html. All performance measurements were made with AIX or AIX 5L operating systems unless otherwise indicated to have used Linux. For new and upgraded systems, AIX Version 4.3 or AIX 5L were used. All other systems used previous versions of AIX. The SPEC CPU2000, LINPACK, and Technical Computing benchmarks were compiled using IBM's high performance C, C++, and FORTRAN compilers for AIX 5L and Linux. For new and upgraded systems, the latest versions of these compilers were used: XL C Enterprise Edition V7.0 for AIX, XL C/C++ Enterprise Edition V7.0 for AIX, XL FORTRAN Enterprise Edition V9.1 for AIX, XL C/C++ Advanced Edition V7.0 for Linux, and XL FORTRAN Advanced Edition V9.1 for Linux. The SPEC CPU95 (retired in 2000) tests used preprocessors, KAP 3.2 for FORTRAN and KAP/C 1.4.2 from Kuck & Associates and VAST-2 v4.01X8 from Pacific-Sierra Research. The preprocessors were purchased separately from these vendors. Other software packages like IBM ESSL for AIX, MASS for AIX and Kazushige Goto’s BLAS Library for Linux were also used in some benchmarks. For a definition/explanation of each benchmark and the full list of detailed results, visit the Web site of the benchmark consortium or benchmark vendor. SPEC http://www.spec.org LINPACK http://www.netlib.org/benchmark/performance.pdf Pro/E http://www.proe.com GPC http://www.spec.org/gpc STREAM http://www.cs.virginia.edu/stream/ Veritest http://www.veritest.com/clients/reports Fluent http://www.fluent.com/software/fluent/index.htm TOP500 Supercomputers http://www.top500.org/ AMBER http://amber.scripps.edu/ FLUENT http://www.fluent.com/software/fluent/fl5bench/index.htm GAMESS http://www.msg.chem.iastate.edu/gamess GAUSSIAN http://www.gaussian.com ABAQUS http://www.abaqus.com/support/sup_tech_notes64.html select Abaqus v6.4 Performance Data ANSYS http://www.ansys.com/services/hardware_support/index.htm select “Hardware Support Database”, then benchmarks. ECLIPSE http://www.sis.slb.com/content/software/simulation/index.asp?seg=geoquest& MM5 http://www.mmm.ucar.edu/mm5/ MSC.NASTRAN http://www.mscsoftware.com/support/prod%5Fsupport/nastran/performance/v04_sngl.cfm STAR-CD www.cd-adapco.com/products/STAR-CD/performance/320/index/html NAMD http://www.ks.uiuc.edu/Research/namd HMMER http://hmmer.janelia.org/ Revised January 15, 2008 http://powerdev.osuosl.org/project/hmmerAltivecGen2mod © 2014 International Business Machines Corporation 256 Notes on performance estimates rPerf for AIX rPerf (Relative Performance) is an estimate of commercial processing performance relative to other IBM UNIX systems. It is derived from an IBM analytical model which uses characteristics from IBM internal workloads, TPC and SPEC benchmarks. The rPerf model is not intended to represent any specific public benchmark results and should not be reasonably used in that way. The model simulates some of the system operations such as CPU, cache and memory. However, the model does not simulate disk or network I/O operations. rPerf estimates are calculated based on systems with the latest levels of AIX and other pertinent software at the time of system announcement. Actual performance will vary based on application and configuration specifics. The IBM eServer pSeries 640 is the baseline reference system and has a value of 1.0. Although rPerf may be used to approximate relative IBM UNIX commercial processing performance, actual system performance may vary and is dependent upon many factors including system hardware configuration and software design and configuration. Variations in incremental system performance may be observed in commercial workloads due to changes in the underlying system architecture. All performance estimates are provided "AS IS" and no warranties or guarantees are expressed or implied by IBM. Buyers should consult other sources of information, including system benchmarks, and application sizing guides to evaluate the performance of a system they are considering buying. For additional information about rPerf, contact your local IBM office or IBM authorized reseller. ======================================================================== CPW for IBM i Commercial Processing Workload (CPW) is a relative measure of performance of processors running the IBM i operating system. Performance in customer environments may vary. The value is based on maximum configurations. More performance information is available in the Performance Capabilities Reference at: www.ibm.com/systems/i/solutions/perfmgmt/resource.html Revised April 2, 2007 © 2014 International Business Machines Corporation 257