2012 R2 Michael Rüefli Cloud Architect INSERTO AG, Switzerland Email: michael.rueefli@inserto.ch Twitter: @drmiru Blog: www.miru.ch • Costs (CapEx) per I/O vs. per GB • Complexity (OpEx) • Performance • Scalability SEQUENTIAL Access RANDOM Access • Storage Spaces • Encryption • Storage Tiering • Big Data (ReFS) • Scaleout File Server • Ease of Management • SMB 3.02 • Automation • Online Deduplication • VHDX Sharing ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE Windows Application Server or File Server Storage Pools and Storage Spaces Physical or virtualized deployments Integrated with other Windows Server 2012 capabilities Windows Virtualized Storage • Virtualization of storage with • Storage resilience and File Server Administration Console Hyper-V Failover Clustering NTFS SMB Direct Cluster Shared Volume NFS Windows Storage Mgmt. SMB Multichannel availability with commodity hardware • Resiliency and data redundancy through n-way mirroring (clustered or unclustered) or parity mode (unclustered) • Utilization optimized through Storage Space Storage Space Storage Space thin and trim provisioning and enclosure awareness • Integration with other Storage Pool Storage Pool Windows Server 2012 capabilities • Serial Attached SCSI (SAS) Physical Storage and Serial AT Attachment (SATA) interconnects (Shared) SAS or SATA Mirror Space Mirror Space Mirror Space Parity Space SIMPLE SPACE 2-Way MIRROR SPACE PARITY SPACE STORAGE POOL Simple Space 2-Way Mirror Space 3-Way Mirror Space Parity Space Dual Parity Space Number of data copies 1 2 3 2 + Parity 3 + Parity Number of columns (default) # Disks # Disks / 2 # Disks / 2 # Disks # Disks Interleafe (default) 256KB 256KB 256KB 256KB 256KB Performance improvements to radically reduce MTTR Rebuild Metric Measurement Data Rebuilt 2,400 GB Time Taken 49 min Rebuild Throughput > 800 MB/s 3TB HDDs, 2-way, 4-column Mirror Space Source: Internal Testing, No Foreground Activity Storage Space New Storage Capabilities with Resilient File System (ReFS) Scale to PetaByte+ ReFS File System Greater compatibility with SATA standards Resilience against power outage corruption Online corruption recovery Implements on-disk structures, such as the Master File Table, to represent files and directories. CONTINUOUS APPLICATION AVAILABILITY CHKDSK NTFS improvements • Seconds to fix corrupted data • Rapid recovery from file system corruption without affecting • availability No offline time when used with CSV • Rapid recovery from file system corruption without affecting availability • Resilient against power outage corruption • Periodic checksum validation of file system metadata • Improved data integrity protection • Ideal for file server volumes • Compatible with CSV • If used as Hyper-V VM Storage, file stream integrity has to be disabled Disk scanning process separated from repair allocate-on-write process •• Data corruption virtually eliminated through Online checksum scanning with volume offline repair •• Period validation ofand file system meta-data • Seamless data integrity protection 400 300 200 100 0 100 Million Files 200 Million Files Windows Server 2008 R2 Source: “Microsoft Internal Testing" 300 Million Files Windows Server 2012 Hot Data Cold Data Hot Data Cold Data Complements Tiering Hyper-V Compute Nodes Seamless Integration & Management Reads/Writes Accumulates Data Activity & WBC Hot Data Cold Data Balanced • Meet • Miss • Miss • Meet • Mix of HDD & SSD • High Capacity HDDs • High Performance SSDs • Best IOPS/$ • Meet • Meet Option Capacity SSD Only (45) 16 TB ~1’000’000 $63,000 19.6 TB ~200’000 $8’000 Mixed (8 + 4) IOPS Cost Hyper-V Hosts 4 Storage Nodes 2 Hyper-V RAM 1,2 TB Storage Capacity (SSD) 700 GB (dual mirroring) Storage Capacity (SAS) 7 TB (dual mirroring Storage Access Protocol SMB3 Multi-Channeling (2 x 10Gbps) Max. write IOPS (8K, 100 % random) / Max. Troughput 180’000 / 1022 MB/s Max. read IOPS (8K, 100% random) / Max. Troughput 220’000 / 1100 MB/s Total CapEx $ 97’000.- >200’000 IOPS >2GB/s Throughput <100K CHF Industry standard commodity storage hardware See www.windowsservercatalog.com under the “Storage Spaces” Category ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE Maximize capacity by removing duplicate data VHD Library • 2:1 with file shares, 20:1 with virtual storage • Less data to back up, archive, and migrate Software Deployment Share Increased scale and performance • Low CPU and memory impact • Configurable compression schedule • Transparent to primary server workload General File Share Improved reliability and integrity User Home Folder (My Docs) • Redundant metadata and critical data • Checksums and integrity checks • Increase availability through redundancy 0% 20% 40% 60% 80% 100% Average savings with Data Deduplication by workload type Source: “Microsoft Internal Testing" Faster file download times with BranchCache • Continuously Available Hyper-V Compute Nodes Storage Platform SMB Mirror SMB Mirror Mirror • Cluster Shared Volume 768Gb/s Shared SAS Links Dual Parity Hyper-V Compute Nodes Mirror Mirror 768Gbps Shared SAS Links SMB SMB SMB Mirror Mirror 768Gbps Shared SAS Links Mirror … Mirror 768Gbps Shared SAS Links Mirror Mirror 768Gbps Shared SAS Links • Top-to-bottom performance analysis and SQL TPC-C transactions/second tuning 4270 (98%) 4315 (100%) 4500 4000 3500 3000 • Windows Server 2012 at 98% of DAS transactional perf 2500 2000 1175 (27%) 1500 1000 500 0 SMB SMB + DAS CONTINUOUS APPLICATION AVAILABILITY • Automatic detection and use of multiple network connections between SMB client and server SMB client NIC • Helps server applications be resilient to network failure • Transparent Failover with recovery of network failure if another connection is unavailable SMB server NIC File copy File copy • Improved throughput • Bandwidth aggregation through NIC Teaming • Multiple nodes/CPUs for network processing with RSS-capable network adapters • Automatic configuration with very little administrative overhead NIC NIC ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE • Higher performance Without With RDMA RDMA File Client File Server App Buffer SMB Buffer SMB Buffer through offloading of network I/O processing onto network adapter • High throughput with low latency and ability to take advantage of highspeed networks (such as InfiniBand and iWARP) • Remote storage at the OS Buffer OS Buffer Driver Buffer Driver Buffer speed of direct storage • Transfer rate of around 50 Gbs on a single NIC port • Compatible with SMB Adapter Buffer *Remote Direct Memory Access NIC rNIC* iWARP InfiniBand rNIC* NIC Adapter Buffer *e.g. Intel® NetEffect™ Server Cluster Adapter Family Multichannel for load balancing and failover ENTERPRISE-CLASS FEATURES ON LESS EXPENSIVE HARDWARE • Highly available, shared Microsoft SQL Server Hyper-V Cluster SMB • Increased flexibility, and Single Logical Server \\Foo\Share easier provisioning and management File Server Cluster • Ability to take advantage of existing network infrastructure Single File System Namespace • No application downtime Cluster Shared Volumes Windows Virtualized Storage Storage Space RAID Array Storage Pool Physical Storage SAN RAID Storage Space Array data store for SQL Server databases and Hyper-V workloads Storage SpaceRAID Array Storage Pool for planned maintenance or unplanned failures with failover clustering • Highly available scale-out file server • Built-in encryption support CONTINUOUS APPLICATION AVAILABILITY • High-performance, continually available fileshares for business critical applications • Support for planned moves, load balancing, operating system restart, unplanned failures, and client redirection (scale-out only) • Resilient for file and directory operations • All servers involved should have Windows Server 2012 Windows Server file server cluster • Failover transparent to server applications with zero downtime and with only a small I/O delay \\foo\share \\foo1\share1 \\foo2\share1 Hyper-V 50% improvement for small IO workloads with SMB over RDMA Performance Increased 8KB IOPs from ~300K IOPS to ~450K IOPS per interface Increased efficiency and density of hosting workloads with small I/O’s such as OLTP database in a VM Efficiency SMB Direct Scale-out File Server Optimizes 40Gbps Ethernet and 56Gbps InfiniBand 50% improvement for small IO workloads VHD \\SOFS\Share2 SMB Share1 Share2 Share1 Share2 Storage Spaces File Server 1 CSV and SMB shares automatically rebalanced Improved network efficiency through drastically reducing redirection traffic File Server 2 IMPROVED PERFORMANCE, MORE CHOICE Offloaded Data Transfer (ODX) Token-based data transfer between intelligent storage arrays Benefits • Rapid virtual machine provisioning and migration • Faster transfers on large files • Minimized latency • Maximized array throughput • Less CPU and network use • Performance not limited by network throughput or server use • Improved datacenter capacity and scale External Intelligent Storage Array Token Virtual Disk Virtual Disk iSCSI Target Server with Network Boot iSCSI network boot Typically used for Hyper-V host boot and HPC boot Rapid deployment Quick recovery Reduce capital expenditures and operating expenditures Ease of management SCVMM VHDX Support SMI-S Support • Provision LARGER (up to 64TB) LUs • Online expand/shrink of LUs • Provision dynamically-growing LUs • Fully manage iSCSI Target Server using SMI-S • Empowers full end-to-end management with System Center Virtual Machine Manager • Standards-based management iSCSI Target Server is highly scalable and flexible using VHDX Manage iSCSI Target Server out-of-the-box with SCVMM iSCSI Target Server delivers a comprehensive management experience iSCSI Target Server Transparent failover support for NFS v3 or 4.1 clients UNIX, Linux, and VMware support New RPC-XDR runtime infrastructure and DLLs make NFS failover faster than ever Backup Server A Read from G Shadow Copy Share Backup File Share Shadow Copy Agent E Backup Agent B Coordinate Shadow Copy Volume Shadow Copy Service Create Shadow Copy C File Share Shadow Copy Provider Application Server D Relay Shadow Copy request Request Shadow Copy Volume Shadow Copy Service Create Shadow Copy F VSS Providers \\fs\foo Data volume File Server \\fs\foo@t1 Shadow Copy IMPROVED PERFORMANCE, MORE CHOICE Workgroup Standard Entry level 50 users Scale up Continuous availability X64 – 32 GB X64 – 2 TB Active Directory Lightweight Directory Services Yes Yes CPU sockets/virtual machines 1+0 2+2 Yes Yes 6, No external SAS Unlimited iSCSI Software Target Yes Yes File sharing (SMB/NFS) Yes Yes Microsoft BitLocker Yes Yes Data Deduplication No Yes Hyper-V No Yes BranchCache – Hosted Cache No Yes Clustering No Yes DHCP, DNS, and WINS No Yes Active Directory DC, Certificate, Federation, Rights Management, Application Server, Network Policy, Terminal Services, WDS, Fax Server No No NAS Segments • Windows Server for NAS appliances that are preconfigured and enterprise ready • Ideal file-based storage solution that is fault tolerant, continuously available, scalable, and cost effective • Workgroup and Standard editions • Multiple vendors Architecture/maximum memory Hardware RAID Disks IMPROVED PERFORMANCE, MORE CHOICE Windows Cluster in a Box ODX SMB Direct Quanta Computer Fujitsu Dell EqualLogic EMC Mellanox HP Intel HP Fujitsu Intel Wiwynn LSI IBM Hitachi Violin Memory HA-DAS.com NetApp NEC Xio Xyratex Chelsio Windows Storage Server 2012 DELL Western Digital Compellent Pivot 3 BOSCH BUFFALO IBM XTORE LACIE Pyramid N-TEC Acma Variel HP MaXXan Unibrain Thomas-Krenn.AG AMAX DNF WINCHESTER SYSTEM NEC AREA CM Broadberry ABERDEEN Storageflex Fujitsu SIEMENS Certified Storage Spaces Hardware High-Performance Servers and Storage http://www.raidinc.com/ http://www.fujitsu.com/fts/ http://www.quantaqct.com/ http://www.dataonstorage.com/ http://www.supermicro.com/ StorSimple's Cloud-integrated Storage (CiS) has been helping customers do this for over a year now and proven it's mettle working in the data centers of large enterprises. CiS on-premises SAN storage exports iSCSI LUNs to servers and connects on the back, or device, side to enterprise cloud storage for storing snapshot, backup, archive and unstructured, dormant data. CiS is a hybrid SAN array having flash SSDs and hard disk layers but it adds a third slower, higherlatency enterprise cloud storage storage layer. It’s 3-tier design is perfectly matched for managing the masses of unstructured data that IT workers wrestle with. SSD A B C A B D E Linear Tier SSD E Deduplicated SAS C D D E Deduplicated Compressed E Cloud Deduplicated Compressed Encrypted Scalability / Performance 7520 20-100TB* usable local 500TB max capacity 5520 10-50TB* usable local 300TB max capacity 7020 4-20TB* usable local 200TB max capacity 5020 2-10TB* usable local 100TB max capacity Capacity * Denotes usable local storage capacity with compression and de-duplication, varies by use case * Additional details about appliance specifications can be found at: http://storsimple.xyratex.com/storsimple/specifications Q&A Thank You! Walter Pitrof Sr. Technology Solution Professional Microsoft Switzerland Email: walterp@microsoft.com Michael Rüefli Cloud Architect INSERTO AG, Switzerland Email: michael.rueefli@inserto.ch Twitter: @drmiru Blog: www.miru.ch