Getting Microsoft Exchange 2010 into the Private Cloud Retain Control of Exchange While Shifting to a New Model for IT Brian Henderson Technical Marketing Manager powerwindows.wordpress.com Q+A: Dustin Smith, Paul Galjan EMC CONFIDENTIAL—INTERNAL USE ONLY 1 Agenda Getting Microsoft Exchange 2010 into the Private Cloud • Virtualization and Private Cloud Review – Industry Trends – Cloud Computing Comparison – Journey to Private Cloud • Exchange 2010 Virtualization and Cloud Best Practices – A 6-Step Process to Virtualize Exchange – Customer Story • Frequently Asked Questions – Storage – Replication – Backups EMC CONFIDENTIAL—INTERNAL USE ONLY 2 Industry Trends …or Virtualization? Verticalization Exchange SharePoint Exchange, SharePoint ,SQL Server SQL Server Application Application Applications Middleware Middleware Middleware Applications Middleware Database Database Database Operating System Operating System Operating System Database Server Server Server Storage Storage Storage Operating System Virtual Infrastructure CPU Pool “End to end” stack EMC CONFIDENTIAL—INTERNAL USE ONLY Storage Pool Network Best of breed 3 HUB/CAS Why Virtualize EDGE Exchange Aging, Physical Infrastructures • Inefficient Servers – Inefficient processor types – Putting out too many BTU’s – Excess power/cooling • Inefficient Management – Slow provisioning – Separate tools • Inefficient Disaster Recovery – Inconsistent backup/DR – Separate tools • High Cost of Ownership MAILBOXES WEB SERVERS APPLICATION SharePoint SQL DATABASES ACTIVE DIRECTORY Basic Infrastructure DHCP & DNS Test/Dev SANDBOX EMC CONFIDENTIAL—INTERNAL USE ONLY 4 After Virtualization Virtualized Components • Reduce physical servers • Increase utilization • Slash power/cooling bills • Save rack space • Provision servers faster • Consolidate protection strategies Exchange Gain speed and agility Improve service levels Decrease overall costs EMC CONFIDENTIAL—INTERNAL USE ONLY SharePoint Infrastructure & Test/Dev 5 Cloud Computing EMC CONFIDENTIAL—INTERNAL USE ONLY 6 Cloud Computing Comparison Private Cloud versus Public Clouds Concerns • • • • • • • • • Security Compliancy Manageability Customization Integration Features Service Levels Architecture Support • • • Security In Public Cloud Most Concerning By Factor Of 3* 70% Will Spend More On Private Cloud Through 2012 Only 8% Spend More On Public Cloud Public Private Off-Premises On-Premises * (Gartner Note: G00200440, 2009 DC Conf Polls) EMC CONFIDENTIAL—INTERNAL USE ONLY Control 7 Benefits of Private Cloud Control, Choice, Efficiency Hybrid Cloud Federation Private Cloud Virtualization Information Public Cloud Security On-Premises EMC CONFIDENTIAL—INTERNAL USE ONLY Third-Party 8 Getting to The Cloud While Retaining Control Private 2 1 Distributed Virtualized Virtual SQL Virtual 3 Public Virtual SharePoint Exchange SQL SharePoint Exchange YESTERDAY EMC CONFIDENTIAL—INTERNAL USE ONLY TODAY TOMORROW 9 Comparing Approaches Getting from Your Current Architecture to Tomorrow Option A Current Service Providers Option B. EMC Current 1 Security Compliancy Manageability Customization Good Bad Good Bad 2 Security Compliancy Manageability Customization Good Good Good Good 3 Security Compliancy Manageability Customization Bad Bad Bad Bad 4 Security Compliancy Manageability Customization Good Bad Good Bad Private Public EMC CONFIDENTIAL—INTERNAL USE ONLY Choices 10 Example: Managed Private Clouds EMC Consulting Offers Additional Cloud Options What if you could get hosted Exchange without compromise in features and functionality? Security Compliancy Manageability Customization On-premises EMC CONFIDENTIAL—INTERNAL USE ONLY Good Good Good Good Off-Premises 11 The Journey to the Private Cloud EMC CONFIDENTIAL—INTERNAL USE ONLY 12 The Journey to the Private Cloud Microsoft Exchange View 1 2 Virtualize Test/Dev and Network Infrastructure B Sandbox Environments AD, DNS, DHCP Legacy Systems (NT, W2000) EMC CONFIDENTIAL—INTERNAL USE ONLY 3 Virtualize Exchange Server Roles First, “Low Requirement” Roles (Everything but Mailbox Servers) Then “High Requirement” Roles (Mailbox Servers) Create Automated Processes Based on Virtualized Layers Dynamic Provisioning of Server, Storage, and Networking Resources Policy-based Management and Chargeback Reporting 13 The Journey to the Private Cloud Guidance to Get You There Faster 1 2 Techbooks Whitpapers Proven Solutions 3 Techbooks Whitepapers Proven Solutions Whitepapers Proven Solutions VBlock B EMC Consulting EMC CONFIDENTIAL—INTERNAL USE ONLY 14 Exchange 2010 Virtualization and Cloud Best Practices EMC CONFIDENTIAL—INTERNAL USE ONLY 15 Exchange 2010 Improvements Changes and Enhancements Storage Engine • Changed schema, page size • Accommodates larger mailboxes • 70% reduction in IOPS Database Replication • Database Availability Groups • Built into Exchange 2010 • Uses Clustering, Log-Shipping EMC CONFIDENTIAL—INTERNAL USE ONLY Server 1 Server 2 Server 3 DB1 DB2 DB3 copy copy copy copy copy copy LAN-Based Log-Shipping Updates Copies Clustering Controls Failover Functionality 16 Microsoft Exchange – Detailed Differences Exchange Server 2007 Standard Server Exchange Server 2007 Enterprise Server Exchange Server 2010 Standard Server Exchange Server 2010 Enterprise Server 1-5 SG’s 1-50 SG’s Discontinued Discontinued Mailbox Databases 1-5 1-50 1-5 1-100 Single Copy Cluster (SCC) No Yes Discontinued Discontinued Standby Continuous Replication (SCR) Yes Yes Discontinued Discontinued Local Continuous Replication (LCR) Yes Yes Discontinued Discontinued Cluster Continuous Replication (CCR) Yes Yes Discontinued Discontinued Database Availability Groups (DAG) No No Yes Yes Single Instance Storage Yes Yes Discontinued Discontinued Extensible Storage Engine (ESE) streaming based backup Yes Yes Discontinued Discontinued Volume Shadow Copy Service (VSS) based backup Yes Yes Yes Yes Recovery Storage Group (RSG) Recovery Storage Group (RSG) Recovery Database (RDB) Recovery Database (RDB) Feature Storage Groups Mailbox Recovery EMC CONFIDENTIAL—INTERNAL USE ONLY 17 Virtualizing Exchange 2010 CAS Hub Mailbox UM EMC CONFIDENTIAL—INTERNAL USE ONLY Exchange 2010 Role Virtual or Physical? Active Directory Servers Virtual Client Access Server (CAS) Virtual Hub Transport Server (HT) Virtual Mailbox Server Virtual Unified Messaging (UM) Physical MS Guidelines for Exchange 2010 Virtualization http://technet.microsoft.com/en-us/library/aa996719.aspx 18 A 6-Step Process to Virtualize Exchange Measure Design Prepare Install Pilot / Test Go Live EMC CONFIDENTIAL—INTERNAL USE ONLY 19 Measure or Estimate Workload Measure Workload with ExSPA Measure Use the Microsoft Exchange Server Profile Analyzer to collect information from your current environment. Design Prepare Install Pilot / Test Go Live EMC CONFIDENTIAL—INTERNAL USE ONLY Example: •1 physical location •16,000 users •Mailbox profiles •Average - 10 messages sent/40 received per day •Average message size of 50KB •500MB mailbox quota 20 Measure or Estimate Workload Storage Building Block Formula Measure Knowing User Profiles, Define Mailbox Server VMs, Using the Formula Design (IOPs * %R) + WP (IOPs * %W) Prepare Install Pilot / Test = Required Physical Disks Physical Disk Speed Where is IOPS the number of input/output operations per second %R the percentage of I/Os that are reads (60%) %W the percentage of I/Os that are writes (40%) WP the RAID write penalty multiplier (RAID 1=2, RAID 5=4) Physical Disk Speed 180 for 15k rpm drives or 140 for 10k rpm drives, 80 for 7.2K Go Live EMC CONFIDENTIAL—INTERNAL USE ONLY 21 Design the Virtual Machines http://www.emc.com/collateral/solutions/white-papers/h7018-exchange-vmax-vp-vsphere-wp.pdf Example: Designing a Building Block Measure Design Prepare Install Pilot / Test Go Live Microsoft Exchange 2010 Efficiency, Flexibility, Performance, and Availability emc.com/exchange EMC CONFIDENTIAL—INTERNAL USE ONLY 22 Design the Virtual Machines Example: Designing a Building Block Measure Design Mailbox Servers Prepare Install Pilot / Test Go Live EMC CONFIDENTIAL—INTERNAL USE ONLY Storage Volumes Mailbox Server Building Block Number of mailboxes supported Virtual machine OS Virtual machine memory Virtual machine CPU Mailbox I/O profile Mailbox size limit Server under test CPU type on test system Value 2,000 Windows 2003 x64 R2 SP2 12 GB 2 vCPU 0.48 (Heavy) 350 MB 16 core/128 GB RAM Intel Xeon 7350 Block Users Production Disks Clone disks 1 2,000 12 disks (8 DB, 4 log) 6 disks 2 4,000 22 disks (16 DB 6 log) 12 disks 3 6,000 32 disks (24 DB 8 log) 18 disks 4 8,000 44 disks (32 DB 12 log) 24 disks 5 10,000 54 disks (40 DB 14 log) 30 disks 23 Prepare Virtual Management Measure Design • Networking. Storage. vCenter. Lab Mgr • VMotion. HA. DRS. DPM. Prepare Install Pilot / Test Go Live EMC CONFIDENTIAL—INTERNAL USE ONLY 24 Install Microsoft Applications Measure Design Prepare Install Pilot / Test Go Live EMC CONFIDENTIAL—INTERNAL USE ONLY • Install Microsoft Applications/Databases and Move Mailboxes •Deployment Steps Microsoft Exchange Deployment Guide – – – – Install Client Access Server(s) Prepare Schema Install Hub Transport(s) Install Mailbox Server(s) • Use the Exchange Best Practices Analyzer – ExBPA scans for routine configuration errors 25 Test and Pilot Measure Design • Test Disk IO with JetStress, Loadgen* • Look for Reference Architectures that are similar to your configuration Prepare DAS or SAN? Install Pilot / Test We’re testing both. efficiency Midrange= SAN VMAX Iomega For large-scale AX4 ForApprox small, low-cost = DAS Approx 250 users 2000 users Approx 80,000 users Up to 100,000+ users Go Live EMC Proven Solutions Reference Architectures EMC CONFIDENTIAL—INTERNAL USE ONLY 26 Go Live. Keep Tabs on Performance. Measure Design Subsystem esxtop Counters CPU %RDY %USED vSphere Counters Memory %ACTV SWW/s SWR/s Active Swapin Swapout Storage ACTV DAVG/cmd KAVG/cmd Network MbRX/s MbTX/s Commands deviceWriteLatency & deviceReadLatency kernelWriteLatency & kernelReadLatency packetsRx packetsTx Prepare Install Pilot / Test Ready Usage Go Live EMC CONFIDENTIAL—INTERNAL USE ONLY 27 Customer Success: Sherweb Exchange 2010 Hosting Provider • Challenge – Providing mail services for 60,000 users while keeping management of a large scale storage infrastructure under control – Competition offering large mailboxes (20 – 30GB) for lower cost • Solution – EMC Consultant analyzed environment and provided a recommendation based on EMC Proven Solutions testing results and TCO analysis over 5 years – EMC CLARiiON CX4-480, SATA, Thin Provisioning, DAGs • Benefits – EMC CLARiiON CX4-480 scales to nearly one petabyte of capacity – EMC CLARiiON with 2TB SATA drives offer competitive cost per mailbox – Thin Provisioning technology allows customer to “pay as they grow” instead of overpaying for storage upfront – Virtual servers can be deployed in hours instead of weeks For more information please visit: www.emc.com/exchange EMC CONFIDENTIAL—INTERNAL USE ONLY 28 Frequently Asked Questions EMC CONFIDENTIAL—INTERNAL USE ONLY 29 Q: Should I Use DAS or SAN Storage? A: Either one will work. DAS or SAN? DAS or SAN? We’re testing both. We’re testing both. For small, low-cost = DAS For large-scale efficiency = SAN Best long-term TCO = SAN Virtualization ready = SAN 1. 2. 3. 4. 5. 6. 7. 8. For large-scale efficiency = SAN AX4 low-cost Midrange IomegaFor small, = DASV-Max Approx 250 users Approx 2000 users Approx 80,000 users Up to 100,000+ users First understand your workload including Background Database Maintenance Protocol: Consider your requirements and choose accordingly Disk: Most common for Exchange 2010 10K FC and 7.2K SATA RAID5 or 6 Formatting and alignment considerations – Windows 2008 is better Consider thin provisioning for SAN deployments Use the Microsoft Storage Calculator as a starting point We walk you through how we design storage for Exchange Use scalable building blocks: X users fit on Y disks. EMC CONFIDENTIAL—INTERNAL USE ONLY 30 Dynamic Capacity Management using EMC Virtual Provisioning Functionality DAS SAN (EMC Virtual Provisioning) 5000 Exchange users x 5GB Mailboxes 5000 Exchange users x 1GB Mailboxes 25 TB 5 TB In DAS world, people Instead, buy the right size, overbuy capacity and pay as you grow with EMC’s virtual provisioning. all the time EMC CONFIDENTIAL—INTERNAL USE ONLY 31 Automated Performance Management with EMC Fully Automated Storage Tiering (FAST) DAS SAN (Fully Automated Storage Tiering) Flash In DAS world, performance problems are solved by adding more disk EMC CONFIDENTIAL—INTERNAL USE ONLY SATA Cloud future Today’s EMC storage array can automatically adjust the workload for you 32 Do I have to use Database Availability Groups? A: No Replication Method Should we use DAGs? TIME Recovery Point Objective (RPO) Potential data loss Recovery Time Objective (RTO) Time to recover full service Sure, but other options are available Synchronous Off-Host Replication Synchronous Replication Multi-App Continuous Protection Virtualization-Centric Options Asynchronous No loss Minutes Asynchronous point in time Seconds to minutes Minutes to hours Minutes to hours Hours/day 1. DAG’s are a good technology, but not perfect • • • • 2. Requires high degree of Exchange knowledge WAN Link Challenges and costs for DAG replication and RTO’s Can be costly: 3 Copies minimum, Enterprise edition required Host/network usage and reseeds can be an issue – careful planning needed Use Other Methods for Synchronous Replication, Virtualization-Centric Options • • • • Exchange 2010 Synchronous API (EMC unique) DAG’s use storage block-level replication technology instead of log shipping! EMC RecoverPoint (Bandwidth reduction, multi-app, continuous replication) Virtualization Centric options provides standardized virtual machine DR EMC CONFIDENTIAL—INTERNAL USE ONLY 33 Obtain a Single, Standardized Protection Scheme Remote Protection Local HA Virtual Virtual Virtual SQL Server Oracle Exchange Virtual SQL Server Virtual Oracle Virtual Any SAN Exchange EMC RecoverPoint with VMware SRM EMC’s RecoverPoint Replication Product • works in physical or virtual environments, • replicates from any SAN to any SAN, • reduces bandwidth costs and usage by 5-10X EMC CONFIDENTIAL—INTERNAL USE ONLY 34 Q: Do we still need backups? A: Yes, most likely. Why backups? DAG logs need to be truncated. Operational and long-term restores. Retain your existing processes. Corruption, viruses, human error. 1. 2. 3. 4. 5. Backup Restore Tape Backup Restore Disk Clone B R Backup/restore speeds First finalize your storage architecture. Prioritize your backup and restore speeds (RPO, RTO). Consider the costs and licensing options. Try a layer of disk – there are much better options than tape. Consider advanced options like deduplication and cloning. EMC CONFIDENTIAL—INTERNAL USE ONLY 35 Getting to The Cloud While Retaining Control Private 2 1 Distributed Virtualized Virtual SQL Virtual 3 Public Virtual SharePoint Exchange SQL SharePoint Exchange YESTERDAY EMC CONFIDENTIAL—INTERNAL USE ONLY TODAY TOMORROW 36 Thank You! • Join us every Thursday at 11:00 AM ET for our EMC Solutions for VMware Webcast Series • SherWeb Customer Story http://www.emc.com/collateral/customer-profiles/h7240-sherweb-cp.pdf • My Blog - http://powerwindows.wordpress.com/ • Private Cloud - http://www.privatecloud.com/ • Dustin Smith’s Exchange In the Private Cloud http://exchangeintheprivatecloud.wordpress.com/ • Paul Galjan PerfCollect – http://powerwindows.wordpress.com/2010/07/13/automating-perfmon-with-perfcollect/ EMC CONFIDENTIAL—INTERNAL USE ONLY 37