HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013
Technical white paper
HP MSA 2040 Array 750 Mailbox
Resiliency Exchange 2013
Storage Solution
Table of contents
Mailbox configuration – primary site offline and single server failure at Disaster Recovery site
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Overview
This document provides information on an HP MSA 2040 LFF Disk Array and HP ProLiant DL380p Gen8 server with HP
SN1000E 16Gb 2-port PCIe Fibre Channel Host Bus Adapters storage solution for Microsoft® Exchange Server 2013
(Exchange), based on the Microsoft Exchange Solution Reviewed Program (ESRP) –Storage program*. For any questions or
comments regarding the contents of this document, see the For more information section.
* The ESRP – Storage program was developed by Microsoft Corporation to provide a common storage testing framework for vendors to provide information on its storage solutions for Microsoft Exchange Server software. For more details on the
Microsoft ESRP – Storage program, see: http://technet.microsoft.com/en-us/exchange/ff182054.aspx
Tested with: ESRP – Storage Version 4.0
Test Date: May 2013
Disclaimer
HP produced this document independently of Microsoft Corporation. Microsoft Corporation expressly disclaims responsibility for, and makes no warranty, express or implied, with respect to the accuracy of the contents of this document.
Features of the tested solution
This solution implements the Database Availability Group (DAG) mailbox resiliency feature found in Microsoft Exchange
Server 2013 (Exchange). This feature is the base component of the high availability and site resilience framework built into
Exchange. A DAG is a group of up to 16 mailbox servers that hosts a set of databases and provides database-level recovery from failures that affect individual servers or databases.
This solution brief describes a tested configuration for deploying Exchange in a 750-user mailbox resilient environment. The performance results and best practices outlined in this document provide tested guidelines for configuring Exchange with the HP MSA 2040 LFF Disk Array and HP ProLiant DL380p Gen8 servers in a SAN storage solution.
This solution used a single DAG to support 750 mailboxes, each with a 5 GB mailbox capacity and a work profile of 200 messages sent and received for each user, each day. To provide mailbox resiliency, there are four copies of each database; two copies located at the primary site and two copies located at the disaster recovery site.
The primary site hosts all 750 users during normal operations. The performance results outlined in this paper are from the
Note
HP has developed the HP Sizer for Microsoft Exchange Server 2013 to assist customers with proper server and storage sizing for their Exchange Server 2013 deployments. The algorithms developed and implemented in this tool originate from extensive testing of Exchange Server 2013 server roles and technologies, HP’s deep experience with Microsoft Exchange, and intricate knowledge of server CPU, memory, and I/O subsystems. Designed to simplify configuration across a broad range of deployments, this tool is free to download and use. For more information, visit: hp.com/solutions/microsoft/exchange2013/sizer
HP MSA 2040 Array overview
The HP MSA 2040 Array shown in Figure 1 provides an excellent value for customers needing increasing performance to support initiatives such as consolidation and virtualization. The MSA 2040 delivers this performance by leveraging new controller architecture with a new processor, four 8Gb or 16Gb Fibre Channel (FC) ports with 4GB cache per controller and using drive technologies such as SSDs. The new MSA Storage ships standard with 64 Snapshots and Volume Copy enabling increased data protection and supporting replication with optional Remote Snap software. The HP MSA 2040 Array is ideal for companies with small budgets or limited IT expertise, and benefits larger companies with departmental or remote requirements. The array is easy to deploy and secure, with low management costs, enabling a rapid return on investment through efficient storage consolidation.
2
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Figure 1: Front view of the HP MSA 2040 Storage (LFF)
Key features and benefits
Easily managed, highly affordable, highly efficient, and flexible storage consolidation
• Delivers low cost, consolidate storage array solutions to meet departmental and small-to-midsize business requirements with one or two 4-port 16Gb/8Gb Fibre Channel controllers with 4GB cache per controller.
• Offers single controller models for low initial investment, or dual controllers for higher data protection. The FC controller allows sharing of resources between different departments with the most cost-effective protocol. A wide choice of drive types means a high return on investment (ROI).
• Offers a choice of drives: high-performance and high-speed SSD drives, enterprise-class SAS, and SAS Midline drives. The array head comes with either 12 (LFF) or 24 (SFF) drive bays, able to accommodate all three-drive types.
• Ships standard with 64 snapshot and Volume Copy cloning capability enabled, optionally increase snapshots to 512 snaps.
• All HP MSA 2040 Array controller models support the Remote Snap (replication) software option.
Start small and grow in number of supported servers and total capacity – adaptable to changing needs
• Grow storage as demands increase up to a raw capacity of 288TB with 3TB LFF drives. The HP MSA 2040 Array can support 8 LFF enclosures and 96 drives, or 8 SFF enclosures and 192 drives. Single or dual controllers accommodate any budget.
• Powerful new controllers and 4GB of read/write cache each provide support for up to 64 hosts. The latest 16Gb Fibre
Channel means that users will have fast, reliable, and affordable access to their data.
• With 512 LUNs and max volume size of 64TB, the HP MSA 2040 Array has more than sufficient LUN flexibility for a wide variety of configuration choices.
• Large Form Factor configurations can scale up to 36TB SAS MDL, expandable to 288 TB SAS MDL with the addition of a maximum of seven MSA 2040 3.5-inch Disk Enclosures.
• Small Form Factor configurations can scale from 24TB SAS MDL. With the addition of seven D2700 JBODs, the MSA 2040 storage can support 199TB SAS MDL.
• Users may configure a 24-drive MSA 2040 array head with 12-drive LFF MSA 2040 3.5-inch disk enclosures. Excellent method for a configuration that supports high-speed SFF SSDs or fast SFF enterprise-class SAS drives in the array head, combine with economical LFF drives staged for archival purposes, all in the same array.
Comprehensive data protection in an easily administered SAN environment
• Reduces risk of IT failure with built in dual active/active controllers, dual-ported drives, and redundant hardware components.
• Increases data protection with HP MSA 2040 Array standard 64 Snapshot (optional 512) and Volume Copy software, allows space-efficient, copy-on-write snapshots and clones. Optional Remote Snap (replication) is available with the Fibre
Channel model.
• Reduces deployment time with easy and secure configuration, which reduces operator errors, resulting in less downtime and data loss, while increasing customer satisfaction.
• Supports data-in-place upgrades, protecting the user’s investment in JBODs and drives, enhancing performance and functionality.
• Intelligently creates and manages application specific snapshots that can be used to quickly restore application instances or databases using HP Recovery Manager Software. Recovery Manager is integrated with Microsoft Volume Shadow Copy
Service (VSS) to make non-disruptive point-in-time copies of Microsoft Exchange for constant data protection.
3
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
For more details on the features and offerings of the HP MSA 2040 Array, visit the following site or contact your HP sales representative: hp.com/go/msa
HP ProLiant DL380p Gen8
With innovations in performance, feature flexibility, and management capabilities, the HP DL380p Gen8 rack server shown in Figure 2 is an unmatched data center investment, which can handle today’s demanding computing requirements.
Redefining the customer experience with HP Proactive Insight architecture
• Prevent data loss, reduce downtime, and improve serviceability with included HP SmartDrives, HP Smart Socket guides,
"Snap and Go" rail kit options, and tool-less access to components.
• Provides intuitive system management with simplified provisioning, proactive health monitoring and alerting, and automated firmware and system software maintenance using Integrated Lifecycle Automation.
• Dynamic Workload Acceleration converges storage, compute, and I/O to turbo-charge performance and resiliency while eliminating bottlenecks.
• Reclaims space, power, and cooling resources needed for workloads and extends your data center capacity with
Automated Energy Optimization.
• Enables industry leading performance, uptime, and productivity integrated into a personalized, simplified support experience with HP support services.
Unlock your infrastructure’s potential with HP’s easy-to-use integrated management and support
• Complete set of embedded features, standard on all ProLiant Gen8 servers, including HP iLO, HP Agentless Management,
HP Active Health System, HP Intelligent Provisioning, and HP Embedded Remote Support using HP iLO Management
Engine.
• Provides 24X7 remote monitoring and anywhere, anytime personalized access to your IT and support status with HP
Insight Online and HP Insight Remote Support.
• Reduces deployment time and update complexity by systematically updating server infrastructure in the data center. It includes HP Smart Update Manager (HP SUM), Service Pack for ProLiant (SPP), and other products using HP SmartUpdate.
• Provides advanced management capabilities across the lifecycle of your HP ProLiant server infrastructure with HP Insight
Control. HP iLO Advanced, a key component, provides enhanced remote server functions that reduce IT travel costs and decrease resolution time.
Improved capacity and performance on compute and storage
• Prevents data loss and downtime with enhanced error handling, while improving workload performance and power efficiency with HP SmartMemory.
• Improves serviceability and prevents data loss with features such as icon-based status display and Do Not Remove LED with HP SmartDrive technology.
• Offers maximum performance, memory, I/O connectivity, and bandwidth for demanding workloads with the Intel® Xeon® processor E5-2600 product family.
Energy efficiency by design
• Includes a 3D array of temperature sensors that help precisely control server fans to direct cooling and reduce unnecessary fan power, saving on cooling costs.
• High efficiency 80+ certified HP Common Slot Power Supplies provide up to 94% efficiency (Platinum) and support HP’s
Power Discovery Services.
• ENERGY STAR® qualified server configurations illustrate HP’s continued commitment to helping customers conserve energy and save money.
Figure 2: HP ProLiant DL380p Gen8 rack server
4
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
HP StoreFabric SN1000E 16Gb Host Bus Adapter
The HP ProLiant DL380p Gen8 servers are configured with the HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bus
Adapter as shown in Figure 3. The SN1000E is backwards compatible with 8 and 4Gb storage networks and protect future investments. With the ability to deliver twice the I/O performance of 8Gb FC HBAs the SN1000 16Gb HBAs take storage networking performance and efficiency to the next level.
Features
• Delivers twice the I/O performance of the 8Gb Fibre Channel HBAs.
• Provides the infrastructure required for the more powerful servers and data intensive applications of the future by moving to 16Gb technology.
• Enables faster storage and retrieval of data with improved I/O performance when using storage intensive applications like backup/restore and database transactions.
• Provides an HP-branded HBA solution that has undergone extensive HP interoperability testing for connecting HP
ProLiant servers into storage and networking environments.
• Enables more applications to run on a single server and Fibre Channel port, resulting in reduced cabling and a higher return on IT investment.
Figure 3: HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bus Adapter
Solution description
This solution brief provides best practices to help administrators implement an Exchange deployment with the following requirements:
• 750 mailbox users
• 0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom)
• 5 GB mailbox
• A single Database Availability Group (DAG) deployment with two mailbox servers in the primary site and two mailbox servers in the disaster recovery site, for a total of four mailbox servers across the entire solution
• Four copies of each mailbox database (one active / three passive)
• Four databases per server (two active and two passive) at the primary site and eight passive database copies at the disaster recovery site)
• Background Database Maintenance (BDM) enabled
• Designed for server and site resiliency
• 16 2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL Hard drives per array for the Exchange databases and transaction logs
•
Storage deployed as RAID-1 Vdisks. See the Storage configuration section for more information
5
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Storage configuration
The recommended best practice for site and server resiliency is two ProLiant DL380p servers and one HP MSA 2040 LFF
Disk Array connected to a dual-I/O module MSA 2040 drive enclosure at each site. The array and enclosure each contain eight 2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL hard drives for a total of 16 drives. For storage performance and redundancy, connect the HP ProLiant DL380p servers using two HP SN1000E HBA cards in each server to both controllers of the HP MSA 2040 Array in SAN mode. The HP MSA 2040 Array uses 16 disks for Exchange database and transaction logs.
The Exchange restore volumes are located on the servers. This highly available, load-balanced configuration has four databases per server on the primary site, two active and two passive during normal operations. Figure 4 illustrates the hardware used in this solution at the primary site.
Figure 4: Rack mounted view of the HP MSA 2040 Array and the HP ProLiant DL380p servers, cabled in a dual-path, SAN configuration at the primary site.
15K
SAS
15K
300 GB
15K
SAS
15K
SAS
15K
SAS
1
3
4
3 4
1
2
1
2
3 7
8
5
6
1 2
PS1
PS2 POWER
CAP
NIC
OVER
TEMP
3 4
AMP
STATUS
DIMMS
2 PROCS
2 4 6 8 10 12
1
2 4 6 8 10 12
1 3 5 7 9 11
FANS 1 2
1 3 5 7 9 11
3 4 5 6
UID
ProLiant
DL380p
Gen8
7
8
5
6
1 2
PS1
PS2
POWER
CAP
NIC
OVER
TEMP
3 4
AMP
STATUS
DIMMS
2 PROCS 1
2 4 6 8 10 12
1 3 5 7 9 11
FANS
1 2
1 3 5 7 9 11
3 4 5 6
UID
ProLiant
DL380p
Gen8
HP
MSA 2040
4
UID
7 10
12
HP
MSA 2040
UID
7 10
12
4
1
2
3
4
1
2
3
1
1
4
5
6 iLO
4
5
6 iLO
UID
PS1
PS2
TOP
UID
PS1
PS2
TOP
4
2
PORT 1 PORT 2 PORT 3 PORT 4
CLI
SERVICE-2 CLI ACT LINK SERVICE-1
PORT 1 PORT 2 PORT 3 PORT 4
CLI
SERVICE-2 CLI ACT LINK SERVICE-1
CACHE
6Gb/s
LINK
CACHE
6Gb/s
LINK
5
PORT 1 PORT 2
CLI
6Gb/s
PORT 3
SERVICE-2 CLI ACT
LINK
LINK
IN
SERVICE-1
6Gb/s
OUT
CACHE
LINK
6Gb/s
LINK
PORT 1 PORT 2
6Gb/s
CLI
PORT 3
SERVICE-2 CLI ACT
LINK
LINK
6Gb/s
OUT
CACHE
LINK
6Gb/s
LINK
1.
HP MSA 2040 Array with eight (8) 2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL Hard drives
2.
Dual-I/O module HP MSA 2040 Drive Enclosure with eight (8) 2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL Hard drives
3.
Two (2) HP ProLiant DL380p Gen8 servers with HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bust Adapters
4.
Primary and secondary paths from the HP MSA 2040 Array to the ProLiant servers
5.
Mini-SAS cables from the HP MSA 2040 Controller to the drive enclosure
The tested building block, a single HP ProLiant DL380p server connected to the HP MSA 2040 LFF Array demonstrates a worst case scenario; the failure of the primary site and one of the two servers in the disaster recovery site. Despite this catastrophic failure scenario, the single server can host four active databases; and continues to pass all tests. See Figure 5.
Figure 5: Rack mounted view of the tested configuration. An HP MSA 2040 Array and an HP ProLiant DL380p server, cabled in a dual-path configuration.
15K
SAS
2
1
3
4
1
2
7
8
5
6
PS1
PS2 POWER
CAP
NIC
1
OVER
TEMP
2 3
AMP
STATUS
4
2 PROCS 1
2 4 6 8 10 12
1 3 5 7 9 11
FANS 1 2
1 3 5 7 9 11
3 4 5 6
UID
ProLiant
DL380p
Gen8
HP
StorageWorks
P2000
UID
1 4 7 10
3 6 9 12
3
4
1
2
3
1
4
5
6 iLO
LINK
ACT
SAS 1 SAS 2
LINK LINK
ACT ACT
CLI
SAS 3
LINK
SAS 4
SERVICE
ACT
LINK
10/100 BASE - T
ACT
LINK
ACT
SAS 1 SAS 2
LINK LINK
ACT ACT
CLI
SAS 3
LINK
SAS 4
SERVICE
ACT
LINK
10/100 BASE - T
ACT
CACHE
ACTIVITY
CACHE
ACTIVITY
LINK
LINK
UID
PS1
PS2
TOP
3
6
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
1.
HP MSA 2040 LFF Disk Array with eight (8) 2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL Hard drives
2.
One HP ProLiant DL380p Gen8 server with HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bust Adapters
3.
Primary and secondary paths from the HP MSA 2040 Array to the ProLiant server
Mailbox configuration – primary site operational
Figure 6 shows the mailbox layout for active and passive database copies when the primary site is operational. This solution brief provides best practices to help administrators implement the Exchange deployment, with the following requirements:
• 750 mailbox users
• 0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom)
• 5 GB mailbox size
• Each mailbox server in the primary site hosts four database copies (two active and two passive).
• Each mailbox server in the disaster recovery site hosts four database copies (four passive)
• Background database maintenance (BDM) enabled
Figure 6: Normal operation with all mailboxes hosted at the Primary Site.
Active Database
Passive Database
Primary Site
MBX1 MBX2
Disaster Recovery Site
MBX3 MBX4
DAG
DB1
DB2
DB3
DB4
DB1
DB2
DB3
DB4
DB1
DB2
DB3
DB4
DB1
DB2
DB3
DB4
7
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Mailbox configuration – primary site unavailable (planned or unplanned)
Figure 7 shows the mailbox layout for active and passive database copies when the primary site is unavailable due to a planned or unplanned event. This solution brief provides best practices to help administrators implement the Exchange deployment, with the following requirements:
• 750 mailbox users
• 0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom)
• 5 GB mailbox size
• Primary site’s database copies are unavailable due to a planned or unplanned event
• Each mailbox server in the disaster recovery site hosts four database copies (two active and two passive)
• Background database maintenance (BDM) enabled
Figure 7: Primary site unavailable with all mailboxes hosted on Disaster Recovery Site.
Active Database
Passive Database
Primary Site
DAG
MBX1 MBX2 X X
DB1 DB1
Disaster Recovery Site
MBX3 MBX4
DB1
DB1
DB2 DB2
DB2
DB2
DB3 DB3 DB3 DB3
DB4 DB4 DB4
DB4
8
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Mailbox configuration – primary site offline and single server failure at Disaster
Recovery site (planned or unplanned)
Figure 8 shows the tested mailbox layout for active database copies when the primary site and one of the servers in the disaster recovery site are unavailable due to a planned or unplanned event. This solution demonstrates the worst-case scenario with one host in the disaster recovery site hosting four active databases, with the following requirements:
• 750 mailbox users
•
•
0.16 IOPS workload per user (200 messages sent and received per user, per day, with an additional 20% headroom)
5 GB mailbox size
• Primary site’s database copies and one of the two servers at the recovery site are unavailable due to a planned or unplanned event
• The mailbox server in the disaster recovery site hosting four database copies (four active)
• Background database maintenance (BDM) enabled
Figure 8: Primary site unavailable and single server failure at Disaster Recovery Site.
Active Database
Passive Database
Primary Site
DAG
MBX1 MBX2 X X
DB1 DB1
Disaster Recovery Site
MBX4
DB1
MBX3 X
DB1
DB2 DB2 DB2 DB2
DB3 DB3
DB3 DB3
DB4 DB4
Tested deployment
The following tables summarize the tested environment.
DB4 DB4
9
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Simulated Exchange configuration
Number of Exchange mailboxes simulated
Number of Database Availability Groups (DAGs)
Number of mailbox servers per DAG
Number of active mailboxes per server
Number of databases per server
Number of copies per database
Number of active mailboxes per database
Simulated profile: I/O operations per second per mailbox
(IOPS, include 20% headroom)
Database and Log LUN size
Total database size for performance testing
Background database maintenance (BDM)
% formatted storage capacity used by Exchange database
750
1
4
375 (normal operations)
750 (site failover and a single server offline)
4
4 (1 active / 3 passive)
188
0.16
1TB
4 TB
Tested with 24/7 BDM enabled
55%
Total DB size/Total Formatted capacity
4TB/7.24TB
Storage hardware
Storage Connectivity
Storage model and firmware version
Storage cache
Number of storage controllers per server
Number of storage ports
Maximum bandwidth of storage connectivity to host
HBA model and Firmware Version
Number of HBAs
Host server type
Total number of disks tested in solution
Maximum number of spindles that can be hosted in the tested configuration
* RAID1 for the Mailbox database and logs
Fibre Channel
HP MSA 2040 Array
Firmware Version: GL100R002
4 GB per controller
2
Four x 16/8Gb FC ports per controller
8 x 16Gb/s
HP SN1000E 16Gb 2P FC HBA
Firmware Version: 1.1.21.8
Driver Version: 2.74.009.001
2 per host
HP ProLiant DL380p Gen8
8*
12
10
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Storage software
HBA Driver
HBA QueueTarget Setting
2.74.009.001 Storport Miniport Driver FC
0
HBA QueueDepth Setting
Host OS
ESE.dll file version
Storage disk configuration (mailbox and log disks)
Disk type, speed, and firmware version
32
Microsoft Windows® Server 2008 R2 Enterprise with SP1
15.0.626.0
Raw capacity for each disk (TB)
Number of physical disks in test
Total raw storage capacity (TB)
RAID level
Total formatted capacity (TB)
Storage capacity utilization
2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL SAS drives
Firmware Version: A001
2 TB
8
16 TB*
RAID 1 (2 disks per Vdisk)
7.24 TB
45%
7.24TB/16TB
Formatted capacity / Total Raw capacity
Database raw storage capacity utilization 25%
4TB/16TB
DB size / Total Raw capacity
* Capacity of drives, and therefore the raw data capacity of the disk array, based on 1KB = 1000 bytes, not 1024 bytes.
This means that 1 GB = 1,000,000,000 bytes, not (1,073,741,824 bytes)
Best practices
Exchange Server is a disk-intensive application. For Exchange 2013 best practices on storage design from Microsoft, see http://technet.microsoft.com/en-us/library/ee832792(v=exchg.150).aspx. For Exchange Server solution guidance, visit HP at hp.com/solutions/Microsoft/exchange.
Based on the testing run using the ESRP framework, we recommend the following to improve the storage performance.
• Drivers and Firmware
Ensure that firmware and drivers for all hardware in the solution are up to date. For more information, see: hp.com/go/support.
• Multipathing
Install Microsoft’s Multipath I/O (MPIO). Multipathing allows for redundant physical paths to the storage and load balancing of the I/O. For more information, see: http://technet.microsoft.com/en-us/library/ee619752(v=ws.10).aspx.
• Jetstress 2013
Before installing Exchange Server 2013, test your storage solution with Jetstress to ensure it is configured properly and meets your requirements. For more information on Jetstress, see: microsoft.com/en-us/download/details.aspx?id=36849.
• Mailbox Database Copies
In addition to the features of RAID1 protection, additional fault tolerance was achieved with four copies of the mailbox databases. There are two database copies at the primary site and two database copies at the disaster recovery site, ensuring business continuity through superior disaster recovery and Exchange availability options.
11
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
• RAID Level
The Vdisks used in this solution were configured as RAID 1 sets with a RAID stripe size of 256 KB (256 KB or larger is recommended). Provisioning of other RAID types is supported but not recommended for this Exchange Server solution.
• Windows Volumes
Ensure that the Windows volumes are formatted with the 64KB allocation unit size for best performance.
For more information on Exchange 2013 Storage Configuration Options and Best Practices recommendation, see: http://technet.microsoft.com/en-us/library/ee832792.aspx.
Test results summary
This section provides a high-level summary of the test data from ESRP and a reference to the detailed HTML reports, generated by the ESRP testing framework.
For solutions that use a uniform building block style, in which each building block is independent and isolated, ESRP requires testing only one building block. For this solution, a building block consisted of one HP ProLiant DL380p Gen8 server and one
HP MSA 2040 LFF Disk Array, with eight (8) 2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL drives hosting all 750 mailboxes.
However, for actual deployments of this solution, additional hardware is required at both the primary and disaster recovery sites. For a complete solution, contact your HP Reseller or HP Sales Representative.
Reliability
Reliability testing exercises the storage with the maximum sustainable Exchange I/O load for 24 hours. The goal is to verify that the storage can handle the maximum I/O load for an extended amount of time. Both log and database files are analyzed for integrity after the stress test to confirm that no database or log corruption occurred.
After running the 24-hour test, we found no relevant errors reported in the event log for the storage reliability testing, and no errors reported for the checksum process.
Storage performance results
Storage performance testing exercises the storage with the maximum sustainable Exchange I/O load for two hours. The test measures storage I/O response times under the maximum sustainable Exchange I/O load. The following data is the sum of all logical disk I/Os and an average of all logical disk I/O latency in the two-hour test duration.
This solution is designed around an Exchange deployment with a single DAG. The DAG has two mailbox servers in the primary site and two mailbox servers in the disaster recovery site. Ideally, the two servers in the disaster recovery site should host all active mailboxes when the primary site is offline (planned or unplanned.)
The performance results tables below shows the worst-case scenario when one server is running all four databases. See
Database I/O
Needed Disk Transfers/sec*
Database Disk Transfers/sec
Database Disk Reads/sec
Database Disk Writes/sec
Average Database Disk Read Latency (ms)
120
673
463
210
17.2
Average Database Disk Write Latency (ms)
Transaction Log I/O
0.99
Log Disk Writes/sec 148
Average Log Disk Write Latency (ms) <1 ms
* This row represents the total IOPS necessary to satisfy the IOPS for all mailboxes in the solution.
12
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Database backup / recovery performance
This section contains two test reports. The first report measures the sequential read rate of the database files; the second report measures the recovery/replay performance (playing transaction logs into the database.) The tests measure the read rates and log replay rates with all mailboxes under concurrent or simultaneous load.
Database Read-Only Performance
This test measures the maximum backup rate for Volume Shadow Copy Service (VSS) aware backup applications. The following table shows the average and sum of the database reads.
Average MB read/sec per database 161.47
MB read/sec total 645.87
Transaction Log Recovery / Replay Performance
This test measures the maximum rate that log files can play against the databases. The following table shows the average rate for log files played. Each log file is 1 MB in size.
Average number of log files played
Average time to play one log file (sec)
Conclusion
504
2.12
The information discussed in this solution brief highlights the tested performance results and configuration best practices for an Exchange solution supporting 750 5GB mailboxes and a 0.16 IOPS workload for each user (200 messages sent and received per user, per day with an additional 20% headroom.) The tested solution included an HP MSA 2040 LFF Disk Array with eight (8) 2TB 6G SAS 7.2K LFF (3.5-inch) Dual Port MDL drives for the mailbox database storage and transaction logs.
Testing demonstrated that the storage subsystem supports the IOPS needed for 750 Exchange users and provides additional performance headroom.
The test results and data presented in this document are from the ESRP test framework. Test results are only a guide; customers should test their specific solution to make sure it meets their requirements.
The ESRP program is not a benchmarking program. The tests do not measure the maximum throughput for a given solution. Rather, program focus is on producing recommendations from vendors for Exchange Server storage solutions, not direct comparisons among solutions.
Appendix A – stress testing
Stress Test Result Report
Test Summary
Overall Test Result Pass
Machine Name
Test Description
Test Start Time
Test End Time
WIN-7K2MCQ5RFC6
5/24/2013 12:24:07 PM
5/27/2013 10:34:53 PM
Collection Start Time 5/24/2013 12:26:05 PM
Collection End Time 5/25/2013 12:25:57 PM
Jetstress Version 15.00.0658.004
ESE Version 15.00.0626.000
Operating System Windows Server 2008 R2 Enterprise Service Pack 1 (6.1.7601.65536)
Performance Log C:\Program Files\Exchange Jetstress\24HR_TEST\Stress_2013_5_24_12_24_16.blg
Database Sizing and Throughput
Achieved Transactional I/O per Second 670.278
Target Transactional I/O per Second 120
Initial Database Size (bytes) 4110778892288
Final Database Size (bytes)
Database Files (Count)
4177032118272
4
13
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Jetstress System Parameters
Thread Count
Minimum Database Cache
Maximum Database Cache
Insert Operations
Delete Operations
Replace Operations
Read Operations
18
128.0 MB
1024.0 MB
40%
20%
5%
35%
Lazy Commits 70%
Run Background Database Maintenance True
Number of Copies per Database
Database Configuration
4
Instance424.1 Log path: C:\dblg1
Database: C:\dblg1\Jetstress001001.edb
Instance424.2 Log path: C:\dblg2
Database: C:\dblg2\Jetstress002001.edb
Instance424.3 Log path: C:\dblg3
Database: C:\dblg3\Jetstress003001.edb
Instance424.4 Log path: C:\dblg4
Database: C:\dblg4\Jetstress004001.edb
Transactional I/O Performance
MSExchange
Database ==>
Instances
I/O
Database
Reads
Average
Latency
(msec)
I/O
Database
Writes
Average
Latency
(msec)
Instance424.1 16.799 0.952
Instance424.2 18.281
Instance424.3 16.588
1.019
0.941
I/O
Database
Reads/sec
I/O
Database
Writes/sec
I/O
Database
Reads
Average
Bytes
I/O
Database
Writes
Average
Bytes
I/O Log
Reads
Average
Latency
(msec)
115.056 52.642 33141.710 35397.117 0.000
114.892 52.535 33151.859 35393.001 0.000
114.959 52.532 33143.105 35402.317 0.000
I/O Log
Writes
Average
Latency
(msec)
0.233
0.238
0.231
I/O Log
Reads/sec
0.000
0.000
0.000
Instance424.4 16.442 1.090 114.991 52.670 33144.543 35398.757 0.000
Background Database Maintenance I/O Performance
0.238 0.000
MSExchange Database ==> Instances Database Maintenance IO Reads/sec Database Maintenance IO Reads Average Bytes
I/O Log
Writes/sec
I/O Log
Reads
Average
Bytes
36.770
36.772
36.711
36.872
0.000
0.000
0.000
0.000
I/O Log
Writes
Average
Bytes
7759.478
7767.136
7768.438
7758.303
Instance424.1
Instance424.2
Instance424.3
Instance424.4
Log Replication I/O Performance
MSExchange Database ==> Instances
Instance424.1
9.894
9.920
9.911
9.909
I/O Log Reads/sec
2.475
261488.004
261498.841
261490.857
261507.672
I/O Log Reads Average Bytes
230417.849
2.479
2.475
2.481
229564.782
229891.802
230089.187
Instance424.2
Instance424.3
Instance424.4
Total I/O Performance
MSExchange
Database ==>
Instances
I/O
Database
Reads
Average
Latency
(msec)
Instance424.1 16.799
Instance424.2 18.281
Instance424.3 16.588
Instance424.4 16.442
I/O
Database
Writes
Average
Latency
(msec)
0.952
1.019
0.941
1.090
I/O
Database
Reads/sec
I/O
Database
Writes/sec
I/O
Database
Reads
Average
Bytes
I/O
Database
Writes
Average
Bytes
I/O Log
Reads
Average
Latency
(msec)
124.951 52.642 51223.378 35397.117 0.484
124.812 52.535 51301.365 35393.001 0.484
124.870 52.532 51266.870 35402.317 0.485
124.900 52.670 51261.377 35398.757 0.482
I/O Log
Writes
Average
Latency
(msec)
0.233
0.238
0.231
0.238
I/O Log
Reads/sec
2.475
2.479
2.475
2.481
I/O Log
Writes/sec
I/O Log
Reads
Average
Bytes
I/O Log
Writes
Average
Bytes
36.770 230417.849 7759.478
36.772 229564.782 7767.136
36.711 229891.802 7768.438
36.872 230089.187 7758.303
14
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Host System Performance
Counter
% Processor Time
Available MBytes
Free System Page Table Entries
Transition Pages RePurposed/sec
Pool Nonpaged Bytes
Pool Paged Bytes
Database Page Fault Stalls/sec
Average
1.879
60802.949
33555351.094
0.000
96227390.687
107340792.520
0.000
Minimum
1.045
60776.000
33555349.000
0.000
96182272.000
106573824.000
0.000
Maximum
10.447
60863.000
33555863.000
0.000
96395264.000
157184000.000
0.000
Test Log 5/24/2013 12:24:07 PM -- Preparing for testing ...
5/24/2013 12:24:11 PM -- Attaching databases ...
5/24/2013 12:24:11 PM -- Preparations for testing are complete.
5/24/2013 12:24:11 PM -- Starting transaction dispatch ..
5/24/2013 12:24:11 PM -- Database cache settings: (minimum: 128.0 MB, maximum: 1.0 GB)
5/24/2013 12:24:11 PM -- Database flush thresholds: (start: 10.2 MB, stop: 20.5 MB)
5/24/2013 12:24:16 PM -- Database read latency thresholds: (average: 20 msec/read, maximum: 200 msec/read).
5/24/2013 12:24:16 PM -- Log write latency thresholds: (average: 10 msec/write, maximum: 200 msec/write).
5/24/2013 12:24:23 PM -- Operation mix: Sessions 18, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%.
5/24/2013 12:24:23 PM -- Performance logging started (interval: 15000 ms).
5/24/2013 12:24:23 PM -- Attaining prerequisites:
5/24/2013 12:26:05 PM -- \MSExchange Database(JetstressWin)\Database Cache Size, Last: 970764300.0 (lower bound: 966367600.0, upper bound: none)
5/25/2013 12:26:06 PM -- Performance logging has ended.
5/27/2013 10:34:52 PM -- JetInterop batch transaction stats: 1159219, 1159218, 1159218 and 1159218.
5/27/2013 10:34:52 PM -- Dispatching transactions ends.
5/27/2013 10:34:52 PM -- Shutting down databases ...
5/27/2013 10:34:53 PM -- Instance424.1 (complete), Instance424.2 (complete), Instance424.3 (complete) and Instance424.4 (complete)
5/27/2013 10:34:53 PM -- C:\Program Files\Exchange Jetstress\24HR_TEST\Stress_2013_5_24_12_24_16.blg has 5756 samples.
5/27/2013 10:34:53 PM -- Creating test report ...
5/27/2013 10:35:19 PM -- Instance424.1 has 16.8 for I/O Database Reads Average Latency.
5/27/2013 10:35:19 PM -- Instance424.1 has 0.2 for I/O Log Writes Average Latency.
5/27/2013 10:35:19 PM -- Instance424.1 has 0.2 for I/O Log Reads Average Latency.
5/27/2013 10:35:19 PM -- Instance424.2 has 18.3 for I/O Database Reads Average Latency.
5/27/2013 10:35:19 PM -- Instance424.2 has 0.2 for I/O Log Writes Average Latency.
5/27/2013 10:35:19 PM -- Instance424.2 has 0.2 for I/O Log Reads Average Latency.
5/27/2013 10:35:19 PM -- Instance424.3 has 16.6 for I/O Database Reads Average Latency.
5/27/2013 10:35:19 PM -- Instance424.3 has 0.2 for I/O Log Writes Average Latency.
5/27/2013 10:35:19 PM -- Instance424.3 has 0.2 for I/O Log Reads Average Latency.
5/27/2013 10:35:19 PM -- Instance424.4 has 16.4 for I/O Database Reads Average Latency.
5/27/2013 10:35:19 PM -- Instance424.4 has 0.2 for I/O Log Writes Average Latency.
5/27/2013 10:35:19 PM -- Instance424.4 has 0.2 for I/O Log Reads Average Latency.
5/27/2013 10:35:19 PM -- Test has 0 Maximum Database Page Fault Stalls/sec.
5/27/2013 10:35:19 PM -- The test has 0 Database Page Fault Stalls/sec samples higher than 0.
5/27/2013 10:35:19 PM -- C:\Program Files\Exchange Jetstress\24HR_TEST\Stress_2013_5_24_12_24_16.xml has 5749 samples queried.
Appendix B – performance testing
Performance Test Result Report
Test Summary
Overall Test Result Pass
Machine Name WIN-7K2MCQ5RFC6
Test Description
Test Start Time 5/20/2013 10:43:20 AM
Test End Time 5/20/2013 1:48:37 PM
Collection Start Time 5/20/2013 10:45:21 AM
Collection End Time 5/20/2013 12:45:14 PM
Jetstress Version 15.00.0658.004
ESE Version 15.00.0626.000
Operating System Windows Server 2008 R2 Enterprise Service Pack 1 (6.1.7601.65536)
Performance Log C:\Program Files\Exchange Jetstress\2HR_TEST\Performance_2013_5_20_10_43_39.blg
Database Sizing and Throughput
15
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Achieved Transactional I/O per Second 672.975
Target Transactional I/O per Second 120
Initial Database Size (bytes)
Final Database Size (bytes)
Database Files (Count)
Jetstress System Parameters
Thread Count
Minimum Database Cache
4106945298432
4109528989696
4
18
128.0 MB
Maximum Database Cache
Insert Operations
Delete Operations
Replace Operations
Read Operations
1024.0 MB
40%
20%
5%
35%
Lazy Commits 70%
Run Background Database Maintenance True
Number of Copies per Database
Database Configuration
4
Instance4852.1 Log path: C:\dblg1
Database: C:\dblg1\Jetstress001001.edb
Instance4852.2 Log path: C:\dblg2
Database: C:\dblg2\Jetstress002001.edb
Instance4852.3 Log path: C:\dblg3
Database: C:\dblg3\Jetstress003001.edb
Instance4852.4 Log path: C:\dblg4
Database: C:\dblg4\Jetstress004001.edb
Transactional I/O Performance
MSExchange
Database ==>
Instances
I/O
Database
Reads
Average
Latency
(msec)
I/O
Database
Writes
Average
Latency
(msec)
Instance4852.1 17.068
Instance4852.2 18.259
0.958
1.010
I/O
Database
Reads/sec
I/O
Database
Writes/sec
I/O
Database
Reads
Average
Bytes
I/O
Database
Writes
Average
Bytes
I/O Log
Reads
Average
Latency
(msec)
I/O Log
Writes
Average
Latency
(msec)
115.849 52.816 33001.666 35082.416 0.000
115.680 52.403 32974.137 35090.908 0.000
0.231
0.232
Instance4852.3 17.038 0.931 115.762 52.736 32980.356 35116.148 0.000 0.229
Instance4852.4 16.394 1.070 115.467 52.261 32987.744 35121.184 0.000
Background Database Maintenance I/O Performance
MSExchange Database ==>
Instances
Database Maintenance IO
Reads/sec
0.231
Database Maintenance IO Reads Average
Bytes
Instance4852.1 9.903 261623.186
Instance4852.2
Instance4852.3
9.909
9.899
Instance4852.4
Log Replication I/O Performance
9.898
MSExchange Database ==> Instances
Instance4852.1
Instance4852.2
Instance4852.3
Instance4852.4
Total I/O Performance
MSExchange
Database ==>
Instances
I/O
Database
Reads
Average
Latency
(msec)
Instance4852.1 17.068
Instance4852.2 18.259
Instance4852.3 17.038
Instance4852.4 16.394
I/O
Database
Writes
Average
Latency
(msec)
0.958
1.010
0.931
1.070
I/O Log Reads/sec
2.519
2.519
2.530
2.504
125.752 52.816
125.589 52.403
125.661 52.736
125.365 52.261
261865.260
261757.651
261748.800
I/O
Database
Reads/sec
I/O
Database
Writes/sec
I/O
Database
Reads
Average
Bytes
I/O Log Reads Average Bytes
231590.473
231643.682
231588.716
231590.289
I/O
Database
Writes
Average
Bytes
I/O Log
Reads
Average
Latency
(msec)
51006.378 35082.416 0.489
51033.375 35090.908 0.488
51001.999 35116.148 0.488
51049.345 35121.184 0.483
I/O Log
Writes
Average
Latency
(msec)
0.231
0.232
0.229
0.231
I/O Log
Reads/sec
0.000
0.000
0.000
0.000
2.519
2.519
2.530
2.504
I/O Log
Writes/sec
37.064
36.993
36.916
36.713
I/O Log
Reads/sec
I/O Log
Writes/sec
I/O Log
Reads
Average
Bytes
37.064
36.993
36.916
36.713
I/O Log
Reads
Average
Bytes
0.000
0.000
0.000
0.000
I/O Log
Writes
Average
Bytes
7805.096
7812.847
7862.580
7824.477
I/O Log
Writes
Average
Bytes
231590.473 7805.096
231643.682 7812.847
231588.716 7862.580
231590.289 7824.477
16
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Host System Performance
Counter
% Processor Time
Available MBytes
Free System Page Table Entries
Transition Pages RePurposed/sec
Pool Nonpaged Bytes
Pool Paged Bytes
Database Page Fault Stalls/sec
Average
1.932
60688.077
33555350.553
0.000
94160780.559
122340679.081
0.000
Minimum
1.272
60599.000
33555347.000
0.000
93548544.000
99418112.000
0.000
Maximum
7.047
60848.000
33555353.000
0.000
94355456.000
147378176.000
0.000
Test Log 5/20/2013 10:43:20 AM -- Preparing for testing ...
5/20/2013 10:43:34 AM -- Attaching databases ...
5/20/2013 10:43:34 AM -- Preparations for testing are complete.
5/20/2013 10:43:34 AM -- Starting transaction dispatch ..
5/20/2013 10:43:35 AM -- Database cache settings: (minimum: 128.0 MB, maximum: 1.0 GB)
5/20/2013 10:43:35 AM -- Database flush thresholds: (start: 10.2 MB, stop: 20.5 MB)
5/20/2013 10:43:39 AM -- Database read latency thresholds: (average: 20 msec/read, maximum: 100 msec/read).
5/20/2013 10:43:39 AM -- Log write latency thresholds: (average: 10 msec/write, maximum: 100 msec/write).
5/20/2013 10:43:46 AM -- Operation mix: Sessions 18, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%.
5/20/2013 10:43:46 AM -- Performance logging started (interval: 15000 ms).
5/20/2013 10:43:46 AM -- Attaining prerequisites:
5/20/2013 10:45:21 AM -- \MSExchange Database(JetstressWin)\Database Cache Size, Last: 972419100.0 (lower bound: 966367600.0, upper bound: none)
5/20/2013 12:45:22 PM -- Performance logging has ended.
5/20/2013 1:48:36 PM -- JetInterop batch transaction stats: 43409, 43409, 43409 and 43408.
5/20/2013 1:48:36 PM -- Dispatching transactions ends.
5/20/2013 1:48:37 PM -- Shutting down databases ...
5/20/2013 1:48:37 PM -- Instance4852.1 (complete), Instance4852.2 (complete), Instance4852.3 (complete) and Instance4852.4 (complete)
5/20/2013 1:48:37 PM -- C:\Program Files\Exchange Jetstress\2HR_TEST\Performance_2013_5_20_10_43_39.blg has 485 samples.
5/20/2013 1:48:37 PM -- Creating test report ...
5/20/2013 1:48:40 PM -- Instance4852.1 has 17.1 for I/O Database Reads Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.1 has 0.2 for I/O Log Writes Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.1 has 0.2 for I/O Log Reads Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.2 has 18.3 for I/O Database Reads Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.2 has 0.2 for I/O Log Writes Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.2 has 0.2 for I/O Log Reads Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.3 has 17.0 for I/O Database Reads Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.3 has 0.2 for I/O Log Writes Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.3 has 0.2 for I/O Log Reads Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.4 has 16.4 for I/O Database Reads Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.4 has 0.2 for I/O Log Writes Average Latency.
5/20/2013 1:48:40 PM -- Instance4852.4 has 0.2 for I/O Log Reads Average Latency.
5/20/2013 1:48:40 PM -- Test has 0 Maximum Database Page Fault Stalls/sec.
5/20/2013 1:48:40 PM -- The test has 0 Database Page Fault Stalls/sec samples higher than 0.
5/20/2013 1:48:40 PM -- C:\Program Files\Exchange Jetstress\2HR_TEST\Performance_2013_5_20_10_43_39.xml has 478 samples queried.
Appendix C – streaming backup testing
Database backup Test Result Report
Database Backup Statistics - All
Database Instance Database Size (MBytes)
Instance1520.1
Instance1520.2
967722.09
967730.09
Instance1520.3
Instance1520.4
Avg
967714.09
967738.09
Sum
Jetstress System Parameters
Thread Count 18
Minimum Database Cache 128.0 MB
Elapsed Backup Time
01:38:20
01:41:44
01:38:04
01:41:30
MBytes Transferred/sec
164.01
158.52
164.44
158.89
161.47
645.87
17
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Maximum Database Cache 1024.0 MB
Insert Operations 40%
Delete Operations
Replace Operations
20%
5%
Read Operations 35%
Lazy Commits
Database Configuration
70%
Instance1520.1 Log path: C:\dblg1
Database: C:\dblg1\Jetstress001001.edb
Instance1520.2 Log path: C:\dblg2
Database: C:\dblg2\Jetstress002001.edb
Instance1520.3 Log path: C:\dblg3
Database: C:\dblg3\Jetstress003001.edb
Instance1520.4 Log path: C:\dblg4
Database: C:\dblg4\Jetstress004001.edb
Transactional I/O Performance
MSExchange
Database ==>
Instances
I/O
Database
Reads
Average
Latency
(msec)
I/O
Database
Writes
Average
Latency
(msec)
Instance1520.1 1.716
Instance1520.2 2.898
0.000
0.000
Instance1520.3 2.800
Instance1520.4 2.892
Host System Performance
Counter
0.000
0.000
% Processor Time
Available MBytes
Free System Page Table Entries
Transition Pages RePurposed/sec
Pool Nonpaged Bytes
Pool Paged Bytes
Database Page Fault Stalls/sec
I/O
Database
Reads/sec
I/O
Database
Writes/sec
655.990 0.000
633.939 0.000
657.582 0.000
635.561 0.000
Average
4.736
62000.670
33555351.128
0.000
93391140.571
96697863.567
0.000
I/O Database
Reads
Average
Bytes
I/O
Database
Writes
Average
Bytes
262144.000 0.000
262144.000 0.000
262144.000 0.000
262144.000 0.000
Minimum
2.196
61964.000
33555351.000
0.000
93380608.000
96669696.000
0.000
I/O Log
Reads
Average
Latency
(msec)
0.000
0.000
0.000
0.000
I/O Log
Writes
Average
Latency
(msec)
0.000
0.000
0.000
0.000
Maximum
5.431
62003.000
33555353.000
0.000
93405184.000
96849920.000
0.000
I/O Log
Reads/sec
0.000
0.000
0.000
0.000
I/O Log
Writes/sec
0.000
0.000
0.000
0.000
I/O Log
Reads
Average
Bytes
0.000
0.000
0.000
0.000
I/O Log
Writes
Average
Bytes
0.000
0.000
0.000
0.000
Test Log 5/17/2013 1:58:57 PM -- Preparing for testing ...
5/17/2013 1:59:01 PM -- Attaching databases ...
5/17/2013 1:59:01 PM -- Preparations for testing are complete.
5/17/2013 1:59:10 PM -- Performance logging started (interval: 30000 ms).
5/17/2013 1:59:10 PM -- Backing up databases ...
5/17/2013 3:40:54 PM -- Performance logging has ended.
5/17/2013 3:40:54 PM -- Instance1520.1 (100% processed), Instance1520.2 (100% processed), Instance1520.3 (100% processed) and Instance1520.4 (100% processed)
5/17/2013 3:40:54 PM -- C:\Program Files\Exchange Jetstress\DB_BACKUP\DatabaseBackup_2013_5_17_13_59_1.blg has 203 samples.
5/17/2013 3:40:54 PM -- Creating test report ...
Appendix D – soft recovery testing
SoftRecovery Test Result Report
Soft-Recovery Statistics - All
Database Instance
Instance4544.1
Instance4544.2
Instance4544.3
Instance4544.4
Avg
Sum
Log files replayed
501
503
509
507
505
2020
Elapsed seconds
1075.5015151
1112.2766186
1071.7503006
1086.2601305
1086.447
4345.7885648
18
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
Database Configuration
Instance4544.1 Log path: C:\dblg1
Database: C:\dblg1\Jetstress001001.edb
Instance4544.2 Log path: C:\dblg2
Database: C:\dblg2\Jetstress002001.edb
Instance4544.3 Log path: C:\dblg3
Database: C:\dblg3\Jetstress003001.edb
Instance4544.4 Log path: C:\dblg4
Database: C:\dblg4\Jetstress004001.edb
Transactional I/O Performance
MSExchange
Database ==>
Instances
I/O
Database
Reads
Average
Latency
(msec)
I/O
Database
Writes
Average
Latency
(msec)
Instance4544.1 19.646 0.218
Instance4544.2 20.407
Instance4544.3 19.607
0.217
0.220
I/O
Database
Reads/sec
I/O
Database
Writes/sec
394.027 1.848
381.542 1.780
388.829 1.877
Instance4544.4 19.808 0.219 389.547 1.832
Background Database Maintenance I/O Performance
MSExchange Database ==>
Instances
Database Maintenance IO
Reads/sec
Instance4544.1 0.000
I/O
Database
Reads
Average
Bytes
I/O Log
Writes
Average
Latency
(msec)
0.000
0.000
0.000
0.000
Database Maintenance IO Reads Average
Bytes
0.000
I/O
Database
Writes
Average
Bytes
I/O Log
Reads
Average
Latency
(msec)
40152.528 28941.981 2.876
40306.762 28470.557 3.771
40167.004 29237.233 2.574
40176.713 29161.075 2.612
I/O Log
Reads/sec
I/O Log
Writes/sec
I/O Log
Reads
Average
Bytes
2.312
2.227
2.349
2.295
0.000
0.000
0.000
0.000
I/O Log
Writes
Average
Bytes
184833.736 0.000
182440.988 0.000
187283.820 0.000
186230.666 0.000
Instance4544.2
Instance4544.3
Instance4544.4
Total I/O Performance
MSExchange
Database ==>
Instances
I/O
Database
Reads
Average
Latency
(msec)
Instance4544.1 19.646
Instance4544.2 20.407
Instance4544.3 19.607
Instance4544.4 19.808
Host System Performance
Counter
I/O
Database
Writes
Average
Latency
(msec)
0.218
0.217
0.220
0.219
0.000
0.000
0.000
I/O
Database
Reads/sec
I/O
Database
Writes/sec
394.027 1.848
381.542 1.780
388.829 1.877
389.547 1.832
Average
2.655
0.000
0.000
0.000
I/O
Database
Reads
Average
Bytes
I/O
Database
Writes
Average
Bytes
I/O Log
Reads
Average
Latency
(msec)
40152.528 28941.981 2.876
40306.762 28470.557 3.771
40167.004 29237.233 2.574
40176.713 29161.075 2.612
Minimum
0.000
I/O Log
Writes
Average
Latency
(msec)
0.000
0.000
0.000
0.000
Maximum
10.569
I/O Log
Reads/sec
2.312
2.227
2.349
2.295
I/O Log
Writes/sec
0.000
0.000
0.000
0.000
I/O Log
Reads
Average
Bytes
I/O Log
Writes
Average
Bytes
184833.736 0.000
182440.988 0.000
187283.820 0.000
186230.666 0.000
% Processor Time
Available MBytes
Free System Page Table Entries
Transition Pages RePurposed/sec
60532.762
33555351.995
0.000
60498.000
33555349.000
0.000
61542.000
33555353.000
0.000
Pool Nonpaged Bytes
Pool Paged Bytes
Database Page Fault Stalls/sec
96177088.698
108428857.716
0.000
96133120.000
108404736.000
0.000
96210944.000
108621824.000
0.000
Test Log 5/21/2013 9:26:33 AM -- Preparing for testing ...
5/21/2013 9:26:37 AM -- Attaching databases ...
5/21/2013 9:26:37 AM -- Preparations for testing are complete.
5/21/2013 9:26:37 AM -- Starting transaction dispatch ..
5/21/2013 9:26:37 AM -- Database cache settings: (minimum: 128.0 MB, maximum: 1.0 GB)
5/21/2013 9:26:37 AM -- Database flush thresholds: (start: 10.2 MB, stop: 20.5 MB)
5/21/2013 9:26:41 AM -- Database read latency thresholds: (average: 20 msec/read, maximum: 100 msec/read).
5/21/2013 9:26:41 AM -- Log write latency thresholds: (average: 10 msec/write, maximum: 100 msec/write).
5/21/2013 9:26:46 AM -- Operation mix: Sessions 18, Inserts 40%, Deletes 20%, Replaces 5%, Reads 35%, Lazy Commits 70%.
5/21/2013 9:26:46 AM -- Performance logging started (interval: 15000 ms).
5/21/2013 9:26:46 AM -- Generating log files ...
5/21/2013 10:48:46 AM -- C:\dblg1 (100.2% generated), C:\dblg2 (100.6% generated), C:\dblg3 (101.8% generated) and C:\dblg4 (101.4% generated)
19
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
5/21/2013 10:48:46 AM -- Performance logging has ended.
5/21/2013 10:48:46 AM -- JetInterop batch transaction stats: 21432, 21432, 21431 and 21431.
5/21/2013 10:48:46 AM -- Dispatching transactions ends.
5/21/2013 10:48:47 AM -- Shutting down databases ...
5/21/2013 10:48:47 AM -- Instance4544.1 (complete), Instance4544.2 (complete), Instance4544.3 (complete) and Instance4544.4 (complete)
5/21/2013 10:48:47 AM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\Performance_2013_5_21_9_26_41.blg has 327 samples.
5/21/2013 10:48:47 AM -- Creating test report ...
5/21/2013 10:48:49 AM -- Instance4544.1 has 16.9 for I/O Database Reads Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.1 has 0.3 for I/O Log Writes Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.1 has 0.3 for I/O Log Reads Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.2 has 18.3 for I/O Database Reads Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.2 has 0.3 for I/O Log Writes Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.2 has 0.3 for I/O Log Reads Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.3 has 16.7 for I/O Database Reads Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.3 has 0.3 for I/O Log Writes Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.3 has 0.3 for I/O Log Reads Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.4 has 16.7 for I/O Database Reads Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.4 has 0.3 for I/O Log Writes Average Latency.
5/21/2013 10:48:49 AM -- Instance4544.4 has 0.3 for I/O Log Reads Average Latency.
5/21/2013 10:48:49 AM -- Test has 0 Maximum Database Page Fault Stalls/sec.
5/21/2013 10:48:49 AM -- The test has 0 Database Page Fault Stalls/sec samples higher than 0.
5/21/2013 10:48:49 AM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\Performance_2013_5_21_9_26_41.xml has 326 samples queried.
5/21/2013 10:48:49 AM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\Performance_2013_5_21_9_26_41.html was saved.
5/21/2013 3:57:29 PM -- Performance logging started (interval: 2000 ms).
5/21/2013 3:57:29 PM -- Recovering databases ...
5/21/2013 4:16:01 PM -- Performance logging has ended.
5/21/2013 4:16:01 PM -- Instance4544.1 (1075.5015151), Instance4544.2 (1112.2766186), Instance4544.3 (1071.7503006) and Instance4544.4
(1086.2601305)
5/21/2013 4:16:02 PM -- C:\Program Files\Exchange Jetstress\SOFT_RECOVERY\SoftRecovery_2013_5_21_15_57_24.blg has 550 samples.
5/21/2013 4:16:02 PM -- Creating test report ...
20
Technical white paper | HP MSA 2040 Array 750 Mailbox Resiliency Exchange 2013 Storage Solution
For more information
HP MSA 2040 Storage Array: hp.com/go/msa2040
QuickSpecs for HP DL380p Gen8 Servers: http://h18004.www1.hp.com/products/quickspecs/14212_div/14212_div.HTML
QuickSpecs for HP SN1000E 16Gb 2-port PCIe Fibre Channel Host Bust Adapters: http://h18004.www1.hp.com/products/quickspecs/14202_div/14202_div.HTML
To read more about HP solutions for Exchange, including best practices and additional testing of HP Server and Storage products with Exchange, see: hp.com/solutions/exchange
For general information on Exchange sizing and best practices, there are several white papers and planning tools that are free to download from: hp.com/solutions/activeanswers/exchange
For more information on Jetstress and the process requirements for validating an Exchange Storage Solution, see: http://gallery.technet.microsoft.com/Jetstress-2013-Field-Guide-2438bc12
Sign up for updates hp.com/go/getupdated
To help us improve our documents, please provide feedback at hp.com/solutions/feedback.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for
HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
Microsoft and Windows are U.S. registered trademarks of Microsoft Corporation. Intel and Xeon are trademarks of Intel Corporation in the U.S. and other countries. ENERGY STAR is a registered mark owned by the U.S. government.
4AA4-7540ENW, September 2013, Rev. 1
