Application Database Archiving Managing database growth, costs, and performance

advertisement
EMC Perspective
Application Database Archiving
Managing database growth, costs,
and performance
An EMC perspective on the business and IT value of
application database archiving
Table of Contents
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
Challenges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2
Solution requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3
EMC DatabaseXtender success . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4
EMC DatabaseXtender solution benefits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .5
Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7
EMC uses DatabaseXtender to manage database growth
1
Introduction
For those enterprises with mission-critical databases, database archiving has rapidly
become a necessity, not an option. Application database archiving solves a number of
seemingly unrelated issues. These include improving the performance and availability of
live production databases, managing data retention policies, conforming to government
regulations, and preserving database data as long as required. Most importantly, database
archiving helps keep businesses running and lowers infrastructure costs.
It was these benefits that prompted the EMC IT organization to asses its own requirements
for growth, accessibility, cost, and performance. EMC IT realized it needed a different
approach to managing the growth, performance, and accessibility of database information.
It needed a robust and rich database archiving solution that would address five primary
business requirements:
• Fulfill both operational and informational requests
• Enable the retention and ongoing administration of data
• Employ storage and other IT assets more efficiently and effectively
• Significantly lower hardware infrastructure costs
• Provide IT management with a predictable view of growth
The IT department chose the company’s own product, EMC® DatabaseXtenderTM. EMC
DatabaseXtender helped the group create an overall database archiving strategy to solve the
ongoing database problems of performance and growth, while reducing data inventory costs.
Challenges
The EMC IT organization realized that due to a large and busy enterprise environment, its
live Oracle Applications 11i production database environment could become too large too
quickly for servers to handle; specifically, the indexes could become too large to keep in
memory and would slow down the environment drastically. In addition, closed-out data
within the Oracle Applications was remaining in the production database environment
longer than necessary—in fact, it was never moved at all.
The environment also was assessed as having unnecessarily large data stores that were
suffering from poor performance. Before the DatabaseXtender solution was implemented,
EMC’s Oracle Applications 11.0.3 database was growing at a rate of 24 GB/month and had
more than doubled since going live with the applications. The vast majority of this growth,
approximately 88 percent, was specifically coming from increases in Inventory, BOM, and
genealogy data stores.
This kind of unbridled data growth resulted in performance degradations that created an
unstable and unpredictable application environment. This instability had an impact on
order management and product bookings at quarter- and year-end affecting sales revenue
and company performance.
EMC uses DatabaseXtender to manage database growth
2
The growth also required the IT organization to increase storage expenses to buy more
disks and capacity to keep pace with the production environment growth. An additional 13
environments were regularly created as full-size copies (in other words, refreshes or
replicated copies) from the production database. Ramesh Razdan, application and
database senior manager, called this the “multiplier effect,” and said, “The growth of the
production environment itself was only a small part of the equation. We needed to create
these additional environments from the production side for development, test, and data
protection to occur without disrupting the primary data. This compelled us to utilize more
database administration resources to manage the overall growth and complexity.”
13 additional environments are regularly created as full-size copies from production
Instead of continuing to add disks, servers, and people to handle its Oracle Applications
11i environment, EMC IT chose a growth management strategy consisting of intelligent
application database archiving.
Solution requirements
Once the database environment problems were identified and their impact on overall
business performance was keenly understood, the solution requirements became very
clear. The IT organization needed an application database archiving solution to meet this
minimum set of requirements for the data relocation project. The solution needed to:
• Include user-definable archiving policies to match business objectives
• Relocate rarely accessed historical data out of the production database
• Maintain transparent visibility and access of the relocated or archived data to the user
community
• Maintain/improve system performance
EMC uses DatabaseXtender to manage database growth
3
• Minimize future investments of storage
• Minimize development tuning and DBA costs
• Include the ability to scale with increased growth rates
The other point that was clear to EMC’s IT organization was that database archiving did not
mean nor should it be confused with being a backup solution. An archive is still the original
production data, not a copy of the data that has been made for data protection purposes.
Therefore, backup solutions did not apply.
EMC DatabaseXtender success
EMC DatabaseXtender helped the EMC IT organization migrate transaction data from its live
Oracle Application production databases to realtime archives based on a set of rules and
policies. DatabaseXender also enables the group to manage the integrity and accessibility
of the transaction data in those archives.
The EMC IT organization used DatabaseXtender Analyzer to discover the capacity and growth
across the entire Oracle 11i Application database environment and to produce a well-defined
snapshot of which applications needed immediate attention. DatabaseXtender Analyzer, a
part of the DatabaseXtender family, monitors application database growth and reports on
application performance.
Specifically, DatabaseXtender Analyzer provided an Oracle Application module distribution
breakdown of the data. This breakdown enabled the IT organization to make informed
decisions about what archiving policies to apply in order to deal with projected ERP growth
across the production instance, production copies, and test copies environment of 3.5TB to
11TB over a five year period.
Capacity discovery breakdown of the ERP database environment
EMC uses DatabaseXtender to manage database growth
4
Once applications and data were discovered and analyzed, the IT organization embarked
on establishing data relocation policies that would effectively manage the data relocation
process. The analytics showed that the biggest growth areas were found in the Oracle
Inventory, BOM, WIP, WF, MRP, and Custom modules. EMC IT decided to retain four months
of production data and relocate anything older than four months on a monthly basis. All the
other modules would remain in an “as is” state until they demonstrated similar growth.
After moving DatabaseXtender into production, the IT organization saw a reduction of 51
percent during the first year in the overall primary storage space across all the Oracle
Applications. After a few months of continuous data relocation or archiving, the IT
organization found that, on average, it was relocating 20 GB per month to a database
archive. Initially, the relocation reduced the production environment by 355 GB.
The impact of DatabaseXtender on the size and scale of the IT database environment was
significant. Using the DatabaseXtender solution to identify, classify, and relocate
application production data older than four months substantially reduced the combined
production and non-production data growth path to 1.8TB in the first year and to 4.5TB in
the fifth year—a reduction of over 50 percent.
Using DatabaseXtender to relocate rarely accessed data has enabled EMC
to greatly reduce total ERP storage
EMC DatabaseXtender solution benefits
Slimming down a mission-critical application database by migrating closed transactions to
an accessible archive can yield significant savings which can be categorized as “hard” and
“soft.” Regardless of the category, the EMC IT organization considers all of the benefits
important to the overall success and impact that DatabaseXtender has delivered to its
production database environments.
EMC uses DatabaseXtender to manage database growth
5
“Hard” DatabaseXtender Savings/Benefits
• Significant reduction in planned tape expenditures
• Reduced tape expense budget
• Total cost avoidance projected over five years > $2.3 M
• Reduction of new hardware expenditures, specifically a new Symmetrix® pair
• Specifically for non-production environments
• Savings of $480K
“Soft” DatabaseXtender Savings/Benefits
• Avoidance of reactive time employees spend with database performance tuning
• Significant reduction in service tickets associated with performance
• Production data stores benefit from its lightened load of transactions
• Predictable performance of Oracle Applications
• During peak windows, CPU utilization stays between 30% and 50%
• No month/quarter/year-end performance issues
• Queries on non-production data no longer compete with production transactions by
being redirected to the active archive
• Reduction in DBA time required to refresh environments
• 2.5 to 3 days down to 1 to 1.5 days
• Reductions in production data enable reasonable response times
• Immediate improvements to SLA performance
• Production environment SLA terms and criteria are protected from penalties
• Separate SLAs for production and archived data
• Archived data is still online to an end user via queries or natively through the original
applications
• Management and cost benefits
• Both the production database and the archived data can be optimized and scale
independently making it easier to manage the performance and growth of each
• Archived data can use high-capacity, lower-cost-effective disk (in other words,
SATA) without performance considerations
EMC uses DatabaseXtender to manage database growth
6
Summary
Using DatabaseXtender has enabled the EMC IT organization to significantly slim down
databases by identifying files that have not been accessed in a set period of time and
moving them to secondary storage. Moving data out of the primary database frees up the
database server’s processing power for running reports, retrieving data, and backing up
new information, and it improves performance
“Due to the nature of structured data, it’s important that whatever you do with it, you don’t
disrupt the relational aspect of data indices and tables during the archive process.
DatabaseXtender has performed very well in the area of data integrity,” states Razdan.
DatabaseXtender has helped the EMC IT organization to improve performance of
mission-critical database applications and as a result reduce infrastructure costs around
servers and storage. The solution also improves the overall manageability of data
protection, replication, and software upgrade operations.
EMC Corporation
Hopkinton
Massachusetts
01748-9103
1-508-435-1000
In North America 1-866-464-7381
EMC2, EMC, Symmetrix, and where information
lives are registered trademarks and
DatabaseXtender is a trademark of EMC
Corporation. All other trademarks used herein
are the property of their respective owners.
© Copyright 2007 EMC Corporation.
All rights reserved. Published in the USA. 1/07
EMC Perspective
S12170107V1
www.EMC.com
7
Download