® IBM Software Group Build Forge Market Overview Sundeep Goel World Wide Alliances © IBM Corporation IBM Software Group | Rational Software | Build Forge Build and Release Management – Joining the Mainstream of Software Development One of the least structured but most essential processes in the lifecycle A critical link between what development creates and what ultimately gets delivered to customers Unlike other development phases, there has been sparse collaboration or published best practices in this area However, And awareness environment is growing… is changing … Changing development paradigms such as Agile “Software build management increasingly impacts successful software deployments, business and IT productivity and is becoming a focus for IT organizations. Continuing push for faster, more frequent application releases ” - IDC inability Governance and Compliance concerns “The to produce consistent, accurate, and repeatable software builds creates a significant bottleneck thatand makes development teams ill prepared to Global development distribution of resources development manage project complexities without adding additional resources.” - Hurwitz “Changing development practices and new compliance requirements have turned a spotlight on a long-neglected development life-cycle activity: build.” - Forrester IBM Software Group | Rational Software | Build Forge Typical deployment cycle roles Why I am I always the last to know that the build broke? I wish I knew immediately when a build breaks and could restart it from there!! Developer Hello! I need to get some testing done!!! Build Engineer Deployer Manually configure the server, the test framework and deploy the build… what environments on how many servers? Source Code Repository Source Build + Scripts = Tester Test Environment Build Results Deploy Package Production Environment IBM Software Group | Rational Software | Build Forge Silos between Groups No shared processes, artifacts or controls “Over the wall” communication Difficulty tracking and testing status of multiple builds Develop Build Test Implement & Iterate Build & Stage Test & Validate Software) Development Assets Build Assets Test Assets Test Environment Minimal reuse Labor intensive Error prone handoffs Deploy ® IBM Software Group Build Forge © IBM Corporation IBM Software Group | Rational Software | Build Forge 2 Minute Drill – What is Build Forge? Manages the “assembly” phase of the development lifecycle Build and release process management The part of the lifecycle between coding (source control) and deployment (Tivoli) This segment of the lifecycle is very immature today! (home grown scripts) Build Forge is a process execution framework Automates the process of creating a deployable application from source artifacts Eliminates manual handoffs between code, build, test, and deploy teams Self documenting system IBM Software Group | Rational Software | Build Forge System Overview BUILD/RELEASE AUTOMATION FRAMEWORK Management Console IDE Plug-Ins Centralized Web-based, Collaborative Distributed Access, Role-Based Security Developer Self-Service, Role-Based Security Control Acceleration Server Mgmt Notification Scheduling Log Analysis Tracking Reporting Process Automation Automated, Repeatable Application Development Lifecycle Development Source Control Product Build Scripting IDEs • RAD • Eclipse • Visual .NET Platforms Quality Assurance Package Release Python, VBscript, Batch, Perl, KSH Languages • Java •C • C++ • C# • etc. Source Control • ClearCase • StarTeam • Perforce • CVS • PVCS • VSS • Synergy • Subversion • etc. Change Mgmt • ClearQuest • Remedy • ChangeMan • DevTrack • Bugzilla • etc. Build Tools • ClearMake • Ant • NAnt • Make • GNUMake • NMake • Open Source • etc. UNIX, Windows Mac, Linux, Proprietary Test Tools • TestManager • Performance • Functional • Robot • LoadRunner • TestDirector • WinRunner • Junit • etc. Release Tools • Tivoli • WebSphere • WebLogic • WIS • etc. IBM Software Group | Rational Software | Build Forge How Build Forge Works ACCESS EXECUTE IMPLEMENT Build Forge Management Console Build Forge Server Build Forge Agents Source Control Windows Build Forge Engine • • • • • • • • • 3 Tier Architecture Centrally Managed Orchestrates Build Forge Tasks Linux HP-UX AIX Build Systems Server Pool Manage Users Configure Resources Set up Build Projects and Steps Schedule Builds and View Status Troubleshoot Build Issues Reporting & Analysis Build Forge IDE Plug-in Solaris Build Forge Database Oracle MySQL SQL Server Sybase • • • • • • Projects and Steps Server Configurations Environment Configurations User/Permission Information Build Statistics System Master Log AIX Windows Linux Solaris Windows Linux Windows Windows HP-UX AIX Mac HP-UX AIX Mac Quality Assurance • Developer Self Service Source Code Repositories Test Suites Deployment Tools SCM Applications Integration • Command Line • Adaptors • API Windows Solaris Linux Agents • Real Time Environment Configuration • Execute Project Steps • Return Output / Logs to Mgmt Server IBM Software Group | Rational Software | Build Forge The Complete Software Delivery Platform IBM Rational Application Developer Developer IBM Rational Build Forge IBM Tivoli Provisioning Manager Build Engineer Deployer Build Records Source Build Results Deployment Unit Deployment Records Tester Analyst Test Results IBM Rational RequisitePro Business Policies/Goals Requirements Test Cases IBM Rational ClearCase and ClearQuest IBM Rational ClearQuest IBM Software Group | Rational Software | Build Forge Build Forge Value Drivers Customer results: reduced cost, improved quality, faster delivery, better compliance Reduced cost of software delivery Through standardized processes, team efficiency, effective asset leverage and hardware usage Increased quality of releases Delivered through reliable, repeatable processes and rapid error detection Decreased overall time to market Through more frequent, iterative development cycles linking development to production Compliance & Governance By providing traceability and auditability of your release process IBM Software Group | Rational Software | Build Forge Compliance Development Application Operations Where these Tests Of this Executable This Produced these Release Test Results System Implemented these on this Requirements Which required these Environment Changes In this Implemented with this Source Code Approval Built using these Approved by Which deployed these Build Scripts Build Artifacts Deployment Artifacts Business value: traceability and consistency drives reproducibility IBM Software Group | Rational Software | Build Forge Governance Code Code Build Build Design Deploy Business value: consistent processes drive IT efficiency ® IBM Software Group Customers © IBM Corporation IBM Software Group | Rational Software | Build Forge Who Uses Rational Build Forge Open View Laser Jet IBM Software Group | Rational Software | Build Forge Rational Case Study Environment “Build Forge helped us improve our turnaround times, quality and overall process by giving us a continuous integration system that allows us to notify developers of project status” Problem 47 Active Projects / Products – 3 Locations Release Team is bottleneck. No developer capabilities 8 Platforms, 124 Build Machines Serial and manual work effort Rational Products Windows, All Unix Flavors 24 Hour “Suite” Build, 14 Hour Product Build Solution Implemented Developer selfservice in 3 mos. “Suite” and point product builds reduced to 3 hours Parallel processes implemented. Automated packaging IBM Software Group | Rational Software | Build Forge Siemens Medical Case Study “We were interested to adopt Agile Development, but were limited by an inflexible, non-standard build process. Each team did their own thing, and there were multiple points of failure on each project.” Environment Problem Solution 1000+ users No standards Build machines around the world (US, EMEA, India) No global access # of build cycles increased 3X Multiple points of failure Build times reduced by 65% Continuous unit testing (Cactus and Junit) Low developer productivity Secure developer self-service established ClearCase, ClearQuest, Test Director No continuous integration $6M savings over 3 years IBM Software Group | Rational Software | Build Forge MetLife Case Study “Build Forge has allowed us to formalize our process and put in place controls to enforce the process through automation that has also streamlined our entire application delivery environment.” Environment Several hundred developers; outsourced script dev Customer-facing web application development Java; Make StarTeam Windows, Linux, All Unix Flavors Problem Failed internal audit in prep for SarBox audit Could not reproduce production app Inability to document deployment process Solution Build Forge projects implement repeatable deployment process Automation has introduced consistency and speed to the process Self-documenting builds provide reliable audit tool IBM Software Group | Rational Software | Build Forge Electronic Arts Case Study “The environment necessary for a successful build is very complex, and is different for every product. This information must be carefully maintained and consistently used.” Environment Problem 500 Developers – 30 CM’s No centralized release mgmt. 20 Products Underutilized server farm C++, .NET, Perl, Python Perforce, DevTrack Windows, Xbox, Playstation 60,000+ graphic files built daily that take 30 minutes to 60 hours Solution Build times reduced by as much as 20X. from 60 to 3 hours. Machine usage improving – reduced HW buys. Management has new intelligence with dashboards. IBM Software Group | Rational Software | Build Forge Build Forge ROI Facts Hurwitz ROI Study, 2005 Benefit Average Improvement Highest Improvement Speeds of Builds and Releases 110% 500-2,000 % (5X-20X) CM/Build Team Productivity 42% 90% or greater Release Frequency 40% 90% or greater Error Reduction 30% 70-80% Developer Productivity 28% 81-90% Development Cost Savings 25% 50-70% General Example: Three year savings $11,287,500 using above Averages Productivity Average Improvement Build Forge Users Average Cost Per Headcount Annual Productivity Savings CM/Build Team 42% 5 $125,000 $262,500 Developers 28% 100 $125,000 $3,500,000 Total Quantified Annual Savings $3,762,500 IBM Software Group | Rational Software | Build Forge Rational Build Forge – Driving Customer Value “We were able to improve from 18 builds per week to over 360 builds per week! Across 50 other projects, that will save us millions annually!” -- Adobe Customer results: higher productivity, improved quality, faster delivery, reduced cost Higher productivity/Reduced cost – typical payback in less than 6 months, millions saved annually. Increased quality of products delivered through reliable, repeatable processes and rapid error detection – as much as 70% improvement. Faster software delivery through more frequent, iterative development cycles. As much as 3 to 20 times faster. Better compliance and governance with integrated audit trails, traceability, and IT controls for each release IBM Software Group | Rational Software | Build Forge Questions IBM Software Group | Rational Software | Build Forge