Six Sigma Example Project Report Presentation Project Number: ABC-123 Project Name: Company New Business Improvement Project Team Leader: Tom Jones Project Sponsor: Sally Run Six Sigma Roadmap Define Measure Analyze Improve Control Company New Business Improvement 2 .PPT All Rights Reserved, Juran Institute, Inc. Operational Definitions of Key Terms Cat 5: Category 5 proposals COPQ: Cost of Poor Quality Delivery SLA: Deliver proposal within agreed time frame, default: 10 business days IS: Infrastructure support On Time delivery: Proposal delivery within agreed timeframes, either to agreed service level of 10 business days between requirement confirmation date and first delivery date or as otherwise agreed RFP: Requirements for Proposal Form, to communicate project PMO: Proposal Management Office Company New Business Improvement 3 .PPT All Rights Reserved, Juran Institute, Inc. Project Goal & Scope Problem Statement: The Company Bid & Proposal process requires improvements in the low proposal approval rate (67% overall proposal approval rate), slow delivery speed (only 64.6% of proposals are delivered in the agreed timeframe) and cost (overspend forecasted against FY08 B&P budget). Goals/Objective(s): Improve delivery speed to 95% of Cat 5 proposals delivered in agreed timeframe and approval rate to 94% of Cat 5 proposals approved by the end FY08 (Mar 2008). In Scope: Company account Proposal management process for Cat 5 proposals Items Out of Scope: Cat 1-4 proposals Database process Other accounts Company New Business Improvement 4 .PPT All Rights Reserved, Juran Institute, Inc. Financial Impact: Business Case or COPQ Calculation Calculation of potential Cost reduction and Revenue increase Assumptions: 1. 2. 3. Reduction of wasted effort for declined proposals leads to cost savings Reduction of declined proposals leads to increased revenue Half the avoided declined proposals can be won Data: Cat 5 only, source: Database, P/L cost report Proposal data for Apr06 – Aug07 hourly cost only (no allocations, leave pay, …) Item Current Cost of declined, annual Total Proposal Income Lost, annual Goal Delta $79,654 $10,644 $69,000 $2,650,329 $1,325,164 $1,325,164 Convert 50% to won 662,582 Potential Cost Reduction of $69,000 and Revenue Increase of $662,582 Company New Business Improvement 5 .PPT All Rights Reserved, Juran Institute, Inc. High Level Process Map (SIPOC) Complete Commercial Qualification Complete Technical Qualification Confirm Customer Requirements Design Project/ Solution Conduct Internal Reviews The scope of this project covers the Company steps of the Bid and Proposal process Company New Business Improvement 6 .PPT All Rights Reserved, Juran Institute, Inc. Voice of the Customer—CTQ Company New Business Improvement 7 .PPT All Rights Reserved, Juran Institute, Inc. Six Sigma Roadmap Define Measure Analyze Improve Control Company New Business Improvement 8 .PPT All Rights Reserved, Juran Institute, Inc. Translate Ys From CTQs VOC quotes could be translated into 2 Ys Company New Business Improvement 9 .PPT All Rights Reserved, Juran Institute, Inc. Project Y (or Ys) in Y=f(x) Y1: Proposal Acceptance Rate = accepted Cat 5 proposals / all Cat 5 proposals accepted and declined x 100; calculated monthly Y2: Delivery in SLA timeframe = Cat 5 proposals delivered in agreed timeframe / total Cat 5 proposals delivered x 100; calculated monthly, as calculated by Database system (see operational definition) Company New Business Improvement 10 .PPT All Rights Reserved, Juran Institute, Inc. Detailed Process Map: Proposal Management Cat 5 Commercial Qualification often rushed Requirements often not well understood Handovers often via Database system, not via verbal comms Even small Cat5 proposals are reviewed Often Rework is not captured properly Work often delegated to inexperienced Solution Designers Final Reviews by PM and Architects are often missed Process workshop immediately identified key issues Company New Business Improvement 11 .PPT All Rights Reserved, Juran Institute, Inc. Data Collection Process Measures Defined Input Measures: Proposal Requests: Number of proposal requests per month Process Measures: Withdrawn Proposals: Number of proposal requests withdrawn per month Commercial Qualification: Number of proposal requests with completed Commercial Qualification documentation Customer Requirement Confirmation: Business Days between Proposal Request Date and Confirmation Date Proposal Reviews: Number of Proposal Reworks Delivery Time: Days between Customer Requirement Qualification and Proposal delivery Output Measures: Approvals: Number of proposals accepted Declines: Number of Proposals declined Proposal cost: Labor cost per Proposal Proposal Revenue: Expected Revenue per Proposal Company New Business Improvement 12 .PPT All Rights Reserved, Juran Institute, Inc. Data Collection (continued) CTQs and Specifications CTQ #1: Proposals delivered in individually agreed timeframe Specification: Proposals are delivered to the customer before or on the agreed delivery date (SLA or individually agreed delivery time) Defect: Proposal delivery date later than agreed delivery date Upper barrier: 100%, LSL: 85% CTQ #2: Customer Requirements confirmed Specification: Proposals are confirmed with the customer on the agreed Customer Requirements Confirmation date Defect: Proposals are not confirmed with the customer on the agreed Customer Requirements confirmation Date Upper barrier: 100%, LSL: 95% CTQ #3: Commercial Qualification Specification: Proposals are fully commercially qualified Defect: Proposals are not fully commercially qualified Upper barrier: 100%, LSL: 95% CTQ #4: Proposal Reviews Specification: Proposals are reviewed by the required people Defect: Proposals are reviewed too often or not by the right people Upper barrier: 100%, LSL: 95% Company New Business Improvement 13 .PPT All Rights Reserved, Juran Institute, Inc. Plan for Data Collection Questions to be answered: Y1: Withdrawn proposals 1. How often is a proposal withdrawn before delivery to the customer? 2. What are the reasons for the withdrawals? 3. How much effort/cost is wasted on withdrawn proposals? Y1: Declined proposals 4. How often are proposals declined? 5. What are the reasons a customer declines a proposal? 6. How much effort/cost is wasted on declined proposals? Y2: Delivery timeframe 7. How long does the delivery of a proposal take? 8. How long does it take to deliver a proposal after the requirements are confirmed with the customer? 9. How often is a proposal late, eg delivered after the agreed delivery date? Y2: Proposal rework 10. How often are proposals rejected by the customer and need to be reworked? Company New Business Improvement 14 .PPT All Rights Reserved, Juran Institute, Inc. Plan for Data Collection (continued) Company New Business Improvement 15 .PPT All Rights Reserved, Juran Institute, Inc. Measure Process Capability Y2 Proposal Delivery Time Proposal Delivery Time (Business Days) 350 300 Proposal 123984: confirmed outlier Business Days 250 200 Proposal 124286: confirmed outlier 150 100 50 0 Dec-06 Jan-07 Feb-07 Mar-07 Apr-07 May-07 Jun-07 Jul-07 Aug-07 Sep-07 Oct-07 Nov-07 Dec-07 Proposal Delivery Time displays two outliers Company New Business Improvement 16 .PPT All Rights Reserved, Juran Institute, Inc. Measure Process Capability (continued) Boxplot of Delivery time 70 60 Delivery time 50 40 30 20 10 0 Plots of Proposal Delivery Time (2 outliers removed) Company New Business Improvement 18 .PPT All Rights Reserved, Juran Institute, Inc. Measure Process Capability (continued) Proposal Delivery Service Level (Proposals delivered in agreed Timeframe 35 90% 80% 30 No of Proposals 60% 20 50% 15 40% 30% 10 20% 5 % delivered within SLA 70% 25 Process Capability (12 mth average) Total Proposals Delivered: 230 Delivery SLA met: 130 On Time Ratio: 57% DPMO: 435,000 Y2 Sigma: 1.66 10% - 0% Jan-07 Feb-07 Mar-07 Proposals delivered Apr-07 May-07 Jun-07 Jul-07 Proposals delivered in agreed time Aug-07 Sep-07 Delivery Time Ratio Oct-07 Nov-07 Dec-07 Linear (Delivery Time Ratio) Proposal Delivery Service Level: 10 days from Requirements confirmation or as agreed The Proposal Delivery to an Agreed Date is getting worse Company New Business Improvement 19 .PPT All Rights Reserved, Juran Institute, Inc. Measure Process Capability (continued) Process Cycle Time Analysis Analysis of a sample of 26 proposals: 13 accepted, 13 declined 3 key process steps: Request Qualification, Proposal Development, Reviews Commercial Qualification Technical Qualification Qualification Average 26 samples Average 13 Accepted proposals Average 13 Declined proposals Customer Requirement Confirmation Project/ Solution Design Internal Reviews Proposal Development Reviews Delivery to Customer Qualify Phase Development phase Review Phase Total Duration Duration Duration Duration Hand Hand Hand Hand (Business (Business (Business (Business overs overs overs overs Days) Days) Days) Days) 6.0 3.2 9.2 1.6 3.0 2.4 18.1 7.2 7.2 3.1 8.5 2.2 2.6 2.6 18.3 7.8 4.8 3.4 9.8 1.0 3.3 2.2 17.8 6.5 Rework analysis – 46% (12 or 26 proposals) of the sampled proposals had at least 1 rework step (data not shown) Many handovers in the Request Qualification and the Review phases as well as the Rework amount appear to be a cause for delay Company New Business Improvement 20 .PPT All Rights Reserved, Juran Institute, Inc. Measure Process Capability (continued) Y1 Acceptance Rate Acceptance and Overall Success rates 100% 90% 80% Process Capability Proposal Acceptance 70% 60% 50% Proposals Accepted 189 Proposals Declined: 33 Acceptance Ratio: 85% DPMO: 150,000 Y1 Sigma: 2.54 40% Jan-07 Feb-07 Mar-07 Apr-07 May-07 Jun-07 Acceptance rate Acceptance Rate = Overall success rate Jul-07 Aug-07 Sep-07 Linear (Acceptance rate) Oct-07 Nov-07 Dec-07 Linear (Overall success rate) Accepted Proposals Accepted + Declined Proposals Overall Success Rate (3 month average) = Accepted Proposals Accepted + Declinded + Withdrawn Proposals The high number of declined proposals over the last 12 months indicates lost efforts Company New Business Improvement 21 .PPT All Rights Reserved, Juran Institute, Inc. Measurement System Analysis Risk of poor Data Data Generation: Low risk: All data is entered into Database, workflow is automated and all Entries are time stamped. Data extraction: All data extracts are carried out via automated Database and SAP reports Data manipulation: All manipulation of data is carried out in EXCEL MSA Incorrect count of delivered Proposals (calculate business days, exclude ‘on hold’ days): based on Extract from Database (801 line items), remove Requests for Change, Budget advices, proposals delivered before Jan 07 or after Aug 07, Cat 1-4 proposals) Error in Database functionality: 2 proposals didn’t have a delivery date, even though they were delivered Measurement System Analysis 2 operators calculating the total category 5 proposals delivered during Jan-Aug 07 from Database Extracts Trial 1 results Operator 1: SE 165 Operator 1: SE 173 Operator 2: SG 162 Operator 2: SG 164 Exact value 164 MSA failed due to wide variance in the calculated number of proposals. Work instructions were created to remove variance. Calculations were not re-tested, due to a changed procedure and staff changes. Company New Business Improvement 22 .PPT All Rights Reserved, Juran Institute, Inc. Potential Xs: XY Prioritization Matrix Possible X's X1 Poorly understood Requirements X2 Poor Commercial Qualification X3 Missing Communication (due to Transact workflow) Missing Proposal reviews by Project Managers X4 Too much rework BSL Pricing information not readily available X5 Missing contact with the customer X6 Lack of proposal ownership Too many financial and commercial reviews for small X7 proposals Price too high Duplicate proposals Proposal request without BSL Business Case Weight of Project Y (0=low, 5=-high) 5 5 5 9 9 3 9 3 9 3 9 5 1 5 1 5 9 9 0 5 5 9 5 5 9 5 5 L TO TA Pr op Re osa du l C cti ost on De Y2 P Tim ropo sa e l Y1 P Ac ropo ce pta sal nc e Ra te Ratings of X's : 0-no relationship 1-a little 3-moderate 5- High 9-Extremely High liv ery X Y Prioritization Matrix - BlueScope Steel New Business Improvements Rank 105 105 85 35 115 50 95 95 2 2 6 11 1 9 4 4 0 9 5 70 7 9 1 9 0 1 1 0 3 3 45 25 65 10 12 8 The team agreed on seven potential causes to be analyzed further Company New Business Improvement 26 .PPT All Rights Reserved, Juran Institute, Inc. Potential Xs: Selection of Xs Seven potential causes will be analyzed further Company New Business Improvement 27 .PPT All Rights Reserved, Juran Institute, Inc. Potential Xs—Theories To Be Tested Seven potential causes will be analyzed to identify the Root Causes (vital few Xs) Company New Business Improvement 28 .PPT All Rights Reserved, Juran Institute, Inc. Six Sigma Roadmap Define Measure Analyze Improve Control Company New Business Improvement 29 .PPT All Rights Reserved, Juran Institute, Inc. Theories To Be Tested Theories for Causal Relationships to be Analyzed X1 Poorly understood requirements X6 Lack of Proposal Ownership A survey was considered but not used due to political and timing reasons X2 Poor Commercial Qualification Y1 Poor Proposal Acceptance X3 Missing Communication in Company X5 Not enough contact with the customer Y2 Proposals are delivered late X4 Too much Rework X7 Financial & Comm. Reviews not needed Seven potential causes leading to nine theories to be tested. The team decided against using X6 for further analysis (covered in X1, X2, X3, x5). Company New Business Improvement 30 .PPT All Rights Reserved, Juran Institute, Inc. Data Collection Plan for Analyze Phase Company New Business Improvement 31 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories Y1 Acceptance Rate=f(X1 Understanding of Customer Requirements) Theory: No difference in Proposal Acceptance Rate after introduction of customer requirement confirmation date Ho: No difference in Proposal Acceptance rate due to customer requirement date Ha: Significant difference in Proposal Acceptance Rate due to customer requirement date Analysis: Test and CI for Two Proportions Sample X N Sample p Date OK 3 27 0.111111 Date not OK 4 21 0.190476 Difference = p (1) - p (2) Estimate for difference: -0.0793651 95% CI for difference: (-0.284933, 0.126203) Test for difference = 0 (vs not = 0): Z = -0.76 P-Value = 0.449 NOTE * The normal approximation may be Inaccurate for small samples. Fisher's exact test: P-Value = 0.683 Statistical Conclusion: alpha = 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: The Proposal Acceptance rate does not change due to customer requirement date. Company New Business Improvement 32 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y2 Delivery SLA=f(X1 Understanding of Customer Requirements) Theory: No difference in Proposal Delivery SLA performance due to customer requirement date Ho: No difference in Proposal Delivery SLA performance due to customer requirement date Ha: Significant difference in Proposal Delivery SLA performance due to customer requirement date Analysis: Test and CI for Two Proportions Sample X N Sample p Date OK 16 27 0.592593 Date not OK 8 21 0.380952 Difference = p (1) - p (2) Estimate for difference: 0.211640 95% CI for difference: (-0.0667272, 0.490008) Test for difference = 0 (vs not = 0): Z = 1.49 P-Value = 0.136 Statistical Conclusion: alpha = 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: There is no difference in Proposal Delivery SLA performance due to customer requirement date. Company New Business Improvement 33 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y1 Acceptance Rate=f(X2 Commercial Qualification) Theory: No difference in the Proposal Acceptance Rate after introduction of Commercial Qualification meetings (Commercial Qualification meetings were introduced Sept 2007) Ho: No difference in Proposal Acceptance Rate after introduction of CQ meetings Ha: Significant difference in Proposal Acceptance Rate after introduction of CQ meetings Analysis: Test and CI for Two Proportions Sample X N Sample p CQ Meetings 11 56 0.196429 No CQ Meetings 22 166 0.132530 Difference = p (1) - p (2) Estimate for difference: 0.0638985 95% CI for difference: (-0.0522402, 0.180037) Test for difference = 0 (vs not = 0): Z = 1.08 P-Value = 0.281 Statistical Conclusion: alpha = 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: There is no difference in the Proposal Acceptance rate after the introduction of Commercial Qualification meetings. Company New Business Improvement 34 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y1 Acceptance Rate=f(X3 Missing Communication Within Company) Theory: No difference in the Proposal Acceptance Rate due to RFP document usage. Ho: No difference in Proposal Acceptance Rate due to RFP document usage Ha: Significant difference in Proposal Acceptance Rate due to RFP document usage Analysis: Test and CI for Two Proportions Sample X N Sample p RFP OK 7 22 0.318182 RFP not OK 27 46 0.586957 Difference = p (1) - p (2) Estimate for difference: -0.268775 95% CI for difference: (-0.509869, -0.0276799) Test for difference = 0 (vs not = 0): Z = -2.18 P-Value = 0.029 Statistical Conclusion: alpha = 0.05. P is smaller than 0.05 reject Ho Practical Conclusion: There is significant difference in the Proposal Acceptance rate after introduction of good documentation of requirements in RFP documents. Company New Business Improvement 35 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y2 Delivery SLA=f(X3 Missing Communication Within Company) Theory: No difference in Proposal Delivery SLA performance due to RFP document usage. Ho: No difference in Proposal Delivery SLA performance due to RFP document usage Ha: Significant difference in Proposal Delivery SLA performance due to RFP document usage Analysis: Test and CI for Two Proportions Sample X N Sample p RFP OK 10 20 0.500000 RFP not OK 18 37 0.486486 Difference = p (1) - p (2) Estimate for difference: 0.0135135 95% CI for difference: (-0.258433, 0.285460) Test for difference = 0 (vs not = 0): Z = 0.10 P-Value = 0.922 Statistical Conclusion: 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: There is no difference in Proposal Delivery SLA performance due to the use of RFP document for requirement documentation. Company New Business Improvement 36 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y1 Acceptance Rate=f(X4 Rework) Theory: No difference in Proposal Acceptance Rate because of Proposal Rework Ho: No difference in Proposal Acceptance Rate due to the occurrence of rework Ha: Significant difference in Proposal Acceptance Rate due to the occurrence of rework Analysis: Test and CI for Two Proportions Sample X N Sample p No Rework 24 50 0.480000 Rework 10 18 0.555556 Difference = p (1) - p (2) Estimate for difference: -0.0755556 95% CI for difference: (-0.343644, 0.192533) Test for difference = 0 (vs not = 0): Z = -0.55 P-Value = 0.581 Statistical Conclusion: 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: There is no difference in the Proposal Acceptance rate due to the occurrence of Proposal rework. Company New Business Improvement 37 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y2 Delivery SLA=f(X4 Rework) Theory: There is no difference in Proposal Delivery SLA performance because of Rework Ho: No difference in Proposal Delivery SLA performance due to Rework Ha: Significant difference in Proposal Delivery SLA performance due to Rework Analysis: Test and CI for Two Proportions Sample X N Sample p No Rework 19 50 0.380000 Rework 10 18 0.555556 Difference = p (1) - p (2) Estimate for difference: -0.175556 95% CI for difference: (-0.441630, 0.0905194) Test for difference = 0 (vs not = 0): Z = -1.29 P-Value = 0.196 Statistical Conclusion: 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: There is no difference in the Proposal Delivery SLA performance because of the occurrence of Rework. Company New Business Improvement 38 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y1 Acceptance Rate=f(X5 Missing Customer Contact Before Proposal Delivery) Theory: No difference in Proposal Acceptance Rate due to customer contact before proposal delivery. Ho: No difference in Proposal Acceptance Rate due to customer contact before proposal delivery Ha: Significant difference in Proposal Acceptance Rate due to customer contact before proposal delivery Analysis: Test and CI for Two Proportions Sample X N Sample p Effective contact 12 28 0.428571 No effective contact 22 49 0.448980 Difference = p (1) - p (2) Estimate for difference: -0.0204082 95% CI for difference: (-0.250612, 0.209796) Test for difference = 0 (vs not = 0): Z = -0.17 P-Value = 0.862 Statistical Conclusion: 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: There is no difference in the Proposal Acceptance rate due to customer contact before the delivery of the proposal. Company New Business Improvement 39 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y2 Delivery SLA=f(X5 Missing Customer Contact Before Proposal Delivery) Theory: No difference in Proposal Delivery SLA performance due to customer contact before proposal delivery. Ho: No difference in Delivery SLA performance due to customer contact before proposal delivery Ha: Significant difference in Delivery SLA performance due to customer contact before proposal delivery Analysis: Test and CI for Two Proportions Sample X N Sample p Effective contact 0 14 0.000000 No effective contact 34 63 0.539683 Difference = p (1) - p (2) Estimate for difference: -0.539683 95% CI for difference: (-0.662759, -0.416606) Test for difference = 0 (vs not = 0): Z = -8.59 P-Value = 0.000 Statistical Conclusion: alpha = 0.05. P is smaller than 0.05 reject Ho Practical Conclusion: Customer contact before the delivery of the proposal does significantly improve the Delivery SLA performance. Company New Business Improvement 40 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y2 Delivery SLA=f(X7 Financial/Commercial Reviews) Theory: No difference in Proposal Delivery SLA performance due to Financial and Commercial review (F&C review) steps Ho: No difference in Delivery SLA performance due to F&C Review steps Ha: Significant difference in Delivery SLA performance due to F&C Review steps Analysis: Sampled proposals: 53 Average Duration of Financial and Commercial reviews: 0.98 business days Test and CI for Two Proportions Sample X N Sample p No F&C Review 23 53 0.433962 F&C Review 16 53 0.301887 Difference = p (1) - p (2) Estimate for difference: 0.132075 95% CI for difference: (-0.0498017, 0.313953) Test for difference = 0 (vs not = 0): Z = 1.42 P-Value = 0.155 Statistical Conclusion: alpha = 0.05. P is greater than 0.05 fail to reject Ho Practical Conclusion: There is no difference in the SLA performance because of the Financial and Commercial Review steps. Company New Business Improvement 41 .PPT All Rights Reserved, Juran Institute, Inc. Summary of Testing Results Potential Cause X Theory Analyze Results Team Decisions X1 Understanding of Customer Requirements Requirement Confirmation meeting impacts Proposal Acceptance rate False No statistical evidence No relevance X1 Understanding of Customer Requirements Requirement Confirmation meeting impacts Delivery SLA performance False No statistical evidence Understanding of requirements speeds up the process X2 Commercial Qualification Commercial Qualification meetings impact on Proposal Acceptance rate False No statistical evidence Commercial Qualification avoids wasted effort in withdrawn and declined proposals X3 Missing Communication within Company Good RFP documentation impacts on Proposal Acceptance rate True Statistical evidence Documented requirements confirm customer expectations X3 Missing Communication within Company Good PRFP documentation impacts on Delivery SLA performance False No statistical evidence Documented requirements improve internal communication X4 Rework Occurrence of Rework impacts on Proposal Acceptance rate False No statistical evidence Little relevance X4 Rework Occurrence of Rework impacts on Delivery SLA performance False No statistical evidence Rework is waste X5 Missing customer contact before delivery Customer contact impacts on Acceptance rate False No statistical evidence Little relevance X5 Missing customer contact before delivery Customer contact impacts on Delivery SLA performance True Statistical evidence Customer contact is important for expectation management X7 Too many reviews Financial and Commercial reviews impact on Delivery SLA performance False No statistical evidence On average 1 business day is lost in F&C reviews The team decided to continue looking for solutions for the proven causes X3, X5, and also for causes X1, X2, X4, and X7. Company New Business Improvement 42 .PPT All Rights Reserved, Juran Institute, Inc. Vital Few Xs Y=f(X1,……Xn) Vital Few Xs are: X1: Confirmation of Customer Requirements X2: Commercial Qualification X3: Missing Communication Within Company (proven cause) X4: Rework X5: Missing customer contact before delivery (proven cause) X7: Too many reviews Company New Business Improvement 43 .PPT All Rights Reserved, Juran Institute, Inc. Six Sigma Roadmap Define Measure Analyze Improve Control Company New Business Improvement 44 .PPT All Rights Reserved, Juran Institute, Inc. Improvement Strategies for Proven Xs Proven Xs (Causes): Strategies: X1 Confirmation of Customer Requirements To improve Customer Requirement Confirmation, we need to involve Company staff in the planning discussions X2 Commercial Qualification To improve Commercial Qualification process, we need to install qualification metrics X3 Missing Communication within Company (proven cause) To improve Company-internal communication we need to ensure better documentation of confirmation of customer requirements and remove process handovers where possible. X4 Rework To avoid proposal rework we need to ensure confirmation of customer requirements and standardize the proposal process. X5 Missing customer contact before delivery (proven cause) To better manage Customer expectations, we need to ensure that Company staff informs BlueScope if the proposal is expected to be delivered late. X7 Too many reviews To reduce internal reviews, we need to remove those that don’t add value. The team decided to continue looking for solutions for the proven causes X3, X5, and also for causes X1, X2, and X7. Company New Business Improvement 45 .PPT All Rights Reserved, Juran Institute, Inc. Solution Alternatives Cause X Solutions from Workshops X1 Confirmation of Customer Requirements Involve Service Manager in bid process Rotate people on sites to sit in planning meeting Confirm each proposal within 48 hours (meeting or phone) X2 Commercial Qualification Create and implement qualification metrics to review the CQ performance (actual vs. planned: effort, confirmation date). X3 Missing Communication within Company Confirm customer requirements Request sufficient RFP documentation for each proposal Remove process handovers X4 Rework Confirm customer requirements, Request sufficient RFP documentation for each proposal Create a pricing database. X5 Missing customer contact before delivery Proposal Owner/Solution Developer to contact the customer before the delivery of a proposal, especially if the proposal is expected to be delivered late X7 Too many reviews Remove the mandatory Financial and Commercial review steps for Cat 5 proposals The team workshopped alternative solutions for the various causes X Company New Business Improvement 46 .PPT All Rights Reserved, Juran Institute, Inc. Possible Solutions Matrix (vs. Proven Xs) Company New Business Improvement 47 .PPT All Rights Reserved, Juran Institute, Inc. Selection Criteria The team felt that alternatives selected should fulfill the following criteria’s: A. Must Criteria (Weighting) Has an impact on Y1 or Y2 Y/N Accepted by relevant stakeholders (Account Management, Architects, New Business, Finance, Commercial and PMO) Y/N B. Want Criteria (Weighting) Improve delivery on time 10 Reduces Bid and Proposal cost 10 Improve Commercial Qualification 8 Improve proposal review process 7 Increase proposal acceptance rate 10 Improve Requirements Confirmation 10 Company New Business Improvement 48 .PPT All Rights Reserved, Juran Institute, Inc. Selected Solution and Selection Process Selected Solution All solution alternatives proposed by the team have been accepted by the Champion. Selection Process Tools Considered: Pugh Concept Selection matrix (shown on next slide) Criteria Based Selection matrix Given that all “must” criteria were met, the Pugh matrix was the preferred tool. The team felt that all solution alternatives satisfy the Must criteria, and a Pugh matrix process was chosen to select the strongest solutions. Company New Business Improvement 49 .PPT All Rights Reserved, Juran Institute, Inc. Evaluation Using Pugh Concept Selection Matrix Quick Win Phase 2 Solution Phase 1 solutions The team selected five improvement alternatives based on the Pugh matrix process and one other improvement as a quick win. Five improvements will be implemented in the first project phase and one in a separate project. Company New Business Improvement 50 .PPT All Rights Reserved, Juran Institute, Inc. Pay-off Matrix of Selected Solutions Key: Brown Solutions are Phase II Confirm each request within 48 hours Contact customer if proposal is late High Request sufficient RFP documentation Rotate Company staff on site The high cost/ high effort solutions involve significant customer negotiations. One of them will be implemented in Phase 2. Benefit Low New Commercial Qualification metrics Remove Financial and Commercial review steps for Cat 5 proposals All low cost solutions were identified as suitable for quick implementation Low High Cost/Effort Company New Business Improvement 51 .PPT All Rights Reserved, Juran Institute, Inc. Refine Solutions Testing and Validation X1 Confirmation of Customer requirements: It was agreed that multiple changes were required to ensure better understanding of the customer’s needs: Involve staff in planning processes, requesting better documentation, confirmation of requirements after Company started working on the proposals. These changes were validated with the PMO prior to implementation as valid to improve customer requirements understanding. X2 Commercial Qualification: PMO confirmed the need to have a strong qualification process in place. The new qualification process is closer to the model used on other accounts. X3 Missing communication within Company: Other accounts provided the model that was used for the new qualification review meeting on this account. Its validity is proven by the successes of other accounts. X4 Rework: A separate green belt project investigates the occurrence of proposal rework in the IS part of Company. It was assumed that this green belt project will drive further changes in the New Business area or proposal management.. X5 Missing customer contact before delivery: This cause was debated in length, as it was felt by some that customers don’t want to be ‘pestered’ with the vendor’s calls. A cultural and attitude change is required and the implementation of this change will require a longer time to complete. Its validity was confirmed by other Company accounts. X7 Too many reviews: Company’s E2E model doesn’t request financial and commercial reviews for Cat 5 proposals. These were implemented on request of Fin and Comm teams, who now agreed that the reviews can be removed. Company New Business Improvement 52 .PPT All Rights Reserved, Juran Institute, Inc. Refine Solutions (continued) Pilot Options A pilot was not required as a Risk assessment was carried out for each solution. Most of the solutions were piloted by other Company accounts in some way. The risk of damage because of failure was eliminated and hence “Piloting” was not required. Cost/Benefit Analysis Since the estimated cost of these solutions was not very significant, implementation proceeded without detailed cost/benefit analysis. The benefits were viewed as significant savings (based on COPQ analysis). All solution alternatives proposed by the team were accepted by the Champion Company New Business Improvement 53 .PPT All Rights Reserved, Juran Institute, Inc. Solution Details Solution 1: Rotate staff on site at Company A roster that allows 2 Company staff to be on site every day in the computer center will involve Company sufficiently in the planning processes and ensure more well documented proposal requests. Cost: Wireless network cards for all staff on the roster Risks: Small risk: If on site, Company staff might miss out on Company internal communication Solution 2: Confirm proposal requests within 48 hours As practiced on other Company accounts, for each proposal request, a Company person confirms the receipt, delivery and high level requirements with the customer Detailed requirements are confirmed later if required. Cost: none Risks: Small risk: Delay, if customer is not available for discussion Company New Business Improvement 54 .PPT All Rights Reserved, Juran Institute, Inc. Solution Details (continued) Solution 3: Commercial Qualification metrics Metrics that outline the quality of the qualification process: actual vs estimated spend, actual vs estimated requirement confirmation dates, likelihood of success. Cost: extra effort for PMO Risks: none Solution 4: Request sufficient RFP documentation RFP documentation was requested from Company for the last 6 months. Here an increased effort is required to get a better documentation of the proposal requirements. Cost: none Risks: Slow change, un-satisfied clients if not communicated well Company New Business Improvement 55 .PPT All Rights Reserved, Juran Institute, Inc. Solution Details (continued) Solution 5: Customer contact for late proposals For most proposals, especially those that might be delivered late, Bid owner or solution developer shall contact the customer and manage their expectations. Cost: none Risks: none Solution 6: Remove Financial and Commercial reviews For Cat 5 proposals, the Financial and Commercial Review steps can be removed Cost: none Risks: incorrect financial details and commercial terms included in the proposals. None of the six solutions included a significant risk Company New Business Improvement 56 .PPT All Rights Reserved, Juran Institute, Inc. Example: Selected Solutions Implementation Company New Business Improvement 57 .PPT All Rights Reserved, Juran Institute, Inc. Updated Process Map Proposal Management Cat 5 Company New Business Improvement 58 .PPT All Rights Reserved, Juran Institute, Inc. Updated Process Map (continued) Proposal Management Cat 5 New step: if requirement (RFP) document is not sufficient, return to customer for more details (Solution 4) New step: Commercial Qualification meeting for each proposal request. (part of Solution 3) New step: Confirm Proposal request within 48 hours (Solution 2) New step: Confirm Proposal Requirements within 5 days (part of Solution 2) Removed step: Financial and Commercial reviews for Cat 5 proposals removed (Solution 6) New step: Customer contact to manage expectation especially if the proposal is late (Solution 5) Company New Business Improvement 59 .PPT Five solutions include process changes All Rights Reserved, Juran Institute, Inc. Evaluation of Financial Impact Y1 Acceptance Rate Improved Commercial Qualification Increased income due to focus on ‘Deals we can win’ Y2 Improved Delivery time SLA Reduced waste, quicker proposal delivery, higher customer satisfaction Reduced proposal development cost Financial Impact 2007 Goal Withdrawal Cost ratio Withdrawal Cost (annual) Decline Cost ratio Decline Cost (annual) 10% $47,277.59 18% $83,933.17 7% $32,969.42 6% $28,259.50 Declined Income ratio Declined Income, annual 50% convertible to income 14% $2,870,279.81 Phase 3 Difference (Mar-Apr 2008) 8.0% 2% $ 35,990.10 $11,287.49 5.9% 12% $ 25,889.06 $58,044.11 $69,331.59 6% $1,202,266.86 $ 4.2% 10% 988,103.00 $1,882,176.81 $941,088.40 The improvements seem to generate the expected financial impact Company New Business Improvement 60 .PPT Cost Saving Income increase All Rights Reserved, Juran Institute, Inc. Statistical Proof of Improvement Y1 Acceptance Rate: Three data points after implementation of changes P Chart of Accepted by Stage 1 2 3 1.0 UCL=1 _ P=0.9583 Proportion 0.9 0.8 LCL=0.7688 0.7 0.6 0.5 1 3 5 7 9 Sample Tests performed with unequal sample sizes 11 13 15 Changes implemented The Acceptance Rate goal of 94% appears achievable based on the results after the first 3 months after the change was implemented Company New Business Improvement 61 .PPT All Rights Reserved, Juran Institute, Inc. Statistical Proof of Improvement (continued) Y1 Acceptance Rate Theory: No difference in Proposal Acceptance Rate due to project changes Ho: No difference in Proposal Acceptance Rate due to project changes Ha: Significant difference in Proposal Acceptance Rate due to project changes Analysis: Test and CI for Two Proportions Sample X N Sample p Before 35 233 0.150215 After 1 24 0.041667 Difference = p (1) - p (2) Estimate for difference: 0.108548 95% CI for difference: (0.0163748, 0.200721) Test for difference = 0 (vs not = 0): Z = 2.31 P-Value = 0.021 Statistical Conclusion: alpha = 0.05. P is smaller than 0.05 reject Ho. Practical Conclusion: The Proposal Acceptance rate has significantly improved because of project changes. Company New Business Improvement 62 .PPT All Rights Reserved, Juran Institute, Inc. Statistical Proof of Improvement (continued) Y2 Delivery SLA: Three data points after implementation of changes P Chart of New SLA met by stage Proportion 1 2 3 1.0 _ UCL=1 P=0.966 0.8 LCL=0.814 0.6 0.4 0.2 0.0 1 3 5 7 9 Sample Tests performed with unequal sample sizes 11 13 15 : Changes implemented The Delivery SLA goal of 95% appears achievable based on the first three months after the change was implemented Company New Business Improvement 63 .PPT All Rights Reserved, Juran Institute, Inc. Test of Theories (continued) Y2 Delivery SLA Theory: No difference in Delivery SLA Performance due to project changes Ho: No difference in Delivery SLA Performance due to project changes Ha: Significant difference in Delivery SLA Performance due to project changes Analysis: Test and CI for Two Proportions Sample X N Sample p Before 81 241 0.336100 After 1 29 0.034483 Difference = p (1) - p (2) Estimate for difference: 0.301617 95% CI for difference: (0.212359, 0.390875) Test for difference = 0 (vs not = 0): Z = 6.62 P-Value = 0.000 Statistical Conclusion: alpha = 0.05. P is smaller than 0.05 reject Ho. Practical Conclusion: The Delivery SLA Performance has significantly improved because of project changes. Company New Business Improvement 64 .PPT All Rights Reserved, Juran Institute, Inc. Six Sigma Roadmap Define Measure Analyze Improve Control Company New Business Improvement 65 .PPT All Rights Reserved, Juran Institute, Inc. Control Plan Company New Business Improvement 66 .PPT All Rights Reserved, Juran Institute, Inc. Control Charts Y1 Proposal Acceptance Rated P Chart of Accepted by Stage 2 1 3 UCL=1 _ P=0.9583 1.0 Proportion 0.9 0.8 LCL=0.7688 0.7 0.6 0.5 1 3 5 7 9 Sample 11 13 15 Tests performed with unequal sample sizes Changes implemented Company New Business Improvement 67 .PPT All Rights Reserved, Juran Institute, Inc. Control Charts (continued) Y1 Proposal Acceptance Rated P Chart of New SLA met by stage_1 1 2 3 _ UCL=1 P=0.9655 1.0 0.9 LCL=0.8137 Proportion 0.8 0.7 0.6 0.5 0.4 0.3 0.2 1 3 5 7 9 Sample 11 13 15 Tests performed with unequal sample sizes Changes implemented Company New Business Improvement 68 .PPT All Rights Reserved, Juran Institute, Inc. Project Benefits Financial (Hard) Benefits Increased Acceptance Rate: 96% – Extra annual revenue: $941,088/a Reduced Decline cost rate: 6% Proposal cost savings: $69,331/a Total financial impact: $1,010, 420/a Soft Benefits Accepted proposal ownership Improved SLA performance leading to improved customer satisfaction with Company’s proposal generation Improved communication within Company Less waste Company New Business Improvement 69 .PPT All Rights Reserved, Juran Institute, Inc. Project Results Project Baseline: Project Target: Project Actual: COPQ= $131,210/a COPQ= $61,229/a COPQ= $61,879/a Metric= Acceptance Rate Metric= Acceptance Rate Metric= Acceptance Rate DPMO= 150,000 DPMO= 60,000 DPMO= 42,000 Sigma Level= 2.54 Sigma Level= 3.05 Sigma Level= 3.25 Metric= Delivery SLA Metric= Delivery SLA Metric= Delivery SLA DPMO= 435,000 DPMO= 50,000 DPMO= 34,483 Sigma Level= 1.66 Sigma Level= 3.14 Sigma Level= 3.32 Company New Business Improvement 70 .PPT All Rights Reserved, Juran Institute, Inc.