-Green Team Evaluation Plan- -AuthorMarissa Hornbrook: Project Manager -DateDecember 10, 2010 SWDS - Green Team 1. Evaluation Plan 12/10/2010 Document Identification This document defines the criteria used to measure success for each phase of the SWDS project. Phase deliverables are evaluated based on the following management criteria: Time, as measured by the Management Plan Cost, as measured by the Budget Plan Scope, as measured by the project requirements Quality, as measured by customer feedback 1.1. Phase 0 SWDS was initially conceived in Phase 0. Research into the problem area allowed us to clearly identify the goals and objectives for the project, as well as create a list of risks. A Work Breakdown Structure (WBS) was created for each phase of the project, as well as implementation plans to guide each phase. Phase 0 also saw the creation of the original SBIR proposal, as well as a final proposal presentation and product website. 1.1.1. Deliverables SBIR Proposal 4 Presentations: Inception, Feasibility, Milestone, and Final Product Website 1.1.2. Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. 1.1.3. Cost This criterion is not used in Phase 0, as there is no Research and Development budget during this phase. 1.1.4. Scope The scope is measured by comparing the grading criteria against each deliverable. This criterion is considered met if each deliverable meets its grading criteria and Phase 1 funding is acquired. 1.1.5. Quality An independent panel will determine the quality of the proposal presentation, according to the grading criteria established by the Professional Workforce Development I professor. An average score of 90 or above for each deliverable will indicate a success. Peer evaluations were completed after each team milestone (Inception, Feasibility, and Milestone Presentations). Each member evaluated themselves and their teammates in participation, quantity, quality, and professionalism. 2 SWDS - Green Team 1.2. Evaluation Plan 12/10/2010 Phase 1 Phase 1 will see the development of a laboratory prototype and its demonstration to a potential customer. An SBIR Phase 2 proposal will also be developed. Success will be measured by satisfactory completion of the prototype, demonstration, and SBIR Phase 2 proposal. Evaluation during Phase 1 will consist of bi-weekly team meetings to ensure the phase is progressing according to the Management Plan. A prototype of the product hardware and software will be completed in Phase 1. The prototype includes: Ultrasonic Sensor/Microcontroller hardware pieces transmitting data to development computer functioning as a flashing road sign Web application with Administrative control panel SWDS Website Initial documentation for SWDS will also be developed during Phase 1, to include an implementation and user guide. 1.2.1. Deliverables Laboratory Prototype Customer Demonstration SBIR Phase 2 Proposal 1.2.2. Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. 1.2.3. Cost The Budget Plan determines the cost estimates for each phase. The actual costs for personnel and equipment will be compared to those items in the Budget Plan; a margin of error within ±5% will be considered acceptable. 1.2.4. Scope Scope in Phase 1 is measured by both the SBIR Phase 2 proposal and the laboratory prototype. Successful completion of all SBIR Phase 2 requirements is necessary to determine whether Phase 1 was within scope. The prototype must meet all required functionality as outlined in the requirements document for Phase 1. Scope for Phase 1 is only met if the SBIR Phase 2 proposal and the prototype are successful and Phase 2 funding is acquired. 1.2.5. Quality The SBIR presentation board will determine the quality of the proposal presentation. This criterion is considered met for the SBIR presentation upon successfully acquiring Phase 2 funding from the SBIR board. Quality is met for 3 SWDS - Green Team Evaluation Plan 12/10/2010 the laboratory prototype if it meets all requirements listed in the requirements document. Each module will undergo code review, unit testing, and integration testing. Once completed, the system itself will go under acceptance testing to ensure it complies with the features and performance expectations as outlined in the requirements document. 1.3. Phase 2 Phase 2 concerns real-world product design and development for SWDS. Evaluation will proceed in Phase 2 much as it did in Phase 1. Bi-weekly meetings will be held to determine if the project is on schedule and within budget, according to the Management and Budget Plans. Testing plans for the production version of SWDS will be drafted and used to measure completion of each module. Results of testing will be reviewed at the bi-weekly meetings. Customer feedback will facilitate refinements in our product and support materials. 1.3.1. Deliverables SWDS Software Package Implementation Procedures User Guides 1.3.2. Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. 1.3.3. Cost The Budget Plan determines the cost estimates for each phase. The actual costs for personnel and equipment will be compared to those items in the Budget Plan; a margin of error within ±10% will be considered acceptable. 1.3.4. Scope The real-world implementation will be measured against the functionality and performance requirements outlined in the requirements document. 1.3.5. Quality The real-world implementation for SWDS must pass all tests defined in Phases 1 and 2. The greatest measure of quality will come from the end-users and customers for each implementation of SWDS. 4 SWDS - Green Team 1.4. Evaluation Plan 12/10/2010 Phase 3 Phase 3 will focus on implementing customized versions of SWDS for new customers. Customer feedback will be used to measure quality. The marketing strategy will be evaluated to ensure we are targeting the correct market. Formal evaluations will be conducted periodically to ensure we stay within the guidelines of the WBS. Sales volume and profit margin will determine Phase 3’s success, along with customer and end-user feedback. 1.4.1. Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. 1.4.2. Cost The Budget Plan determines the cost estimates for each phase. The actual costs for personnel and equipment will be compared to those items in the Budget Plan; a margin of error within ±10% will be considered acceptable. 1.4.3. Scope Scope for Phase 3 will be determined by the break-even analysis in the Funding Plan. The actual profit and projected profit will be compared; a margin of error within ±10% will be considered acceptable. 1.4.4. Quality Quality for Phase 3 is measured by end-user and customer satisfaction surveys. 5