[DMS EVALUATION PLAN] December 16, 2009 Digital Mapping Solution DMS Staffing Plan Version: Author: Date: Status: 1.0 Brittany Cunningham 16 December 2009 Final Purpose This document defines the criteria used to measure success for each phase of the DMS project. Phase deliverables are evaluated based on the following management criteria: Time, as measured by the Management Plan, Cost, as measured by the Budget Plan, Scope, as measured by the project requirements, and Quality, as measured by customer feedback. ODU Computer Science | CS410 Green Team 1 [DMS EVALUATION PLAN] December 16, 2009 Phase 0 DMS was initially conceived in Phase 0. Research into the problem area allowed us to clearly identify the goals and objectives for the project, as well as create a list of risks. A Work Breakdown Structure (WBS) was created for each phase of the project, as well as implementation plans to guide each phase. Phase 0 also saw the creation of the original SBIR proposal, as well as a final proposal presentation and product website. Deliverables SBIR Proposal Proposal Presentation Product Website Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. Cost This criterion is not used in Phase 0, as there is no Research and Development budget during this phase. Scope The scope is measured by comparing the grading criteria against each deliverable. This criterion is considered met if each deliverable meets its grading criteria and Phase 1 funding is acquired. Quality An independent panel will determine the quality of the proposal presentation, according to the grading criteria established by the Professional Workforce Development I professor. An average score of 90 or above for each deliverable will indicate a success. Peer evaluations were completed after each team milestone (Inception, Feasibility, and Milestone Presentations). Each member evaluated themselves and their teammates in participation, quantity, quality, and professionalism. [This space intentionally left blank.] ODU Computer Science | CS410 Green Team 2 [DMS EVALUATION PLAN] December 16, 2009 Phase 1 Phase 1 will see the development of a laboratory prototype and its demonstration to a potential customer. An SBIR Phase 2 proposal will also be developed. Success will be measured by satisfactory completion of the prototype, demonstration, and SBIR Phase 2 proposal. Evaluation during Phase 1 will consist of bi-weekly team meetings to ensure the phase is progressing according to the Management Plan. A prototype of the product database and software will be completed in Phase 1. The software includes: Backend Database (MySQL) Administrative Interface User Interface DMS Website Initial documentation for DMS will also be developed during Phase 1, to include an implementation and user guide. Deliverables Laboratory Prototype Customer Demonstration SBIR Phase 2 Proposal Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. Cost The Budget Plan determines the cost estimates for each phase. The actual costs for personnel and equipment will be compared to those items in the Budget Plan; a margin of error within ±5% will be considered acceptable. Scope Scope in Phase 1 is measured by both the SBIR Phase 2 proposal and the laboratory prototype. Successful completion of all SBIR Phase 2 requirements is necessary to determine whether Phase 1 was within scope. The prototype must meet all required functionality as outlined in the requirements document for Phase 1. Scope for Phase 1 is only met if the SBIR Phase 2 proposal and the prototype are successful and Phase 2 funding is acquired. ODU Computer Science | CS410 Green Team 3 [DMS EVALUATION PLAN] December 16, 2009 Quality The SBIR presentation board will determine the quality of the proposal presentation. This criterion is considered met for the SBIR presentation upon successfully acquiring Phase 2 funding from the SBIR board. Quality is met for the laboratory prototype if it meets all requirements listed in the requirements document. Each module will undergo code review, unit and integration testing. Once complete, the system itself will go under acceptance testing to ensure it complies with the features and performance expectations as outlined in the requirements document. Phase 2 Phase 2 concerns real-world product design and development for DMS. Evaluation will proceed in Phase 2 much as it did in Phase 1. Bi-weekly meetings will be held to determine if the project is on schedule and within budget, according to the Management and Budget Plans. Testing plans for the production version of DMS will be drafted and used to measure completion of each module. Results of testing will be reviewed at the bi-weekly meetings. Customer feedback will facilitate refinements in our product and support materials. Deliverables DMS Software Package Implementation Procedures User Guides Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. Cost The Budget Plan determines the cost estimates for each phase. The actual costs for personnel and equipment will be compared to those items in the Budget Plan; a margin of error within ±10% will be considered acceptable. Scope The real-world implementation will be measured against the functionality and performance requirements outlined in the requirements document. [This space intentionally left blank.] ODU Computer Science | CS410 Green Team 4 [DMS EVALUATION PLAN] December 16, 2009 Quality The real-world implementation for DMS must pass all tests defined in Phases 1 and 2. The greatest measure of quality will come from the end-users and customers for each implementation of DMS. Phase 3 Phase 3 will focus on implementing customized versions of DMS for new customers. Customer feedback will be used to measure quality. The marketing strategy will be evaluated to ensure we are targeting the correct market. Formal evaluations will be conducted periodically to ensure we stay within the guidelines of the WBS. Sales volume and profit margin will determine Phase 3’s success, along with customer and end-user feedback. Time The Management Plan contains the WBS and schedule, and defines the date deliverables should be completed. This criterion is considered met for a particular deliverable if that item is delivered on or before the estimated date in the Management Plan. Cost The Budget Plan determines the cost estimates for each phase. The actual costs for personnel and equipment will be compared to those items in the Budget Plan; a margin of error within ±10% will be considered acceptable. Scope Scope for Phase 3 will be determined by the break-even analysis in the Funding Plan. The actual profit and projected profit will be compared; a margin of error within ±10% will be considered acceptable. Quality Quality for Phase 3 is measured by end-user and customer satisfaction surveys. ODU Computer Science | CS410 Green Team 5