Air Force Life Cycle Management Center Standard Process For Self-Assessment Program Process Owner: AFLCMC/IG Date: 27 January 2015 Version: 1.4 Record of Changes. Version 1.0 Effective Date 25 June 2013 1.1 1.2 5 August 2013 23 September 2013 1.3 21 February 2014 1.4 27 January 2015 Record of Changes Summary Standard process approved by S&P Board on 20 June 2013. Corrected administrative errors in 5.2 & 6.1.6 Updated AFLCMC Unit Self Inspection (USAP) Business Rules MICT software 2.0.10 the following words changed: “Deficiency” changed to “Observation” “Clone checklist” changed to “Instance” Business Rules added “Security (SE)” to para 1.0 Changed process owner from XP to IG. i ii Self-Assessment Program (SAP) Process 1.0. Description. This is the AFLCMC process for executing the unit self-assessment program (USAP) and will be performed by USAP managers and their monitors, assessors, reviewers and organizational leaders. Self-assessment (SA) provides leaders with a tool for internal assessment of unit health and complements external assessments. The Commanders Inspection Program (CCIP) will replace reliance on external inspections with a trusted-andverified SAP/USAP process. Leaders will have the capability to inspect their unit’s ability to execute the mission, manage resources, lead people and improve performance. 2.0. Purpose. 2.1. This process was in need of being standardized and streamlined after the stand-up of Air Force Life Cycle Management Center (AFLCMC). There were multiple unitlevel processes that did not link into a standardized process across a geographically dispersed AFLCMC utilizing a virtual environment. This complicated the ability of senior leadership to garner a full perspective of the Center Self-Assessment Program. 2.2. CCIP assesses the same four major graded areas (MGA) and sub-MGAs as a unit effectiveness inspection (UEI): manage resources, leading people, improving the unit and executing the mission shown below in Figure 1. Figure 1. CCIP Major Graded Areas (MGA and Sub-MGAs) 2.3. USAP is the cornerstone to the CCIP. The CCIP is the foundation of the Air Force Inspection System (AFIS) and has two key components: 2.3.1. An inspection program, executed by the Center IG with support from subjectmatter experts (SME). 1 2.3.2. A self-assessment program, using the Management Internal Control Toolset (MICT), that reports compliance with requirements listed in Self-Assessment Checklists (SAC) to the chain of command and appropriate staffs. 3.0. Entry/Exit Criteria. 3.1. Assessment 3.2. Entry - The annual unit SA for AFLCMC will have the flexibility to run SAs as their workload and mission dictate from 1 April to 31 December each year. Financial Management (FM) has a requirement to run their checklists twice a year (May/November). 3.2.1. Exit - The annual SA cycle will end on 31 December for all of AFLCMC. To be considered complete all checklists will be run within the last 9 months. Once the Directorates/Group/Wing has completed their annual SA, the 2-Ltr USAP Managers will prepare a completion report memo to be signed by their commander/director and submitted to AFLCMC/XP in the month of December. 3.2.1.1. Center SAP manager will notify the Command Self-Assessment Program manager confirming completion of the AFLCMC annual Self-Assessment. 3.3. Observations 3.3.1. Entry – Once a observation is identified a root cause analysis (RCA) is opened. 3.3.2. Exit –Observations will be reported quarterly until they have closed. To be closed, the corrective action plan (CAP) must be executed and the observation closed by the reviewer/supervisor. 2 4.0. Process Workflow and Activities. 4.1. Suppliers, Inputs, Process, Outputs, Customers (SIPOC). The chart below represents the SIPOC. Suppliers Inputs Process Outputs Customers Center SAP manager, 2-ltr USAP managers, USAP monitors, Assessors, Reviewers/Supervisors Appointment letters, MICT permissions, checklists, MICT, SharePoint Execute assessment Completed and approved checklists Center SAP manager, Directors, Wing & Group Commanders Assessors, Reviewers/Supervisors, Directors, Wing & Group Commanders Completed/ approved checklists, identified observations, RCA/CAP Resolve observations Closed observations Center SAP manager, Directors, Wing & Group Commanders Center SAP manager, Functional 2-Ltr USAP managers Completed checklists, identified observations, MICT reports Data analysis Checklist change recommendations and feedback to 2-Ltr USAP managers 2-Ltr USAP managers, checklists owners, Senior Functionals & MAJCOM FAMs 4.2. Process Flowchart. The process flowchart, Figure 2, below represents the steps to standardize the self-assessment program process. 4.3. Work Breakdown Structure (WBS). The self-assessment program process is structured in a WBS format which provides more details on steps shown in the process flow chart. Figure 3 below is an excerpt from the WBS. For more detail see the entire WBS provided as an Excel file, Attachment 1. 4.4. Work guidance package. Additional detailed instructions on the SAP process are contained in the USAP Business Rules, Attachment 2. 3 4 Figure 2. SAP Process Flowchart AFLCMC Standard Process for Self Assessment Program (SAP) Center SAP Manager 1.1 Execute Assessment ---------------------------- 1.2 Resolve Observations ----------------------------- 1.3 Conduct Data Analysis 2 Ltr USAP Manager 1.1.2 Notify Assessors to Begin Assessment 1.3.5 Advise Directorates of BOS checklists Observations Closed 1.1.1 1.2.7 Report Open Observations to Center SAP Manager 1.1.5 Reports Closure to 2 Ltr USAP Manager 1.3.2 Perform Functional Trend Analysis Supervisor Assessor / Checklist Owner 1.3.1 Perform Base Operating Support (BOS) Checklist Trend Analysis 1.1.6 Provide Signed Assessment Closure Letter to Center SAP Manager Functional Directorates 1.1.1 Notify USAP Monitors to Begin Assessment USAP Monitor Assessment Cycle Closed 1.1.4 Approve Assessment Closure & Reports to USAP Monitor 1.2.4 Approve CAP 1.2.2 Conduct Root Cause Analysis (RCA) 1.2.3 Develop Corrective Action Plan (CAP) 1.3.3 Out-brief Senior Functional 1.3.4 Notify MAJCOM FAM 1.3.6 Advise PEO/ Execution Directorates of Functional Checklists 1.1.1 1.2.6 Monitor CAP to Closure and Close Observation No 1.1.3 Complete USAP Checklist in MICT 1.2.1 Observations Yes 1.2.5 Execute CAP 5 Figure 3. SAP Process WBS Lvl WBS Activity Description Execute the unit self-assessment program AFLCMC/XP (USAP) to provide leaders with a standard methodology to internally assess unit health and complement external assessments. 1 1.0 Execute SAP Process 2 1.1 3 1.1.1 Execute Assessment Notify USAP monitors to begin assessment 1.1.2 3 1.1.3 3 1.1.4 3 1.1.5 3 1.1.6 2 1.2 3 1.2.1 3 1.2.2 From 1 April on 2-Ltr USAP manager will notify USAP monitors within their Directorate/Wing/Group; ensure supervisors, monitors and assessors for their 2-Ltr have correct permissions. USAP monitor USAP monitor notifies assessors. For an notifies assessors out-of-cycle run of checklist, assessors will be notified by email when checklists have been changed by FAMs. Out-ofcycle run of checklist has a 90-day requirement to complete. Assessors complete Assessors complete USAP checklist(s) USAP checklist(s) and notify reviewer/supervisor Approve assessment Reviewer/ Supervisor approves closure assessment closure Report closure to 2- Once all checklists in their workcenter are Ltr USAP manager complete, USAP monitors report closure to 2-Ltr USAP manager Provide signed Once all checklists in their execution assessment closure directorate are complete and have been letter to Center SAP run once within the last 9 months, 2-Ltr manager USAP managers will report closure to center SAP manager by the Assessment Closure Letter signed by the Director in December each year. Resolve Observations Identify While completing the checklists the observations Assessor identifies a observation. Observations on functional checklists are reported to the respective functional 2-Ltr USAP manager in addition to their Reviewer/Supervisor Conduct Root Assessor conducts RCA on observation. Cause Analysis This may include an 8-step methodology (RCA) on scaled to the scope/severity of observation observation. Assessor may need training in RCA or 8 Step. OPR Duration 9 Months 2-Ltr USAP managers USAP monitors Assessor Reviewer/ Supervisor USAP monitors 2-Ltr USAP managers Assessor Assessor 6 Lvl WBS Activity 3 1.2.3 Develop Corrective Action Plan (CAP) 3 1.2.4 3 1.2.5 3 1.2.6 3 1.2.7 2 1.3 3 1.3.1 3 1.3.2 3 1.3.3 3 1.3.4 3 1.3.5 3 1.3.6 Description Assessor develops Corrective Action Plan (CAP) for the observation. Recommended to use the 8-Step problem solving methodology to develop the CAP (scaled to observation) Approve Corrective Reviewer/ Supervisor reviews the Action Plan (CAP) supporting documentation and approves the CAP Execute Corrective Assessor executes Corrective Action Plan Action Plan (CAP) to completion and reports to the Reviewer/Supervisor. Recommend linking to electronic records management (ERM) for documentation. Monitor CAP to Reviewer/ Supervisor monitors CAP to closure closure and closes observation in MICT Reports observation 2-Ltr USAP manager runs a observation closure to Center report in MICT on open observations and SAP manager sends to the Center SAP manager quarterly Conduct Data Analysis Performs trend Center SAP manager performs trend analysis on BOS analysis on BOS checklists, provides checklists feedback to 2-Ltr USAP managers, checklists owners and revises BOS checklist recommendation Perform trend Functionals pull reports from MICT and analysis on perform trend analysis on functional functional checklists that were completed across checklists AFLCMC. Provide feedback to 2-Ltr USAP managers, checklists owners and revise yearly functional checklist recommendation Out-brief Center Out-brief Center Senior Functional Senior Functional Notify MAJCOM FAM of checklist analysis AFLCMC advise Directors/USAP manager on BOS checklists Advise PEO/ Execution Directorates of functional checklists to run Notify MAJCOM FAM of checklist analysis and recommended changes to checklists. Email from Center SAP manager with base operating support (BOS) (crosscutting) checklists approved by AFLCMC. This activity may be performed as a result of BOS checklist trend analysis. Each 2-Ltr Functional advises all PEO/Execution USAP managers and organizational senior functionals (OSFs) of what functional checklists to run and at what level they should be run. OPR Duration Assessor Reviewer/ Supervisor Assessor Reviewer/ Supervisor 2-Ltr USAP manager 3 Months Center SAP manager Functional 2Ltr USAP managers Functional 2Ltr USAP managers AFLCMC/XP 2-Ltr Functional USAP managers 7 5.0. Measurement. Three metrics will be reported for the SAP process: unit assessments 100% complete by 31 December; number of MICT observations open; and number of days observations are open. All measurements are reported at 2-letter level. 5.1. Annual unit assessments 100% completion by 31 December each year. USAP managers will initiate SA review cycle per their directorate’s instructions. The SA will have the flexibility to run checklists as their workload and mission dictate as long as each checklist is run once every 12 months. The SA for each cycle will end on 31 December. To be complete all checklists will need to be run in the last 9 months. Once the SA is complete for the unit, USAP managers will complete the Completion Report Memo signed by the Commander/Director of the unit and upload it to the AFLCMC CCIP/Self-Assessment Program site USAP Completion Report Memos folder in the month of December. 5.2. Number of MICT observations per unit and average number of days observations are open will be reported to their Commander/Director and to the Center SAP Manager quarterly. Two-letter USAP managers upload the data quarterly to the following folder: USAP Process Reports. This data can be pulled from a MICT report, under the “Reports” tab in MICT, select “Inspection”, and then either the “Unit Compliance” or the “Commander Compliance” for the unit. Both numbers can be pulled from the same report. 6.0. Roles and Responsibilities. 6.1. Center SAP Manager (AFLCMC/XP) 6.1.1. Will manage the SAP for the Center. 6.1.2. Will ensure AFLCMC conducts an annual self-assessment ending on the last day of December, to meet AFMC’s annual self-assessment requirements. Note: Financial Management (FM) must perform self-assessment every 6 months (May/November) to meet semi-annual requirements, using their AFMC FM functional processes. Contracting (AFLCMC/PK) must perform selfassessment annually to meet functional requirements using their AFMC/PK functional checklist. 6.1.3. Will brief AFLCMC/CC and senior staff at an internal meeting established by AFLCMC/DS on the SAP and associated performance measurements. 6.1.4. Will provide Center SAP training to the 2-letter USAP Managers and ensure they have the correct permissions in MICT. 6.1.5. Will perform trend analysis on BOS checklists for the Center and revise BOS list yearly. Additional information is included in the AFLCMC Business Rules. 6.1.6. Will submit an approved Center Self-Assessment Program Report by email to the Command Self-Assessment Program Manager confirming completion of annual self-assessment in January each year. 8 6.2. USAP Managers for Directorates/Group/Wing (AFLCMC/XX, 66 ABG, 88 ABW) 6.2.1. Will have at a minimum a primary and an alternate on appointment letter filed with AFLCMC/XP (See appointment letter template). 6.2.2. Will manage the USAP for their Directorate/Group/Wing and will notify a specific unit to start annual SA. 6.2.3. Will have completed MICT administrative training and Center USAP training within 90 days of being appointed. 6.2.4. Will manage MICT units to organization hierarchy chart within MICT. 6.2.5. Will ensure annual assessments are conducted in MICT on the entire unit (including GSUs) and presented to the commander/director of the inspected unit. 6.2.6. Will attend Center team meetings and be responsible for distributing information across their organization. 6.2.7. Will be responsible for getting all users trained within their organization to include supervisors, monitors and assessors at all their locations. Note: Functionals within Directorates will be trained by the 2-Ltr USAP manager of the Directorate. 6.2.8. Will attach POC to workcenters and grants appropriate permissions in MICT. 6.2.9. Will ensure self-assessment includes all relevant checklists. Note: Checklists are strictly an aid for self-assessments. Members must continue to be compliant with regulatory guidance/instructions. 6.2.10. Will monitor USAP assessors throughout the year through in/out processing checklist and remove permissions in MICT when they out process. 6.2.11. At a minimum, each directorate (2-Ltr) should have at least one POC trained in 8-Step Problem Solving and RCA for support correcting observations. Note: Divisions are encouraged to have additional personnel trained in 8-Step Problem Solving and RCA. 6.3. Functional Directorates 6.3.1. Functional directorate 2-ltr managers will advise all PEO/Execution USAP managers and OSFs on the functional checklists to run each year and the level the checklists should be run. 6.3.2. Center functional directorate 2-ltr managers will pull reports from MICT and perform trend analysis on functional checklists completed across AFLCMC, will out-brief Center Senior Functionals, and will provide recommendation to the MAJCOM FAMs. 6.4. Assessor / Checklist Owner 6.4.1. Complete checklist questions in MICT 6.4.1.1. All questions require a yes, no, or non-applicable (n/a). 9 6.4.1.2. Provide supporting comments for all questions in the note section. In addition to the supporting comments you may do one of the following: 6.4.1.2.1. Provide a link to supporting documentation in the folder. Note: This is the preferred method for supporting documentation. It also enables you to edit and delete. 6.4.1.2.2. Upload supporting documentation to folder. Note: Once uploaded you may archive, but not delete or edit. 6.4.1.2.3. Describe where the supporting documentation is located in the note section or upload a document. Note: Once uploaded you may archive, but not delete or edit. 6.4.1.3. Identify and resolve observations 6.4.1.3.1. Checklist questions answered “no” will become a observation. Observation resolution requires RCA and CAP. 6.4.1.4. Out-of-Cycle Assessment. 6.4.1.4.1. Occurs when Assessor/checklist owner is notified by email the checklist assigned to them has been changed by the Functional Area Manager (FAM). 6.4.1.4.2. Assessors/checklist owners will have 90 days to run their updated checklist in MICT. 6.4.1.4.3. All previous checklist artifacts will stay attached and assessor will be required to answer the questions that changed. 6.4.1.4.4. Checklist will change to the new assessment date. 6.5. Reviewer/Supervisor 6.5.1. Reviewer/Supervisor role is designated in MICT at the division/squadron level or lower and must be either a military or civilian personnel. 6.5.2. Review and close checklists. 6.5.3. Approve CAPs. 6.5.4. Close observations. 6.6. Commanders/Directors 6.6.1. Will designate primary and alternate 2-Ltr USAP Managers using the appointment letter template. 6.6.2. Will sign assessment closure letter confirming the completion of the annual self-assessment. 6.6.3. Will review CAPs depending on the tier and observation level. 6.6.3.1. Tier 1 – Non-compliance puts Airmen, Commanders, or the USAF at risk of mission or program failure, injury, legal jeopardy or 10 unacceptable waste. For observations in Tier 1, with a observation level of significant or critical, the CAP will be reviewed by a Commander/Director. 6.6.3.2. Tier 2 – Non-compliance degrades mission or program effectiveness or efficiency, and has potential, if not corrected, to create risk of mission or program failure, injury, legal jeopardy or unacceptable waste. For observations in Tier 2, with a observation level of significant or critical, the CAP will be reviewed at the squadron/division or equivalent level. 6.6.3.3. Tier 3 – Non-compliance limits mission or program effectiveness or efficiency. For observations in Tier 3 with any observation level the CAP should be reviewed at the Squadron/Division/Flight/ Branch or equivalent level. 7.0. Tools. 7.1. Management Internal Control Toolset (MICT) – A web-based, automated SelfAssessment Program for accessing SA checklists from the repository within MICT. MICT is a force multiplying tool that reports, tracks, validates, trends, observations, and corrective actions. MICT is Air Force approved software that will be used by all AF units running Self-Assessment Checklists (SACs). URL: https://mict.us.af.mil/ . 7.2. SharePoint. The AFLCMC CCIP / Self-Assessment Program work guidance is located at the following SharePoint site: https://org4.eis.afmc.af.mil/sites/1604/sip/default.aspx 8.0. Training. 8.1. MICT Administrative training will be computer based training (CBT) and should be available by July 2013. This training is for those users that will be assigning POCs and setting permissions. Training slides are available on the MICT Customer Support Communities of Practice (CoP). 8.2. The 8-Step Processing and the RCA is Air Force approved training for solving observations and creating CAPs. This training is offered through base education offices at many locations and may also be found in the MICT Customer Support CoP. 9.0. Definitions, Guiding Principles and/or Ground Rules & Assumptions. 9.1. “Unit” is defined as 88 ABW, 66 ABG, and Directorates. 9.2. USAP is a leader’s tool to enable and strengthen effectiveness and efficiency. 9.3. Self-assessment motivates and promotes civilian/military discipline, improves unit performance, and management excellence up and down the chain of command. 9.4. Self-assessment identifies issues interfering with effectiveness, efficiency, compliance, discipline, readiness, performance, surety and management excellence. 9.5. USAP allows Commanders to discover specific strengths and innovative practices of individuals, teams or units that promote greater efficiencies, which are candidates for 11 widespread benefits. 12 10.0. References to Law, Policy, Instructions or Guidance. 10.1. Air Force Guidance Memorandum to AFI 90-201 AFGM3, 13 Feb 2013, The Air Force Inspection System. In advance of a rewrite of AFI 90-201, this memorandum provides new guidance and procedures for implementation of the new Air Force Inspection System. 10.2. Management Internal Control Toolset, MICT Customer Support CoP: https://afkm.wpafb.af.mil/community/views/home.aspx?Filter=25432 Attachment 1 – WBS Excel File MS Excel SAP WBS Attachment 2 – USAP Business Rules AFLCMC USAP Business Rules 13