SOUTHEASTERN EUROPE SIMULATION NETWORK 2012 (SEESIM 12) Collection Management Plan 15 September 2012 JOINT STAFF, J7, JOINT AND COALITION WARFIGHTING 116 Lake View Parkway, Suite 100 Suffolk, VA 23435-2697 SEESIM 12 COLLECTION MANAGEMENT PLAN Table of Contents I. GENERAL OVERVIEW .........................................................................................................2 A. Purpose ............................................................................................................................... 2 B. Exercise Summary.............................................................................................................. 2 C. Exercise Objectives ............................................................................................................. 2 D. NATO Task List (NTL) ...................................................................................................... 2 II AFTER-ACTION REVIEW (AAR) RESPONSIBILITIES AND ORGANIZATION ...................................................................................................................3 A. AAR Responsibilities. ......................................................................................................... 3 B. The AAR Organization....................................................................................................... 3 III. USING THE COLLECTION MANAGEMENT PLAN.....................................................5 A. General................................................................................................................................ 5 B. AAR Team/CMP Relationship. .......................................................................................... 5 C. Joint Exercise Management Module (JEMM). ................................................................ 5 D. Collection Management Forms. ........................................................................................ 6 IV. FUNCTIONAL AREA REVIEWS .......................................................................................7 A. Timely Force Availability ................................................................................................... 7 B. Effective Intelligence .......................................................................................................... 8 C. Deployability and Mobility ................................................................................................. 9 D. Effective Engagement ...................................................................................................... 10 E. Effective Command, Control and Communications (C3) ............................................... 12 F. Logistics Sustainability..................................................................................................... 12 G. Survivability and Force Protection .................................................................................. 14 Annex A – Observation Collection Template ............................................................................17 Annex B – After-Action Review Template ................................................................................18 I. GENERAL OVERVIEW A. Purpose: The purpose of the SEESIM 12 Collection Management Plan (CMP) is to focus the AfterAction Review (AAR) Managers’ and Analysts’ collection efforts. The AAR Managers use the collected information to develop the end-of-exercise AAR and the Final Exercise Report (FER). The overall goal is to provide feedback to the participating audience on selected tasks and supporting training objectives (TOs) in support of SEESIM 12. B. Exercise Summary: The Southeastern Europe Simulation 2012 (SEESIM 12) Computer Assisted Exercise (CAX) is the sixth in a series of exercises within the framework of the Southeast Europe Defence Ministerial (SEDM) process. The purpose of the exercise is to promote cooperation, coordination and interoperability of civil-military operations and reinforce real world crisis response within and among the SEDM nations and their various SEDM initiatives through effective use of computer modeling and simulation (M&S). The specific aim is to develop the capabilities and procedures of national and regional coordination, cooperation, and mutual assistance among the SEDM nations in the face of devastating emergencies, such as natural disasters or terrorist attacks. C. Exercise Objectives: Standardize and improve national, SEEBRIG HQ and regional processes and procedures in emergency response situations; improve interoperability among the SEDM nations and SEEBRIG HQ Provide a training environment to promote SEDM and NATO objectives of transparency, confidence-building and good neighborliness Serve as a focal point for facilitating the integration of SEDM initiatives Encourage development of national simulation capabilities D. NATO Task List (NTL): ST 1.2.3 Provide for En-Route Support and Clearances ST 4.10.1 Assist in Combating Terrorism ST 6.3.1 Coordinate Support for Forces in the Joint Operations Area (JOA) ST 6.5.5 Provide Support for Humanitarian Assistance, Disaster Relief, and Civil Military Cooperation ST 7.3.7.4 Employ Theatre Computer Security (COMPUSEC) OT 1.7.8 Plan and Conduct Patient Evacuation OT 2.1.5 Develop Multinational Intelligence / Information Sharing Structure OT 2.5.0 Disseminate and Integrate Operational Intelligence OT 3.2.4 Provide for Movement Services in Area of Operations OT 4.11.4 Establish Disaster Control Measures OT 4.12.6 Coordinate Disaster Relief OT 5.1.6 Coordinate Information Assurance (IA) Procedures OT 7.1.0 Provide Force Protection OT 7.1.5.4 Coordinate Consequence Management (CM) in JOA 2 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY II. AFTER-ACTION REVIEW (AAR) RESPONSIBILITIES AND ORGANIZATION A. AAR Responsibilities: The AAR Managers located at Exercise Control (EXCON) Main have overall responsibility for CMP execution. They lead both the collection and analytic efforts. The AAR Managers also assign EXCON Forward AAR analysts to collect and analyze information on specific tasks. The AAR analysts provide coverage of their respective training audience staffs located in each country’s Emergency Operations Centers (EOC). Using the CMP as a guide, AAR analysts collect and analyze data relating to training audience’s ability to perform selected tasks. The collection efforts involve both objective and subjective interpretation of command and staff activities. Interpretations are based on professional judgment and overall team assessment. Observations are reviewed for significant trends that lead to focus areas or issues for the After-Action Review (AAR) and post-exercise reporting. B. The AAR Organization: The AAR Analyst organization is shown below: POSITION NAME NATIONALITY AAR Manager LTC Hristo HRISTOV Bulgaria AAR Manager MAJ Nikolay KRASTEV Bulgaria AAR Manager Mr. Dale SCHULTZ United States AAR Analyst LTC Ilirian DAUTI Albania AAR Analyst LTC Ibro ALISPAHIĆ Bosnia and Herzegovina AAR Analyst (MOI) Mr. Svetlin STANEV Bulgaria AAR Analyst (MOD) Maj Boncho BONEV Bulgaria AAR Analyst Mr. Tomislav LUKAC AAR Analyst TBD AAR Analyst Ms. Slavka MILETIĆ AAR Analyst LTC Kostantinos PLATSAS AAR Analyst LTC Dragan BRANOVIĆ Italy 3 JWFC Support Team Croatia UNCLASSIFIED/FOR OFFICIAL USE ONLY Montenegro SEEBRIG HQ Serbia * AAR Analyst Mr. Toni STANKOVSKI the former Yugoslav Republic of Macedonia* AAR Analyst Mr. Ljupco STALEVSKI the former Yugoslav Republic of Macedonia* AAR Analyst MAJ Yaroslav MELNIK Ukraine Turkey recognizes the Republic of Macedonia with its constitutional name 4 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY III. USING THE COLLECTION MANAGEMENT PLAN A. General. The CMP is a guide for AAR analysts to observe the exercise, collect information, and assess the nations’ and region’s ability to cooperate in meeting selected training objectives and tasks consistent with national policy and direction. The information is used in different ways: AAR analysts assess whether the nations successfully accomplish selected training objectives. AAR analysts assess whether the exercise design provides the training audience sufficient opportunity to demonstrate proficiency in each task. The exercise AAR Manager continuously provides this assessment to EXCON to facilitate control of the exercise. The AAR manager may recommend certain exercise adjustments to ensure that the nations have sufficient opportunity to perform the tasks. Assessment of the regional cooperation as the basis for various post-exercise reports. B. AAR Team/CMP Relationship. AAR Managers have overall responsibility for the implementation of the CMP. They orchestrate the collection and analysis efforts and assign responsibility for each AAR analyst. Using the CMP as a guide, AAR analysts collect and analyze data relating to national capabilities. If needed, Site Managers may employ additional observers to assist in collection of observations. These analysts and observers must be familiar with the nations’/region’s organization and procedures. They must be able to make objective observations, function effectively as a collection group, and capture their observations and findings concisely. AAR analysts discuss their observations to the AAR Managers at the afternoon AAR VTC. This venue not only allows the AAR Managers to track the nations’ progress, but also provides valuable insight for recommending exercise corrections needed to the EXCON. C. Joint Exercise Management Module (JEMM). JEMM helps EXCON to manage and maintain approved and coordinated information flow between the exercise organization and the training audience. It also monitors if the training audience achieves the aimed training objectives. JEMM can easily adjust the storyboard through dynamic scripting and supports the AAR Analyst observation process. But, JEMM is just a tool. The success of the exercise is driven by the people who put the data into JEMM during SEESIM 12 planning, by the people who role-play the injections or elements of information that are provided to the training audience, and by the people who interpret the results of the injections – the AAR Analysts and the AAR Managers. Below are key JEMM terminology for the AAR Analyst to understand: 5 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY Incident – A storyline (e.g., earthquake, flooding, explosion, etc.) created for each critical training objective. Every storyline must specify primary/secondary training objectives and intended players (training audience). Each storyline must have a clearly described intended storyline outcome. Injection - Element of information that is provided to the training audience. An injection can introduce the conditions of a storyline or it can be a reaction, positive (reward), negative (encourage) or neutral to the execution of the intended process by the training audience. Action - Activity undertaken by an actor that is not controlled by the training audience to assist in setting the conditions for a specific storyline. ISO (Intended Storyline Outcome) - The process that the training audience is expected to initiate and the product the training audience is expected to produce as a consequence of a particular storyline. The AAR team will use the JEMM Observation Planning, Collection, Analysis and Reporting (OPCAR) tab as the primary method to communicate between EXCON Main and EXCON forward locations. Other means of communication are available as backup: VTC, telephone, VoIP, and email. AAR Analyst Training in September 2012 will provide specific “hands-on” exposure to JEMM and the OPCAR feature. D. Collection Management Forms Observation Collection Forms (Annex A) As a backup to JEMM OPCAR function, AAR analysts and observers may record observations using the observation collection formats in Annex A. If used, these forms will be e-mailed from the AAR analyst’s location to the AAR Manager as often as necessary to arrive prior to the daily AAR Team VTC at 1400 (Sofia time). After-Action Review (AAR) Template (Annex B) Each participating nation and Headquarters, SEEBRIG will be asked to report on their exercise experiences using the AAR template at Annex B to summarize the aspects that went particularly well and should be sustained in future exercises and operations, as well as those aspects which may require further research and refinement for improvement. These slides must be submitted to the AAR Manager no later than 1400 hours (Sofia time) on the day prior to the AAR. 6 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY IV. ESSENTIAL OPERATIONAL CAPABILITIES The following essential operational capabilities and respective training objectives have been selected for observation and feedback during SEESIM 12. A. Timely Force Availability To establish and sustain sufficient and effective military presence at the right time, including the ability to build up forces, through appropriate and graduated readiness, to meet any requirements resulting from a change in the strategic environment, and to rotate forces which are in engaged in an operation. Training Objectives: ST 1.2.3 Provide for En-Route Support and Clearances. Definition: To arrange support, diplomatic clearances, and over-flight rights with affected nations for forces that are in transit from one locality to another. Strategic deployments may need intermediate staging bases or areas for refueling, regrouping of ship convoys, replenishment, exercise, inspection, and concentration or redistribution of forces. Staging bases or areas may require airfields and facilities (e.g., navigation aids, communications, maintenance and servicing facilities); security; augmentation support; parking and throughput facilities; construction services; health services; berths; beaches; stevedores; and utilities. TIMELY FORCE AVAILABILITY CONSIDERATIONS (ST 1.2.3) Possible Challenges Levels of Performance Coordinate support, diplomatic clearances, and over-flight rights for regional partners that are in transit from one locality to another. Countries or international agencies that are providing assistance to a regional disaster, within or adjacent to own boundaries, are identified through national civilian, military, or diplomatic channels National ministries are contacted to arrange for necessary clearances to transit air, sea or ground lines of communication. Arrange for intermediate staging bases or areas for refueling or replenishment as needed by international organizations and regional partners. Supporting agencies have been contacted through best available channels to determine refueling and replenishment requirements. Planning has been conducted to identify applicable staging bases.. 7 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY OT 1.7.8 Plan and Conduct Patient Evacuation. Definition: To conduct patient evacuation and provide transportation of patients by any means to greater capability of medical care. To provide forces, resources, and evacuation channels for patient evacuation. Planning evacuation includes identifying and considering all the issues associated with the optimum utilization of patient evacuation resources and producing the necessary products to ensure that effectiveness of patient evacuation operations is maximized. TIMELY FORCE AVAILABILITY CONSIDERATIONS (OT 1.7.8) Possible Challenges Levels of Performance Coordinate transportation for evacuation of victims of a natural disaster or consequence management incident. All the issues associated with the optimum utilization of patient evacuation resources have been identified and considered. Planning ensures effective patient evacuation operations have been maximized. B. Effective Intelligence To collect and disseminate reliable information in a timely manner in order to anticipate and respond, as necessary, to any requirement resulting from challenges to Alliance security interests or hostile actions. Training Objectives: OT 2.1.5 Develop Multinational Intelligence / Information Sharing Structure: Definition: This task involves completing an operational architecture that is capable of accommodating the widest possible range of missions and operational scenarios. This structure must respond to the Commander’s requirements for information at any time and any place and be capable of supporting multinational operations with no loss in timeliness. In addition it must achieve a seamless integration of the Commander’s decision-making and execution cycles with all phases of the intelligence cycle. 8 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY EFFECTIVE INTELLIGENCE CONSIDERATIONS (OT 2.1.5) Possible Challenges Levels of Performance Coordinate with regional intelligence activities to provide a complete picture of the operational environment (OE) as relates to humanitarian assistance / disaster response (HA/DR) or consequence management incident. Intelligence organizations are able to provide reliable OE information in regard to regional partners. Intelligence organizations provide national planning groups with information that allows for effective cross-border coordination and meets decision-making criteria. OT 2.5.0 Disseminate and Integrate Operational Intelligence: Definition: To provide common operational intelligence, in a timely way, in an appropriate form, and by the most suitable means, to the component commanders and JTF commander and to ensure that the intelligence is understood and considered by the commanders. EFFECTIVE INTELLIGENCE CONSIDERATIONS (OT 2.5.0) Possible Challenges Levels of Performance Provide common operational intelligence. Intelligence is provided in a timely way, in an appropriate form, and by the most suitable means. There is a viable flow of information between the intelligence organization and the end users. C. Deployability and Mobility To concentrate forces and engagement capability, at the right place and appropriate time (deployability) and to be able to move quickly once deployed (mobility). Training Objective: OT 3.2.4 Provide for Movement Services in Area of Operations. Definition: To coordinate movement of weapons, ordnance, equipment, fuel, supplies and personnel supplies to sustain operations and to provide transportation resources for moving the forces that execute those operations. 9 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY DEPLOYABILITY AND MOBILITY CONSIDERATIONS (OT 3.2.4) Possible Challenges Levels of Performance Coordinate movement of equipment, fuel, supplies, and personnel supplies necessary to sustain emergency response within the region. Emergency Operation Center personnel respond to information requiring disaster response in an expeditious manner. Coordinate transportation resources necessary to move forces responding to emergencies within the region. Emergency Operation Center personnel respond to information requiring disaster response in an expeditious manner. Appropriate Ministries are notified and asked to provide appropriate support. D. Effective Engagement To be able to operate forces, particularly weapons systems, effectively across the wide spectrum of possible circumstances. Training Objectives: ST 4.10.1 Assist in Combating Terrorism. Definition: To produce effective protective measures to reduce the probability of a successful terrorist attack. This task includes those defensive measures (antiterrorism) used to reduce vulnerability of individuals and property to terrorist acts, to include limited response and containment by local military forces. This task also includes those offensive measures (counter-terrorism) taken to prevent, deter, and respond to terrorism. EFFECTIVE ENGAGEMENT CONSIDERATIONS (ST 4.10.1) Possible Challenges Levels of Performance Develop effective protective measures to protect against known or emergent terrorism threats within the region. Emergency Operation Center (EOC) personnel react to information requiring response to terrorism in an expeditious manner. Local military and law enforcement forces are placed on heightened alert in order to contain terrorist activities. OT 4.11.4 Establish Disaster Control Measures. Definition: To take measures before, during, or after hostile action or natural disasters to reduce probability of damage, minimize its effects, and initiate recovery. 10 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY EFFECTIVE ENGAGEMENT CONSIDERATIONS (OT 4.11.4) Possible Challenges Levels of Performance Initiate appropriate response to contain negative effects created by terrorist activity or as a result of a natural disaster. Emergency response actions have been taken to mitigate interruption of normal activities by an impending disruptive occurrence, whether caused by nature or by human activity. Local military and/or law enforcement forces are mobilized to provide crowd control as residents flee from the area of the disaster. Coordination has been initiated with ministries and international organizations in order to concentrate the necessary medical and relief supplies to the disaster area OT 4.12.6 Coordinate Disaster Relief. Definition: Disaster relief is assistance to a population or a region that is affected by a sudden calamity or an emergency that has brought great damage, loss or destruction. Disaster relief concerns the sustainment of the means to safeguard lives and requires very rapid reaction particularly where extremes of the climate are encountered. EFFECTIVE ENGAGEMENT CONSIDERATIONS (OT 4.12.6) Possible Challenges Levels of Performance Arrange for provision of relief personnel and supplies to the disaster site. Relief personnel and supplies are enroute to the disaster site within _____ hours of the initial report. Sufficient medical personnel and medical supplies (including blood) has been identified for transit to the disaster site. 11 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY E. Effective Command, Control and Communications (C3) To direct Allied forces and HQs for the accomplishment of Alliance missions or tasks. Training Objectives: OT 5.1.6 Coordinate Information Assurance (IA) Procedures. Definition: To coordinate IA procedures established by the joint force commander for forward deployed operations. FUNCTIONAL AREA CONSIDERATIONS Possible Challenges Levels of Performance Review information assurance procedures to counter a known regional cyberterrorist threat. Upon reports of an indicated cyber-threat the EOC reviews standard procedures and notifies IA personnel to conduct planning against possible cyber activity. EOC personnel contacts ministerial authorities to warn of possible activity. Contact is made with regional counterparts in an effort to contain an expanding cyber-threat. Countermeasures are implemented in response to a confirmed suspicious/malicious intrusion or activity. F. Logistics Sustainability To provide timely and effective logistic support for any operations until NATO’s objectives have been achieved Training Objectives: ST 6.3.1 Coordinate Support for Forces in the area of concern.* Definition: To coordinate the provision of trained and organizationally sound units and replacements and to provide necessary personnel administration, supply, field, and health services to support theatre strategy campaigns. *Note: This title changed to read area of concern vice Joint Operations Area (JOA) due to nature of SEDM mission. 12 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY FUNCTIONAL AREA CONSIDERATIONS Possible Challenges Levels of Performance Coordinate the provision of forces and international organizations responding to the disaster area. This includes crossborder coordination. Necessary personnel administration, supply, field, and health services have been arranged and scheduled for onward movement into the disaster area. Movement across adjacent borders has been coordinated for safe transit. Synchronize the movement of supplies, personnel, and equipment throughout the disaster area. Movement schedules have been deconflicted to prevent over-stressing the infrastructure (e.g., roads, bridges, tunnels, etc.) Routes have been scrubbed to ensure that responders do not become victims due to neglect for caution. ST 6.5.5 Provide Support for Humanitarian Assistance, Disaster Relief, and Civil Military Cooperation. Definition: To provide assistance before, during, and after hostile action or natural and man-made disasters to reduce the probability of damage, minimize its effects, initiate recovery, and to help reduce conditions that present a serious threat to life and property. Disaster relief includes providing health service support, communications, shelter, subsistence, water, engineering support, transportation, refugee assistance, restoration of law and order, and damage assessment. Assistance provided is to be limited in scope and duration and is designed to supplement the efforts of civilian authorities, which have primary responsibility for providing such assistance. FUNCTIONAL AREA CONSIDERATIONS Possible Challenges Levels of Performance Determine the extent of need for HA/DR and civil military cooperation in the affected area. Status reports are requested and received by the EOC concerning the extent of physical damage and human suffering at disaster site. Attempts to determine tolls on human life and need for emergency medical services have been initiated. For disasters in an adjacent country, internal governmental ministries have been notified to determine the possibility of extending offers of assistance. 13 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY Identify and implement any host nation support (HNS), memorandums of understanding (MOU), or mutual support agreements (MSA) throughout the affected area. Maps of the affected area have been updated to indicate jurisdictional boundaries (e.g., military, law enforcement, emergency services, etc.) Existing HNS, MOU, and MSA’s in effect are reviewed and current points of contact are identified and contacted. G. Survivability and Force Protection To minimise the effects of any adversarial action, to include the effects of CBRN weapons and devices and toxic industrial materials, whilst ensuring allied freedom of action and force effectiveness. Training Objectives: ST 7.3.7.4 Employ Theatre Computer Security (COMPUSEC). Definition: To employ the theatre wide application of hardware, firmware and software security features to a computer system in order to protect against, or prevent, the unauthorised disclosure, manipulation, modification or deletion of information or denial of service. FUNCTIONAL AREA CONSIDERATIONS Possible Challenges Levels of Performance Respond to COMPUSEC compromise and determine needed actions. An alert has been sent to all agencies and organizations concerning indication of a cyber attack against a governmental facility. A determination has been made whether the cyber attack has regional implications or was directed to a specific target for a specific reason (i.e., a local vice regional act of terror.) Monitor networks, detect and recover from network intrusion and assess vulnerabilities, and respond to a possible computer network virus. The EOC (within National guidelines) has alerted all pertinent organizations to the possibility of a virus having been planted on their systems and has instructed them to conduct a sweep of all computer-based systems. The EOC has initiated an immediate scrub of EOC computer systems and has reviewed plans for continuing EOC operations in the advent of a loss of all or some computers. 14 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY OT 7.1.0 Provide Force Protection. Definition: To safeguard friendly centers of gravity and operational force potential by reducing or avoiding the effects of adversary’s operational level and unintentional friendly, actions (includes movement and electronic warfare). In military operations other than war, this activity includes protection of governmental and civil infrastructure and populace of the country being supported; this includes antiterrorism. This task also includes supporting evacuation of non-combatants (NEO) from areas of responsibility. FUNCTIONAL AREA CONSIDERATIONS Possible Challenges Levels of Performance Conduct criticality assessment, threat assessment, risk management, and mitigation in accordance with National requirements. Analysis of protection requirements includes all assets involved with mitigation of the disaster including international organizations and cross-border assets. The EOC has integrated operational protection into the planning process OT 7.1.5.4 Coordinate Consequence Management (CM) in the area of concern.*Note: This title changed to read area of concern vice Joint Operations Area (JOA) due to nature of SEDM mission. Definition: To coordinate support for interagency essential services and activities required to manage and mitigate damage resulting from the employment of CBRN weapons or release of toxic industrial materials and/or contaminants or natural borne disasters. Services and activities can include population evacuation, decontamination, transportation, communications, public works and engineering; fire fighting, information and planning, mass casualty (MASCAL) care, resource support, health and medical services, urban SAR, hazardous materials, food and energy. CM may occur during military operations, be required in support of friends and allies, or occur within NATO Territory.. 15 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY FUNCTIONAL AREA CONSIDERATIONS Possible Challenges Levels of Performance Coordinate support from internal ministries to manage and mitigate damage caused by chemical, biological, radiological, nuclear, and high-yield explosives (CBRNE) or consequence management (CM) activities. The EOC has conducted some or all of the following tasks: Incident site reconnaissance and assessments. Incident site entry/exit management. Assistance with decontamination of personnel, equipment, facilities, and/or terrain. Analysis and recommendations for near-term management of the incident. Medical assessments and screening. Initial interface with local responders. 16 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY Annex A. SEESIM 12 Observation Collection Template (Copy and paste into email or save to portal to:EXCON Main AAR Manager) EXCON Forward ID: _______________________ _____________________ Country or Organization Last Name, First Name Date & Time of Observation: ________________ Subject of Observation: MEL/MIL # ___________________ Related NATO tasks: ___________ Observation: Discussion / Lessons Learned: AAR Issues (Sustain & Improve): Reviewed by Analyst_________ Entered in Database _________ 17 JWFC Support Team UNCLASSIFIED/FOR OFFICIAL USE ONLY Southeastern Europe Simulation 2012 (SEESIM 12) Collection Management Plan (CMP) Annex B. 1 2 3 4 5 6 7 18