Intelligent Agent-Based
Tactical Operations Center Staff
Training Systems
Yu Zhang, Keith Biggers, Linli He, John Yen, Thomas Ioerger
University XXI
Texas A&M University
Sponsors
STRICOM, TEES
Motivation
• Provide Scenario-Based Training At Drastically Lower
Costs (Personnel and Dollars) Through The Use Of
Agent-Based Technologies
• Provide a Solution For What Simulations Currently Lack
- Aggregate Unit Decision Making
- Communication and Interactions with Human
Players
TOC Staff Training Layout
BDE Trainees
S2
CDR
S3
FSO
BN
Trainer/Observer
OTB
Scenario
Agents
High-Level Architecture of DBST
PDUs
OTB
mouse
PDUs
Puckster
Interface
Agents
actions
RFS,
CFF
inform, request,
direct, approve,
respond
BDE
Interface
text, forms,
map
Brigade Trainee Interfaces
Example S2 Map Display
Example S2 Report Forms
Simulation
OneSAF
Testbed
DIS
Periodic Updates From Simulation
Cache
Agents
KB
PDUs Translated To Facts
(speed, location, unit type, etc.)
Agent Decision-Tracking Window/Controller
TaskableAgents Architecture
• Written in Java
• TRL Knowledge Representation Language
- For Capturing Procedural Knowledge (Tasks & Methods)
• APTE Method Selection-Algorithm
• Inference Engine JARE
- Java Automated Reasoning Engine
- Knowledge Base with Facts and Horn Clauses
- Updating World With Facts
TaskableAgents
TaskableAgents
TRL Task
Decomposition
Hierarchy
TRL KB:
tasks &
methods
APTE
Algorithm
Process
Nets
operators
messages
OTB
(simulation)
assert,
query,
retract
results
sensing
Other
Agents
JARE KB:
facts &
Horn-clauses
messages
Task Representation Language (TRL)
• Provides descriptors for: goals, tasks, methods, and operators
• Tasks: “what to do”
– Can associate alternative methods, with priorities or
preference conditions
– Can have termination conditions
• Methods: “how to do it”
– Can define preference conditions for alternatives
– Process Net
- Procedural language for specifying how to do things
- While loops, if conditionals, sequential, parallel
constructs
- Can invoke sub-tasks or operators
- Semantics based on Event Logic
Task Representation Language (Cont.)
• Operators: lowest-level actions that can be directly executed in
the simulation environment, e.g. move unit, send message, fire
on enemy
• Each descriptor is a schema with arguments and variables
• Conditions are evaluated as queries to JARE
Example TRL Knowledge
(:Task Monitor (?unit)
(:Term-cond (destroyed ?unit))
(:Method (Track-with-UAV ?unit)
(:Pref-cond (not (weather cloudy))))
(:Method (Follow-with-scouts ?unit)
(:Pref-cond (ground-cover dense))))
(:Method Track-with-UAV (?unit)
(:Pre-cond (have-assets UAV))
(:Process
(:seq
(:if(:cond(not(launched UAV)))(launch UAV))
(:let((x y)(loc ?unit ?x ?y))(fly UAV ?x ?y))
(circle UAV ?x ?y))))
Task-Decomposition Hierarchy
level 1
T1
level 2
M1
T3
level 3
T2
T5
T4
level 4
M7
M12
M92
M60
level 5
T15
Tx =Task
Mx = Method
C = Condition
T18
T40
T45
T40
C
T45
T2
Adaptive Protocol for Task Execution (APTE)
• Task decomposition tree
– Selecting appropriate methods for tasks
– Instantiating the process networks for selected methods
– Identifying sub-tasks that could be taken as “first steps”
– Recursively expanding these sub-tasks further downward
• Collecting the set of all active operators and selecting one to
execute
APTE (Cont.)
T1
M1
T3
M2
M3
T5
T2
T7
T4
T6
process net
APTE (Cont.)
• Repairing the task-decomposition tree
– Move token forward in the corresponding process net
– Check conditions associated with the tasks and methods
– If termination condition has been reached, APTE back-tracks
and tries to find another method that would satisfy the
parent task
– If a task at some level has successfully completed, then a
step forward can be taken in the process net of its parent
APTE (Cont.)
T1
M1
T1
M2
M1
M3
M2
M3
step
T3
T3
T5
T2
T7
T4
T6
process net
After T2 completes
T5
T2
T7
T4
T6
process net
After T7 completes
Distributed TaskableAgents
• Message Queue (MQ)
– A queue system for receiving string messages
– Each message is tagged with a sender ID and a timestamp
– Implemented in Java Remote Method Invocation (RMI)
– Methods for sending and receiving messages written in TRL
Java Process 2
update
Java Process 1
Sender
Agent MQ
RMI
SEND Operator
MQ
KB
Receiver
Agent
TOC Staff - Agent Decomposition
Control indirect fire,
Artillery,
Close Air,
ATK Helicopter
Maintain friendly situation,
S3
Maneuver sub-units
FSO
CDR
Companies
Maneuver,
React to enemy/orders,
Move along assigned route
Maintain enemy situation,
Detect/evaluate threats,
Evaluate PIRs
S2
Move/hold,
Make commands/decisions,
RFI to Brigade
Scouts
Move to OP,
Track enemy
* Selected Functions handled by our model
Commander Agent and Interactions
Scout
BDE CDR
CCIR
RFI/
RFS
Move/Hold
S3
PIR
Threats
CDR
Enemy
Info
S2
Move/Hold,
RFI
Decision Point Reached=Order
Move
S2 Agent and Interactions
BDE
S2
RFI/RFS
SALT/ INTSUM
S2
CCIR
Enemy
info
intel
Move to
OP
Threat
level,
PIR
BDE/DIV
Sensors/
Recon
intel
Scou
t
CD
R
DP
approval
S3
S3 Agent and Interactions
Situation
Update
Scou
t
Obstacles,
BDA
Bde
S3
S2
Track/ Threats,
Destroy PIR
RFS,
RFI
S3
Friendly units info,
Shift priority of fires
FSO
Inform
INTSUM
CDR
Move/hold,
Shift main effort,
Commit reserves
DP reached=order
Company
FSO Agent and Interactions
S2
CFF
Scout
CFF
Companie
s
Fire Missions,
Artillery,
Enemy
Close Air,
info
ATK
BDE
Helicopter
FSO
Inform
CD
R
Fire support
approval
FSO
Friendly units info,
Shift main effort
S3
Tactical Overview
• Movement to Contact
- High tempo and high uncertainty
• Early stages in which reconnaissance is occurring,
developing towards the engagement
Decision Points
1
Continuation of attack to north or hasty defense
2
Initiation of Bde fires & CAS
3
Shift fires & CAS to TF close fight
uav
IB
2X1
BOB
3-66 =1-22
4ID XX 1CD
Lampasas
4
5
Commitment of BCT reserve
Shift fires & CAS to 2d echelon
Copperas
Cove
TF 3-66
MATTHEW
Killeen
TF 1-22
Hy 190
LD
Vignette 1 – Scout Reaction to Enemy Recon Unit
Variation A:
Move to OP
(Position to Develop Intel)
Variation B:
Attack by Indirect Fire
(Using TAI & planned TRP)
AA5
AA4
AA3
AA4
OP Y
2 vehicles
1-4 vehicles ?
AA5
Artillery target
NAI/
TAI X
AE xxxx SCT
AA3
NAI X
OP Y
Sec n
SCT
SCT
SCT
SCT
Sec n
SCT
•Assess threat
•Select action
•Select OP
•Select scout section
•Order
•Report move
•Assess threat
•Select action
•Select method(s)
•Order
•Discern target & Call for fire(CFF)
•Shoot target
•Report Results - BDA
Vignette 1A Time Line
Source – Task Force Units
Sequence #
Timing
01
H+3
02
H+3.05
03
H+3.1
04
H+3.15
S2 determines which OP is best suited to
position Scouts for development of
situation. (OP Y over watches NAI X)
05
H+3.2
S2 sends order to Scout Ldr to move a
section to OP Y immediately)
Bde S2 passes Recon report
via INTSUM to TF 1-22.
TFS2 relays enemy sighting to Cdr, S3,
FSO and Scout Ldr. S2 assesses threat.
H+3.27
Scout Ldr determines Scout Sec n is
closest to OP Y. Sends order to Scout Sec
n (OTB action).
07
H+3.75
Scout Sec n reports when on OP Y to
Scout Ldr.
H+3.78
09
H+3.8
Source – Brigade
Bde Recon reports to Bde S2:
1 tank & 2 BMPs moving along
AA3 south toward NAI X.
06
08
Source - Task Force
TOC/Staff/Cdr
S2 monitors.
Scout Ldr reports to TF S2.
TF S2 reports move of scouts to Bde S2.
Vignette 1B Time Line
Sequence #
Timing
Source – Task Force Units
01
H+3
Scout Sec n is on OP Y, reports (SALT) 2
vehicles moving south on AA3, 2 kms
north of NAI X.
02
H+3.15
Scout Ldr relays report to S2.
03
H+3.15
FIST with Scouts generates a CFF that
goes to FSO.
Source - Task Force
TOC/Staff/Cdr
Source – Brigade
TF S2 monitors
04
H+3.2
TF S2 reports enemy vehicles to Cdr and staff.
FSO informs on CFF.
05
H+3.25
TF S3 collaborates with Cdr and decides to
approve artillery fire on enemy.
06
H+3.3
FSO confirms target as AE xxxx. S3 approves.
07
H+3.31
FSO sends approval to Bde FSO.
08
H+3.333.35
Bde FSO receives TF target. DS
artillery unit receives target and fires
mission.
09
H+3.353.40
Scout FIST observes fire and corrects as
needed.
10
H+3.45
Scout Sec n reports BDA (I BMP
destroyed, 1BRDM damaged and halted)
11
H+3.5
Scout Ldr relays BDA to S2
12
H+3.55
S2 reports BDA to Cdr, staff and Bde S2
Vignette 2 – Decision Point 1 [Shift Main Effort]
IB
Company
Size forces
3
234
1
234
1
Company
Size forces
AA5
235
3-234
IB
AA5
1-235
1-234
Company
Size forces
AA3
PL
AA6c
Main
Effort(ME)
1
4ID X C
X D
CoC
3-66=1-22
TmB
PL
AA3
AA4
AA5c
PL
3-66=1-22
Main
Effort(ME)
TmB
CoC
TmA
1
4ID X C
X D
PL
TmA
INTEL
AA5a
AA5a
AA4
• 2 Companies of 3-234 heading along AA3
• 3-234 lead Bn of 234 Regt.
• Situation unclear on AA5
DP1
Variation A:
Enemy major threat is on
Shift ME from Tm B to Co C?
main route (AA) as in route
(planned AA).
N
Y
INTEL
• 2 Companies of 234 heading along AA3 & AA4
• 3-234 lead Bn of 234 Regt intent is unclear.
• Lead Bn (1-235) of 235 Regt on AA5a
Variation B:
Enemy major threat changes
to secondary approach
DP1
Shift ME from Tm B to Co C?
N
Y
Vignette 2A Time Line
Sequence #
Timing
01
H+7
02
H+7.1
Source – Task Force
Units
Source - Task Force
TOC/Staff/Cdr
Source – Brigade
Scouts report all enemy
recon units destroyed.
TF S2 informs TOC and Bde S2
03
Bde Recon sights major units moving along IB on AA3
south.
04
Bde S2: Company size units moving south on AA’s 4&5.
05
TF S2 assesses threat to determine PIR
status. Informs TOC and Companies of Bde
S2 INTSUM.
06
TF S3 assesses location of companies
relative to PL Y.
07
Bde UAV indicates heavy forces crossing IB west of
Gatesville to south. Artillery spotted just north of IB.
08
Bde S2 assessment is that the UAV sighting is a
battalion of the 234 Mech Bde.
09
TF S2 checks position of scouts along AA3.
Orders OP occupation if needed. Reports to
Cdr and S3 that PIR now indicates lead bn
on AA3. (DP 1 trigger)
10
Cdr: DP 1 is triggered to a NO. (Lead Bn
was on AA3, which is already ME (TmB).
11
S3 assesses closing speed of threat on PL
Y versus Tm B.
12
S2 informs companies and scouts that lead
bn is along AA3
Vignette 2B Time Line
Sequence #
Timing
01
H+7
Source – Task Force Units
Source - Task Force
TOC/Staff/Cdr
Source – Brigade
Scouts report new recon units
along AA5
02
S2 RFI to Bde S2 on situation in 235 Mech Bde
area.
03
Bde S2 request info from Recon and Div G2.
04
Div G2 relays that a UAV and other platforms
indicate artillery and tank columns north of IB
on AA5.
05
Bde S2 confirms what seems to be lead Bn of
235 Regt near IB east of Gatesville
06
Scouts report no unusual
movement of enemy on AA’s 3&4.
07
S2 informs Cdr that PIR on lead bn has been
triggered and main threat is in east.
08
Cdr triggers DP 1 YES and informs S3.
09
S3 informs TOC and issues FRAGO changing
main effort to Co C.
10
FSO informs Bde FSO
Vignette 3 – Decision Point 2 [Commit TF Reserve]
IB
Company
Size forces
3
234
234
1
1
AA5
235
Company
Size forces
3-234
IB
AA5
1-235
1-234
Company
Size forces
AA3
PL
AA6c
Main
Effort(ME)
1
4ID X C
X D
CoC
TmB
…
Res
Variation A:
Heavy enemy threat across
across entire sector.
Blocking
Positions
AA4
AA5c
PL
3-66=1-22
TmA (-)
Main
Effort(ME)
…
Res
TmB (+)
CoC
1
4ID X C
X D
PL
TmA
INTEL
AA3
TAI
Y
3-66=1-22
PL
AA5a
AA5a
AA4
• Company units of 3 different Bns on all 3 AAs
• Estimate enemy will reach PL Y at same time
• 238 Regt lead units not committed
INTEL
• 2 Companies of 234 heading down AA3
• Uniform pressure on AA’s 4 & 5ar.
• Calculations indicate Tm A unit can move
to PL Y prior to lead of enemy unit.
DP2
DP2
Commit the TF Reserve platoon?
N
Y
Go to DP 3
Variation B:
Major enemy movement on
one avenue (AA).
Commit the TF Reserve platoon?
N
Y
Vignette 3A Time Line
Sequence #
Timing
01
H+8
Source – Task Force Units
Source - Task Force
TOC/Staff/Cdr
Bde Recon & Div intel confirms that at least
2 companies each are advancing south
across IB on AA’s 3,4 &5 (INTSUM)
02
TF S2 relays report (INTSUM) to TOC, scouts and
companies.
03
TF S2 requests (RFI) for any intel on enemy
reserves and artillery (PIR)
04
TF S3 checks status of companies to occupy battle
positions along PL Y
05
Bde S2 responds to RFI that major reserves
have not been confirmed, artillery is
disbursed.
06
S2 confirms to Cdr PIR on lead bns (DP 2 trigger)
07
Cdr: assessment is that threat is uniform and
chooses not to weaken any of the 3 TF positions
along PL Y
08
Cdr: reports decision to S3 and staff
09
S3 requests (RFS) to Bde S3 FASCAM and air
strikes or atk helicopters at targets south of IB along
AA’s.
10
11
Source – Brigade
Companies report positions
relative to PL Y.
FSO RFS to Bde FSO for FASCAM, and air
support.
Vignette 3B Time Line
Sequence #
Timing
01
H+8
02
Source – Task Force Units
Source - Task Force
TOC/Staff/Cdr
Bde Recon and UAV sightings report
(SALT) concentration of artillery and C2
just north of IB west of Gatesville near AA3
Scouts confirm lack of movement along AA4.
03
S2 passes Bde INTSUM and SALT to
TOC and companies. RFI to Bde S2 for
intel to the east in 1st CD sector (AA5).
04
Bde S2 reports that 1CD G2 has reported
a battalion on AA5. At least one company
size force turning west on AA5a.
05
06
S3 checks location of companies moving
to PL Y positions. (RFI)
Companies report status.
07
S2 informs Cdr that PIR on ID of lead Bn
of the 234 Mech Bde indicates major
enemy avenue to be AA3 into Tm B area.
08
Cdr triggers DP’s (DP 1 n/a) DP 2 TF
reserve can be released due to low threat
in center (AA4) DP 2 is Y commit one
platoon of Tm AQ to TmB.
09
S3 (FRAGO) Heavy enemy on AA3, Tm
A detach on platoon of tanks to Tm B
immediately, move to PL Y.
10
Companies move to occupy along PL Y.
11
12
Source – Brigade
FSO RFS to Bde FSO for FASCAM at
target north of TAI n.
S2 checks positions of scouts for Ops 5
to 10 Kms north of PL Y.
Scouts move as needed
Vignette 4 – Decision Point 3 [Request Bde Reserve]
IB
Company
Size forces
Company
Size forces
234
3
234
1
235
AA5
TAI Z
1
AA3
Company
Size forces
PL
Y
AA5a
AA5a
AA4
AA6c
Main
Effort(ME)
AA3
NAI
PL
Y
TmA
3-66=1-22
1
4ID X C
X D
CoC
…
Res
TmB
PL
3-66=1-22
AA4
Blocking
Positions
INTEL
Variation A:
Heavy threat across sector
slowed by Bde artillery
and air strikes.
Company units of 3 different Bns on all 3 AAs
Enemy can be blocked along PL Y
238 Regt lead units not committed
Weather is clear and observation unhindered.
Bde & Div are destroying DAG/RAG
DP1
N
…
Res
TmB (+)
Request Bde Reserve ?
Y
N
Request
FASCAM/CAS
Go to DP 4
1
4ID X C
X D
CoC
2Co
Co
1-66
INTEL
AA5c
TmA (-)
Brigade
Reserve
• Lead Bn of 238 regt sighted by UAV
moving toward AA5.
• Major 2 Bn threat on AA5a & 5c.
• Pressure continues on AA’s 3 & 4.
DP1
DP3
TAI Z
Main
Effort(ME)
PL
•
•
•
•
•
AA5
1-235
1-238
3-234
IB
TAI X
TAI Y
ll
Variation B:
Major enemy reserve force is
is committed.
Y
DP2
NA
DP3
Request Bde Reserve ?
N
Go to DP 4
Y
Vignette 4A Time Line
Sequence #
Timing
Source – Task Force Units
01
H+9
Scouts report that Bde Recon to north
have been sighting increased enemy
movement on AA’s 3, 4 &5.
02
Source - Task Force
TOC/Staff/Cdr
Source – Brigade
S2 requests (RFI) intel assessment by Bde S2.
03
Bde S2 provides INTSUM to the effect that
the 230 Mech Bde is moving south in the
3-66AR (AA’s 1&2), indications are that the
234th Bde will cross with a Bn each on AA
3 and AA 4. 1CD pressure on the 235th
Bde will likely lead to at least one Bn on
AA5a. No indicators on commitment of
enemy division reserve (238th Bde)
04
S2 relays INTSUM to TOC and companies.
05
S3 assesses company progress and status on
battle positions along PL Y.
06
Bde S3 reports that massive air strikes and
attack helicopter sorties have slowed
enemy attack along IB.
07
S2 informs Cdr that PIR indications on lead Bn
indicate equal threat across front. Major
reserve unit remains uncommitted.
08
Cdr triggers DP criteria: DP 1 (neutral) DP 2
(neutral); DP 3 (attacks are slowed and TF can
handle current threat using artillery and air)
09
S3 coordinates with FSO on FASCAM targets
on AA3 and AA5a, air strikes on AA3&4.
10
FSO passes requests (RFS) to Bde FSO.
11
S2 assess scout location for moves.
Vignette 4B Time Line
Sequence #
Timing
Source – Task Force Units
01
H+10
Companies & Scouts report enemy
attack slowed by air strikes north of
PL Y. Companies are in BPs on along
PL Y. Tm A has detached one platoon
to Tm B in west.
02
Source - Task Force
TOC/Staff/Cdr
S2 passes SALT to Bde S2 & TOC.
S2 RFI to Bde S2 for intel on 238th Bde.
03
Bde S2 responds that recent UAV sightings
show logistic re-supply points at highway 36
in Gatesville. C2 elements have moved
south of IB and a full bn (believed to be
1-235) is moving on AA5.
04
S2 passes assessment to TOC and Cdr that
indications are that the enemy division has
committed the reserve 238Bde in a push
south and SW along AA5, 5a and 5c. Cdr is
alerted to trigger for DP 3.
05
S3 informs companies to hold positions along
PL Y and be prepared to defend.
06
Source – Brigade
Companies report units in BP’s.
Scouts priority is on AA5a and 5c.
S2 checks positions and moves if necessary.
07
Cdr triggers DPs: Dp1 (Y ME is now CoC);
DP2 (n/a, TF reserve with Tm B); DP 3 (Y
major threat above TF ability)
08
Cdr/S3 RFS that Bde commit 1-66AR to block
enemy on AA5c and reinforce Tm A in center
with at least 1 company.
09
FSO changes priority of fires to Co C.
Request CAS and attack helicopters
10
Cdr considers DP 4
Future Work
• Model Multiple Battalions
• Simulating Higher-Level Decision-Making and Situation
Assessment, i.e. Command and Control (C2)
• More Generic and Flexible Knowledge
• Increase Comprehensiveness and Robustness of
Knowledge (Handle more missions/situations)
• Modeling Multi-Agent Teamwork Through Reasoning About
Beliefs and Shared Goals