FIGURES
S.1. A Top-Level DynaRank Scorecard ..........................
S.2. A Subordinate DynaRank Scorecard.........................
S.3. Cost-Effectiveness Rankings of Options Representing Different
Views Obtained with Different Emphasis, or Weighting, of
Top-Level Measures .....................................
S.4. DynaRank in the Spectrum of Defense Analysis Tools ...........
1.1. Defense Strategy Components .............................
1.2. Dimensions in the Evaluation of a Defense Portfolio ............
1.3. Basic Elements of a Top-Level DynaRank Scorecard ............
1.4. General Conclusions Based on Interactive Ranking .............
1.5. The Spectrum of Defense Analysis Models and Methodologies .....
1.6. DynaRank Linked to Models and Used to Screen New
Capabilities at Several Levels .............................
2.1. The FORWARD Model and Scorecard .......................
2.2. Schematic of Measures and Options Included in the Air Force
Shaping Scorecard ......................................
2.3. The Process of Applying DynaRank to Evaluating Policy
Options...............................................
2.4. Model Outputs As a Source of Input to DynaRank ..............
2.5. A DynaRank Scorecard ..................................
2.6. A DynaRank Template ...................................
2.7. Cumulative Cost-Effectiveness and Plots of Ranked Options ......
2.8. Alternative “Views” Stored in a Rank Sheet with Common
Items Colored Alike .....................................
2.9. A Subordinate Scorecard .................................
3.1. Options Were Organized in Force Structure, Modernization,
and Efficiency Categories .................................
3.2. A Portion of the Main QDR Scorecard .......................
3.3. A Portion of the Subordinate Scorecard Used for the SWA
Contingencies..........................................
3.4. A Portion of the QDR Scorecard Used for the Shaping
Component of Strategy ...................................
3.5. Comparison of Ranked Lists with Different Emphasis on the
Strategy Components ....................................
3.6. Efficiency Options Save Money and Often Improve
Effectiveness as Well ....................................
vii
xiv
xv
xvi
xvii
3
4
5
7
7
8
14
15
16
17
18
20
21
22
24
31
33
34
35
36
37
viii Resource Allocation for the New Defense Strategy
A.1. Using the Pull-Down Menu to Create a New Scorecard
Template .............................................
A.2. Dialogue Box for Naming a Scorecard Template ................
A.3. DynaRank Template Blocks for Entering Options, Option
Types, and Scorecard Labels ..............................
A.4. Filled-In Option and Option Type Blocks in a DynaRank
Template .............................................
A.5. The Measures Block in a DynaRank Template .................
A.6. A Filled-In Measures Block in a DynaRank Template ...........
A.7. A Filled-In Cost Block in a DynaRank Template ...............
A.8. Menu Selection from a Template Worksheet to Create a New
Scorecard .............................................
A.9. Naming a New Scorecard .................................
A.10. Menu of Existing Scorecards in the Workbook .................
A.11. A DynaRank Scorecard ..................................
A.12. Rows Are Associated with Options in the DynaRank
Scorecard .............................................
A.13. Measures Form the Basic Columns of a DynaRank Scorecard .....
A.14. Measures Weights ......................................
A.15. Choosing the Min Across Measures .........................
A.16. The Base-Case Row of a Scorecard ..........................
A.17. The Goal Row of a Scorecard ..............................
A.18. Color Values...........................................
A.19. The Aggregate Utility Column .............................
A.20. The Cost Columns of the DynaRank Worksheet ................
A.21. The Cost-Effectiveness Columns ...........................
A.22. Aggregate Scorecard for Top-Level Measures ..................
A.23. Derived Scorecard for Rollup to Level 2 Measures ..............
A.24. Choosing to Rank the Scorecard Options by Cost-Effectiveness ....
A.25. Selecting a Cumulative Cost-Effectiveness Chart ...............
A.26. Cumulative Cost and Effectiveness Chart ....................
A.27. The Cumulative Cost and Effectiveness Chart Limited to the
Top 10 Ranked Options ..................................
A.28. Cumulative Effectiveness by Top-Level Measures and Cost .......
A.29. Choosing to Transfer Results to a Rank Sheet .................
A.30. A Rank Sheet with One Transferred View Called “New Rank” .....
A.31. A Rank Sheet with Three “Views” Representing Different
Emphases.............................................
A.32. Coloring the Common Items in the Top x Items of the Views ......
A.33. Transferring Results to a Results Sheet ......................
A.34. A Single View Transferred to a Results Sheet .................
A.35. The Composite Effectiveness, Cost, and Cost-Effectiveness
Ranking of Options in a Results Sheet .......................
A.36. Several Views Transferred to the Same Results Sheet ...........
A.37. Options Ranked Based on a Composite Weighting of the Views
in the Results Sheet .....................................
A.38. Creating a Combined Scorecard ............................
43
43
44
45
46
47
48
48
49
49
51
52
53
54
55
56
58
59
60
61
62
64
65
67
67
68
69
69
71
71
72
73
74
75
76
77
77
79
Figures
A.39. Dialogue Box to Create a Combined Scorecard .................
A.40. A Combined Scorecard ...................................
A.41. Choosing to Highlight a Scorecard with Colors from Another
Scorecard .............................................
A.42. Choosing the Scorecard from Which to Obtain the Highlight
Colors................................................
A.43. Highlights Shown on a Scorecard ...........................
ix
80
81
82
82
83