A Bi'bliography on System Performance Evaluation
A. H. Agajanian
IBM
Introduction
The measurement of computer performance is of
interest to several classes of people associated with
computers. Systems analysts, system designers, software
designers, and users all have a continuing interest in the
most effective techniques for quantifying the performance
of the machines they build, program, and use. This
bibliography of 440 references covering the period January
1970 to March 1975 was compiled to assist those working
in the field.
A number of bibliographies already cover the literature
up to 1971 (see "Bibliographies" below). The preceding
article by Nutt1 4 °on computer system monitors also has a
substantial bibliography. This compilation was made in a
effort to update existing bibliographies without having a
significant overlap.
Computer and Control Abstracts and the Engineering
Index of January 1970 to March 1975 were the main
sources used in this search. In addition, current journals,
current conference proceedings and abstracts, Books in
Print, Cumulative Book Index, the IBM Technical
Information Retrieval Center (ITIRC), and the library card
catalog were consulted.
November 1975
For ready access, this bibliography is divided into 26
sections as follows:
Conferences
Bibliographies
Books
Review Articles
Applied Performance Evaluation Techniques
Simulation Models
Analytical and Statistical Techniques
Empirical Techniques
Measurement Applications/Tools
System Performance Parameters
Model Development, Validation and Calibration
Optimization and Verification
Performance Evaluation: Case Studies
Data Base Design/Tuning
Application Development
63
Software Design
Operating Systems
Virtual Systems
Installation Planning
Peripheral Equipment
Human Factors
Cost-Benefit Analysis
Timesharing Systems
System Comparison Results/Benchmarks
Large Systems
Medium and Small Systems
Reliability, Availability, and Serviceability (RAS)
Reliability Modeling
Techniques
System Failure Rate Analysis
System Failure Rate Prediction
Results
Following each heading, the bibliographies are listed in
alphabetical order of the names of the principal authors in a
conventional format. The language in which the article is
published, if not English, is given. The volume and number
of Computer and Controls Abstracts (CCA) are also given
for easy access to the abstracts. A great deal of the
literature is published in conference proceedings; therefore,
some of the important conferences related to this subject
are listed in Section 1. A quarterly publication by ACM
SIGMETRICS, "Performance Evaluation Review," is a
contribution to this field.
Acknowledgments
The author would like to thank Mr. J. L. Dellheim and
Mr. R. Ramos for helpful discussions, and all of the IBM
East Fishkill library staff for their valuable assistance.
Conferences
Fall Joint Computer Conference, Anaheim, California, December
5-7, 1972; proceedings published by AFIPS Press, Montvale,
N. J., 1972, 1320 pp.
Fifth Annual Computer Society Conference, Boston, Mass.,
September 22-24, 1971; conference digest published by IEEE,
New York, N. Y., 1971, 213 pp.
7th Annual Computer Society International Conference, COMPCON
73, San Francisco, California, February 27-March 1, 1973; digest
of papers published by IEEE, New York, N. Y., 1973, 248 pp.
International Conference on Electricity Distribution: Part 1,
London, England, May 7-10, 1973; papers published by IEE
Conference Publications, London, England, 1973, 283 pp.
197-2 Systems Building Conference, Gaithersburg, Md., February
24-26, 1972; proceedings published by ASCE, New York, N. Y.,
1972, 343 pp.
IEEE International Symposium on Fault-Tolerant Computing,
Pasadena, California, March 1-3, 1971; digest of papers published
by IEEE, New York, N. Y., 1971, 152 pp.
5th World Congress of the International Federation of Automatic
Control (IFAC), Paris, France, June 12-17, 1972; papers
published by IFAC, distributed by ISA, Pittsburgh, Pa., 1972.
Hawaii International Conference on System Sciences, Honolulu,
Hawaii, January 9-11, 1973; proceedings published by Western
Periodical Co., North Hollywood, Calif., 1973, 145 pp.
64
IEEE International Conference on Communications, Seattle,
Washington, June 11-13, 1973; conference record published by
IEEE, New York, N. Y., 1973, 2 vols.
Annual Reliability and Maintainability Symposium, Philadelphia,
Pa., January 23-25, 1973; proceedings published by IEEE, New
York, N. Y., 1973, 648 pp.
5th Australian Computer Conference, Brisbane, Australia, May
22-26, 1972; proceedings published by Aust. Computer Soc.,
Inc., Watson, Aust., 1972, 634 pp.
19th International ISA Aerospace Instrumentation Symposium, Las
Vegas, Nev., May 21-23, 1973; proceedings published by ISA,
Pittsburgh, Pa., 1973, 312 pp.
7th Annual Symposium on the Interface of Computer Science and
Statistics; Iowa State University, Ames, Iowa, October 22-29,
1973; proceedings published by Iowa State University, Ames,
Iowa, 1973.
IEEE Symposium on Computer Software Reliability, New York,
N. Y., April 30-May 2, 1973; record of papers published by
IEEE, New York, N. Y., 1973, 167 pp.
Asilomar Conference on Circuits and Systems, Pacific Grove,
California, November 15-17, 1972; papers of conference record
published by Western Periodicals Co., North Hollywood,
California, 1973, 527 pp.
Minicomputer Evaluation and Selection, London, England, June
4-6, 1973; proceedings published by Miniconsult, London,
England, 1973, 169 pp.
Conference on Operational Research in the Design of Electronic
Data Processing Systems, Munich, Germany, 1971; proceedings
published by English University Press, London, England, 1973.
8th Meeting of Computer Performance Evaluation Users Group on
Computer Performance Evaluation, Gaithersburg, Md., December 4-7, 1973; proceedings published by US Army; Inst Comp.
Sci. & Technol.; Washington, D.C., 1974.
Bibliographies
1. Buchholz, W., "A Selected Bibliography on Computer
Performance Evaluation," Computer Group News, vol. 2 (8),
21 (1969).
-2. Carroll, B. D. and E. W. Smith, "A Bibliography of Fault
Tolerant Computing," Report AU-T-22, Auburn Univ., Ala.,
1972, 46 pp., CCA7-24455.
3. Crooke, S. and J. Minker, "Key Word in Context Index and
Bibliography on Computer Systems Simulation and Evaluation," Report NASA-CR-103212, Maryland Univ., College
Park, 1969, 42 pp., CCA5-15655.
4. Crooke, S., J. Minker, and J. Yeh, "Key Word in Context
Index and Bibliography on Computer Systems Evaluation
Techniques," Report NASA-CR-11757, Univ. Maryland,
College Park, 1971, 66 pp., CCA7-11558.
5. Hughes, T., P. G. Williams, and D. Norman, "Glossary of
Systems Engineering and Systems Management Effectiveness
Terms and Definitions Together with a Selected Reading List
and Bibliography, Covering the Technical Support Disciplines
of Quality: Reliability and Maintainability to the Engineering
of Hardware Systems/Equipment and Products," Report
N74-16147/2, Central Electricity Generating Board, London,
England, 1973, 171 pp.
6. Miller, E. F., Jr., "Bibliography on Techniques of Computer
Performance Analysis," Computer, voL 5 (5), 39 (1972),
CCA8-1513.
Books
7. Amstader, B. L., Reliability Mathematics: Fundamentals,
Practices, Procedures, McGraw-Hill Book Co., New York,
1971.
8. Au, T., R. M. Shane, and L. A. Hoel, Fundamentals of
Systems Engineering Probabilistic Models, Addison-Wesley,
New York, 1972.
COMPUTER
9. Carroll, H., OS Data Processing with Review of OS/VS,
Wiley-Interscience, New York, 1974.
10. Drummond, M. E., Jr., Evaluation and Measurement
Techniques for Digital Computer Systems, Prentice-Hall,
Englewood Cliffs, N. J., 1973.
11. Enslow, P. H. (Ed.), Multiprocessors and Parallel Processing,
Wiley-Interscience, New York, 1974.
12. Everling, W., Exercise in Computer Systems Analysis,
Springer-Verlag, Berlin, Germany, 1972.
13. Gordon, G., System Simulation, Prentice-Hall, Inc., Englewood Cliffs, N. J., 1969.
14. Martin, F. F., Computer Modeling and Simulation, John
Wiley & Sons, Inc., New York, 1968.
15. Martin J., Design of Real-Time Computer Systems,
Prentice-Hall, Inc., Englewood Cliffs, N. J., 1967.
16. Sharpe, W. F., The Economics of Computers, Report
R-463-PR, Rand Corp., Santa Monica, Calif., 1969, 581 pp.,
CCA5-17412.
17. Shinners, S. M., Techniques of System Engineering,
McGraw-Hill Book Company, New York, 196 7.
18. Shooman, M. L., Probabilistics Reliability: An Engineering
Approach, McGraw-Hill Book Company, New York, 1968.
19. Stimler, S., Real-time Data-processing Systems, McGrawHill Book Company, New York, 1969.
Review Articles
20. Anon., "Savings from Performance Monitoring," EDP Anal.,
voL 10 (9), 1 (1972), CCA8-4270.
21. Ashany, R., "Application of Control Theory Techniques to
Performance-Analysis of Computer Systems (Some Aspects of
the State of the Art)," 6th Asilomar Conference on Circuits
and Systems, 1972, pp. 90-101, 1973, CCA8-14926.
22. Bell, T. E., "Performance Determination-The Selection of
Tools, If Any," AFIPS Conference Proceedings, voL 42, 1973
National Computer Composition and Exposition, pp. 31-37,
CCA8-16883.
23. Borovits, I. and E. I. Golembo, "Measuring Computer
Performance," J Syst. Mgt., voL 24 (11), 38 (1973),
CCA9-8024.
24. Butler, D., "Computer Performance Appraisal," Data
Process, voL 12 (3), 206 (1970), CCA5-17425.
25. Clements, C., "Software Services-Sparing the Time to
Analyse the Performance," Comput. Wkly., vol. 13 (313), 12
(1972), CCA8-4259.
26. Cooke, M. P., "Some Techniques for the Measurement of
Computer Performance," presented at the 5th Australian
Computer Conference, Brisbane, Australia, May 1972,
CCA7-16 138.
27. Copeland, D. E., "Computer Evaluation Techniques," Report
RG-TR-72-3, Army Missile Command, Redstone Arsenal,
Ala., 1972, 204 pp., CCA8-7 159.
28. Douson, P. O., "Control Data Corporation's Cyber 70:
Procedures for Performance Evaluation," Report AD785192/8, Air Force Inst. of Tech. Wright-Patterson AFB
Ohio School of Engineering, Air Force Logistics Command,
Wright-Patterson AFB, Ohio, 1974, 114 pp.
29. Drummond, M. E., Jr., "A Perspective on System
Performance Evaluation," IBM Syst. J., voL 8 (4), 252
(1969), CCA5-4293.
30. Gertler, J., H. Glynn, V. Hobbs, and F. Woolfall, "Computer
Systems Performance Measurement Techniques," Report
AD-733-764, Transportation Systems Center, Cambridge,
Mass., 1971, 76 pp.
31. Greco, R. J., "An Investigation of Evaluation Techniques of
Real-Time Systems," Advances in Instrumentation, Proceedings of 24th annual ISA Conference, 1969, 8 pp.,
CCA5-19960.
32. Hart, L. E., "The User's Guide to Evaluation Products,"
Datamation, voL 16 (17), 32 (1970).
November 1975
33. Hutchinson, G. K., "Simulation and System Evaluation," In:
Real Time: International Computer State of the Art Report,
Infotech, Maidenhead, Berks, England, pp. 333-350 (1971),
CCA6-16729.
34. Hytha, R. K., "Computer in Contrast-Survey of Methods of
Evaluation and Choice," ADL-Machr., voL 18 (80), 26
(1973), German, CCA8-21956.
35. Johnson, R. R., "Needed: A Measure for Measure,"
Datamation, vol. 16 (17), 22 (1970), CCA6-8884.
36. Kiviat, P. J. and M. F. Morris, "Getting Started in Computer
Performance Evaluation," Proceedings of the 8th Meeting of
Computer Performance Evaluation Users Group, 1973, pp.
5-13, 1974, CCA10-2643.
37. Kummerle, K., "Determining the Efficiency and Performance
of EDP Equipment," Elektrotech. Z. (ETZ) B, voL 25 (7-8),
150 (1973), German, CCA8-14840.
38. Lientz, B. P., "Computer Performance Evaluation," Report
AD-782243/0, University of Southern California, Los Angeles
School of Engineering, 1973, 14 pp.
39. Lopato, G. P., G. D. Smirnov, N. G. Antonova, and N. A.
Mal'tsev, "A Rational Approach to the Appraisal of Technical
and Economic Effectiveness of Computers," Izv. VUZ
Elektromekh., voL 12, 1355 (1972), Russian, CCA8-16743.
40. Lucas, H. C., Jr., "Performance Evaluation and Monitoring,"
Comput. Sunr., voL 3 (3), 79 (1971), CCA7-5726.
41. Mulroy, J. J., "Computer Performance Analysis," In:
Application Techniques: International Computer State of the
Art Report No. 8, Infotech, Maidenhead, Berks, England, pp.
399-418 (1972), CCA7-18883.
42. Osswald, B., "Master Techniques of Computer Performance
Measurement and Evaluation," Angew. Inf:, vol. 8, 373
(1972), German, CCA7-23585.
43. Pryke, P. J., "Methods of Measuring System Performance,"
Comput. Wkly., voL 13 (315), 6 (1972), CCA8-4262.
44. Shively, R. R., "Performance Evaluation," Computer, voL 5
(5), 12-5 (1972).
45. Sulyok, I., "Evaluation and Choosing Computers," Inf:
Elektron., voL 6 (2), 116 (1971), Hungarian, CCA6-19357.
46. Vallbracht, G., "Evaluation of Information System Performance-A Survey of Techniques," Conference on Operational Research in the Design of Electronic Data Processing
Systems, 1971, pp. 25-28, 1973, CCA8-18698.
47. Venese, D. M.. "A Methodology for Performance Measurement," Proceedings of the 8th Meeting of Computer
Performance Evaluation Users Group, 1973, pp. 15-22, 1974,
CCA1 0-2789.
48. Wilk, M. B., "Study of Complex Systems," Comput. Sci and
Stat., Proc., 7th Annual Symp. on the Interface, 1973, pp.
2-10.
49. Williams, T., "Computer Systems Measurement and Evaluation," Comput. BulL, vol. 16 (2), 100 (1972), CCA7-11546.
50. Wilson, D., "The State-of-the-Art in Evaluating Computer
Systems," Comput. Management, voL 5 (4), 46 (1970),
CCA5-15086.
Applied Performance Evaluation
Simulation Models
51. Balachandran, V. and L. S. Gephart, "A Computerized
Approach to Simulation System Effectiveness," Proceedings
of the 1971 Annual Symposium on Reliability, 1971, pp.
245-253, CCA6-9469.
52. Beretvas, T., E. L. Miles, G. B. Rasch, and R. J. Wicks,
"System-Independent Tracing for Prediction of System
Performance," IBM Tech. Disclosure Bull., vol. 16 (7), 2349
(1973), CCA9-11 117.
53. Bowdon, E. K., Sr., "Using Simulation to Evaluate System
Performance," Proc., 11th Design Automation Workshop,
1974, pp. 359-365, CCA9-19920.
65
54. Bowdon, E. K., Sr., S. A. Mamrak, and F. R. Salz,
"Simulation-A Tool for Performance Evaluation in Network
Computers," AFIPS Conference Proceedings, vol. 42, 1973
National Computer Conference and Exposition, pp. 121-131,
CCA8-1781 3.
55. Bowdon, E. K., Sr., S. A. Mamrak, and F. R. Salz, "A
Simulation Tool for Performance Evaluation of the IBM
360/75," Int J. Comput. & Inf. Sci, vol. 3 (1), 33 (1974),
CCA9-19890.
56. Buchanan, A. L., and R. B. Waina, "A General Simulation
Model for Information Systems: A Report on a Modeling
Concept," Third Conference on Applications of Simulation,
1969, pp. 418-425, 1970. CCA5-15889.
57. Catanai, S. C., "Computer System Models," Comput. &
Autom., voL 21 (3), 14 (1972), CCA7-13825.
58. Copeland, D. E., "Computer Evaluation Techniques," Report
AD-737605, Army Missile Command, Redstone Arsenal, Ala.,
Guidance and Control Directorate, 1972, 229 pp.
59. Dahle, 0. J. and J. Piene, "Evaluation of Computer Systems
through Simulation," Manage. Inf, vol. 2 (6), 279 (1973),
CCA9-8030.
60. Ihrer, F. C., "Benchmarking vs. Simulation," Comput. &
Autom., vol. 21 (11), 8 (1972), CCA8-8792.
61. Kleinrock, L., "Models for Computer Networks,"Proc., 1969
IEEE International Conference on Communications, 8 pp.,
CCAS-4593.
62. Kummerle, K., "Simulation of the Performance of Computer
Systems," Elektron. Rechenanlagen, vol. 12 (6), 324 (1970),
CCA6-5485.
63. Mancini R. J., "Performance Analysis for the Skylab
Terminal System," IBM Syst. J., vol. 13 (2), 94 (1974).
64. Michel, G. J., "Systems Analysis and Systems Simulation in
Education-Applications and Evaluation," AEDS Monit., vol.
12 (7), 10 (1974), CCA9-17414.
65. O'Brien, F., "Simulation Techniques for Performance
Prediction and Analysis," In: Computer Systems Measurement: International Computer State-of-the-Art Report, C. J.
Bunyan (Ed.), Infotech, Maidenhead, Berks, England, pp.
337-363, CCA10-2764.
66. Querubin, R. and C. V. Ramamoorthy, "Study of
Multiprogrammed Computer Systems with Memory Hierarchies," Report AD-756476, Univ. of Texas Electronics
Research Center, Austin, 1972, 210 pp.
67. Racoveanu, N., "System Simulation, Models and Categories,"
Econ. Comput. Cybernetics Stud. Res., vol. 4 (23) (1969),
CCA5-14074.
68. Rechtschaffen, R. N., "Queueing Simulation Using a Random
Number Generator," IBM Syst. J., voL 11(3), 255 (1972).
69. Salz, F. R., "Simulation Analysis of a Network Computer,"
Report PB-221, 687/7, Illinois Univ., Dept. of Computer
Science, Urbana, 1973, 48 pp.
70. Seaman, P. H. and R. C. Soucy, "Simulating Operating
Systems," IBM Syst. J., voL 8 (4), 264 (1969), CCA5-4302.
71. Shemer, J. E., "Simulation and Mathematical Modeling of an
On-line Accounting System," Proc., Fourth Conference on
Applications of Simulation, 1970, pp. 282-289.
72. Waldron, M., "Reducing the Overheads by Simulation,"
Comput. Wkly. voL 15 (359), 6 (1973), CCA9-598.
73. Walsh, A. P. and T. J. Li "Simulation and Analysis of a Loop
Communication System," Proc., 7th Annual Simul. Symp.,
1974, pp. 183-202.
74. Walsh, J. E., "Evaluation of Simulation from its Ability to
Simulate Components Subsystems of Overall System,"
Report Themis-SMU-TR-56, Southern Methodist Univ.,
Dallas, Tex., 1970, 11 pp., CCA6-2394.
75. Williams, T., F. M. Richards, J. E. Weatherbee, and L. K. Paul,
"The MSFC Univac 1108 Exec 8 Simulation Model," Report
NASA-CR-6 1379, Computer Sci Corp., Huntsville, Ala.,
1972, 38 pp., CCA8-7158.
76. Williams, T. G. and J. E. Weatherbee, "Computer System
Simulation and Analysis," Report NASA-CR-61376, Computer Sci. Corp., Huntsville, Ala., 1972, 22 pp., CCA8-7157.
66
Analytical and Statistical Techniques
77. Abrams, M. D., "A New Approach to Performance Evaluation
of Computer Networks," Proceedings of the 1974 Symposium on Computer Networks: Trends and Applications,
IEEE Computer Society, pp. 15-20, CCA9-22016.
78. Allen, A. O., "Elements of Probability for System Design,"
IBM Syst. J., vol. 13 (4), 325 (1974).
79. Baskett, F., "Confidence Intervals for Simulation Results: A
Case Study of Buffer Pool Performance," Comput. Sci. and
Stat., Proc., 7th Annual Symp. on the Interface, 1973, pp.
58-64.
80. Beliner, H., "Method of Good Balance: A Tool for Improving
Computing Systems Performance," Comput. Sci and Stat.,
7th Annu. Symp. on the Interface, Proc., 1973, pp. 110-116.
81. Beizer, B., "Analytical Techniques for the Statistical
Evaluation of Program Running Time," AFIPS Conference
Proceedings, 1970 Fall Joint Computer Conference, pp.
519-524, CCA6-10265.
82. Berk, M. A., C. W. Dunbar, and G. C. Hobson, "Design and
Performance Considerations for the Retail Store System,"
IBM Syst. J., voL 14 (1), 64 (1975).
83. Brown, G. F., Jr., and W. F. Rogers, "Bayesian Approach to
Demand Estimation and Inventory Provisioning," Nav. Res.
Logistics Q, voL 20 (4), 607 (1973).
84. Carlson, E. D., "Evaluating the Impact of Information
Systems," Manage. Inf:, voL 3 (2), 57 (1974).
85. Chu, W. W. and A. G. Konheim, "On the Analysis and
Modeling of a Class of Computer Communication Systems,"
IEEE Trans. Commun., COM-20 (3), 645 (1972), CCA717389.
86. Cole, G. D., "Performance Measurements on the ARPA
Computer Network," IEEE Trans. Commun., COM-20 (3),
630 (1972), CCA7-17388.
87. Cooperman, J. A., H. W. Lynch, and W. H. Tetzlaff, "SPG:
An Effective Use of Performance and Usage Data,"
Computer, voL 5 (5), 20-23 (1972).
88. Fry, R. A. and I. H. Banner, "Transmission Performance
Assessment of Telephone Networks," Post Office Electr. Eng.
J., voL 65 (3), 145 (1972).
89. Garbe, H., "Diagnosis and Evaluation of Information
Systems," Angew. Inf, vol. 16 (4), 159 (1974), German,
CCA9-1741 3.
90. Hansler, E., G. K. McAuliffe, and R. S. Wilkov, "Exact
Calculation of Computer Network Reliability," Networks,
voL 4 (2), 95 (1974), CCA9-12003.
91. Irani, K. B. and I. S. Uppal, "Performance Analysis and
Optimization of Computer Systems Using Markovian
Models," Proceedings, 1st USA-Japan Computer Conference,
1972, pp. 145-152, CCA8-18609.
92. Iyudu, K. A., "Causal Approach to the Analysis of Control
Hardware Failures," Autom Remote Control, vol. 33 (6),
1013 (1972).
93. Jensen, P. A. and M. Belimore, "An Algorithm to Determine
the Reliability of a Complex System," IEEE Trans.
Reliability, R-18 (4), 169 (1969), CCA5-8664.
94. Kimbleton, S. R. and C. G. Moore, "A Limited Resource
Approach to System Performance Evaluation," Report
AD-734008, Michigan Univ., Dept. of Industrial Engineering,
Ann Arbor, 1971, 39 pp.
95. Locks, M. O., "The Maximum Error in System Reliability
Calculations by Using a Subset of the Minimal States," IEEE
Trans. Reliability, R-20 (4), 231 (1971), CCA7-2186.
96. Proschan, F., "Probabilistic Models and Statistical Inference
in Reliability, Life Testing, and Fatigue Failure," Report
AD-76 3818, Florida State Univ., Dept of Statistics,
Tallahassee, 1973, 14 pp.
97. Schneide-wind, N. F., "Software Reliability and Quality
Control," Bull. Oper. Res. Soc. Am. voL 20 (suppl. 2), B/388
(1972), CCA8-4458.
98. Shemer, J. E., "Probability Models and Computer System
Design," Thesis, Southern Methodist Univ., USA, 1968, 118
pp., Order No. 68-17052, CCA5-5026.
99. Singpurwalla, N. D., "Statistical Fatigue Models: A Survey,"
IEEE Trans. Reliability, R-20 (3), 185 (1971), CCA6-22675.
COMPUTER
100. Skinner, C. E. and J. R. Asher, "Effects of Storage
Contention on System Performance," IBM Syst. J. voL 8 (4),
319 (1969), CCA5-4744.
101. Tiger, B., "System Effectiveness by Computer," Proceedings,
1972 Annual Reliability and Maintainability Symposium, pp.
59-67, CCA7-12197.
102. Vavra, R., and R. Franta, "Robustness and Analytic
Computer System Models," Proc., 1973 Winter Simulation
Conference, pp. 873-874, CCA8-18696.
103. Watson, R. A., "The Use of Computer System Accounting
Data to Measure the Effect of a System Modification,"
Report AD-731257, Rand Corp., Santa Monica, Calif., 1971,
16 pp.
104. Winokur,, H. S., Jr., and L. J. Goldstein, "Analysis of
Mission-Oriented Systems," IEEE Trans. Reliability, R-18 (4),
144 (1969), CCA5-8660.
105. Yourdon, E., "Reliability Measurements for Third Generation
Computer Systems," Proceedings of the 1972 Annual Reliability and Maintainability Symposium, pp. 174-183, CCA712411.
Empirical Techniques
Measurement Applications/Tools
106. Amiot, L., N. K. Natarajan, and R. A. Aschenbrenner,
"Evaluating a Remote Batch Processing System," Computer,
vol. 5 (5), 24 (1972), CCA8-1511.
107. Arndt, F. R. and G. M. Oliver, "Hardware Monitoring of
Real-Time Computer System Performance," Computer, voL 5
(4), 25-29 (1972).
108. Baird, R., "APET-A Versatile Tool for Estimating Computer
Application Performance," Software Pract. & Exper., voL 3
(4), 385 (1973), CCA9-8033.
109. Belady, L. A., W. R. DeOrazio, and R. W. O'Neill, "Computer
Performance Measurements," IBM Tech. Disclosure BulL, voL
16 (2), 455 (1973), CCA8-23882.
110. Bell, T. E., "Choose Your Tools to Check Your Computer,"
Comput. Decis., voL 4 (11), 12 (1972), CCA8-8795.
111. Bloom, B. H., M. H. Clark, C. G. Feldman, and R. K. Coe,
"Criteria for Evaluating the Performance of Compilers,"
Report AD/A-002 322/6SL, Softech Inc., Waltham, Mass.,
Rome Air Development Center, Griffiss AFB, N. Y., 1974,
353 pp.
112. Bookman, P. G., B. A. Brotman, and K. L. Schmitt, "Use
Measurement Engineering for Better System Performance,"
Comput. Decis., voL 4 (4), 28 (1972), CCA7-18859.
113. Buchholz, W., "A Synthetic Job for Measuring System
Performance," IBM Syst. J., voL 8 (4), 309 (1969),
CCA5-4291.
114. Bussell, B. and R. A. Koster, "Instrumenting Computer
Systems and Their Programs," AFIPS Conference Proceedings, 1970 Fall Joint Computer Conference, pp. 525-534,
CCA6-10266.
1i15. Carlson, G., "Practical Economics of Computer Monitoring,"
Manage. Inf., vol. 1 (6), 251 (1972), CCA8-6622.
116. Chyrkin, B. P., "Computer Analysis of Performance Indices
of Complex Systems," Sov. Autom. Control, vol. 6 (6), 27
(1973), CCA9-22227.
117. Conti, D. M., "A Case Study in Monitoring the CDC 6700-A
Multi-Programming, Multi-Processing, Multi-Mode System,"
Proceedings of the 8th Meeting of Computer Performance
Evaluation Users Group on Computer Performance Evaluation, 1973, pp. 115-118, 1974, CCA10-3621.
118. Early, R. H. and B. N. Early, "On the Relative Performance
of the Optimal Control System with Measurements," IEEE
Trans. Autom. Control, AC-1 7 (4), 555 (1972).
119. East, D. G., C. C. Davis, and R. D. Phillips, "Relocate and
Multiprocessor Map and Trace Monitor," IBM Tech.
Disclosure BulL, voL 15 (4), 1377 (1972), CCA86611.
120. Engelbart,- D. C., "Online Team Environment (Network
Information Center and Computer Augmented Team
Interaction)," Report AD-766005/3, Stanford Research Inst,
Augmentation Research, Menlo Park, Calif, 1972, 272 pp.
November 1975
121. Ferrari, D., "Firmware-Monitoring Tools for Measuring the
Performance of Microprogrammed Computer Systems,"
Proceedings of the 2nd International Computing Symposium,
1972, pp. 83-90, CCA7-20052.
122. Ferrari, D., "Workload Characterization and Selection in
Computer Performance Measurement," Comptuter, voL 5 (4),
18-24 (1972).
123. Freedy, A., R. Weisbrod, D. May, S. Schwartz, and G.
Weitman, "Adaptive Computer Aiding in Dynamic Decision
Processes: Analysis and Design," Report AD-769113/2,
Perceptronics, Inc., Encino, Calif., 1973, 127 pp.
124. Gemar, W., "Improved Performance for Less Cost," Data
Processing, voL 16 (4), 225 (1974), CCA10-830.
125. Gimble, R. and H. Schwetman, "Measurement Techniques for
Computer System Performance Evaluation," Comput. Sci.
and Stat., Proc., 7th Annual Symp. on the Interface, 1973,
pp. 22-29.
126. Grant, C. A., "Software Performance Measurement: Requirements and Techniques," In: Computer Systems Measurement:
International Computer State of the Art Report, C. J. Bunyan
(Ed.), Infotech, Maidenhead, Berks, England, pp. 325-336,
CCA10-2763.
127. Grodsky, H. R., "Performance Measurement Within the HIS
Series 6000," Report AD-759808, Mitre Corp., Bedford,
Mass., 1973, 50 pp.
128. Hanke, R. R., "Preliminary Steps in Optimizing University
Computer Performance Using Hardware and Software
Monitors," Report AD-741145, Naval Postgraduate School,
Monterey, Calif., 1971, 103 pp.
129. Harder, D. C., "Measuring the Performance of the Compact
Computer," Data Management, vol. 9 (11), 30 (1971),
CCA7-75 14.
130. Hedeman, W. R., III, and P. 0. Minear, "Internal Performance
Measurement for Data Processing System," IBM Tech.
Disclosure Bull., vol. 16 (7), 2356 (1973), CCA9-8198.
131. Hobbs, V. J. and J. G. Gertler, "Computer System
Performance Measurement Techniques for Arts III Computer
Systems," Report AD-772475/0, Transportation Systems
Center, Cambridge, Mass., 1973, 112 pp.
132. Hughes, J., "Case Histories: Using a Hardware Monitor as an
Intelligent Peripheral," Comput. Sci. and Stat., Proc., 7th
Annual Symp. on the Interface, 1973, pp. 117-121.
133. Kahn, H. J. and J. W. R. May, "Use of Logic Simulation in
the Design of a Large Computer System," Radio Electron.
Eng., voL 43 (8), 497 (1973).
134. Kanazawa, M., H. Kitagawa, H. Hagiwara, and 0. Miwa, "An
Evaluation of CPU Performance by Means of the Concatenate
Instruction Mix," J. Inf. Process. Soc. Jap., vol. 14 (9), 715
(1973), Japanese, CCA9-8200.
135. Karush, A., "Performance Measurement," Data Management,
vol. 9 (7), 36 (1971), CCA6-19352.
136. Kitagawa, H., "Computer Systems and Efficiency," Syst. &
Control, voL i6 (8), 616 (1972), Japanese, CCA84461.
137. Kraulis, 0. E., "Computer Systems Performance Evaluation,"
Proceedings. 4th Hawaii International Conference on System
Sciences, 1971, pp. 437-439, CCA7-9613.
138. Leon, B. J. and R. T. Kitahara, "Monitor Simulation of the
NEC TRP QPSK Receiver," Conf. Rec. 1973 Natl.
Telecommun. Conf., vol. 1, pap. 4D, 8pp.
139. McFadden, T. F. and J. C. Strauss, "Quantitative Evaluation
of File Management Performance Improvements," AFIPS
Conference Proceedings, 1973 National Computer Conference, pp. 6 3-6 8.
140. Nutt, G., "Computer System Monitors," Computer, vol. 8
(11), November 1975, pp. 51-61.
141. Schumacher, D., "A Methodology to Establish and Control
Computer Performance," Proceedings of SHARE XLI,
vol. 1, 1973, pp. 173-183.
142. Smith, D. R., "Performance Assessment of Digital Transmission Systems," Conf. Rec., 1973 National Telecommun.
Conf, vol. 1, pap. 4F, 5 pp.
143. Sutherland, G. G., "Measurement of Lawrence Livermore
Laboratory CDC-7600 System Performance," Proc., 1st
Annual SIGME Symp. on Meas. and Eval., 1973, pp. 78-99.
144. Svobodova, L., "Online System Performance Measurenments
with Software and Hybrid Monitors," 4th Symp. on Oper.
Syst. Princ., 1973, pp. 45-53.
67
145. Svobodova, L., "Computer System Performance Measurement: Instruction Set Processor Level and Microcode Level,"
Report AD/A-000 946/4ST, Stanford Univ., Calif., Stanford
Electronics Labs., Army Electronics Command, Fort
Monmouth, N. J., 1974, 10 pp.
146. Svobodova, L., "Computer Performance Measurement and
Evaluation Methods: Analysis and Applications," Report
AD/A-000 947/2ST, Stanford Unlv., Calif., Stanford
Electronics Labs., Army Electronics Command, Fort
Monmouth, N. J., 1974, 13 pp.
147. Tabke, R. B., "Channel Monitor," IBM Tech. Disclosure Bull.,
voL 15 (4), 1395 (1972), CCA8-7330,
System Performance Parameters
148. Chastain, D. R. and P. Katonak, "Organizing for Performance
Anialysis," Proceedings of SHARE XL, voL 1, 1973, pp.
99-119.
149. Dellheim, J. L., "Some System Evaluation Characteristics,"
presented at Aragon National Laboratories Symposium on
System Performance Evaluations, Aragon, Illinois, October
1971.
150. Feher, K., R. Goulet, and S. Morissette, "Performance
Evaluation Criteria of Hybrid Microwave Systems," IEEE
Trans. Commun., COM-22 (6), 873 (1974).
151. Frank, H., M. Gerla, and W. Chou, "Issues in the Design of
Large Distributed Computer Communication Networks,"
Conf: Rec., 1973 National Telecommum Conf., vol. 2, pap.
37A, 9 pp.
152. Frank, H., R. E. Kahn, and L. Kleinrock, "Computer
Communication Network Design: Experience with Theory
and Practice," Networks, voL 2 (2), 135 (1972).
153. Hughes, P. H. and G. Moe, "A Structural Approach to
Computer Performance Analysis," AFIPS Conference Proceedings, 1973 National Computer Conference, vol. 42, pp.
109-120, CCA8-16885.
154. Jephson, J. S., R. P. McQuarrie, and R. E. Vogelsberg, "A
Three-Value Computer Design Verification System," IBM
Syst. J., vol. 8 (3), 178 (1969).
155. Kerner, H. and K. Kuemmerle, "A Workload Model and
Measures for Computer Performance Evaluation," Report
N72-33195, National Aeronautics and Space Administration,
Marshall Space Flight Center, Huntsville, Ala, 1972, 31 pp.
156. Kreindler, E., "On Performance Sensitivity of Optimal
Control Systems," Int. J. Contr., voL 15 (3), 481 (1972),
CCA7-6723.
157. Kummerle, K., "Characteristic Parameters for the Description
of Performance and Efficiency of EDP Systems," Elektron.
Rechernanlagen, voL 14 (1), 12 (1972), German, CCA7-9612.
158. Rhodes, I. B., "Performance Evaluation for Dynamic Systems
in the Presence of Uncertainty," Report AD-778452/3,
Washington Univ., Control Systems Science and Engineering,
St. Louis, Mo., 1974, 6 pp.
159. Suzuki, T. and K. Kageyama, "A Parameter Adjusting Method
in the Model Reference Adaptive Control System," Trans.
Soc. Instrum. Contr. Eng., voL 7 (6), 563 (1971),
CCA7-1085 1.
160. Van Cauwenberghe, A. R. and S. Willequet, "Parameter
Evaluation for a Second-Order Dead-Time Model from the
System's Step Response," J. A. (Belgium), vol. 15 (3), 114
(1974), CCA10-207.
161. Vesely, J., "The Throughput of a Computer System," Mech.
Autom. Adm, vol 13 (10), 409 (1973), Czech, CCA9-5 172.
162. Zone, G. and K. S. Chang, "A Successive Approximation
Method for Non-Linear Distributed-Parameter Control Systems," Int. J. Contr., voL 15 (2), 255 (1972), CCA7-5220.
Model Development, Validation and Calibration
163. Abrams, M. D., "New Approach to Performance Evaluation
of Computer Networks," Proc., 1974 Symposium on
Computer Networks: Trends & Applications, IEEE Computer
Society, pp. 15-20.
68
164. Anthony, A. L. and H. K. Watson, "Techniques for
Developing Analytic Models," IBM Syst. J., voL 11 (4), 316
(1972), CCA8-11726.
165. Caplener, H. D. and J. A. Janku, "Improved Modeling of
Computer Hardware Systems," Comput. Design, vol. 12 (8),
59 (1973).
166. Cheng, P. S., "Trace-Driven System Modeling," IBM Syst. J.,
voL 8 (4), 280 (1969), CCA5-4303.
167. Cole, G. D., "Performance Measurements on the ARPA
Computer Network," )EEE Trans. Commun., COM-20 (3),
630 (1972).
168. Crowley, F. V., "Simulation of a Minicomputer in a
Communications System," Proc., 1974 Winter Simulation
Conference, vol. I, pp. 69-75, CCA9-12046.
169. DaRin Mills, L. A., "Queues and Network Computers,"
Report PB-221 307/2, Illinois Univ., Dept. of Computer
Science, Urbana, 1973, 77 pp.
170. Gecsei, J. and J. A. Lukes, "A Model for the Evaluation of
Storage Hierarchies," IBM Syst. ., vol. 13 (2), 163 (1974).
171. Goel, A. L. and Y. Liu, "Analysis of ISAM by Two-Level
Factorial Designs," Comput. Sci and Stat., Proc., 7th Annual
Symp. on the Interface, 1973, pp. 16-21.
172. Gordon, E. and P. G. Freese, "Development of a Stochastic
Simulation Model for Performance Evaluation," NASA Spec.
PubL 336, 7th Space Simulation Conf., 1973, pp. 251-263.
173. Hakozaki, K., M. Yamamoto, T. Ono, N. Ohno, and M.
Umemura, "Design and Evaluation System for Computer
Architecture," AFIPS Conference Proceedings, 1973 National
Computer Conference, vol. 42, pp. 81-86.
174. Hayes, J. F., "Modeling an Experimental Computer
Communication Network," 3rd Data Commun. Symp., 1973,
pp. 4-11.
175. Hayes, J. F., "Performance Models of an Experimental
Compbter Communication Network," Bell Syst. Tech. J., voL
53 (2), 225 (1974).
176. Kasperowicz, S. K., "Modeling Complex Systems with
Multi-Nominal Networks," 1973 IEEE Region Six Conference, Minicomputers and Their Applications, pp. 1 7-21.
177. Kimble, S. R., "Performance Evaluation-A Structured
Approach," AFIPS Conference Proceedings, 1972 Spring
Joint Computer Conference, vol. 40, pp. 411-416, CCA718887.
178. Kimbleton, S. R., "The Role of Computer System Models in
Performance Evaluation," CACM, vol. 15 (7), 586 (1972),
CCA7-216 19.
179. Kiviat, P. J., "The Validation of Computer System Simulation
Models: A Practitioner's Approach," Bull. Oper. Res. Soc.
Am., vol. 21 (suppL 2), B220 (1973), CCA9-5942.
180. Kleinrock, L., "Measurement and Modeling of the ARPA
Computer Network," Bull. Oper. Res. Soc. Amer., vol 18
(suppl. 1), B45 (1970), CCA5-18190.
181. Kranz, F. H., "System Performance Models," Bull. Oper. Res.
Soc. Amer., voL 17 (2), B279 (1969), CCA5-14085.
182. Metz, W. C., Jr. and D. Savir, "Store Performance Studies for
the Supermarket System," IBM Syst. J., voL 14 (1), 46
(1975).
183. Metzger, J. K., "Predicting Performance Changes in
Computing Systems," 1972 -Canadian Computer Conference
Session, pp. 3141 (13 pp), CCA7-21 3440.
184. Mihram, G. A., "Some Practical Aspects of the Verification
and Validation of Simulation Models," Op. Res Q., vol. 23
(1), 17 (1972), CCA7-15020.
185. Opderbeck, H., "Measurement and Modeling of Program
Behavior and Its Applications," Report AD-779884/6,
Univ. of California, School of Engineering and Applied
Science, Los Angeles, 1974, 286 pp.
186. Rickard, W. I., "Delay Performance of a Buffered
Communication Network," IEEE Trans. Commun., COM-20
(5), 1008 (1972).
187. Roome, W. D. and H. C. Torng, "Modeling and Design of
Computer Networks with Distributed Computation Facilities," Proc., 1974 Symposium on Computer Networks:
Trends & Applications, IEEE Computer Society, 1974, pp.
30-38.
COMPUTER
188. Schatzoff, M., "Some Approaches to the Modeling and
Evaluation of Programs and Systems," In: Computer Systems
Measurement: Infotech International Computer State of the
Art Report, C. J. Bunyan (Ed.), Infotech, Maidenhead, Berks,
England, pp. 597-620, CCA10-2768.
189. Smith, A. J., "Performance Analysis of Computer System
Components," Stanford Univ., Digital Systems Lab., Calif.,
Office of Naval Research, Arlington, Va., National Science
Foundation, Washington, D. C., 1974, 325 pp.
Optimization and Verification
190. Aiso, H., "Studies on Computer Systems Simulation," Res.
Electrotech. Lab., (703), 1 (1969), Japanese, CCA5-22222.
191. Artis, H. P., "Simulation Techniques for Computer Systems
Scheduling and Evaluation," Bull. Oper. Res. Soc. Am., vol.
21 (suppl. 2), B200 (1973), CCA9-5136.
192. Bell, C. G. and D. Casasent, "Implementation of a Buffer
Memory in Minicomputers," Comput. Design, vol. 10 (1 1), 83
(1971), CCA7-6357.
193. Bell, T. E., B. W. floehm, and R. A. Watson, "How to Get
Started on Performance Improvement," Comput. Decisions,
vol. 5 (3), 30 (1973), CCA8-16741.
194. Bell, T. W., B. W. Boehm, and R. A. Watson, "Computer
Performance Analysis: Framework and Initial Phases for a
Performance Improvement Effort," In: Computing Econlomies: Infotech International Computer State of the Art
Report No. 1, St.-J. Hugo (Ed.), Infotech, Maidenhead, Berks,
England, pp. 407-445 (1973), CCA7-17267.
195. Blatny, J., S. R. Clark, and T. A. Rouke, "On the
Optimization of Performance of Time-Sharing Systems by
Simulation," CACM, vol. 15 (6), 411 (1972), CCA7-17267.
196. Bonner, A. J., "Using System Monitor Output to Improve
Performance," IBM Syst. J., vol. 8 (4), 290 (1969).
197. Chiang, A. T. and J. C. Strauss, "Priority Control for
Maximum Thruput with Equal Job Class Turnaround,"
Comput. Sci and Stat., Proc., 7th Annual Symp. on the
Interface, 1973, pp. 100-109.
198. Clark, R. A. and W. W. Farr, Jr., "Performance Optimization
Procedure for Digital Systems," Comput. Design, vol. 11 (12),
65 (1972), CCA8-11724.
199. Dellheim, J. L., "Program Execution Tracing Systems
Improvement," US Patent 3707725, published December
1972.
200. Graves, J. M., "Using SMF and TFLOW for Performance
Enhancement," Proceedings of the 8th Meeting of Computer
Performance Evaluation Users Group on Computer Performance Evaluation, 1973, pp. 33-36, 1974, CCA10-2769.
201. Green, P. E. and D. T. Tang, "Some Recent Developments in
Teleprocessing System Optimization," 1973 IEEE Intercon
Technical Papers, voL 1, Pap. 14/1, 7 pp.
202. Irani, K. B., I. S. Uppal, E. P. Jensen, C. R. Sonnenberg, and
M. F. Mitoma, "A Study of Information in Multiple-Computer and Multiple-Console Data Processing Systems," Report AD-769889/7, Michigan Univ., Systems
Engineering Lab., Ann Arbor, 1973, 106 pp.
203. Kleinrock, L., "Analytic and Simulation Methods in
Computer Network Design," AFIPS Conference Proceedings,
1970 Spring Joint Computer Conference, pp. 569-579,
CCA6-21 34.
204. Kohn, C. E., "The Evaluation of a Large Computer System,"
Infor., voL 9 (2), 140 (1971), CCA6-19358.
205. Lloyd, G. R. and R. E. Merwin, "Evaluation of Performance
of Parallel Processors in a Real-Time Environment," AFIPS
Conference Proceedings, 1973 National Computer Conference, pp. 101-108.
206. Lucas, L. W., "Improving Computer Performance-A Case
Study," Bull. Oper. Res. Soc. Am., vol. 21 (suppl. 2), B199
(1973), CCA9-5 364.
207. Luderer, G. W. R., "On Memory Usage Under Microprogramming," Computer, vol. 5 (5), 31-34 (1972).
208. Pohl, H., "The Optimisation of EDP Systems," Z.
Datenverarb., vol. 10 (5), 404 (1972), German, CCA7-23760.
209. Prowse, P., "Experience with Optimizing Computer Systems," Software Engineering: Infotech International Com-
puter State of tse-,Art Rejx.rt No. 11, 1971, pp.
1972, CCA8-6634.`
NOvembet 1975
30$33,
210. Schmidt, J. W. and R. E. Taylor, "System Optimization
Through Simulation," Simulation, vol. 18 (2), 41 (1972),
CCA7-1285 1.
211. Schutzer, D. M. and F. J. Ricci, "Optimizing a Communication Systems Performance Through the Use of Adaptive
Control," Conf Rec., 1973 National Telecommun. Confi, vol.
1, pap. 2A, 8 pp.
212. Sherwood, J. W., Jr., L. G. Piety, and A. C. Constable,
"Computer Performance Analysis and Optimization," 3rd
International Conference on Computer Management, 1972,
pp. 199-206, CCA7-16 163.
213. Speyer, J. L., J. Deyst, and D. H. Jacobsen, "Optimization of
Stochastic Linear Systems with Additive Measurement and
Process Noise Using Exponential Performance Criteria," IEEE
Transactions on Automatic Control, AC-19 (4), p. 358
(1974).
214. Sutcliffe, J., "Performance Measurement and Optimisation of
Real-Time Systems," Datafair 73. I., 1973, pp. 109-114,
CCA8-14849.
215. Takaya, K., "On Estimation of Performance Criterion to be
Optimized by a Given System Performance," Bull. Res. Inst.
Appl. Elec., vol. 23 (1), 30 (1971), CCA7-2601.
Performance Evaluation: Case Studies
Data Base Design/Tuning
216. Collmeyer, A. J. and J. E. Shemer, "Analysis of Retrieval
Performance for Selected File Organization Techniques,"
AFIPS Conference Proceedings, 1970 Fall Joint Computer
Conference, pp. 201-210.
217. Ghosh, S. P., "Structures of Data Bases and Performance
Problems," Comput. Sci and Stat., Proc., 7th Annual Symp.
on the Interface, 1973, pp. 12-15.
218. Grafton, W. P., "Tuning IMS for Better Performance,"
Proceedings of SHARE XL, vol. 2, 1973, pp. 1047-1088.
219. Petefish, W. M., "IMS Data Base Tuning," Proceedings of
SHARE XL, vol. 2, 1973, pp. 1034-1037.
220. Roach, V., "An Automated Technique for Designing Optimal
Performance IMS Data Bases," BACMF, (2), 16 (1974).
221. Shemer, J. E. and A. J. Collmeyer, "Database Sharing: a
Study of Interference, Roadblock, and Deadlock," Proceedings, 1972 ACM/SIGFIDET Workshop, pp. 147-164.
222. Zipperer, W. C., M. K. Park, and J. L. Carmon, "CA
Integrated Subject File 2. Evaluation of Alternative Data Base
Organizations," J. Chem. Doc., vol. 14 (1), 15 (1974).
Application Development
223. Childs, P. B., "Project Development and Evaluation Model,"
WestElectr. Eng., vol. 18 (2), 36 (1974).
224. Hudson, W. D., "A Modern Metropolis Looks Ahead," ASCE
Transp. Eng. J., vol. 100 (4), 801 (1974).
225. Knight, J. R., "Case Study: Airlines Reservations Systems,"
Proc. IEEE, vol. 60 (11), 1423 (1972).
226. Waite, W. M., "Sampling Monitor for Applications Programs,"
Software-Pract. Exper., voL 3 (1), 75 (1973).
Software Design
227. Anderson, C. J., "Proprietary Software: Profitability through
Evaluation," 1970 WESCON Technical Papers, vol. 14,
Western Electronic Show and Convention, 4 pp., CCA6-4991.
228. Bard, Y., "Experimental Evaluation of System Performance,"
IBM Syst. J., vol. 12 (3), 302 (1973).
229. Bemer, R. W., "A Software Engineer's Workshop: Tools and
Techniques," Software Engineering: Infotech International
Computer State of the Art Report No. 11, 1971, pp.
27 3-286, 1972, CCA8-6553.
230. Benedict, G. G., "An Enciphering Module for Multics,"
Report MAC-TM50, MIT, Cambridge, Mass., 1974, 69 pp.
6g
231. Camp, J. W. and R. L. Sullivan, "Use of Simulation in
Real-Time Program Development," Proc., 6th Annual Simul.
Symp., 1973, pp. 127-136.
232. Carey, L. J., "Software Quality Assurance-a State of the Art
Report," 1970 WESCON Technical Papers, Western Electronic Show and Convention, vol. 16, 1972, 21/1 7 pp.,
CCA8-6562.
233. Coleman, H., "Coupler Test Program CPLl for Use with a HP
(Hewlett-Packard) Automatic Network Analyzer," Report
AD-764046, Naval Research Lab., Washington, D. C., 1973,
17 pp.
234. Duncan, A. H., "Reflections from Practical Experience,"
Conference on the Planning and Control of Larger
Programming Projects, 1970, p. 16, CCA6-755 3.
235. Ellison, G. and J. Egloff, "Survey of National Airspace
System, En Route Related Support and Data Reduction and
Analysis Programs," Report AD-779495/1, National Aviation
Facilities Experimental Center, Atlantic City, N. J., 1974,
240 pp.
236. Graham, R. M., G. J. Clancy, Jr., and D. B. DeVaney,
"Software Design and Evaluation System," CACM, vol. 16
(2), 110 (1973).
237. Kolence, K. W., "A Software View of Measurement Tools,"
Datamation, vol. 17 (1), 32 (1971), CCA6-10160.
238. Levy, J., "Minicomputer Software Evaluation," Minicomputer Evaluation and Selection, 1973, pp. 61-71, 1974,
CCA9- 19603.
239. Littlewood, B. and J. L. Verrall, "A Bayesian Reliability
Growth Model for Computer Software," Proc., 1973 IEEE
Symposium on Computer Software Reliability, pp. 70-77,
CCA8-176 14.
240. McClelland, W. A. and A. L. Klosterman, "Nastran for
Dynamic Analysis of Vehicle Systems," Proc., Int. Conf on
Veh. Struct. Mech., 1974, pp. 95-107.
241. Nahouraii, E., "Direct Access Device Simulation," Proc.,
1973 Summer Computer Simulation Conf, pp. 172-176.
242. Prowse, P. H., "Software Engineering," Conference on the
Planning and Control of Larger Programming Projects, 1970,
p. 12, CCA6-7412.
243. Ramamoorthy, C. V., R. E. Meeker, Jr. and J. Turner,
"Design and Construction of an Automated Software
Evaluation System," Proc., 1973 IEEE Symposium on
Computer Software Reliability, 1973, pp. 28-37,
CCA8-16877.
244. Reitwiesner, G. W., "On Computer Performance Measurement
Programming: Measuring Indexing Adroitness by Isolating
Complex Primes," Report NBS-TN-572, NBS, Washington,
D. C., 1971, 25 pp., CCA8-3894.
245. Russell, L. J., "The Software/Middleware Hierarchy,"
Conference on the Planning and Control of Larger
Programming Projects, 1970, p. 13, CCA6-74 13.
246. Samet, P. A., -"Measuring the Efficiency of Software,"
Comptut. Bull., voL 13 (10), 351 (1969), CCA5-4292.
247.
, "Measuring the Efficiency, of Software," Presented
at the Datafair 1969, Manchester, England, August 1969,
CCA5-11 156.
248.
, "Software Efficiency," Software Engineering:
Infotech International Computer State of the Art Report No.
11, 1971, pp. 517-529, 1972, CCA8-6561.
249. Scott, T., "Role of Software in Industry," Control Instrum.,
vol. 5 (6), 44 (1973).
250. Stanley, W. I., "Measurement of System Operational
Statistics," IBM Syst. J., vol. 8 (4), 299 (1969), CCA5-4304.
251. Stillman, R. B., "A Survey of Techniques for Increasing
Software Reliability," Proceedings of the 1973 Summer
Computer Simulation Conference, Pt. II, pp. 1130-1133,
CCA8-23777.
9
252. Weinberg, G. M. and E. L. Schulman, "Goals and Performance
in Computer Programming," Hum. Factors, vol. 16 (1), 70
(1974), CCA9-24212.
253. Winder, R. 0., "A Data Base for Computer Performance
Evaluation," Computer, voL 6 (3), 25 (1973), CCA8-16872.
254. Wood, D. C., "Test and Evaluation Criteria for Network
Software," Proc., 1974 Symposium on Computer Networks:
Trends & Applications, IEEE Computer Society, pp. 44-46.
70
255. Yamamoto, M., M. Hattori, M. Yano, K. Hakozaki, K.
Kagiyama, and K. Fujino, "A Microprogrammed Computer
Design and Evaluation System," NEC Res. & Dev., (28), 47
(1973), CCA8-17437.
256.
, "A Microprogrammed Computer Design and
Evaluation System," 1st USA-Japan Computer Conference
Proceedings (AFIPS 1972), pp. 139-144, CCA8-17438.
Operating Systems
257. Belady, L. A. and R. F. Tsao, "Memory Allocation and
Program Behavior Under Multiprogramming," Comput. Sci.
and Stat., Proc., 7th Annual Symp. on the Interface, 1973,
pp. 72-78.
258. Cotten, L. W. and A. M. Abd-Alla, "Processing Times for
Segmented Jobs with I/O Compute Overlap," J. Assoc.
Comput. Mach., vol. 21(1), 18 (1974).
259. Dubner, H. and J. Abate, "TICKETRON. A Successfully
Operating System Without an Operating System," AFIPS
Conference Proceedings, Spring Joint Computer Conference,
1970, pp. 143-155.
260. Freeman, D. N., "Performance Measurement and Tuning for
System/360," Hardware/Software/Firmware Tradeoffs: 5th
Annual International IEEE Computer Society Conference,
1971, pp. 21-22, CCA7-9634.
261. Friedman, H. P. and G. Waldbaum, "Evaluating Computer
System Changes under Uncontrolled Workload Conditions: A
Case Study," Comput. Sci. and Stat., Proc., 7th Annual
Symp. on the Interface, 1973, pp. 65-71.
262. Katzan, J., Jr., "Operating Systems Architecture," AFIPS
Conference Proceedings, Spring Joint Computer Conference,
1970, pp. 190-218.
263. Kernighan, B. W. and P. A. Hamilton, "Synthetically
Generated Performance Test Loads for Operating Systems,"
Proc., 1st Annual SIGME Symp. on Meas. and Eval., 1973,
pp. 121-126.
264. Ketchledge, B. A., "Benchmark Evaluation of Operating
System Software: Experiments on IBM's VS/2 System,"
Proceedings of the 8th Meeting of Computer Performance
Evaluation Users Group on Computer Performance Evaluation, 1973, pp. 45-48, 1974, CCA10-2790.
265. Lloyd, G. R. and R. E. Merwin, "Evaluation of Performance
of Parallel Processors in a Real-Time Environment," AFIPS
Conference Proceedings, 1973 National Computer Conferencie, vol. 42, pp. 101-108, CCA8-16884.
266. Lynch, H. W. and J. B. Page, "The OS/VS2 Release 2 System
Resources Manager," IBM Syst. J., vol. 13 (4), 274 (1974).
267. Lynch, W. C., "Operating System Performance," Commun.
ACM, vol. 15 (7), 579 (1972), CCA7-21618.
268. McFadden,/ T. F. and J. C. Strauss, "Quantitative Evaluation
of File Management Performance Improvements," AFIPS
Conference Proceedings, 1973 National Computer Conference.
269. Ramamoorthy, C. V., "Performance Measurement of
Software and Hardware Components," In: Giant Computers,
Infotech State of the Art Report No. 2, Maidenhead, Berks,
England, pp. 463-478 (1971), CCA6-16710.
270. Rees, M. J. and W. G. Clements, "Some Performance
Monitoring Techniques for Multi-Access Operating Systems,"
Datafair 73. II., pp. 370-377, CCA8-14936.
271. Rogers, J. C., "System Availability-An Operating System
Viewpoint," Hardware/Software/Firmware Tradeoffs: 5th
Annual International IEEE Computer Society Conference,
pp. 31-32, CCA7-9635.
272. Schneck, P. B., "Design Principles of a High Performance
Operating System," Datafair 73, II, pp. 342-347, CCA814931.
Virtual Systems
273. Anderson, H. A., Jr., G. L. Galati, and M. Reiser,
"Classification of the Interactive Workload for a Virtual
Memory Computer System," Comput. Sci and Stat., 7th
Annu. Symp. on the Interface, Proc., 1973, pp. 30-40.
COMPUTER
274. Arora, S. R. and S. K. Kachhal, "Optimization of Design
Parameters in a Virtual Memory System," Comput. Sci and
Stat., Proc., 7th Annual Symp. on the Interface, 1973, pp.
138-141.
275. Bard, Y., "Prediction of System Paging Rates," Comput. Sci
and Stat. Proc., 7th Annual Symp. on the Interface, 1973, pp.
138-141.
276. Buzen, J. P., P. P. Chen, and R P. Goldberg, "Virtual
Machine Techniques for Improving System Reliability,"
Proc., 1973 IEEE Symposium on Computer Software
Reliability, pp. 12-17, CCA8-16927.
277. Hobayashi H., "Some Recent Progress in Analytic Studies of
System Performance," Proceedings, 1st USA-Japan Computer
Conference (AFIPS 1972), pp. 130-138, CCA8-17608.
278. MacMillan, W. S., "Is Virtual Storage Virtual Saving?"
Software World, voL 3, pp. 6-8, (1972).
279. Morrison, J. E., "User Program Performance in Virtual
Storage Systems," IBM Syst. J., voL 12 (3), 216 (1973).
Installation Planning
280. Anon., "Installing a Computer-One Company's Approach,"
Data Processing, vol. 11 (5), 468 (1969), CCA5-960.
281. Gray, A. S., D. H. Mee, and D. B. Soothil, "Specification,
Purchase and Installation of a Computer Control System,"
Proc. Inst Radio & ElectrorL Eng. Aust., vol. 33 (5), 174
(1972), CCA7-18872.
282. Haklits, I., "Installation Problems of Electronic DataCentres," Inf: Elektron, voL 7 (1), 55 (1972), Hungarian,
CCA7-18871.
283. Kirton, D. J., "First Steps in Computing. V. Evaluating the
Manufacturers' Proposals," Mechanical Accounting Comput.
Management, voL 4 (8), 40 (1969), CCA5-967.
284. Leggio, A., "Criteria for an Efficient Use of Computer
Equipment-Evaluation of Computer Efficiency," Papers of
the IBIICC 1st World Conference on Informatics in
Government, 1972, pp. 459-471, CCA8-12904.
285. Ringer, J., "Control of a Commercial Computer Installation.
VII. Financial Management," Mechanical Accounting Comput. Management, voL 4 (8), 24 (1969), CCA5-966.
286. Watson, R., "Computer Performance Analysis: Applications
of Accounting Data," Report NASA-CR-12 1436, Rand Corp.,
Santa Monica, Calif., 1971, 70 pp., CCA7-140 15.
Peripheral Equipment
287. Buzen, J. P., "Optimal Balancing of I/O Requests to Sector
Scheduled Drums," Comput. Sci and Stat., Proc., 7th Annual
Symp. on the Interface, 1973, pp. 130-137.
288. Diethelm, M. A., "Method of Evaluating Mass Storage Effects
on System Performance," AFIPS Conference Proceedings,
1973 National Computer Conference, pp. 69-74.
289. Fuller, S. M., "Performance on an I/O Channel with Multiple
Paging Drums," SIGME Symp. on Meas and Eval., lstAnnu.,
Proc., 1973, pp. 13-21.
290. Grubb, D. S., "Data Communications System Throughput
Performance Using High Speed Terminals on the Dial
Telephone Network," Report COM-73-50571, National
Bureau of Standards, Washington, D. C., 1973, 41 pp.
291. James, D. L., "A Remote Terminal Emulator for Loading and
Performance Measurement of Online Systems," Proceedings
of SHARE XXXVIII, voL 2, 1972, pp. 990-1005.
292. Lum, V. Y., "General Performance Analysis of Key-toAddress Transformation Methods Using an Abstract File
Concept," CACM, voL 16 (10), 603-612 (1973).
293. Lum, V. Y., P. S. T. Yuen, and M. Dodd, "Key-to-Address
Transform Techniques: a Fundamental Performance Study on
Large Existing Formatted Files," CACM, vol. 14 (4), 228-239
(1971).
294. Madnick, S. E., "Analysis of Modern File Systems," Datafair
1969, 5 pp., CCA5-11155.
295. Nahouraii, E., "Direct-Access Device Simulation," IBM Syst.
J., vol. 13 (1), 19 (1974).
296. Nuspl, S. J. and M. D. Johnson, "TThe Effect of I/O
Characteristics on the Performance of a Parallel Processor,"
Hardware/Software/Firmware Tradeoffs: 5thAnnualInterna-
November 1975
tional IEEE Computer Society Conference, pp. 127-128,
CCA7-96 16.
297. Smith, A. J., "Performance Analysis of Multiple Channel
Controllers," SIGME Symp. on Meas. and Eval., 1st Annu.,
Proc., 1973, pp. 37-46.
Human Factors
298. Balke, K. G., "Person-Centered Measurement," Comput. Sci
and Stat., Proc., 7th Annual Symp. on the Interface, 1973,
pp. 86-91.
299. Boies, S. J., "User Behavior on an Interactive Computer
System," IBM Syst. J., voL 13 (1), 2 (1974).
300. Grignetti, M. C. and D. C. Miller, "Information Processing
Models of Human-Computer Interaction," Report AD732232, Bolt Beranek & Newman, Inc., Cambridge, Mass.,
1971, 26 pp.
301. Harder, D. C., "A Catalog of Bottlenecks," Computers and
People, vol. 11 (1974).
302. Jutila, S. T. and G. Baram, "A User-Oriented Evaluation of a
Time-Shared Computer System," IEEE Trans. Syst., Man &
Cyberm., SMC-1 (4), 344 (1971), CCA6-21526.
303. Lockett, J. A. and A. R. White, "Controlled Tests for
Performance Evaluation," Report AD/A-001 994/3SL, Rand
Corp., Santa Monica, Calif., 1973, 12 pp.
304. Nathan, I., "Case Study: A Redesign Program that Doubled
Product Reliability at No Increase in Cost," ASME Paper No.
73-DE-33 for Meet., 1973, 7 pp.
305. Shinners, S. M., "Modeling of Human Operator Performance
Utilizing Time Series Analysis," IEEE Trans. Syst., Man &
Cybern., SMC-4 (5), 446 (1974), CCA9-21035.
306. Toivanen, M. L., B. S. Gurman, and E. Biser, "The Use of a
Hybrid Computer to Evaluate Mar-Machine Performance of
Complex Vehicle Control Systems," Proc., 15th Conf on
Design of Experiments in Army Research Development and
Testing, ARO-D Rep. 7-02,1970, pp. 607-652.
307. Weigel, J., "Measuring Data Center Performance," Infosystems, voL 21 (12), 36 (1974).
308. White, D. N., "Clinical Evaluation of the Automatic Midline
Computer," Proceedings of the 24th Annual Conference on
Engineering in Medicine and Biology, 1972, p. 63,
CCA7-14849.
Cost-Benefit Analysis
309. Cushing, B. E. and D. H. Dial, "Cost-Performance Tradeoffs
in Real-Time Systems Design," Manage. Advis., vol. 10 (6), 29
(1973), CCA9-8028.
310. Erikson, W. J., "Comparative Economics of Computer
Systems," Bull Op. Resg Soc. Am, voL 20 (suppl. 1), B99
(1972), CCA7-13835.
311. Johnston, A. S., "System Design and Selection," Minicomputer Evaluation and Selection, 1973, pp. 73-83, 1974,
CCA9-19604.
312. Leibert, A., "Price/Performance Evaluation of 360 and 370
Systems," Software World, voL 4 (8), 2 (1973), CCA9-5176.
313. Mohr, M. and R. M. Green, "Computer Control: The
Analogue or Digital Question," Digital Control of Large
Industrial Systems, 1968, 18 pp., CCA5-1239.
314. Ollivier, R T., "Selection Strategies for Minicomputers,"
1971 WESCON Technical Papers, Western Electronic Show
and Convention, 1971, 1/5 3 pp.' CCA7-1240.
315. Rosenman, B. B., "A Method for Estimating Inventory-Related Savings of a New ADP System," Bull Oper. Res.
Soc Am., voL 21 (suppL 2), B172 (1973), CCA9-5632.
316. Stimler, S., "A Methodology for Evaluating Real Time
System Performance," In: Real Time: Infotech International
Computer State of the Art Report, Infotech, Maidenhead,
Berks, England, pp. 487-496 (1971), CCA6-16730.
317. Stimler, S., "How to Assess System Performance and Control
Costs," Canadian Datasyst., vol. 6 (6), 42 (1974),
CCA9-24222.
318. Streeter, D. N., "Cost-Benefit Evaluation of ,Scientific
Computing Services," IBM Syst. J., voL 11 (3), 219 (1972),
CCA8-4273.
71
Timesharing Systems
319. Bard, Y., "Performance Criteria and Measurement for a
Time-Sharing System," IBM Syst. J., vol. 10 (3), 193 (1971),
CCA7-6368.
320. Blatny, J., S. R Clark, and T. A. Rouke, "On the
Optimization of Performance of Time-Sharing Systems by
Simulation," CACM, vol. 15 (6), 411 (1972).
321. Crochow, J. M., "Utility Functions for Time-Sharing System
Performance Evaluation," Computer, voL 5 (5), 16 (1972),
CCA8-1509.
322. Crochow, J. M., "On User Supplied Evaluations of
Time-Shared Computer Systems," IEEE Trans. Syst., Man &
Cybern., SMC-3 (2), 204 (1973), CCA8-66 12.
323. Doherty, W. J., "TSS (Time Sharing System) Performance
Measurement," Proceedings of SHARE XXXVIII, vol. 1,
1972, pp. 235-247.
324. Kawai, H., M. D. Abrams, and T. N. Pyke, Jr., "Performance
Measurement of Remote Access Computer Systems," Bull
Electrotech. Lab., voL 34 (10), 1 (1970), CCA6-11978.
325. Lachlan, Reed A. and T. E. Kleffman, "Time Sharing: The
Parameters of Its Validation," Progress of Cybernetics:
Proceedings of Ist Internat. Congress of Cybernetics, 1969,
pp. 823-831, 1970, CCA6-5802.
326. McGeachie, J. S., "Reliability of the Dartmouth Time Sharing
System," Proc., 1973 IEEE Symposium on Computer
Software Reliability, pp. 117-123, CCA8-16928.
327. Muglia, V. O., "Aerospace, Education, Electronics and
Manufacturing Industries Evaluation of Computer TimeSharing Service with an Overview of the Timesharing
Industry," 1970 WESCON Technical Papers, vol. 14, Western
Electronic Show and Convention, 33 pp., CCA6-4994.
328. Nielsen, N. R., "An Analysis of Some Time-Sharing
Techniques," CACM, vol. 14 (2), 79 (1971), CCA6-10270.
329. Sencer, M. A. and C. L. Sheng, "Analysis of Multiprogrammed Time-Sharing Computer Systems," AFIPS
Conference Proceedings, 1973 National Computer Conference, pp. 87-91.
330. Shemer, J. E. and J. B. Robertson, "Instrumentation ef
Time-Shared Systems," Computer, voL 5 (4), 39-48 (1972).
331. Wehry, A. H., "Engineering Evaluation of Timesharing," 1970
WESCON Technical Papers, voL 14, Western Electronic Show
and Convention, 6 pp., CCA6-5 80 1.
332. Zaharias, J. L., "Military Time-Sharing Evaluation as
Performed by a Navy Laboratory," 1970 WESCON Technical
Papers, voL 14, Western Electronic Show and Convention, 5
pp., CCA6-5 816.
System Comparison Results/Benchmarks
Large Systems
333. Anon., "Synthetic Programs Library-Concepts and Facilities,
User's Guide," Report AD-785 357/5, Federal Cobol Compiler
Testing Service, Washington, D. C., 1974, 52 pp.
334. Baird, R., "APET-A Versatile Tool for Estimating Computer
Application Performance," Software Pract. & Exper., vol. 3
(4), 385 (1973), CCA9-8033.
335. Boksenbaum, M., "Results of Benchmark Comparison of the
Performance of IBM 360/85 and 370/165," Proceedings of
SHARE XXXVII, voL 1, 1971, pp. 31-36.
336. Boydstun, J., "Evaluating the Performance of Large
Systems," Data Process. Mag. Data Dyn., vol. 13 (9), 57
(1971), CCA7-11554.
337. Dexter, A. S., "Modelling and Benchmarking a Time-Shared
Environment," Canadian Computer Conference Session 1972,
3143/19 pp., CCA7-21441.
338. Duncan, A. H., "Benchmark Testing," in: Handbook of
Computer Management,
R B.
Yearsley,
G.
M. R. Graham
(Eds.), Gower Press, Epping, Essex, England, pp. 71-78
(1973), CCA9-5 186.
339. Korn, G. A., J. McLeod, and J. Wait, "DARE/PHYSBE,"
Simulation, vol. 15 (5), 229 (1970), CCA6-10521.
72
340. Kral, J. J., "IMS Performance Improvement Through System
Loading," Proceedings of SHARE XL, vol. 2, 1973, pp.
1002-1018.
341. Liebert, A., "IBM's Ranges Compared-the 360 Versus the
370," Comput. Manage., voL 8 (10), 26 (1973), CCA9-10920.
342. Littrell, R. F., "Economies of Scale in the IBM 360 and 370,"
Datamation, voL 20 (3), 83 (1974), CCA9-1 3461.
343. Shirley, S., "Evaluating Benchmark Tests," Data Syst., voL 31
(1969), CCA5-958.
344. Stone, S., "Access Method Selection for Performance,"
Proceedings of SHARE XL, vol. 2, 1973, pp. 1026-1032.
345. Swoyer, V. H. and M. F. Armstrong, "Analyzing the
Operation of a Large-Scale Computer System," Bull. Op. Res.
Soc. Am., voL 20 (suppl. 1), B85 (1972), CCA7-13834.
346. Tietze, R., "Analytical Considerations in the Selection of an
Electronic Data Processing System," ADL-Nachr., vol. 18
(80), 28 (1973), German, CCA8-21957.
347. Wierzbixi, A. P., "Coordination and Sensitivity Analysis of a
Large Scale System with Performance Interaction," Abstracts
of the IFAC 5th World Congress, 1972, p. 121, CCA7-20684.
Medium and Small Systems
348. Herke, P., "The OEM Viewpoint in the Selection of
Minicomputers," Minicomputer Evaluation and Selection,
1973, pp. 93-98, 1974, CCA9-19606.
349. Krings, B. J., "Alternative Systems for Rapid-Transit
Propulsion and Electrical Braking," Westinghouse Eng., voL
33 (2), 34 (1973).
350. Mensh, M., "Evaluating Minicomputer Software," Automation, vol. 19 (7), 54 (1972), CCA7-23757.
351. O'Brien, W. J., "Hydraulic and Flight Control System for
Space Shuttle Orbiter," SAE Prepr. No. 720838 for Meet.,
Oct. 2-5, 1972, 15 pp.
352. Solomon, S. L., "Simulation of the Small Commercial
Computer Environment: An Equipment Selection Tool,"
Proc., 6th Annual Simlul. Symp., 1973, pp. 70-85.
353. Turtle, D., "Minicomputer Hardware Evaluation," Minicomputer Evaluation and Selection, 1973, pp. 53-60, 1974,
CCA9-19602.
Reliability, Availability and Serviceability
Reliability Modeling
354. Arnold, T. F., "Concept of Coverage and Its Effect on the
Reliability Model of a Repairable System," IEEE Trans.
Comput., C-22 (3), 251 (1973).
355. Balachandran, V., "Non-Parametric vs. Exponential Reliability in Simulating Systems Effectiveness," 10th Annual
Reliability and Maintainability Conference 1971, pp. 205-216,
CCA7-10749.
356. Bauman, M. F., "A Comparative Analysis of Reliability
Growth Models," Report AD-768119/0, Army Material
Command, Intern. Training Center, Texarkana, Tex., 1973,
60 pp.
357. Branson, M. H. and B. Shah, "Reliability Analysis of Systems
Comprised of Units with Arbitrary Repair-Time Distributions," IEEE Trans. Rel., R20 (4), 217 (1971), CCA7-2184.
358. Brennan, J. F., "The Self-Repairing Computer," IBMNachr.,
vol. 20 (199), 7 (1970), German, CCA5-20632.
359. Brennan, R. D., "Continuous System Simulation for Quality
Control Studies," Transactions of the 24th Annual Technical
Conference of the American Society for Quality Control,
1970, pp. 441-448, CCA6-2397.
360. Boe, C., T. Heimly, and T. C. Mathiesen, "A Reliability Model
Using Markov Chains for Utility Evaluation of Computer
Systems Onboard Ships," 1973 Winter Simulation Conference, pp. 829-43, CCA8-18616.
COMPUTER
361. Boe, C., T. Heimly, and T. C. Mathiesen, "A Reliability Model
Using Markov Chains for Utility Evaluation of Computer
Systems Onboard Ships," Norw. Marit. Res., vol. 1 (1), 27
(1973), CCA8-19565.
362. Bouricius, W. G., W. C. Carter, D. C. Jessep, P. R. Schneider,
and A. B. Wadia, "Reliability Modelling for Fault-Tolerant
Computers," IEEE Trans. Computers, C-20 (11), 1306
(1971), CCA7-1938.
363. Bricker, J. L., "A Unified Method for Analyzing Mission
Reliability for Fault Tolerant Computer Systems," IEEE
Trans. Reliab., R-22 (2), 72 (1973), CCA8-12878.
364. Burgess, L. H., "System Reliability," Hosp. Eng., voL 28, 3
(1974), CCA10-242.
365. Chow, D. K., "Reliability of Some Redundant Systems with
Repair," IEEE Trans. Reliab., R-22 (4), 223 (1973).
366. DeMercado, J. B., "Reliability Prediction Studies of Complex
Systems Having Many Failed States," IEEE Trans Rel., R-20
(4), 223 (1971), CCA7-2185.
367. Doyon, L. R., "Applying 'Sampled-Signal' Methods in R&M
Models," Proceedings of the 1974 Annual Reliability and
Maintainability Conference, pp. 123-129, CCA9-14824.
368. Endrenyi, J. 0. and R. Billinton, "Reliability Evaluation of
Power Transmission Networks-Models and Methods," Int.
Conf. on Large High- Voltage Electr. System., 25th Sess., BulL
No. 1, 1974, 12 pp.
369. Frey, H. H., "Safety Evaluation of Mass Transit Systems by
Reliability, Analysis," IEEE Trans. Reliab., R-23 (3), 161
(1974).
370. Gambrill, L. M., "Computers Help Design Reliable Telephone
Systems," Microelectron Rel., voL 12 (6), 505 (1973).
371. Ghita, A., "Reliability of Components with Discontinuous
Operation," Stud. Cercetari Energetica Electrotechnica, voL
20 (2), 479 (1970), Rumanian, CCA5-18699.
372. Gulyaev, V. A., "On the Evaluation of Reliability of a
Computer with a Check Control," Avtom. & VychisL Tekh.,
vol. 2, 84 (1971), Russian, CCA6-19349.
373. Jones, H. C., "Reliability Modeling," Proceedings of the 1972
Annual Reliability and Maintainability Symposium, pp.
24-29, CCA7-10739.
374. Knauer, E., "On the Distribution of Random Lifetimes for
the Reliability Theoretical Model of a System with Repairable
Elements," Elektronische Inform Vera B. Kybernetik, vol. 5
(2), 91 (1969), German, CCA6-2936.
375. Kumar, S., "A System Reliability with Pay-offs," IEEE Trans.
ReL, R-21 (2), 117 (1972), CCA7-15014.
376. Laurant, A. G., "Models for Life Testing and Reliability
Data," Bull. Oper. Res. Soc. Amer., vol. 16 (suppl. 2), B239
(1968), CCA5-6809.
377. Littlewood, B. and J. L. Verall, "Bayesian Reliability Model
with a Stochastically Monotone Failure Rate," IEEE Trans.
Reliab., R-23 (2), 108 (1974).
378. Mann, N. R. and F. E. Grubbs, "Approximately Optimum
Confidence Bounds for System Reliability Based on
Component Test Data," Report AD-7729 18/9, Ballistic
Research Labs, Aberdeen Proving Ground, Md., 1973, 37 pp.
379. Mathur, F. P., "Reliability Modeling and Architecture of
Ultra-reliable Fault-tolerant Digital Computers," Thesis, Univ.
California, Los Angeles, 1970, 383 pp., Order No. 71-662,
CCA6-17538.
380. Mathur, F. P., "On Reliability Modelling and Analysis of
Ultra-reliable Fault-tolerant Digital Systems," IEEE Trans.
Comput., C-20 (11), 1376 (1971), CCA7-1940.
381. Meyer, J. F., "A General Model for the Study of Fault
Tolerance and Diagnosis," Proceedings of the 6th Hawaii
International Conference on Systems Sciences, 1973, pp.
163-165, CCA8-10948.
382. Peters, O., "Systems Analysis Methods with Reference to
Reliability Assurance," Nachrichtentech. Z. (NTZ), vol. 24
(1), 25 (1971), German, CCA6-9577.
383.
Racicot, R., "Reliability
Data
Analysis Model" Report
AD-765481/7, Watervliet ArsenaL N. Y., 1973, 91 pp.
384. Regulinski, T. L., "Systems Reliability Modeling," Transactions of the 26th Annual Quality Control Conference,
1970, pp. 127-138, CCA6-22685.
November 1975
385. Rennels, D. A. and A. Avizienis, "RMS: A Reliability
Modeling System for Self-Repairing Computers," Dig. of Pap.,
3rd IEEE Int. Symp. on Fault-Tolerant Comsput., 1973, pp.
131-135.
386. Sharma, J., "Design of an Industrial Distribution System for
Reliability," Int. J. Electr. Eng. Educ., vol. 11 (3), 197
(1974).
387. Shaw, L., M. Shooman, and R. Schatz, "Time-Dependent
Stress-Strength Models for Non-electrical and Electrical
Systems," Report AD-758396, Polytechnic Inst. of Brooklyn,
Dept. of Electrical Engineering and Electrophysics, N. Y.,
1973, 36 pp.
388. Singh, C. and R. Billinton, "Reliability Modelling in Systems
with Non-exponential Down Time Distributions," IEEE
Trans. Power Appar. Syst., PAS-92 (2), 790 (1973).
389. Spragins, J. D., "Reliability Models for Computer Communication Systems," Confi Rec., 7th Annual Asilomar Conf.
on Circuits, Syst. and Comput., 1974, pp. 302-307.
390. Surana, S. L. and A. Brameller,
Power-System Generation," Proc.
(5), 348 (1974), CCA9-14819.
391. Wood, D. R., E. J. Muehl, and
Process Plant Reliability," Chema
(1974).
"Short-Term Reliability of
Inst. Electr. Eng., voL 121
A. E. Lyon, "Determining
Eng. Prog., vol. 70 (10), 62
392. Yang, W. T. and C. C. Lin, "Reliability Model for Dependent
Failures in Parallel Redundant Systems," IEEE Trans. Rel.,
R-23 (4), 286 (1974).
Techniques
System Failure Rate Analysis
393. Alam, M. and V. V. S. Sarma, "Optimum Maintenance Policy
for an Equipment Subject to Deterioration and Random
Failure," IEEE Trans. Syst., Man & Cybern., SMC-4 (2), 172
(1974), CCA9-105 14.
394. Bailey, W. O., "The Processor Figure of Merit," Honeywell
Comput. J., voL 5 (4), 201 (1971), CCA7-18838.
395. Baldonado, 0. C. and J. W. Pierson, "FORTRAN vs. GPSS in
Reliability Simulation," Proceedings of the 1973 Annual
Reliability and Maintainability Symposium, pp. 550-3,
CCA8-15297.
396. Dorrough, D. C., "A Theoretical Analysis of System Quality,"
IEEE Trans. KeL, R-20 (3), 169 (1971), CCA6-22672.
397. Dvoracek, P., "Failure Modes, Effects and Criticality Analysis
(FMECA) of Category III Instrument Landing System,"
Report AD-741555, Texas Instruments, Inc., Austin, 1972,
199 pp.
398. Gopalan, M. N., "Reliability Analysis of a System with
Dependent Units," Microelectron. & Reliab., voL 12 (6), 547
(1973), CCA9-148 14.
399. Hoover, S. V., R. J. Murphy, W. B. Nowak, and R. W. Sexton,
"Selected Reliability Studies for the Nerva Program," Report
N74-31949/2SL; Northeastern Univ., Boston, Mass., 1974, 75
pp400. Kelly, A., "The Control of Industrial Maintenance. I.," Plant
Eng., voL 18 (1), 21 (1974), CCA9-10524.
401. Longbottom, R., "Analysis of Computer System Reliability
and Maintainability," Radio & Electron. Eng., voL 42 (12),
537 (1972), CCA8-6577.
402. McNichols, R. J. and G. H. Messer, Jr., "A Cost-based
Availability Allocation Algorithm," IEEE Trans. Rel, R-20
(3), 178 (1971), CCA6-22673.
403. Menicou, G. and L. Van Os, "Comprehensive Computer
Programs for Solving Complex Reliability Problems," Electr.
Commun., voL 48 (3), 251 (1973).
404. Mine, H. and S. Osaki "On Failure-time Distributions for
Systems of Dissimilar Units," IEEE Trans Rel., R-18 (4), 165
(1969), CCA5-8663.
405. Misra, K. B., "An Algorithm.for the Reliability Evaluation of
Redundant Networks," IEEE Trans. Rel., vol. 19 (4), 146
(1970), CCA6-12458.
73
406. Mitichkin, Y. N., "Determination of Computer Availability
Function," Cybern., voL 9 (3), 478 (1972), CCA7-17269.
407. Moses, 'F., "Reliability of Structural Systems," ASCE J.
Struct. Div., vol. 100 (9), 1813 (1974).
408. Neander, J., "Reliability Analysis of Complex Systems with
Sequences of Failures," Angew. Inform., (1), 43 (1971),
Germnan, CCA6-8276.
409. Pac, J., "Some Problems of Planning and Evaluation of
Testing the Reliability of Computers," Automatizace, vol. 17
(3), 68 (1974), Czech, CCA9-17442.
410. Pau, L. F., "Application of Patfern Recognition to the
Diagnosis of Equipment Failures," Pattern Recogn, voL 6
(1), 3 (1974).
411. Raabe, P. H., "Constant Failure Rate of Redundant
Repairable Hardware," ASME Pap. No. 73-WA/NE-1 for
Meet., Nov. 11-15, 1973, 6 pp.
412. Sunjata, M. M., "Sensitivity Analysis of a Reliability
Estimation Procedure for a Component Whose Failure
Density is a Mixture of Exponential Failure Densities,"
Report AD-787369/8ST, Naval Postgraduate School, Monterey, Calif., 1974, 88 pp.
413. Wilkov, R. S., "Analysis and Design of Reliable Computer
Networks," IEEE Trans. Commun, COM-20 (3),660 (1972),
CCA7-17390.
414. Zafiropulo, P., "Performance Evaluation of Reliability
Improvement Techniques for Single-Loop Communciations
Systems," IEEE Trans. Commun., COM-22 (6), 742 (1974).
System Failure Rate Prediction
415. Boicourt, G. P., "Prediction of Failures in C.T.R. Systems,"
Symp. on Eng. Probl. of Fusion Res., 5th, Proc., 1973, pp.
308-313, 1974.
416. DeMercardo, J. B., "Reliability Prediction. Studies of
Degradation-Prone Systems," Proceedings of the 1972 Annual
Reliability and Maintainability Symposium, pp. 200-204,
CCA7-10742.
417. Erickson, R. F. and D. H. Hammond, "A Description of
Expected Failure Rates of Newly Acquired Components Prior
to Steady State," Report AD-775697/6 (Thesis), Air Force
Inst of Tech., Wright-Patterson AFB Ohio School of Systems
and Logistics, 1974, 141 pp.
418. Flynn, M. J. and S. A. Szygenda, "A Perspective on Computer
Reliability," Proceedings of the 1972 Annual Reliability and
Maintainability Symposium, pp. 166-173, CCA7-12410.
419. Glinski G. S., J. B. DeMercado, and P. M. Thompson, "A
Difffusion Method for Reliability Prediction," IEEE Trans.
Reliability, R-18 (4), 149 (1969), CCA5-8661.
420. James, L. E., T. S. Sheffield, and K. M. Plein, "Study of
Reliability Prediction Techniques for Conceptual Phases of
Development," Report AD/A-001 919/OSL, Hughes Aircraft
Co., Systems Effectiveness Dept., Fullerton, Calif., Rome Air
Development Center, Grfffiss AFB, N.-Y., 1974, 208 pp.
421. Lambert, B. K., A. Q. Walvekar, and J. P. Hirmas, "Optimal
Redundancy and AvailabiLity Allocation in Multistage
Systems," IEEE Trans. ReL., R-20 (3), 182 (1971),
CCA6-22674.
422. Parr, V. B., "An Efficient Minimal Cut Set Generator
(MCUT)," Digest Record, 1969 Joint Conference on
Mathematical and Computer Aids to Design, Anaheim, Calif.,
October 1%9, CCA5-6737.
423. Singh, N., T. Lwin, and L. A. Cunningham, "On Prediction
Problems in Reliability," Microelectron Rel., voL 12 (5), 451
(1973).
424. Spann, A. C., "A Synergistic Reliability and Maintainability
Prediction Package," Proceedings of the 1973 Annual
Reliability and Maintainability Symposium, pp. 542-549,
CCA8-15296.
425. Spann, A. C., "Painless Predictions (of Electronic Equipment
Reliability). I.," Qual. Prog., voL 6 (9), 28 (1973),
EEA77-17813.
426. Spann, A. C., "Painless Predictions (of Electronic Equipment
Reliability). II.," Qual Prog., voL 6 (10), 17 (1973),
EEA77-17814.
74
427. Steckman, G. L., "Automated Ship Maintenance System,"
Nav. Eng. J., voL 85 (2), 23 (1973).
428. Taylor, T., M. LeVarn, and J. O'Connell, "Performance
Monitoring and Fault Diagnostics of Command and Control
Systems," RCA Eng., voL 19 (5), 56 (1974), CCA1O-2932.
429. Wilson, M. A., "Experience with Bayesian Reliability
Measurement of Large Systems," IEEE Trans. Reliab., R-21
(3), 181 (1972).
Results
430. Beyer, W., "Reliability of Systems with Indication of Defects
and Revival," Robotron. Tech. Commun., voL 15 (10), 19
(1973), CCA9-21077.
431. Curtice, W. L., 111, "Commercial Quality Video Recorders forAirborne Military Applications," SPIE Semin Proc., vol. 36,
1973, pp. 43-47.
432. Filene, R. J. and W. M. Daly, "Reliability Impact of Mission
Abort Strategies on Redundant Flight Computer Systems,"
IEEE Trans. Comput., C-23 (7), 739 (1974).
433. Garney, D. J., R. W. Arnold, B. C6hen, and A. M. D'Amore,
"TCS Call Processing Software," Electr. Commun., voL 48
(4), 397 (1973).
434. Hansler, E., G. K. Mcauliffe, and R.,S. Wilkov, "Optimizing
the Reliability in Centralized Computer Networks," IEEE
Trans. Commun., COM-20 (3), 640 (1972), CCA7-17272.
435. Hippert, R. O., L. R. Palounek, J. Provetero, and R. 0.
Skatrud, "Reliability, Availability, and Serviceability Design
Considerations for the Supermarket and Retail Store
Systems," IBM Syst. J., voL 14 (1), 81 (1975).
436. Keeley, J. F., "System/370-Reliability from a System
Viewpoint," Hardware/Software/Firmware Tradeoffs: 5th
Annual International IEEE Computer Society Conference,
pp. 33-34, CCA7-9486.
437. Kobylar, A. W. and H. A. Malec, "System Effectiveness
Trade-off in a Space-Time-Space Network for a Digital
Exchange," G.T.E. Autom. Electr. Tech. J., voL 13 (7), 348
(1973).
438. Lwin, T. M., "Bayes Estimation in Life Testing and
Reliability: A Multivariate Case," Microelectron. Rel., voL 13
(4), 267 (1974).
439. Segawa, S. and A. Tanaka, "Reliability of a Control
Computer System," J. Soc. Instrum. & Control Eng, voL 12
(11), 897 (1973), Japanese, CCA9-10936.
440. Vaccari, G. C. and A. Cicu, "Study for the 'Availability'
Evaluation of a System for a Customer," Proceedings of the
11th Automation and Instrumentation Conference, 1970, pp.
1094-108, CCA6-16736.-
Arthur H. Agajanian is on the library staff at
IBM's East FishkiUl Facility, System Products
Division, where he is engaged in literature
search and publication of bibliographies in
| topics of current interest in microelectronics
and computers. With IBM since 1957, Agajanian has also worked on the development of
new ferrites for computer applications at
Poughkeepsie and on the characterization of
glasses, glass ceramics, and semiconductors at
the Components Division, East FishkilL He received the BSc and
MSc degrees in mathematics from the University of London in 1952
and 1954, respectively, and the MS degree in physics from MIT in
1957.