September 2009 Version Resources for Test and Evaluation and Systems Engineering Professionals This document lists free or low cost resources (test and evaluation, systems engineering, and acquisition resources), which are on-line or easily available. This document lists the following types of resources: publications, websites, classes & training, software resources, M&S resources, T&E resources, and systems engineering resources. (The first line in each section is highlighted.) Note: As a policy, the Defense Acquisition University (who developed this list of resources) does NOT endorse any of the resources listed in this document. Item / Name Publications Description / Information Web-Link The Acquisition Life cycle management information on: Process Wall Chart phases, milestones, technical reviews; JCIDS process and documents; contracting, logistics, sustainment; Planning, Programming, Budgeting & Execution Process (PPBE); systems engineering and T&E processes and events. National Defense Electronic version is free. Magazine (NDIA Journal) https://acc.dau.mil/IFC/ Defense Acquisition Review Journal Used to be called Acquisition Review Quarterly www.dau.mil/pubs/arqtoc.asp Defense AT&L Magazine Used to be called Program Manager Magazine http://www.dau.mil/pubs/damtoc.asp Government Executive Magazine www.govexec.com Government Computer News Magazine www.gcn.com CrossTalk The Journal of Defense Software Engineering www.stsc.hill.af.mil www.nationaldefensemagazine.org Chips Magazine Sponsored by Navy Chief Information Officer, and SPAWAR IT Umbrella Program Office www.chips.navy.mil or chips@spawar.navy.mil Defense News Magazine is NOT free. Website has some free information www.defensenews.com Army AL&T Magazine http://asc.army.mil/altmag/ Aviation Week Magazine is NOT free. Website has some free information, articles, photos, links to other websites www.aviationnow.com The ITEA Journal of T&E Magazine is NOT free (magazine comes with ITEA membership). Website has some free information, such as magazine articles & abstracts. www.ITEA.org Early Bird DoD related news articles http://ebird.osd.mil DoD News Services News releases, contract announcements, photos, news archives. http://www.defenselink.mil/news/dodnew s.aspx Links to Army, Navy, Air Force, Marine Corps, war on terrorism, and other federal government newsletters. e-Letter http://aimpoints.hq.af.mil/index.cfm U.S. Air Force AIM POINTS Handbooks, Guides, Publications Defense Acquisition Guidebook T&E Management Guide http://www.dau.mil/pubs/Online_Pubs.asp Systems Engineering Fundamentals Glossary Defense Acq. Acronyms/Terms Intro. to Defense Acq. Management Program Managers Tool Kit Performance Based Logistics Guide Scheduling Guide for PMs Joint Program Management Handbook Knowledge Mgmt. and IT Guide COTS & Commercial Item Guide COSSI Handbook Guide to Incentive Strategies Guide to Performance Based Services Acq Interactive on-line version of the Defense https://akss.dau.mil/dag/ Acquisition Guidebook Handbooks, Guides, Publications Acquisition Logistics Guide Contracting for the Rest of Us DoD Guide for Achieving RM&A DoD Guide, Uniquely Identifying Items EVM Implementation Guide Engineering Data Management Guide Guide for Mgmt. of Multinational Pgms. Risk Mgmt. Guide for DoD Acq. Mngr’s Guide to Tech. Transition GAO Reports (Acquisition Related) DoD Acquisition Mgmt. Metrics DoD IPPD Handbook Technology Readiness Assessment Guide Numerous other handbooks and guides. http://akss.dau.mil/guidebookalphabeticLi nks.do Operational Test Director’s Guide COMOPTEVFOR publication www.cotf.navy.mil/otdguide.htm e-Handbook of Statistical Methods Handbook of Engineering Statistics http://www.itl.nist.gov/div898/handbook/ Guide to Specification Writing, for U.S. Government Engineers NAVAIR publication http://nawctsd.navair.navy.mil/resources/ library/acqguide/spec.htm A Modular Open Systems Approach to Acquisition Guidebook www.acq.osd.mil/osjtf/pmguide.html Defense Procurement and Acquisition Policy Contracting guidebooks, policy and information www.acq.osd.mil/dpap/ DoD Corrosion Prevention and Control Planning Guidebook Guidebook and other corrosion prevention information http://www.corrdefense.org/default.aspx DoD Guide to Integrated Product and Process Development Guidebook http://sepo.spawar.navy.mil/DoD_Guide_ To_IPPD.pdf https://akss.dau.mil/ Click on Guidebooks and Handbooks (on the left column menu) Top Eleven Ways to Manage Technical Risk (NAVSO P-3686) Risk Guide. Also information on diminishing manufacturing sources and material shortages. http://www.gidep.org/mod_perl/framepag e.cgi?pg=/data/dmsms/library/dmslibrary. htm Joint Testing Handbook Handbook http://www.jte.osd.mil/ click on JT&E handbook (menu on left side) On-line Videos and Training Materials View the following videos: - DoD’s Business Transformation - The PPBE Process - The JCIDS Process - DoDI 5000.02 - Corrosion Prevention - Item Unique Identification - Radio Frequency Identification - Weapon Systems Acq. Reform Act http://www.dau.mil/Performance_support/ RDT.asp Virtual Library Pentagon Virtual Library http://www.whs.mil/library/ Virtual Library Naval Postgraduate School Virtual Library “Ask a Librarian” http://www.nps.edu/Library/index.html Virtual Library Library of Congress Virtual Library http://catalog.loc.gov Virtual Library Air Force Institution of Technology Virtual Library http://library.afit.edu/ Military Library Network Search electronic catalogs of more than 30 http://merln.ndu.edu military libraries. Also has defense related U.S. Policy statements on selected key topics. Library locator Library locator. Also has access to 500,000 eBook titles http://netlibrary.net Project Gutenberg (30,000+ public domain books) Public domain books http://www.gutenberg.org/ Websites AT&L Knowledge Sharing System (AKSS) Policy documents Glossaries & acronyms Education / professional development info News & publications Rapid Deployment Training Ask-A-Professor http://akss.dau.mil Acquisition Community Connection (ACC) ACC – A website where the AT&L workforce meets to share knowledge. https://acc.dau.mil/ Join ACC and access important acquisition resources, connect with professionals in your field, share information and knowledge (including posting documents to the ACC website) ACC has Communities of Practice / Special Interest Areas for Systems Engineering, Test & Evaluation, and numerous others Web-links www.dau.mil/library/websites.asp Acquisition Central Documents, instructions, website links www.acqnet.gov Navy Research, Development & Acquisition Website Website http://acquisition.navy.mil/ Army Acquisition Support Center Website http://asc.army.mil Defense Science Board (DSB) Download or order DSB reports www.acq.osd.mil/dsb/ Defense Acquisition Policy Center Documents, Defense Acquisition Process tutorial, DoD 5000 and JCIDS briefings, Policy Documents https://akss.dau.mil/dapc/index.aspx AcqWeb USD(AT&L) Website Documents, OSD information & website links, search engine www.acq.osd.mil Acquisition website links FARSite Contracting docs, regs, forms, tools http://farsite.hill.af.mil Army Knowledge Online, Defense Knowledge Online Army-wide and DoD-wide information, Email, search engine, locator https://www.us.army.mil Navy Knowledge Online Navy-wide information https://wwwa.nko.navy.mil Air Force Portal Air Force-wide information www.my.af.mil Marine Corps Home Page Marine Corps-wide information www.marines.mil Air Force Center of Excellence for Knowledge Mgmt. Documents (search engine), samples & examples, POC’s, web links, tools, communities of practice (including T&E) https://afkm.wpafb.af.mil Air Force Documentation Documents, publications http://afpubs.hq.af.mil Army Documentation Documents, publications www.apd.army.mil Navy Documentation Documents, publications http://doni.daps.dla.mil/default.aspx Defense Technical Information Center DoD documents, reports, publications (search, order docs) www.dtic.mil www.dtic.mil/whs/directives DoD Locator & Search Engine Documents, websites, news releases www.defenselink.mil Government Search Engines, links to government Information Search information Engines http://www.usa.gov/ http://www.gpoaccess.gov/advancedsearc h.html Worldwide Military Installations Info. Website http://www.militaryinstallations.dod.mil/is mart/MHF-MI/ DoD Military Installations DoD installation and duty station information www.militaryonesource.com www.militaryHOMEFRONT.dod.mil/mo ving Air War College DoD / military Lessons Learned http://www.au.af.mil/au/awc/awcgate/awc -lesn.htm Air Force Knowledge Management Best Practices / Lessons Learned https://afkm.wpafb.af.mil Center for Army Lessons Learned Best Practices / Lessons Learned http://call.army.mil/ Acquisition Best Practices Clearinghouse Best Practices (especially in areas of systems engineering and software acquisition.) Information on how to implement & implementation results. Numerous Lessons Learned web-links https://bpch.dau.mil/pages/default.aspx Naval Postgraduate School Library http://www.nps.edu/library/research/subje ctguides/index.html click on lessons learned (which is listed under military resources) Marine Corps Lessons Learned Best Practices / Lessons Learned https://www.mccll.usmc.mil/ DoD Quality Management Office Numerous links and on-line resources http://quality.disa.mil/ National Defense Industrial Association (NDIA) Documents, web-links, info on meetings & events, links to NDIA committees & local chapters. www.ndia.org Defense Acquisition University students may obtain free NDIA membership through the DAU website Free NDIA membership for DAU students: www.DAU.mil click on link in lower left corner North American Technology & Industrial Base Organization Website www.dtic.mil/natibo Office of Technology Transition Website http://www.acq.osd.mil/ott/ Research & Engineering Portal Information on federally funded R&D projects (budget, planning, project summaries, news highlights). https://rdte.osd.mil Search engine, links to other websites. Independent Research & Development Website www.dtic.mil/ird Defense Advanced Research Projects Agency (DARPA) Website www.darpa.mil Human Systems Integration (HSI) and Advanced Distributed Learning Websites, web-links www.manprint.army.mil http://www.dtic.mil/dticasd/org.html http://spider.adlnet.gov/ Reliability Analysis Center Publications, tools, training http://www.theriac.org/ Open Systems Joint Task Force Tools & guides, documents, lessons learned www.acq.osd.mil/osjtf/ Best Manufacturing Practices Industry / Government / Academia cooperative effort www.bmpcoe.org/ Defense Environmental Network Website https://www.denix.osd.mil DoD Chief Information Officer Website Home page has Section 508 information. Archives contains: Net-Centric docs & checklist, Global Information Grid guidance & docs, C3I documents. www.defenselink.mil/nii/ DIACAP Website DIACAP Knowledge Service Website https://diacap.iaportal.navy.mil/ DoD Architecture Framework (DODAF) version 2.0 Download DODAF docs (Volume I, Volume II, Volume III). https://dars1.army.mil/IER/index.jsp https://www.us.army.mil/suite/page/4547 07 Joint Capability Technology Demonstrations Website http://www.acq.osd.mil/jctd/ Comparative Testing Office Administers the Defense Acquisition Challenge (DAC) Program, and Foreign Comparative Testing (FCT) Program http://www.acq.osd.mil/cto/ Test Information Free testing information (particularly software testing) and articles from leading consultants www.stickyminds.com Survivability / Vulnerability Information Analysis Center Website www.bahdayton.com/surviac/ Director, OT&E T&E website www.dote.osd.mil Deputy Director, DT&E T&E website www.acq.osd.mil/sse/ Joint Interoperability Test Command (JITC) T&E / interoperability website http://jitc.fhu.disa.mil Test Resource management Center (TRMC) T&E website http://www.acq.osd.mil/trmc/ Range Commanders’ Council T&E website https://wsmrc2vger.wsmr.army.mil/rcc/sel mid.htm International T&E Association (ITEA) T&E website http://www.itea.org/ Navy OT&E Force (OPTEVFOR) T&E website www.cotf.navy.mil Army T&E Command (ATEC) T&E website www.atec.army.mil Army T&E Office T&E website https://www.us.army.mil/suite/page/25 www.hqda.army.mil/teo Marine Corps OT&E Activity (MCOTEA) T&E website http://www.quantico.usmc.mil/activities/? section=MCOTEA Air Force OT&E T&E website Center (AFOTEC) www.afotec.af.mil Joint Service T&E information T&E website http://www.jte.osd.mil/ Hundreds of Statistics Website Links Everything you ever wanted to know about statistics! (Also data analysis, evaluation, data collection & management, etc.) http://www.math.yorku.ca/SCS/StatReso urce.html www.resources4evaluators.info/ http://gsociology.icaap.org/methods http://onlinestatbook.com/ Statistics Websites (Statistics software & tools) Free statistical software & tools, statistical software websites http://gsociology.icaap.org/methods/soft. html http://gsociology.icaap.org/methods/stato ntheweb.html http://www.almc.army.mil/sed/KOOL/in dex.asp http://statpages.org/ Statistics Weblinks & Tools Free statistical software & tools, statistical software websites www.bettycjung.net Click on site index. Then scroll down to the statistics sections. ACQuipedia website An online encyclopedia of common defense acquisition topics. https://acquipedia.dau.mil/ DoDTechipedia website Contains information on who is performing what work in DoD research and development. https://www.dodtechipedia.mil/ Classes & Training Note: As a policy, the Defense Acquisition University (who developed this list of resources) does NOT endorse any non-government sources of education or training Defense Acquisition University (DAU) Courses Web based Classes: ACQ 101, PQM 101, http://www.dau.mil/ SAM 101, SYS 101, SYS 202, TST 102, https://learn.dau.mil/ many others. Resident Courses offered at numerous locations: TST 203, TST 302, SYS 203, SYS 302, many others. DAU Strategic Partnerships with Colleges and Universities College credit for DAU classes DAU credit for college classes http://www.dau.mil/aboutdau/partnerships.aspx DAU Continuous Learning Modules More than 200 continuous learning modules - Can browse or take for credit. http://clc.dau.mil/ Modules include: - System Safety in Systems Engineering - Technical Reviews - Assessment of Tech. Readiness Levels - Designing for Supportability - Contracting for the Rest of Us - IPT Management and Leadership - Information Assurance - Introduction to Interoperability - Reducing Total Ownership Costs - Risk Management - M&S for T&E - DTEPI Intro. to Probability & Statistics - Testing in a Joint Environment - Environmental Issues in T&E - Telemetry - Time-Space-Position Information DAU Catalog and iCatalog Chapter 3 – Course descriptions http://www.dau.mil/catalog/default.aspx http://icatalog.dau.mil/ Appendix B – Career Field Certification Requirements (Requirements for DAWIA Certification) Appendix C – Course equivalencies Appendix D – Continuing Education Units (CEUs) Appendix E – American Council on Education (ACE) recommended credits DAU Support Services Research, analysis, consulting, problem solving, targeted training www.dau.mil Click on “Performance Support” U.S. Navy Distance Learning Distance Learning Courses & Degree Programs https://www.navycollege.navy.mil/storefr ont.cfm U.S. Government E-Learning Courses International Engineering Consortium Distance Learning Courses www.golearn.gov Distance Learning Courses www.iec.org International Council on Systems Engineering (INCOSE) Distance Learning Courses www.incose.org/educationcareers/shortco urses.aspx Federal Acquisition Institute Distance Learning Courses http://www.fai.gov/ Note: Other colleges and universities (besides those listed) offer classes in systems engineering. The following universities offer on-line SE degrees or certificates. See the next eleven rows (listings) in this table. On-line M.S. Systems Architecture & Engineering http://www.usc.edu/dept/ise/ Oklahoma State University On-line M.S. Control Systems Engineering http://osu.okstate.edu/ University of Alabama in Huntsville (UAH) Masters Certificate, Systems Engineering (Also certificates in T&E, M&S, Rocket Propulsion, and Reliability & Missile Systems). Classroom or distance learning. www.coned.uah.edu Systems Engineering (SE) On-Line Degrees University of Southern California National Technical University (now part of Walden University) Arizona State University Some DAU classes transfer towards UAH certificates. On-line M.S. degrees in Systems Engineering, and Software Engineering (312) 263-0456 (866) 492-5336 On-line Master of Engineering, in the following areas: Modeling and Simulation, Systems Engineering, Software Engineering, Quality and Reliability Engineering, Technical Engineering Management, Industrial Engineering, Electrical Engineering On-line Graduate Certificate in Statistics 1-800-448-4035 http://www.waldenu.edu/c/Schools/Schoo ls_1373.htm http://cpd.asu.edu/online/ Southern Methodist University Naval Postgraduate School Air Force Institute of Technology MS, Systems Engineering (distance learning or classroom setting). Certificate programs. Some DAU course credits may transfer. DoD employees may receive reduced tuition. M.S. Systems Engineering http://engr.smu.edu/emis/sys/ www.nps.edu M.S. and Masters Certificate in Systems and Engineering Management On-line continuing education www.afit.edu On-Line Engineering Degrees Search engine www.classesusa.com Engineering degrees (some are on-line) Search engine www.allengineeringschools.com Systems Engineering Academic Programs World-wide listing http://www.incose.org/educationcareers/a cademicprogramdirectory.aspx T&E Certificates & Degrees Note: Other colleges and universities (besides those listed) offer classes in T&E. The following universities offer T&E related degrees or certificates. See the next seven rows (listings) in this table. Air Force Institute of Technology M.S. in Operations Research. Masters Certificate in Test and Evaluation. www.afit.edu University of Alabama in Huntsville T&E Certificate Systems Engineering Certificate Modeling & Simulation Certificate Classroom or distance learning www.coned.uah.edu University of Florida Graduate-level T&E Certificate http://www.gerc.eng.ufl.edu/ Florida Institute of Technology M.S., Operations Research www.fit.edu Georgia Tech T&E Certificate www.terec.gatech.edu 1-800-448-4035 National Test Pilot School Masters programs, flight testing www.ntps.com Naval Postgraduate School U.S. Army Logistics Management College Masters in Operations Analysis http://www.nps.edu/Academics/Schools/ GSOIS/Departments/OR/index.html Operations Research classes (also Army Acquisition, Environmental Science, and Logistics classes) www.almc.army.mil U.S. Air Force Test Pilot School Short courses www.edwards.af.mil/ click on U.S. Air Force Test Pilot School Information Navy COMOPTEVFOR Operational Test Director Course www.cotf.navy.mil AFOTEC T&E University Courses focus on OT&E training for AFOTEC personnel Training@afotec.af.mil (505) 846-6074 Army T&E Basic Course (TEBC) Course focuses on T&E training for Army personnel www.atec.army.mil/TEBC/tebc.htm 53rd Wing Design of Experiments & Statistics Classes The U.S. Air Force 53rd Wing offers a wide variety of Design of Experiments & Statistics classes (many classes offered at Eglin Air Force Base). https://wwwmil.53wg.eglin.af.mil/milweb /index.htm Click on training (on the black menu bar at the top) Access the website to sign up for an account, view the schedule, get course details, or register for a course. Software Programming and Web-Development More than 450 on-line classes www.thedacs.com/training/element_k.php Software Resources DoD Software Data & Analysis Center Software engineering data & information http://www.thedacs.com/ (numerous software related areas), Software Tech newsletter & E-newsletter, “Golden Practices” including those for software testing Software Security Assurance Download the July 31, 2007 State-of-theArt Report (SOAR). http://iac.dtic.mil/iatac/download/security. pdf Systems and Software Consortium, Inc. (formerly Software Productivity Consortium, SPC) Processes, methods, tools, support services. http://www.software.org/ Software Program Managers Network (SPMN) Lessons learned, best practices, guides to testing, configuration management. Originally sponsored by DoD, but now a commercial entity. http://www.spmn.com Army Software Metrics Office Information on metrics and Army software initiatives www.armysoftwaremetrics.org Practical Software & Systems Measurement Information based on best measurement practices (DoD, government, industry) and ISO Measurement Standard. www.psmsc.com Some assets only available to consortium members. Provides a basis for enterprise level management. Provides some free guidelines and handbooks. Software Engineering Measurement and Analysis (SEMA) Initiative SEMA is a technical initiative at the Software Engineering Institute (SEI), that provides guidance and expertise in the field of software measurement and analysis. http://www.sei.cmu.edu/sema/publications .html Software Engineering Institute (SEI) SEI is a DoD federally funded R&D center, sponsored by the OSD AT&L. http://www.sei.cmu.edu/ https://seir.sei.cmu.edu/seir/ Core purpose is to help others make measured improvements in their software engineering capabilities. Web-links are the SEI home page, and Software Engineering Repository of technical information. SEI Capability Maturity Model SEI was the original developer of the Software Capability Maturity Model (SWCMM), which has been supplanted by an integrated model called the CMMI. Web-links give CMMI and legacy CMM information. http://www.sei.cmu.edu/cmmi/ http://www.sei.cmu.edu/cmm/ Software Security Build Security in (BSI) website contains and has links to best practices, tools, guidelines, rules, principles, & other resources for software developers, architects, & security practitioners. Air Force Software Publishes CrossTalk, monthly magazine Technology of software management issues and Support Center current practice, including testing. (STSC) Web-links are the STSC home page, and “Guidelines for Successful Acquisition and Management of Software Intensive Systems” publications. https://buildsecurityin.uscert.gov/daisy/bsi/home.html http://www.stsc.hill.af.mil/ http://www.stsc.hill.af.mil/resources/tech _docs/ Army CECOM Software Engineering Center Web-links are the home page, and a useful http://www.sed.monmouth.army.mil/sit/in legacy checklist, Domain 6 which covers dex.htm T&E. http://www.sed.monmouth.army.mil/sit/sit start.htm Marine Corps Tactical Systems Support Activity Software support center http://www.mctssa.USMC.mil SPAWAR – Software Engineering & Process Office Process asset library covering all parts of the software development process. Software Management for Executives Guidebook. http://sepo.spawar.navy.mil Acquisition Community Connection (ACC) The ACC Systems Engineering and IT Communities-of-Practice, and the Software Acquisition Management Special Interest Area, contain many Software Related Resources https://acc.dau.mil/ Continuous Learning Center (CLC) short courses Distance learning short courses available for Information Assurance, Enterprise Integration, Interoperability, Naval Open Architecture, and the Net-Ready KPP http://clc.dau.mil/ Federal Chief Information Officers Council Website has best practices, guidebooks & other documents http://www.cio.gov For Enterprise Resource Planning (ERP) projects: DoD Enterprise Integration Toolkit http://www.eitoolkit.com/ National Vulnerability Database A comprehensive cyber security vulnerability database that contains and has links to numerous resources and information sources. http://www.us-cert.gov/nvd.html M&S references and resources, standards, and education http://www.msco.mil/ M&S Resources Modeling & Simulation Coordination Office (formerly Defense Modeling & Simulation Office) Links to service (& NATO) M&S activities M&S Resource Repositories Links to numerous M&S resources and repositories http://nmso.navy.mil/tab.cfm?tab=106 Air Force Agency for Modeling & Simulation Documents, links, lessons learned www.afams.af.mil U.S. Army Program Executive Office for Simulation, Training and Instrumentation M&S Support Center www.peostri.army.mil Threat Systems Office Automated Joint threat Systems Handbook (available on the SIPRNET) – lists threat simulators, facilities, targets, M&S, ranges, and foreign assets For additional information, contact the DOT&E Threat Systems Office: www.dote.osd.mil/ Joint Accreditation Support Activity VV&A resources, training, archives http://www.navair.navy.mil/nawcwd/jasa/ Navy M&S Office Articles, information, help desk https://nmso.navy.mil/ Air Force M&S Resource Repository M&S Resources https://afmsrr.afams.af.mil/ Army M&S Resource Repository M&S Resources https://www.msrr.army.mil/ Navy M&S Resource Repository M&S Resources http://nmso.navy.mil/ Verification, Validation, & Accreditation (VV&A) Recommended Practices Guide VV&A information, templates, reference documents, diagrams. http://vva.msco.mil/ http://dvdt.nmso.navy.mil/Help/MS_Inter view.aspx Annual DoD M&S Awards Outstanding Achievement in development or application of M&S within DoD. Discussion of VV&A activities (legacy, new, or federation M&S) from perspective of the User, Developer, M&S Program Manager, V&V Agent, and Accreditation Agent. http://www.msco.mil/awardsprogram.html www.trainingsystems.org/nomform.cfm DoD awards are sponsored by the M&S Coordination Office (formerly DMSO) Industry & Academia awards sponsored by National Training Systems Association T&E Resources Central Test and Evaluation Investment Program (CTEIP) CTEIP objectives include: - Fund & help solve shortfalls in T&E infrastructure - Achieve consistency, commonality & interoperability - Develop & exploit M&S to support T&E - Develop mobile instrumentation - Expand / maintain T&E technology base http://www.acq.osd.mil/trmc/jipp/cteip/fu nctions.htm Acquisition Community Connection (ACC) These ACC Special Interest Areas contain many T&E related resources: - Test & Evaluation - TRMC T&E Science & Technology - Operations Research/Systems Analysis https://acc.dau.mil/ DOT&E Publications Various T&E related reports, articles and/or presentations are available at the DOT&E website. www.dote.osd.mil/pubs.html Range Commanders Council Organization of DoD test, training and operational range commanders that: - Fosters cooperation & standardization - Seeks solutions to common needs - Establishes technical standards - Facilitates technical & equipment exchanges - Forms technical working groups for various functions https://wsmrc2vger.wsmr.army.mil/rcc/sel mid.htm Test & Evaluation / Science & Technology Program (TEST) Program Goals: To fund / exploit new technologies, and expedite their transition from the laboratory to the T&E community. https://acc.dau.mil Website is for the Acquisition Community Connection TEST Program special interest area. Note: The TEST Program is the responsibility of the Department of Defense Test Resource Management Center (DTRMC), which reports to USD (AT&L). DTRMC plans to put some TEST Program information on their (future) website. Test Resource Management Center Annual Report Information on the CTEIP Program, T&E Science & Technology Program, Test ranges & resources, and other TRMC programs and initiatives. www.acq.osd.mil/trmc/publications.htm Army OT Entrance Criteria Templates Appendix X of DA Pam 73-1 contains a set of 33 detailed templates, covering all aspects of T&E (Test Planning & Documentation, System Design & Performance, Test Assets & Support) https://www.us.army.mil/suite/page/25 Army T&E Publications Army TEMP approval status report “TEMP Preparation 101” T&E Refresher Course T&E WIPT “Smart Book” Army T&E Strategic Plan Army Guidelines: Use of M&S to support T&E Many other T&E reference documents https://www.us.army.mil/suite/page/25 Army Software Testing Standards DA PAM 73-1 “T&E in Support of Systems Acquisition”, Appendices Q & T https://www.us.army.mil/suite/page/25 NAVAIR T&E Training and Guides This NAVAIR website has: - T&E training on the role of T&E, and the T&E process - T&E definitions - T&E Guide for Project Engineers - TEMP guidance, format, and training http://nawctsd.navair.navy.mil/resources/li brary/acqguide/testing.htm Guidelines for Conducting OT&E of SoftwareIntensive System Increments Guidance for OT&E of software intensive systems http://sepo.nosc.mil/Guidelines_for_Cond ucting_OT&E.doc Defense Acquisition Guidebook Chapter 9 has T&E Resources & Information Section 9.3 lists DT&E resources & guidelines Section 9.4 lists OT&E resources & guidelines Section 9.5 lists LFT&E resources & guidelines Section 9.6 discusses T&E planning documentation (TES and TEMP) Section 9.8 lists T&E best practices Section 9.10 presents the TEMP recommended format https://acc.dau.mil/dag Joint T&E Methodology Capability Test Methodology Handbooks for Testing in a Joint (distributed) Environment. Also briefings & tutorials. https://www.jte.osd.mil/jtemctm/handboo ks/index.html - Systems Engineering Plan (SEP) Preparation Guide, and other related documents - Policy for Systems Engineering in DoD - Contracting for Systems Engineering - Designing & Assessing Supportability in DoD Weapon Systems - Technical review checklists - System of Systems Engineering Guides - Systems Engineering guides from various organizations http://www.acq.osd.mil/sse/ Systems Engineering Resources DoD Systems Engineering Guidance Click on policy and guidance. Then click on policy, for systems engineering policy memos and instructions – or click on guidance & tools, for other systems engineering documents Air Force Center for Systems Engineering Air Force Systems Engineering Info., SE guidance and resource docs, SE web-links http://www.afit.edu/cse/ Air Force Deskbook – Engineering Detailed engineering documents, for use by acquisition professionals https://afkm.wpafb.af.mil/ASPs/deskbook/ index2.asp?Filter=OOEN&Cat=EN&Type=WA SPAWAR Systems Navy systems engineering information: Engineering Links & library for systems engineering, Process Office software engineering, process improvement, project management http://sepo.spawar.navy.mil/ Links to INCOSE Systems Engineering Handbook, Industry SE standards, NASA guidebooks and standards NAVAIR Acquisition Guide Acquisition Roadmap has a graphical flowchart, with detailed descriptions & guidance. Policies, documents, links, search engine. http://nawctsd.navair.navy.mil/resources/li brary/acqguide/acqguide.htm Detailed information on contracts, configuration mgmt., funding, logistics, and numerous other topics. Navy Technical Reviews Info. & Guides Technical review checklists, entry & exit criteria, other information on technical reviews. http://nawctsd.navair.navy.mil/resources/li brary/acqguide/reviews.htm Navy Technical Reviews Handbooks & Checklists Detailed handbooks & checklists for each technical review http://www.navair.navy.mil/kms/41g/ Roll your mouse/curser over each review to access handbooks & checklists Defense Acquisition Guidebook Chapter 4 Systems Engineering (SE) Resources & Info. - Section 4.2 discusses the eight technical https://acc.dau.mil/dag processes & eight technical mgmt. processes - Section 4.3 discusses SE activities in the System Life Cycle - Section 4.4 discusses 21 SE design considerations - Section 4.5 discusses key SE tools & techniques - Section 4.6 discusses best practices, case studies, and lessons learned - Section 4.7 discusses SE resources International Council On Systems Engineering (INCOSE) Non-profit membership organization. Website has: - News & events - Publications & book reviews - Systems Engineering Primer - Technical resources & tools - Technical Measurement Guide - Systems Engineering job bank - Professional certification program - INSIGHT newsletter - Listing of SE short courses - Directory of SE Academic Programs - Ethics for Engineering Professionals www.incose.org DoD Architecture Framework (DoDAF) Integrated Architectures include: Operational Views (OV), Systems & Services Views (SV), Technical Standards Views (TV) https://dars1.army.mil/IER/index.jsp https://www.us.army.mil/suite/page/45470 7 Website links to DODAF documents (Volumes I, II, and III) Communities of Practice & Special Interest Areas, which are available on the Acquisition Community Connection (ACC) Systems Engineering Risk Management Data Management Program Management Earned Value Management Logistics Management Science & Technology Management Spectrum & E3 Compliance Environmental Safety & Occupational Health Reliability & Maintainability Test and Evaluation Unique Identification Production Quality & Manufacturing Information Technology Joint Rapid Acquisition https://acc.dau.mil Risk Management Information & Tools The Acquisition Community Connection has a wealth of risk management information & tools, including: risk management systems, databases, analysis tools, templates. https://acc.dau.mil, click on risk management The Reliability Toolkit Publications, documents, tools http://quanterion.com/ The ASSIST Database Download DoD Standards & Specifications, HAZMAT information, Data Item Descriptions (DIDs), adopted Non-Governmental Standards, links to industry & international specs & standards, DoD POCs http://assist.daps.dla.mil/ For example, can download: MIL-STD-810F, DoD Test Method Standard (environmental testing) MIL-STD-882D, System Safety MIL-STD-963B, Data Item Descriptions MIL-HDBK-245D, Statement of Work (SOW) Preparation MIL-HDBK-881A, Work Breakdown Structure MIL-HDBK-502, Acquisition Logistics MIL-HDBK-61A, Configuration Management MIL-STD-961E, Defense & Program Unique Specifications MIL-STD-1521B (canceled), Technical Reviews DoD Specifications & Standards Repository Specifications & standards http://dodssp.daps.dla.mil American National Standards Institute Specifications & standards www.ansi.org Institute for Electrical and Electronic Engineers Specifications & standards www.ieee.org Specifications & standards http://www.nssn.org/ Specifications & standards http://www.iso.org/iso/home.htm National Standards Systems Network International Organization for Standardization (ISO) Specifications & Standards Tools Turbo SpecRite (a tool to assist in http://acquisition.navy.mil/aosfiles/tools/s developing performance specs), and other pecright/sdg.htm specifications & standards tools The Joint Spectrum Center (JSC) The JSC website has: An electromagnetic spectrum chart, contact information, links to numerous other websites (DoD, Services, U.S. Government, International) http://www.disa.mil/jsc/index.html NAVSO P-6071, Best Practices – How to Avoid Surprises During the Transition from Development to Production Identifies potential bad consequences, and specific (proven) best practices to avoid or alleviate these consequences http://www.dau.mil/educdept/mm_dept_r esources/guidance/6071.pdf DoD 4245.7-M, Transition from Development to Production Provides assistance in: structuring technically sound programs, assessing program risks, identifying areas needing corrective action. www.dtic.mil/whs/directives/corres/pub1 .html http://www.dau.mil/library/ Note: DoD 4245.7 was expanded into 4 books (available from the Defense Acquisition University library): - Design to Reduce Technical Risk - Design’s Impact on Logistics - Moving a Design into Production - Testing to Verify Design and Manufacturing Readiness DoD IT Standards Registry (DISR) DISR contains lists of standards, which are applicable to all DoD systems that produce, use, or exchange information. (Links to the standards organizations are provided.) DISR was formerly called Joint Technical Architecture (JTA). DISRonline website replaces (includes) the former JTA website. DISRonline is the electronic version of DISR / JTA. DISRonline contains tools, questionnaires, user guides to create IT profiles https://disronline.disa.mil/ DoD Manufacturing Technology Program – Guides and Publications DoD Technology Readiness Assessment Deskbook Manager’s Guide to Technology Transition in an Evolutionary Acquisition Environment Technology Transition for Affordability: A Guide for S&T Program Managers Adopting Commercial Practices in DoD Defense Science & Technology Planning Documents. QDR & Transformation Planning Guidance. https://www.dodmantech.com