Release Notes CTEL Test Manager Sample Exam Version 1.0 CTFL Sample Exam Release Notes Version: 1.1 Date: 30/July/2011 Revision History Date 30/October/2011 For General Release Version 1.0 Description CTEL Test Manager Sample Exam ready for publishing on ISTQB website. EWG - ISTQB, 2011 Author Mette Bruhn-Pedersen Page 2 of 7 CTFL Sample Exam Release Notes Version: 1.1 Date: 30/July/2011 Table of Contents 1. 2. 3. 4. 5. Introduction 4 1.1 1.2 1.3 1.4 1.5 1.6 1.7 4 4 4 5 5 5 5 Purpose Scope Overview Usage (IMPORTANT) Responsible Issues Comments & Feedback Process Detailed Description of Release Contents 5 2.1 2.2 2.3 2.4 5 6 6 6 CTEL_Test_Manager_Sample_Exam_Paper_v2011_Release_Version.pdf CTEL TM Answer Sheet for Multiple Choice Practice Exam Paper.pdf CTEL TM Sample Exam Questions Chpt X Release.pdf Candidate X Essay Questions.pdf Developing process and review 6 3.1 3.2 6 7 General developing process Review process Planned Releases 7 4.1 4.2 7 7 Scope for Release 2 Scope for Release 3 Localization For General Release 7 EWG - ISTQB, 2011 Page 3 of 7 CTFL Sample Exam Release Notes Version: 1.1 Date: 30/July/2011 Release Notes 1. Introduction This document provides information about the release version of CTEL Test Manager Sample Exam (Sample Exam). 1.1 Purpose The purpose of the Release Notes is to describe the contents of the Sample Exam release, how to use it, and what the scope is for the next planned releases. The release notes also cover known problems and suggested workarounds. 1.2 Scope This document describes the CTEL Test Manager Sample Exam release version 1.0 based on CTEL Test Manager Syllabus v2011 which was officially approved for release on the General Assembly meeting in Shanghai on October 31st 2011. 1.3 Overview The CTEL Test Manager Sample Exam was created from beginning of July to mid-October 2011. The sample exam was created by a team of questions writers from the Examination Working Group (EWG) and the Expert Level Working Group (ELWG) Test Manager subgroup. The purpose of the Sample Exam is to give National and Regional Boards, training and exam providers, as well as potential test takers an impression of how a real exam could but not necessarily will look. Especially the essay question examples are expected to provide the biggest value. The Sample Exam is also meant as training material for coming markers of Expert essay questions as the release contains examples of answers. The Sample Exam has gone through several reviews, see section 3.2 Review process. The CTEL Test Manager Sample Exam release consists of a full set of multiple choice and essay questions that follows the ISTQB Question Writing Rules and Recommendations, but not necessarily the division of questions outlined in CTEL Test Manager Structure and Rules. The release consists of the following documents: CTEL_Test_Manager_Sample_Exam_Paper_v2011_Release_Version.pdf CTEL TM Answer Sheet for Multiple Choice Practice Exam Paper.pdf CTEL TM Sample Exam Questions Chpt 5 Release.pdf CTEL TM Sample Exam Questions Chpt 3 and 4 Release.pdf CTEL TM Sample Exam Questions Chpt 2 and 9 Release.pdf CTEL TM Sample Exam Questions Chpt 6 and 8 Release.pdf CTEL TM Sample Exam Questions Chpt 7 Release.pdf Candidate 1 Essay Questions.pdf Candidate 2 Essay Questions.pdf Candidate 3 01 Q10.pdf Candidate 3 02 Q10.pdf Candidate 3 03 Q15.pdf Candidate 3 04 Q15.pdf Candidate 3 05 Q16.pdf Candidate 3 06 Q16.pdf Candidate 3 07 Q16.pdf Candidate 3 08 Q25.pdf Candidate 3 09 Q25.pdf Candidate 3 10 Q25.pdf For General Release EWG - ISTQB, 2011 Page 4 of 7 CTFL Sample Exam Release Notes Version: 1.1 Date: 30/July/2011 1.4 Usage (IMPORTANT) The entire release is for INTERNAL use except for: CTEL_Test_Manager_Sample_Exam_Paper_v2011_Release_Version.pdf CTEL TM Answer Sheet for Multiple Choice Practice Exam Paper.pdf This means that National and Regional Boards are only allowed to put the actual sample exam paper on public web sites and in other public distributions. Everything else in the release is only for National and Regional Boards as well as Training and Exam providers who have signed an “Affiliate and non disclosure agreement with ISTQB” The reason is that the EWG has not prepared the other documents for external usage. 1.5 Responsible Mette Bruhn-Pedersen from DSTB is responsible for maintaining the CTEL Test Manager Sample Exam documents outlined in the Overview section above until GA in Wellington (March 2012). 1.6 Issues The sample test takers commented that it was hard to manage time because the essay questions are scattered throughout the examination paper. It was suggested to have all multiple choice questions together and all essay questions together. Although it is not wrong to mix the questions types the suggestion will be implemented in the next version. 1.7 Comments & Feedback Process All comments and feedback should be provided by the National and Regional Boards. Hence it is the responsibility of the National and Regional Boards to collect comments and feedback from the public and pass it on to the person responsible for the CTEL Test Manager Sample Exam in the Examination Working Group using the feedback form “Review Comments for CTEL Test Manager Sample Exam” spreadsheet and email it to Mette Bruhn-Pedersen: m.bruhn-pedersen@dstb.dk 2. Detailed Description of Release Contents This is the first official version of a CTEL Sample Exam. The following documents are described in further detail below: CTEL_Test_Manager_Sample_Exam_Paper_v2011_Release_Version.pdf CTEL TM Answer Sheet for Multiple Choice Practice Exam Paper.pdf CTEL TM Sample Exam Questions Chpt X Release.pdf Candidate X Essay Questions.pdf 2.1 CTEL_Test_Manager_Sample_Exam_Paper_v2011_Release_Version.pdf The document contains all the questions. The multiple choice and essay questions are listed in the order in which they were delivered by the question writers; see CTEL TM Sample Exam Questions Chpt X Release.pdf documents. As the sample test takers raised this as an issue the order will be changed in version 2. For General Release EWG - ISTQB, 2011 Page 5 of 7 CTFL Sample Exam Release Notes Version: 1.1 Date: 30/July/2011 2.2 CTEL TM Answer Sheet for Multiple Choice Practice Exam Paper.pdf The document contains the correct answers for all multiple choice questions and maps each question to its corresponding Learning Objective and K-Level. 2.3 CTEL TM Sample Exam Questions Chpt X Release.pdf The documents contain all questions as they were created by the question writers. The documents include justification for correct answers as well as the essay marking schemes. 2.4 Candidate X Essay Questions.pdf The documents contain the example answers to essay questions which could be used for practicing marking of essay questions. The Candidate 3 answers are hand-written. 3. Developing process and review 3.1 General developing process The development process is documented on the EWG intranet: http://istqb.org/display/EXAMINATION/CTEL+Test+Manager+Sample+Exam The following milestone plan was followed: Jul 31 Authors submit all essay and multiple choice questions for work group internal review Aug 11 Review comments from all authors are submitted and discussed Aug 21 Reworked questions are sent to EWG and ELWG for review Aug 24 Reworked questions are sent to the secretary to be included in the GA agenda and review comments from national boards can be submitted Sep 11 Review comments from EWG, ELWG and national boards are discussed Sep 18 Reworked questions are sent to EWG and ELWG for approval Sep 25 Approved questions are sent to the secretary to be included in the GA agenda Oct 11 Technical writer reviews all questions Oct 16 Final version is ready Note that the process agreed with the question writers did not include the sample test takers. That was added later on. For General Release EWG - ISTQB, 2011 Page 6 of 7 CTFL Sample Exam Release Notes Version: 1.1 Date: 30/July/2011 3.2 Review process - Internal review by the question writers. Each question writer has reviewed all questions. 4. - Focused review by 4 members of the EWG. - Review by 2 National Boards. - Feedback from sample test takers (feedback will be incorporated from version 2). - Review by Technical Editor. - Discussions of release version on EWG workshop in Shanghai on the 29 th of November 2011. Planned Releases There are already planned two new releases of the Sample Exam. The exact release dates are not settled but it is expected that Release 2 is completed before Christmas 2011 and that Release 3 is completed by mid-March 2012. 4.1 Scope for Release 2 Reorder questions to avoid switching between multiple choice and essay questions Add points and timings to help test takers manage examination time Other cosmetic issues 4.2 Scope for Release 3 Improve essay question marking schemes Examples of how to mark the sample essay questions 5. Localization All national and regional boards are allowed to translate the CTEL Test Manager Sample Exam. If changes are made it should be clearly stated in the beginning of the paper that it has been modified by the national or regional board. For General Release EWG - ISTQB, 2011 Page 7 of 7