TECHNOLOGY MARKER GUIDE NOTES 2015 You must read these Technology Marker Guide Notes before the panel meeting and take them with you when you attend. Use the Technology Marker Guide Notes as a reference before, during, and after marking. All panel members must follow these instructions. If you have ‘how to’ questions that relate to administration and not to specific assessment decisions, you should first refer to the Technology Marker Guide Notes, and then contact the Marker Helpline. The Technology Marker Guide Notes are organised to reflect the sequence of the marking process, which is indexed on page 2. FOR INTERNAL USE ONLY – NOT FOR DISTRIBUTION Contents BEFORE MARKING ....................................................................................................................... 4 1. Need help? ................................................................................................................................................ 4 2. Who is responsible for what? ................................................................................................................. 5 3. Marker calendar 2015 ............................................................................................................................... 6 4. Before marking checklist......................................................................................................................... 7 5. Updating contact details online .............................................................................................................. 7 Logging into your Marking Home page ...................................................................................................... 7 Updating your contact details ..................................................................................................................... 7 6. Pre-approval process for travel over 100 km ........................................................................................ 7 7. Marker’s Pack ........................................................................................................................................... 8 8. CourierPost’s materials ........................................................................................................................... 8 DURING MARKING ........................................................................................................................ 9 9. Delivery of reports .................................................................................................................................... 9 10. Barcode label on folders ......................................................................................................................... 9 11. Receipt of folders ................................................................................................................................... 10 If you receive a folder for a standard you are not marking ....................................................................... 10 If the folder is for your standard, but has another marker code on the barcode ...................................... 10 Folder not on control sheet, has your marker code, correct standard ..................................................... 10 Damaged folders or reports received in plastic bags ............................................................................... 11 12. Checklist before panel meeting ............................................................................................................ 11 13. Panel meeting ......................................................................................................................................... 11 Panel meeting aims .................................................................................................................................. 12 Panel leader provides ............................................................................................................................... 12 14. Must Do Marking Practices (MDMP) ..................................................................................................... 12 MDMP: Making marks on the report or folder .......................................................................................... 12 MDMP: Correcting errors.......................................................................................................................... 12 MDMP: Securely processing reports ........................................................................................................ 13 MDMP: NSN mismatch procedures ......................................................................................................... 13 MDMP: Empty folders ............................................................................................................................... 15 MDMP: Entering results – initial entry ...................................................................................................... 15 MDMP: Entering results – double entry.................................................................................................... 15 15. Understanding the assessment schedule ........................................................................................... 16 16. Marking using training reports ............................................................................................................. 16 17. Test marking ........................................................................................................................................... 16 18. Assessment decisions........................................................................................................................... 16 19. Marking timeline ..................................................................................................................................... 16 Technology Marker Guide Notes 2015 Page 2 of 30 20. Check marking ........................................................................................................................................ 16 Recording and couriering reports for check marking ............................................................................... 16 Receiving check marking feedback .......................................................................................................... 17 21. Irregular reports ..................................................................................................................................... 17 22. Re-marking .............................................................................................................................................. 18 23. Marking Home page ............................................................................................................................... 18 24. View your details .................................................................................................................................... 18 25. Marking Pages ........................................................................................................................................ 19 A Allocation Summary ............................................................................................................................. 19 B Search for Candidate/Sort Pages ........................................................................................................ 19 C Control Sheet Pages ............................................................................................................................ 19 D Supplementary Pages.......................................................................................................................... 19 E Additional Pages .................................................................................................................................. 20 26. Search for Candidate ............................................................................................................................. 20 Locate an entry ......................................................................................................................................... 20 Transfer a result entry line from another marker’s allocation to yourself ................................................. 20 Late changes to results ............................................................................................................................ 21 Completion of marking and final submission of results ............................................................................ 21 27. Reports requested by NZQA ................................................................................................................. 22 28. Result entry and report return issues .................................................................................................. 22 AFTER MARKING ........................................................................................................................ 23 29. Checklist after marking.......................................................................................................................... 23 30. Marker report .......................................................................................................................................... 23 31. Marking evaluation ................................................................................................................................. 23 32. Return of reports .................................................................................................................................... 23 33. Final pick up of reports.......................................................................................................................... 23 Courier tracking ........................................................................................................................................ 24 34. Remaining materials .............................................................................................................................. 24 35. Marker claims ......................................................................................................................................... 24 Completing your claim online ................................................................................................................... 24 Appendix D: Marking Timeline ..................................................................................................................... 26 Appendix E: Courier Tracking Sheet ........................................................................................................... 27 Appendix F: Check Marking Summary Form .............................................................................................. 28 Appendix G: Irregular Submission Marker’s Report .................................................................................. 29 Appendix H: Control Sheet ........................................................................................................................... 30 Technology Marker Guide Notes 2015 Page 3 of 30 BEFORE MARKING Need help? Call the Marker Helpline on 0800 697 296 (8 am–5 pm weekdays) Have a copy of the Technology Marker Guide Notes available as the operations officer will refer to them. If you have issues with entries, or WNSN processes, deliveries, or couriers: If you need more materials: Physical address Contact: Operations Officer Phone: (04) 4463 4238 Email: bianca.muollo@nzqa.govt.nz Contact: Logistics NZQA Phone: (04) 04 463 3003 125 The Terrace Email: paul.oconnor@nzqa.govt.nz Wellington 6011 ATTN: (NAME) Secondary Operations ATTN: (NAME) Secondary Operations NZQA Postal address: NZQA P O Box 160 WELLINGTON 6140 NZQA c/o Printlink courier address If you need help with delivery and pick up: NZQA c/o Printlink, 33-43 Jackson Street, Petone, Wellington 5012 Contact: CourierPost Phone: 0800 501 504 Email: Panel leader: Phone: Best time to contact: Email: Check marker: Phone: Best time to contact: Technology Marker Guide Notes 2015 Page 4 of 30 Who is responsible for what? National assessment facilitator (NAF) has overall responsibility for: all assessment and administration processes appointment and contracting of all markers. Markers have responsibility for: all aspects of marking as outlined in their contract for marking following all processes and procedures in these Technology Marker Guide Notes attending all panel meetings being available for marking until 24 December 2015 ensuring that all reports are marked according to the assessment schedule, Must Do Marking Practices, and any other instructions provided by the panel leader responding immediately to instructions and/or advice given by the panel leader or check marker regarding check marking and marking again if required undertaking and completing any re-marking as necessary ensuring that all reports are marked consistently and fairly entering results online daily ensuring that reports and result entries are free from marker errors and omissions maintaining the security and confidentiality of all candidate submissions, associated marking material, and all work in connection with the assessment meeting all deadlines writing and submitting a Marker’s Report to the panel leader by 18 December 2015. Senior marker has additional responsibility for: participating in the benchmarking meeting. Check marker has responsibility for: participating in the benchmarking meeting on-going check marking. Panel leader has responsibility for: all aspects of marking and assessment conducting the benchmarking process and the panel meetings liaising with the National Assessment Facilitator (NAF) the quality control of assessment through check marking, consistent application of the assessment schedule, and Must Do Marking Practices the quality control of assessment through monitoring the quality and progress of results entry writing the final assessment schedule and Panel Leader’s Report by 11 January 2016 any contractual requirements agreed to following 24 December 2015, should these be required. Operations officer (OPO) has responsibility for: supporting the NAF in the organisation and administration of marking processes. Technology Marker Guide Notes 2015 Page 5 of 30 Marker calendar 2015 BEFORE MARKING August Markers able to view and amend personal details on NZQA website. September Check address using www.courierpost.co.nz/tools/admin-checker and amend on NZQA website Read the Technology Marker Guide Notes. Watch the online movie October Final amendments of personal details on NZQA website: home and postal addresses, delivery address, pick up address, and contact details, including mobile phone number. Wednesday 14 October Final address changes must be made online by this date. To change an address after this date, notify the Marker Helpline. Wednesday 28 October Email Pre-approval Travel Request Form to the NAF. Friday 6 November Contact paul.oconnor@nzqa.govt.nz (or call 0800 692 463) if your Marker’s Pack has not arrived.. DURING MARKING Receive candidate folders, in orange boxes, by 16 November. Check off all folders received on your answer booklet control sheets. Return misdirected reports to NZQA C/- Printlink, 33 Jackson St, Petone, Wellington 5012 immediately. Use yellow, pre-addressed courier bags. November/December Attend panel meeting(s). Begin marking. Enter results daily online using the Marking Pages. Send check marking and act on feedback. Continue with marking. 7 December Last day candidate folders delivered to a school or workplace address. After this date, deliveries will be made to a home address. Monday 14 December Additional Pages, if required, will become visible online. Final Submission button will become visible online once all Marking Pages are completed. Sunday 20 December Final results submission for all examinations. AFTER MARKING 15, 16, 17, 18, 21, 22, 23 and 29 December Friday 18 December CourierPost collect orange boxes. No pick up on 19, 20 or 24 December. Book pickups by noon for pick-up by 5.30 pm on same day. Preferred final pick up date of boxes. Marker Report emailed to the panel leader (or earlier if requested). Marking Evaluation Form emailed to the NAF. January 2016 Friday 22 January 2016 Return all unused stationery and courier items to NZQA. Destroy all other examination related materials. Last day for submitting marker claims online. Technology Marker Guide Notes 2015 Page 6 of 30 Before marking checklist Have you done the following before marking? Tick Checked your online access? Watched the Marker Administration movie? Confirmed your delivery and pick up address online? Read these Technology Marker Guide Notes? Checked the receipt of marker materials from your Marker’s Pack? Checked the delivery of the reports? Returned any misdirected or mis-sorted folders to NZQA? Printed and read the standard and the assessment specifications? Downloaded and read the exemplars? Updating contact details online All markers must check and update their contact details on their NZQA Marking Home page by 14 October. Logging into your Marking Home page On the Home page of the NZQA website, click on Login in the top right hand corner. On the Login page, click on Login for NZQA contractors including markers, moderators, exam centre managers and enter your user name/ID and password. Updating your contact details Select Marking Home, then click on View your Details. Addresses must: be a physical address include a postcode be accurate by 14 October, after this date notify the Marker Helpline of any change of address. Address types: delivery: for all orange boxes until 7 December home: for Marker’s Pack, general correspondence, and delivery of candidate folders after 7 December pick up: for final pick up of marked folders. Check your address using courierpost.co.nz/tools/address-checker Pre-approval process for travel over 100 km Markers are paid for 100 km of travel to panel and other marking meetings as part of their marking incidentals fee. If your travel is likely to exceed 100 km and you require payment for the extra kilometres, you must request pre-approval from your NAF. Download and complete a Pre-approval Travel Request Form and email to your NAF by 28 October. Technology Marker Guide Notes 2015 Page 7 of 30 Marker’s Pack In late October you will receive a Marker’s Pack, containing: a cover letter adhesive tape for resealing report boxes envelopes and labels two small and two large Freepost envelopes for returning materials to NZQA (If you run out of NZQA Freepost envelopes address an ordinary envelope to: Freepost 3221,Secondary Operations, NZQA, P O Box 160, Wellington 6140.) ten pink courier bags for sending folders to and from the check marker or NZQA two yellow courier bags pre-addressed to NZQA c/o Printlink for misdirected folders two Saturday Delivery prepaid tickets for courier bags. If you have not received your pack by 6 November, contact Paul O’Connor at NZQA. CourierPost’s materials Used to: Orange Boxes Signature required Send you the bulk of your reports. Return reports at the end of marking. Used to: Pink Courier Bags Send and return check marking (no signature required). Send late reports to you for marking. Signature required Return reports requested by NZQA. Send WNSN to Bianca Muollo. Send irregular reports to your panel leader. Yellow Courier Bags No signature required Used to: Technology Marker Guide Notes 2015 Return mis-sorted to NZQA for redirection. Page 8 of 30 DURING MARKING Delivery of candidate reports Reports will be delivered in personalised folders. The folders will be delivered in orange coloured boxes. The boxes must be signed for at your delivery address. If the boxes are left without a signature, call the NZQA co-ordinator at CourierPost on 0800 501 504 and Bianca Muollo on 04 463 4238. Count the number of boxes received, and ensure this is the same as the count recorded on the delivery label. If the count is not the same as the count on the delivery label, contact Bianca Muollo on 04 463 4238 immediately. Barcode label on folders All folders will be personalised with a barcode. The example below shows the data contained on the barcode for a technology folder. Exam Centre Code 2 Marker Code Candidate Sort Code Exam Code D115 NSN Code Standard Code (National Student Number) The Exam Centre Code is the number of the examination centre. The Exam Code is the packing order. D will always be before E, and D115 will always be before D116. Your Marker Code consists of four numbers and the letter A. The Candidate Sort Code assists with the sorting of folders back to candidates. Technology Marker Guide Notes 2015 Page 9 of 30 The NSN (National Student Number) is the candidate’s unique identification number. The Standard Code is the achievement standard number. Receipt of folders Markers will receive bulk of folders in orange boxes on 11 November. Late folders will arrive in pink courier bags. Receive the courier bags as if they were boxes. When you receive orange boxes (or pink courier bags), you must: 1. Only ever open one box at a time. 2. Organise the boxes in numerical order eg, 1 of 6, 2 of 6. 3. Identify the box with the sticker ‘Packing List Enclosed’. 4. Open this box first and remove the Answer Booklet Control Sheets (see example in Appendix H). 5. Keep the Control Sheets in the order you received them. 6. Remove return address labels and stick these over your address label on each box – one box = one ticket. 7. Open box number 1 by carefully by slitting the tape so that the box can be used to return folders. 8. Remove the folders from box 1; keep in packed order. 9. The exam code on the first folder in the pile will match the first line on the first page of your Control Sheets. 10. Confirm the receipt of each folder by finding the Exam Code on the folder and the Control Sheet and ticking the Rec’d column. 11. Keep the folders in the order you receive them. 12. Mark Z on the Control Sheet if a folder is missing. 13. Repeat the checking process for all folders in all boxes. 14. Place the checked control sheets in boxes with the corresponding folders. 15. Close each checked box and store it in a secure place. 16. When all folders are processed, enter any Z results online. If you receive a folder for a standard you are not marking 1. Put the folder in a pre-addressed, yellow courier bag. 2. Send the bag to NZQA c/o Printlink. 3. Stick the Customer Copy courier sticker onto the Courier Tracking Sheet (Appendix E). If the folder is for your standard, is on your control sheet but has another marker code on the barcode 1. Leave the folder in the box in the same position. 2. Mark the report in the normal sequence of marking Folder not on control sheet, has your marker code, correct standard 1. Leave the folder in the box in the same position. 2. Mark the report in the normal sequence of marking. (see result entry 15 Technology Marker Guide Notes 2015 Page 10 of 30 Damaged folders or reports received in plastic bags 1. Leave the folder in the box in the same position. 2. Mark the report. 3. If necessary, use the Search for Candidate function to find the entry line. 4. Enter the result online. 5. Repack the folder in its plastic bag at the top of the box. Checklist before panel meeting Do you understand the following outcomes? Tick Attending the panel meeting? The Must Do Marking Practices (MDMPs): Using red pen only? Making corrections? Using the stamp to show the report has been marked? Recording the grade on the report? Recording the grade on the folder? Crossing off the other criteria boxes on the folder? Securely processing reports? Using the wrong NSN process? Entering results online daily? Entering results as initial entries? Entering results as double entries? Applying the assessment schedule and benchmark reports? Following the Marking Timeline? Sending reports for check marking on time? Use and removal of sticky notes? Keeping the Customer Copy labels from courier bags you have used? Responding to check marker advice regarding required marking changes? Completing all Additional Pages online, if any appear? Clicking the Final Submission button? Panel meeting All markers must attend the panel meeting. Markers must not begin marking until after the panel meeting. Take the following to the panel meeting: Technology Marker Guide Notes your Marker’s Pack a copy of the standard Technology Marker Guide Notes 2015 Page 11 of 30 a copy of the assessment specifications a red pen, pencil, and highlighter anything else the panel leader has asked you to bring e.g. sticky notes. If time permits, you will begin test marking. If this is likely to occur your panel leader will ask you to bring some of your marking allocation to the panel meeting. Panel meeting aims Ensure markers know where to find the Must Do Marking Practices (MDMPs) in the Technology Marker Guide Notes. Markers are responsible for understanding these procedures before the meeting. Ensure markers understand the assessment schedule and benchmark reports. Begin achieving a consistent standard of marking by marking of training reports. Finalise the Marking Timeline (Appendix D). Begin test marking using the marker’s own allocation (if time permits). Panel leader provides The referenced assessment schedule which will refer to benchmark reports from the 2015 submission identified by the panel leader and the senior marker. The marked benchmark reports that are referred to in the assessment schedule. The assessment schedule and the benchmark reports will set the standard in 2015. A set of graded training reports without visible grades. These will provide the first opportunity for further discussion and an opportunity to mark independently and receive feedback. A finalised Marking Timeline (Appendix D). Must Do Marking Practices (MDMP) Must Do Marking Practices (MDMPs) are non-negotiable; these practices ensure marking is consistent. MDMP: Making marks on the report or folder Do not mark the report or folder in any way except for the following: 1. Use red pen only. 2. Use the stamp provided once on each page to show that it has been marked. 3. Only write codes provided by your panel leader onto the report. 4. Do not write comments on the folder or report. If required, use a sticky note. 5. Tick the box or boxes on the folder that indicate the grade. One tick for achieved, two ticks for Merit, three ticks for Excellence. 6. Put a horizontal line through each of the other boxes on the folder cover. Three horizontal for Not Achieved, two horizontal for Achieved, one horizontal for Merit. 7. Enter the grade letter N, A, M, E, or V in the Overall Level of Performance box on the front of the folder. 8. Do not use correcting fluid. MDMP: Correcting errors If you change any mark you have put on the report or folder: Technology Marker Guide Notes 2015 Page 12 of 30 Cross it out correct it circle the correction initial next to the circle. MDMP: Securely processing reports 1. Only open one box at a time. 2. Stand the folders vertically in the box. 3. Take out only one folder at a time for marking. 4. Open only one folder at a time. 5. Remove the report. 6. Check that both NSNs on the cover of the folder and the NSN on the report are the same. (If there is any mismatches of NSNs follow the procedures below.) 7. Mark the report. 8. Record the result on the report, the folder, and the Control Sheet. 9. Double check the marks that record the grade are consistent on the folder cover and the report. 10. Return the report to the folder. 11. Return the folder to its position in the box. 12. When a box of folders has been marked, return the marked reports to the horizontal position in the box and keep them in the packed order. 13. Do not seal the box. MDMP: NSN mismatch procedures The guiding rule is that the report must be positively identified by two matching NSNs. Printed NSN on folder, no handwritten NSN on folder, no NSN on report 1. Mark the report. 2. Enter the grade on the first page of the report at the top right. 3. Beside the grade on the report, write the code WNSN (wrong NSN). 4. On the folder write WNSN under the final grade box. 5. Enter the grade and the code WNSN on the Control Sheet next to the Exam Code / NSN from the folder. This record will be used if the courier bag goes astray. 6. Record the NSN and grade on the Courier Tracking Sheet (Appendix E). 7. Replace the report in its folder. 8. Put the folder into a pink courier bag and address this to Fiona Crookes, Level 14, NZQA, 125 The Terrace, Wellington 6011. 9. Tick the signature required box. 10. Clearly write the code WNSN on the back of the courier bag. 11. Every Monday, send any courier bags to Fiona Crookes, Level 14, NZQA, 125 The Terrace, Wellington 6011. 12. NZQA will identify the correct line for entry and enter the result on your page as soon as possible. 13. If you have any problems with this process contact the Marker Helpline. Technology Marker Guide Notes 2015 Page 13 of 30 NSN on report is different to printed NSN on folder 1. Mark the report. 2. Enter the grade on the first page of the report at the top right. 3. Beside the grade on the report, write the code WNSN. 4. Search for the NSN from the report using the Candidate Search function online. 5. Enter the result online next to NSN from the report. 6. On the folder cover, in the Overall Level of Performance box, write V. 7. Beside the Overall Level of Performance box write WNSN. 8. Record the NSN, and grade on the Courier Tracking Sheet (Appendix E). 9. Replace the report in its folder. 10. Put the folder into a pink courier bag. Tick the signature required box. 11. Clearly write the code WNSN on the back of the courier bag. 12. Every Monday, send any pink courier bags to Fiona Crookes, Level 14, NZQA, 125 The Terrace, Wellington 6011. 13. If you have any problems with this process contact the Marker Helpline. NSN on report same as printed NSN on folder, no handwritten NSN 1. Mark the report. 2. Enter the grade on the first page of the report at the top right. 3. Mark the folder cover as usual, in the Overall Level of Performance box, write the Grade. 4. Beside the Overall Level of Performance box write WNSN. 5. Put a pen line through the handwritten NSN boxes and circle the line. 6. Return the report to the box. 7. Enter the result online in the normal data entry process. NSN same as handwritten NSN, no NSN on report 1. Mark the report. 2. Enter the grade on the first page of the report at the top right. 3. Mark the folder cover as usual, in the Overall Level of Performance box, write the Grade. 4. Beside the Overall Level of Performance box write WNSN. 5. Write the NSN from the folder cover onto the first page top right hand corner of the report. Circle the NSN and initial the circle. 6. Return the report to the box. 7. Enter the result online in the normal data entry process. Handwritten details, or no details printed on folder 1. Mark the report. 2. Enter the result online, using the Candidate Search function. 3. Use a pink courier bag to return the folder to Fiona Crookes, Level 14, NZQA, 125 The Terrace, Wellington 6011. 4. Record sending the folder using the Courier Tracking Sheet (Appendix E). Technology Marker Guide Notes 2015 Page 14 of 30 MDMP: Empty folders If a folder is empty, write Void on the cover, draw horizontal lines through the criteria boxes and write V for void in the Overall Level of Performance box. Enter the V result online. Return the folder to the box. MDMP: Entering results – initial entry 1. You must enter results online each day as each batch is marked. 2. After logging into your Marking Home page, click on Result Pages for Marker Code xxxx under Marking Pages. 3. Each Marking Page matches one Control Sheet page. 4. The Control Sheet page number (top right side) matches the Marking Page number on your screen. 5. A page may start part of the way into a box of folders. 6. When you are ready to enter results, click on Initial Entry for your first page. 7. Enter the results from the folder cover. 8. Enter results as N, A, M, E, or V. 9. Z can be used if a folder is missing. 10. Entering the result shifts the cursor to the next result field. 11. The enter key and the down arrow key also shift the cursor. 12. NZQA will load Y results. Y means absent. Do not overwrite these codes. 13. Click on Save every time you exit, even if you are only part of the way through a page. 14. Where there is no result line for a report you have marked use the search for candidate function to find the entry line. Accept the entry line and enter the result. If you cannot retrieve a result entry line, record the result on your answer booklet control sheet, download a Supplementary Result sheetform from the Marker Home Page Forms and return both the folder and form to NZQA. Record the result online when the Additional Pages appear. When each entry on the page has a grade of N, A, M, E or a code V, Y, or Z, the page status will change from Initial Entry to Complete. You can still change the grades on Complete pages after check marking up to the point of double entry. MDMP: Entering results – double entry 1. The purpose of the double entry is to confirm the initial result as correct. 2. Enter the results in the Double Entry column from the cover of the folder. 3. Before double entry, you must keep the folders in their packed order. 4. The process for double entry of results is the same as that for initial entry. 5. Once you have completed a page, click Save. 6. If there are any mismatches with the initial entry, you will see the mismatch screen. 7. Correct any mismatch results from the grade on the front of the folder. 8. Enter the confirmed result and click Save; you will return to the Marking Pages screen. 9. After double entry is completed, you can put folders in boxes in any order. Technology Marker Guide Notes 2015 Page 15 of 30 Understanding the assessment schedule The panel leader and senior marker have identified benchmark reports for 2015 which reference the assessment schedule and define the boundaries for marking. You must agree with these judgements. Marking using training reports The panel leader and senior marker have identified and graded training reports using the referenced assessment schedule for 2015. You will blind mark a selection of these reports at the panel meeting to establish and improve your grasp of the standard. The panel leader or senior marker will record the outcomes of this process and provide feedback. This process will assist you to develop your ability to mark consistently. Test marking Either during or immediately after the panel meeting markers will begin test marking. This involves marking 100 reports and entering the results online. Markers are not to mark any more than 100 reports until the panel leader has given clearance to continue marking. Assessment decisions As you mark, you will be required to make interpretations of the standard, the assessment schedule, the benchmark reports, and candidate’s reports based on your professional judgment to award grades. In exercising your professional judgment, you must ensure that: The candidate’s performance meets the standard required by the achievement standard, as illustrated by the 2015 assessment schedule and benchmark reports. The evidence provided by the candidate is sufficient for a reliable judgement. Other markers would make a comparable decision. The grade would be acceptable to the panel leader and/or check marker. Marking timeline You must follow the Marking Timeline in Appendix D. The panel leader will give you a copy of the timeline at the panel meeting. You are responsible for negotiating changes to this Marking Timeline. Check marking The role of check marking is to provide consistency. Your panel leader will explain the procedures for the selection and recording of the reports for check marking. Feedback received from your panel leader or check marker may require changes to previous marking decisions. You may continue marking your normal allocation while you wait for feedback from your panel leader or check marker. You must make changes to already marked work if instructed to do so by the panel leader or check marker. Recording and couriering reports for check marking Follow your check marker’s instructions about the number of reports to be check marked and the frequency and dates of check marking. Make sure all reports to be check marked have grades entered online. Record the NSN and grade from the report you are sending for check marking on the Check Marking Summary Form (Appendix F). This safeguard is essential in case reports are lost. Technology Marker Guide Notes 2015 Page 16 of 30 Book a courier pick up by calling CourierPost on 0800 501 504 by noon. A pick up will be made before 5.30 pm. Write your name and marker code on a sticky note, attach it to the top folder, and place all folders in a pink courier bag. Include a self-addressed, ticketed, pink courier bag (unless you have already given a supply of these to your panel leader or check marker) for the return of reports to you. Address the courier bag to your panel leader or check marker. Stick the Customer Copy courier label onto the Check Marking Summary Form (Appendix F). Courier bags collected on Monday to Thursday are delivered by CourierPost on the following day. Courier bags being sent on a Friday for Saturday delivery must have a Saturday Delivery courier ticket attached. Check with your panel leader whether their addrerss is rural. If it is a rural address, Saturday delivery cannot occur. Receiving check marking feedback Be prepared for feedback by phone at a pre-arranged time. This may occur before the return of the reports. To record this feedback, use the Check Marking Summary Form (Appendix F). Note down the check marker grade. Follow the advice and instructions of your check marker. Discuss the extent of any required review of grades already entered online. Review and amend any results online as required by the check marker. When check marked folders are returned, remove any check marking sticky or other notes. Replace folders in a box in the correct position using the Exam Code as your guide. Irregular reports Teachers who cannot verify the authenticity of a candidate’s report will send a Possible Breach of the Rules Form to NZQA. NZQA will investigate. The candidate will have been informed of this process. The Breaches Team may ask you to send folders to their address at NZQA. Please mark these folders without prejudice. Send the folder as soon as possible to Breaches Team, Secondary Operations, NZQA Level 15, 125 The Terrace, Wellington 6011. Reports that are so poorly referenced or so generic that an individual demonstration of understanding is not possible are not irregular; they are simply N. Your panel leader might instruct you to use a code in addition to the N grade. If you suspect deliberate, purposive, collusion, or other forms of deliberate, purposive, misconduct then the report is ‘irregular’. You must: Mark the report as you would any other on the quality of the report measured against the standard as represented by the assessment schedule and the referenced benchmark reports. Enter the result online. Record the result on the control sheet for double entry. Technology Marker Guide Notes 2015 Page 17 of 30 Download and complete an Irregular Submission Marker’s Report (Appendix G). This is available from the Forms for Markers section of your Marking Home page. Send the folder to your panel leader in a pink courier bag with the completed Irregular Submission Marker’s Report attached. Stick the Customer Copy courier label to the Courier Tracking Sheet (Appendix E). Use the code IR in the code column on the Courier Tracking Sheet (Appendix E). The panel leader will let you know the outcome. The two possible outcomes are no further action or referral to the NAF for further investigation. It is the panel leader’s responsibility to return the folder to NZQA c/o Printlink at the end of marking. Re-marking Re-marking occurs when there is substantial evidence that the assessment schedule has not been interpreted or applied fairly during marking. This can only occur following written permission from the Manager, Secondary Examinations, NZQA. Marking Home page When you log in and click on Marking Home, the top area of the screen displays messages to markers which you should always check. The following links appear on your Marking Home page, and are explained in detail below: View your Details Marking Pages Result Pages for Marker Code xxxx Booklets returned to NZQA Search for Candidate Forms and Guide Notes View your details Change personal details such as email, phone numbers, and addresses using this screen. After 14 October notify the Marker Helpline of any change of address as online changes will no longer be valid. Technology Marker Guide Notes 2015 Page 18 of 30 Marking Pages Below is an example of the online Marking Pages, with explanations A B C D E A Allocation Summary This table provides a summary of the entries which should appear on your Marking Pages. B Search for Candidate/Sort Pages The Search for Candidate link finds the location of a result entry line on your Marking Pages. Do not use the Sort Pages function unless your NAF asks you to, because the sort cannot be undone. It re-sorts the entries on the Marking Pages into Exam Centre Code / Exam Code order. C Control Sheet Pages Each Control Sheet Page has one line. The number of reports per page is up to 40, shown in the Entries column. As marking progresses, new pages may appear at the end of your Control Sheet Pages. These will contain entries for reports sent to you after late processing by NZQA. D Supplementary Pages Supplementary Pages will only appear when you reallocate a report from another marker to yourself. Technology Marker Guide Notes 2015 Page 19 of 30 Once this reallocation has been done, a result entry line for the folder will appear on a Supplementary Page. E Additional Pages Additional Pages may appear from 14 December. enter Z on all lines for which you have not received a booklet. Search for Candidate Use this link to locate a report requested by NZQA or one from your own allocation, and to transfer a result entry line from another marker’s allocation to yours to enter a result. Locate an entry click on Search for Candidate enter either the candidate’s NSN or both their Exam Centre Code and Exam Code select the relevant standard number from the drop-down list click on Search if the candidate is located you automatically go to their entry on the Control Sheet Page if the candidate is not located there will be a notification message. Transfer a result entry line from another marker’s allocation to yourself click on Search for Candidate enter either the candidate’s NSN or both their Exam Centre Code and Exam Code select the relevant standard number from the drop-down list click on Search if the candidate is located the details of the requested report will appear click on Accept on each new screen. The result entry line will be transferred (your name and marker code will appear) and you can add a result by clicking on Edit and then on Save. Technology Marker Guide Notes 2015 Page 20 of 30 When you transfer a result entry line from another marker to yourself a Supplementary Page will be created on your Marking Pages. Additional reports transferred from other markers to you will appear on this Supplementary Page until there are 40 result entry lines, when a new Supplementary Page will be created. When you transfer a result entry line from another marker to yourself warning messages may appear: ‘Warning: forbidden learner’ or ‘Warning: forbidden provider’ mean the result entry line belongs to a specific candidate indicated as forbidden, or a candidate from a school indicated as a forbidden provider: do not mark the report send it to your panel leader who will reallocate the result entry line. ‘Reallocation failed: result code already present’ means a marker has already entered a result for this candidate for the same standard: check the NSN is entered correctly if you are still unable to transfer the result entry line, mark the report as normal and email the result and the NSN to your NAF download and complete an Irregular Submission Marker’s Report (Appendix G) and include the other marker’s code, the candidate’s NSN, and the standard number send the form and report to your NAF using a pink courier bag. If you cannot find a result entry line on the Marking Pages after using Search for Candidate, wait until 115 December when Additional Pages become visible. If there is still no result entry line, download and complete a Supplementary Result/Change of Result Sheet and email it to your NAF. Late changes to results Late changes to results can be made even if a page is shown as Complete. On the Marking Pages screen click on Complete under the Initial Entry column and re-enter the results. Then click on Complete under the Double Entry column, double enter the changed results and click on Save. Completion of marking and final submission of results The Final Submission button will appear on screen from 14 December when all your Marking Pages, including any Additional Pages, are completed. Your panel leader will give approval to click the Final Submission button. Technology Marker Guide Notes 2015 Page 21 of 30 When you are certain no more edits are required, click the Final Submission button. You are asked to confirm, and if you answer Yes, your entries are complete. The message ‘The final submission is now complete. Pages can be viewed but not edited.’ will appear. If you need to unlock the pages call the Marker Helpline. All results must either be entered online or recorded using a Supplementary Result Sheet/Change of Result Sheet (downloaded from the Forms and Guide Notes section of Marking Home) before reports are returned to NZQA c/o Printlink at the completion of marking. Sunday 20 December is the final results submission date for all examinations. Reports requested by NZQA Reports may be requested by NZQA in connection with possible breaches of examination rules. The message ‘NZQA requires the return of booklets’ will appear beside the Booklets returned to NZQA link on your Marking Home page. It will disappear once the requested reports have been checked off in the Booklets returned to NZQA screen. You will also be sent a letter and prepaid envelope to follow up this online request. If you receive this request you must immediately: find the report in your allocation by using the Search for Candidate link mark it as normal enter the result online on your Marking Pages, and record it on the Control Sheet send the report to NZQA using the prepaid envelope if you have not yet received the report, wait until the final week of marking and if it still has not arrived, complete the form at the bottom of the letter and return it in the prepaid envelope. Result entry and report return issues If there are two separate lines on your marking pages for the same report: mark the report enter the ‘live’ result (N, A, M, E, or V) on one of the lines enter a ‘Z’ code (missing) on the other line. If you cannot find a line anywhere on the Marking Pages to enter a result for a report: use the Search for Candidate function to reallocate the result entry line to yourself. If you have returned all your boxes and then have to return a marked folder: send the folder in a pink courier bag to NZQA c/o Printlink. Technology Marker Guide Notes 2015 Page 22 of 30 AFTER MARKING Checklist after marking Have you done the following? Tick Clicked the Final Submission button? Pre-arranged pick up of boxes with CourierPost? Removed all sticky notes from folders and reports? Sealed the boxes before sticking on the return address label? Stuck the Customer Copy portion from the courier label onto the Control Sheet? Put the Control Sheets in a secure place? Returned all unused materials to NZQA? Sent your Marker Report to your panel leader by 19 December? Emailed a completed Marking Evaluation Form to the NAF by 22 December? Phoned both CourierPost and the Marker Helpline immediately after midday on 29 December if any boxes of reports are still in your possession? Checked and submitted your claim to NZQA by 22 January 2016? Marker report Download and complete a Marker Report Form and email it to your panel leader by 19 December (or earlier if requested). Keep notes during marking to assist with the completion of this report. Marking evaluation Download and complete a Marking Evaluation Form and email it to your NAF by 19 December. If you have experienced any specific issues with the courier service, include your marker code and address in your feedback. Return of boxes Do not return any reports to NZQA without entering their results online or completing a Supplementary Result Sheet/Change of Result Sheet and emailing it to your NAF or faxing it to 04 463 3113. Final pick up of boxes The panel leader will give approval for the final pick up of boxes for return to Printlink. Before couriering, remove sticky notes, close the folder flaps, carefully place folders barcode up in boxes. Place reports in plastic bags at the top of the boxes. Attach the Customer Copy portion of the courier tickets to the Courier Tracking Sheet (Appendix E). If you use extra boxes address them to NZQA c/o Printlink, 33 Jackson Street, Petone 5012. The courier will apply a freight forward ticket for charge back to NZQA. Book the final pick up of all reports with CourierPost 24 hours in advance (but not before), confirming the number of boxes and pick up address. CourierPost will collect from your pick up addresses on either 15, 16, 17, 18, 19, 22, 23, or 29 December. Technology Marker Guide Notes 2015 Page 23 of 30 Final pick up or drop-off of boxes to a CourierPost depot should occur by Friday 18 December. If your boxes are not picked up or dropped off by 19 December, you must arrange a pick up between 8 am and 12 noon on 29 December and be available to hand over your boxes. If your boxes have not been collected by 12 noon on 29 December, call CourierPost and the Marker Helpline immediately. Do not return split consignments. All of your boxes of reports must be picked up by CourierPost or dropped off at a CourierPost depot at the same time. Courier tracking To track the courier consignment, use the Track & Trace function on the CourierPost website: log on to www.courierpost.co.nz enter the consignment number from the courier ticket) in the Track & Trace field click on Trace Now the next screen indicates the delivery status. Remaining materials Return all unused stationery and courier items to NZQA during January 2016. Destroy all other examination related material after checking for any reports. Marker claims Payment for marking will be made under the terms of the contract for marking. Marker claims can be made online, and if accurately submitted by 22 January 2016 will be paid by the end of February 2016. You can print a copy of your claim from the NZQA website at any time. Any claims for postage, couriers, telephones, and meals for more than $5.00 must have a GST receipt. NZQA is unable to pay for items that are classified as capital expenditure (e.g. filing cabinets and computers) or tax deductible (e.g. printer paper and cartridges). Completing your claim online Log in, go to Marking Home, and click on Claim Details (this button will appear towards the end of marking) and then on Start Claim. If the contract drop-down list is not panel leader, marker, or check marker call the Marker Helpline. If you have different marking roles on separate panels (e.g. panel leader on one panel, marker on another) call the Marker Helpline before you make the second claim. Enter your claim entitlements on the Payment Information page, as below. Claim type If you are submitting a GST invoice for your services, select the GST Invoice option. Otherwise, leave the Normal Claim option selected and choose the payment method. Technology Marker Guide Notes 2015 Page 24 of 30 Report marking If you marked more than one standard, there will be a line for each. The Returned box will contain the number of reports for which you entered results (including V reports). If you were a check marker, enter the number of reports you check marked in the Marked box, and note this in the Notes box. Marking Fees Tick the Marker Administration fee and Marking Incidentals boxes. Click on Save. A summary of the claim will appear for you to check. If you need to change any details, click on Edit Claim Information, make the changes, and click on Save again. Check the accuracy of all information to avoid delays in your claim being processed. When the claim is correct, tick the confirmation box, then click on Submit Claim. A confirmation message will appear. You cannot edit the claim any further. If you need to change something, call the Marker Helpline. If you have receipts to submit, print out a copy of your completed claim form, attach the receipts and post to NZQA in an envelope from your Marker’s Pack. Receipts must be itemised, and include the GST number. EFTPOS receipts without a GST number will not be accepted. Tracking claims To track your claim, log in and click on Claim Details. A message will appear which indicates the current status of your claim. The initial status will be Submitted, which changes to Approved, and then to Sent for Payment. If NZQA requires additional information you will be contacted and the status will be On Hold. Technology Marker Guide Notes 2015 Page 25 of 30 Appendix D: Marking Timeline This form is an example only. Panel leaders should adapt this form for their own markers. Reports received 700 Marker number Panel meeting 18/11/2015 Marker name Start page number Marking day Day Date Daily marking quota Cumulative total Check marking dispatch dates Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 8 Day 10 Day 11 HOLD Day 12 Day 14 Day 15 Day 16 Day 17 Day 18 Day 19 Day 21 Day 22 Check marking complete. Markers can mark to their capacity. If monitoring shows unexpected results, further check marking may be required. Email a completed copy of this Marking Timeline to your NAF before or immediately after the panel meeting. Use the title as the subject line. Technology Marker Guide Notes 2015 Page 26 of 30 Appendix E: Courier Tracking Sheet Stick the Customer Copy labels from any courier bag you use onto this sheet. The labels will be needed for tracking if any courier bag goes astray. Date NSN Grade Technology Marker Guide Notes 2015 WNSN or IR Sent to Courier label Page 27 of 30 Appendix F: Check Marking Summary Form Use one copy of this form for each check marking round. Send the completed Check Marking Summary Form to the NAF at the end of marking, with the Marker’s Report. Achievement Standard Number: …………………………….. Marker name: Marker code: Phone: Page: Check marking round (circle): 1 2 3 4 5 NSN Marker grade Check mark grade Comments Marking standard (circle): Hard Accurate Generous Consistency (circle): Consistent Sometimes variable Erratic Mechanical processes (circle): Accurate Some errors Frequent errors Attach Customer Copy portion from courier ticket(s) here. Technology Marker Guide Notes 2015 Page 28 of 30 Appendix G: Irregular Submission Marker’s Report Complete all sections of this form electronically. Print out a copy of the completed form and sign it. Place a printed, signed copy of this report with the folder/submission and send it to the panel leader or NAF. Note: A copy of this completed form will be included in any NZQA correspondence with the candidate in the event of a suspected breach of the rules. I have marked the folder/submission (click) I have entered the result online (click) Candidate NSN: Subject: Standard: Outline of the irregularities identified in the submission, including page number where appropriate. Marker’s initials: …………………… Marker Code: Date: Panel leader comments: Panel leader action: (delete or cross out what does not apply) No further action Sent to NAF (Courier the report with the folder/submission to your NAF at NZQA, Level 13, 125 The Terrace, Wellington 6011. Use a signature required pink courier bag and stick the Customer Copy label onto the Courier Tracking Sheet Appendix E.) Panel leader’s initials: ……………………………… Date: ........................................ NAF Action NFA Referred to Breaches Team Other (detail below) ................................................................................................................................................ ................................................................................................................................................ Technology Marker Guide Notes 2015 Page 29 of 30 Appendix H: Control Sheet This form is an example only. Standard: Line No Exam centre 91048 Exam code National Student Number Marker Rec’d Result 1774 CM Line No Control Sheet Page: Exam centre Exam code National Student Number 1 432 L177 133304123 21 96 D149 133304678 2 432 H118 123513081 22 96 G143 123413123 3 432 C123 133413345 23 96 H131 133413456 4 432 K105 133543678 24 96 J120 133533789 5 432 K107 133523321 255 96 J147 133573321 6 432 K118 123513901 26 96 J148 123583334 7 432 H121 134513789 27 96 M130 134113665 8 247 A139 132513888 28 96 M144 133513567 9 247 A144 134513896 29 40 N147 132513567 10 247 V119 133413887 30 40 N148 132413723 11 172 M134 133573442 31 40 X107 133573337 12 172 L145 133583112 32 40 B135 133583334 13 172 E148 133413768 33 40 T109 133413768 14 172 B129 133313089 34 40 X117 132313675 15 172 P102 133213081 35 40 W122 134213443 16 172 S119 133713081 36 40 X111 135713678 17 172 X122 133813876 37 27 W122 136813564 18 172 H132 133593081 38 27 M128 137593445 19 96 C142 133523874 39 27 N139 138523667 20 96 D136 133533231 40 27 J147 139533556 Technology Marker Guide Notes 2015 Rec’d P06011 Result CM Page 30 of 30