Portfolio submission for applicants applying for test user qualifications in forensic testing contexts Route 2 applicants only Assistant Test User: Forensic NB: Please ensure that all identifying information, such as names and email addresses, is removed from your portfolio submission and supporting documents before being submitted. Name:________________________________________________ BPS Membership number: _______________________________ Module Set: 4C Module reference number Evidence of how you have applied the standards described in the previous column Module contents 1 Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Module 4.107 Introduction to testing: Forensic Category: Psychological Knowledge This module introduces the different types of test and other assessments used in forensic contexts, considers the role of testing in the broader assessment processes and issues in the administration of tests under different levels of supervision. An Assistant Test User should understand the differences between the main types of tests (ability, typical functioning, identifications of impairments/risk factors, actuarial, structured professional judgement, clinical) and related assessments/tools used in forensic assessment/contexts. Assistant Test Users should also be able to describe key concepts such as risk factors, protective factors, aptitude, ability, personality; outline core forensic theories/models such as and demonstrate (giving specific examples) that testing is a subset of the overall assessment process, that testing/or some types of tests might not always be appropriate, and plays an important role in intervention/risk management planning. Assistant Test Users should appreciate the impact of technology on modes of test administration and be able to describe the benefits and issues associated with each of these. They should be able to outline the role of the Assistant Test User and Test User and understand the limits of the Assistant Test Users competences and the requirements to practice within competences/skills and that further training will be required to use many specific tools/tests. Module reference number An Assistant Test User should: 107.1 Be able to distinguish between tests of ability, aptitude and Evidence of how you have applied the standards 2 Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 attainment. 107.2 107.3 107.4 Be able to describe in general terms the distinction between tests which describe what someone is currently capable of doing, those that are intended to predict what someone will be able to learn or do in the future and those which measure their current level of knowledge understanding or skill. Assistant Test Users should be able to provide examples of the appropriate use of each type of test. Be able to distinguish between different types of risk assessment measures/tools and describe other tests frequency used in forensic contexts. Be able to describe in general terms the distinction between different risk assessment approaches (e.g. actuarial, clinical, SPJ) and other tests frequently used in forensic contexts (e.g. the PCL-R). Assistant Test Users should be able to provide examples of the appropriate use of each type of test. Be able to distinguish between different types of questions/factors included in tests. Be able to describe in general terms different types of questions/factors used in tests, such as risk and protective factors, static, historic and dynamic factors. Assistant Test Users should be able to identify which types of questions/factors are assessed in a range of test examples. Be able to distinguish between open, controlled, supervised and managed modes of test administration: Be able to explain the four modes of testing as defined by the International Test Commission (ITC) guidelines on Computer based testing (CBT) and the Internet: open mode is free access (e.g. on the web); controlled mode requires the test taker to be identified (e.g. via unique login and password; often referred to as 3 107.5 107.6 remote administration); supervised mode requires the presence of a test administrator; managed mode involves the use of a secure test centre with appropriately trained staff. Be able to demonstrate an understanding of the purpose of testing within the overall context of assessment: Be able to demonstrate an understanding of how assessment is undertaken in broad terms, that it involves a process and is not simply ’client centred’. Also show understanding that psychometric testing is only a possible part of this process and show appreciation for its usefulness and limitations. Demonstrate an understanding of how test results can be used to inform future intervention, determine type and level of intervention and assess intervention outcome. Be able to demonstrate an understanding of key theories relevant to testing in forensic contexts: Be able to demonstrate an understanding of key theories relevant to testing in forensic contexts such as concurrent widely accepted theories. Module reference number Evidence of how you have applied the standards described in the previous column Module contents Module 4.108. This module covers practical skills in preparing a face-to-face test Administering administration session, administering and scoring tests. tests to one Assistant Test Users should be able to demonstrate their abilities or more test 4 Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 to prepare the test taker, organise the test setting and materials, and check and take account of any special considerations that might affect the test taker’s performance. Assistant Test Users Category: Practitioner Skill should be able to describe the appropriate processes and any specific issues related to online/computer based testing and assessments conducted using file/collateral information. They should also demonstrate the practical skills of test scoring, converting raw scores into standardised scores and making appropriate checks to ensure the accuracy of these. takers, part 1 Module An Assistant Test User: Forensic Contexts should: 108.1 Ensure adequate preparation by studying the relevant sections of the test user manual and other relevant documents and becoming familiar with all relevant materials and procedures in advance of the session/assessment. 108.2 Read and understand the administration requirements and instructions of specific tests. Ensure that all test takers receive appropriate briefing and preparation materials a suitable time prior to the testing session. Provide appropriate briefing and preparation information for relevant tests and contexts. Assistant Test Users should demonstrate awareness of the need to provide sufficient information for test takers with specific disabilities and/or needs and decide whether they may need accommodations. 5 Evidence of how you have applied the standards Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 When administering supervised or managed mode assessments: 108.3 108.4 Supervised and managed modes and those where a test administrator is present during the test session. Essentially they require the Assistant Test User to ensure that all the practical administrative requirements of the test are followed to ensure that the results when obtained are both reliable and valid. Ensure that the location is suitable for the duration and type of assessment, equipment required, numbers of test takers and safety of all present. Be able to arrange seating and desk space appropriately for the test whether for individuals or groups. Inform the test takers of the time and place well in advance and ensure they are adequately prepared, where relevant, for what they will be required to do and why. Ensure that those doing the test are not unduly disturbed or distracted and that the ambient qualities of the room are appropriate and suitable. Demonstrate an awareness of health and safety issues including where the test taking should be located, how the environment arranged etc. to ensure the safety of all test takers, Assistant Test User(s) and other people present. Ensure all necessary materials are available in sufficient quantities and that materials are in good condition and equipment in working order. Ensure, where re-usable materials are being used, that they are carefully checked for marks or notes that may have been made by previous candidates. Ensure that any equipment (e.g. computers) is operating correctly and sufficient test materials are available for use by the test taker(s). Where appropriate, test takers should be given the opportunity to familiarise themselves with response mechanisms or other special test equipment. 6 108.5 108.6 108.7 108.8 Ensure that any necessary test accommodations for disabled test takers are available, well understood and appropriately provided. Implement requirements and adjustments as arranged by the holder of a Test User level qualification or other suitably responsible and qualified Test User supervising the session. Brief test takers on the purpose of the test session and key rules and put them at their ease while maintaining an appropriate atmosphere. Apply appropriate rules that might include some or all of following: not talking to or colluding with others during the session; not having any recording devices; including mobile phones, which should be turned off and left with the test administrator; heeding any advice provided by the test manual on the content and wording of the briefing. Follow standard test procedures and instructions as specified in the tests’ user manuals. Be able to follow all test instructions/requirements for all types of testing sessions including tests completed at a distance from the Test Users, of using file/collateral information. Where appropriate, Assistant Test Users should: provide test takers with sufficient time to work through example test items; make careful checks to ensure proper use of the answer sheets and response procedures; explain any time limits and ensure that during the test silence is maintained to avoid distraction; make clear that once the test or timed subtest has begun no further questions can be answered; adhere strictly to test-specific instructions concerning pacing and timing; deal appropriately with any questions that arise without compromising the purpose of the test. Monitor behaviour before and during the test to identify any issues or problems that may arise. 7 108.9 Appropriately monitor test takers before and during the session to check they have appropriate presentation/capacity for the test. They should ensure that appropriate invigilation of the test session is maintained to identify test takers who are confused, not following test instructions, etc., and avoid issues such as cheating and recording information about the test. Assistant Test Users should observe and record any notable issues to help interpret data when it comes to report writing or feedback. They should be able to outline when it is appropriate to make arrangements for a re-schedule testing session and how this would be arranged/managed. Ensure that all necessary information has been logged and recorded including details of any provisions that were made for any special needs. Ensure that the test takers’ personal details have been recorded, together with relevant details of what assessment instruments were used, what accommodations were made for any special needs and whether accommodations met their needs. Record any other relevant information, such as any particular problems that arose during the session that might have affected a candidate’s performance. Evidence of how you have applied the standards described in the previous column Module reference number Module contents Module 4.109. This practical module covers the skills of developing rapport with test takers and conducting the test session and scoring in 8 Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Administering tests to one or more test takers, part 2: Forensic accordance with test guidelines. Assistant Test Users should be able to demonstrate abilities to build rapport with test takers and administer tests according to the instructions in the manuals whether this is by using computers, paper formats, in face-to-face testing sessions, or testing completed at a distance or conducting assessments from Practitioner Skill file/collateral information. Module 109.1 109.2 In the case of individual testing, the Assistant Test User should be able to: Establish a satisfactory rapport with the test taker prior to the commencement of testing and maintain this throughout the session. Establish and maintain a suitable relationship with the test taker such that the test taker performs to an optimum level of performance but in so doing the Assistant Test User must ensure that standard instructions are used and that the test remains valid and reliable. Prompt the test taker where appropriate in accordance with the test instructions and without invalidating the test item. Ensure that where it is appropriate the test taker’s questions about the test are answered in such a way as to ensure the test is not invalidated in any way. Where doubt exists the Assistant Test User should normally explain that a question cannot be 9 Evidence of how you have applied the standards Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 answered because to do so would invalidate the test. 109.3 109.4 109.5 Address the test takers concerns and perhaps reluctance regarding test completion in an appropriate manner, ensuring the test is not invalidated, and ethical practice is maintained. Ensure that where it is appropriate the test taker’s questions about the purpose of the tests, how the results will be used, who will see the results, and the impact of completion and noncompletion in an honest and appropriately ethical manner, ensuring that the test is not invalidated. Use appropriately discreet scoring procedures so that the test taker does not become unduly conscious of failure. Be able to score the test accurately whilst ensuring that test takers are not given inappropriate sight of the scoring and are not unduly discouraged by any wrong answers. Follow discontinuation procedures in line with the guidelines in the test manual while ensuring that the test taker does not become disheartened through obvious failure. Be compliant with test instructions regarding discontinuation. If judgment is such that a test has to be curtailed before discontinuation point is reached the Assistant Test User must have and demonstrate a suitable rationale for this and make appropriate reference and attach suitable caution to results in feedback. Module In the case of testing at a distance, the Assistant Test User should be able to: 10 Evidence of how you have applied the standards Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 109.6 109.7 109.8 Ensure that test takers are sent the necessary information and log in details in good time. Present test takers with clear explanations about the purpose(s) of the assessment, how the data will be treated, privacy and confidentiality, and what provisions are available for letting the Test User know if internet access is a problem for the candidate. Ensure that test takers understand what is required of them and what will be happen after completion of the assessment and that they have a means of raising queries. Brief test takers in a way that establishes an appropriate honesty contract with them and explains that scores obtained in unsupervised situations may be checked later in the process. In the case of testing via file and/or collateral information, the Assistant Test User should ensure the test takers understand the processes that are being completed, the purposes of the assessment and that appropriate consent has been given. Be able to outline the appropriate procedures that should be followed when assessments are made using file/collateral information. They should be able to brief the assesses in an appropriate manner and present clear explanations of the purpose(s) of the assessment, how the data will be collected/used, privacy and confidentiality, how the results will be used and who will see these etc. Module reference number Evidence of how you have applied the standards described in the previous column Module contents 11 Reference (if applicable) Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Module 4.110 Maintaining security and confidentiality of the test materials and the test data: Forensic This module covers the ethical use of tests and test data including storage, confidentiality and compliance with relevant legislation. Assistant Test Users should be able to demonstrate clear understandings of the ethics of testing, ethical issues/practices specific to testing in forensic contexts and that they will act in an ethical manner. Assistant Test Users should be able to demonstrate their abilities to provide test takers and other stakeholders, where appropriate, with clear information of how Practitioner Skill test results will be used and show how they will make suitable arrangements for the storage of test materials, data and reports. Module An Assistant Test User: Forensic Contexts should: 110.1 Ensure that best practice is followed in giving clear descriptions to the test taker(s), or relevant others, prior to the assessment concerning: how the results are to be used; who will be given access to them; what they will be used for; for how long they will be retained etc. Ensure that test takers receive clear and appropriate information about the use and storage of their test results and access to them, so that informed consent is obtained, either in writing or by clicking consent on computer administration. In some cases 12 Evidence of how you have applied the standards Reference - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 consent may be required from relevant others, such as parents or guardians. 110.2 110.3 110.4 Ensure that all test data are stored in accordance with current legislation (and the need to update knowledge in line with legislative/guidance updates/developments) and local/organisation rules/policies and guidance; store data in a secure place and that access is not given to unauthorised personnel. Ensure understanding of relevant aspects of Privacy, Digital Rights Management and the Equal Opportunities Commission (EOC) Legislation in the country of use, rules/guidance/policies for relevant organisations, and test takers’ rights and need to update knowledge in line with legislative/guidance changes. Assistant Test Users must know how and where data is stored, if in a digital environment. If Assistant Test Users delegate some part of the process to others, they must be competent to exercise appropriate responsibilities. Ensure that all test materials are kept in a secure place that is not accessible to people other than authorised Assistant/Test Users. Ensure appropriate measures and processes are in place so that all paper-based test materials are stored securely and access to computer-based tests is restricted to authorised Test Users. Ensure that potential test takers are not provided with prior access to test materials other than those specifically designed to help test takers prepare for their assessments. Ensure that where available, test takers are given access to appropriate preparation materials but that security policies and procedures prevent test takers accessing actual test materials prior to testing. 13 14