Portfolio submission for applicants applying for test user qualifications in forensic testing contexts Route 2 applicants only Assistant Test User: Forensic Exemplar portfolio NB: Please ensure that all identifying information, such as names and email addresses, is removed from your portfolio submission and supporting documents before being submitted. Name:________________________________________________ BPS Membership number: _______________________________ Module Set: 4C Module reference number Evidence of how you have applied the standards described in the previous column Module contents 1 Reference (if applicable) - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Module 4.107 Introduction to testing: Forensic This module introduces the different types of test and other assessments used in forensic contexts, considers the role of testing in the broader assessment processes and issues in the administration of tests under different levels of supervision. An Assistant Test User should understand the differences between the main types of tests (ability, typical functioning, Category: identifications of impairments/risk factors, actuarial, structured Psychological professional judgement, clinical) and related assessments/tools Knowledge used in forensic assessment/contexts. Assistant Test Users should also be able to describe key concepts such as risk factors, protective factors, aptitude, ability, personality; outline core forensic theories/models such as and demonstrate (giving specific examples) that testing is a subset of the overall assessment process, that testing/or some types of tests might not always be appropriate, and plays an important role in intervention/risk management planning. Assistant Test Users should appreciate the impact of technology on modes of test administration and be able to describe the benefits and issues associated with each of these. They should be able to outline the role of the Assistant Test User and Test User and understand the limits of the Assistant Test Users competences and the requirements to practice within competences/skills and that further training will be required to use many specific tools/tests. My DClinPsy degree (Institute of Psychiatry, XXX) included specific components on both test use in clinical contexts and specific forensic teaching I have 5 years of continued practice as a qualified clinical psychologist in forensic (medium secure) context, including supervision from experienced test users In my practice over the last 8 years I have used a range of tests in the context of a prison setting to assess cognitive functioning and risk in the broader context of psychological assessment of offenders referred for psychological assessment. Initially I was observed administering the tests and as my experience grew, my supervisor only reviewed my scoring and report writing skills. I have used tools such as the HCR20, STATIC-99, WAIS-IV and WASI, in the context of the offender being referred for participation in accredited programmes, for sentence planning. I have used each type of test in my 2 Document 4 – Degree certificate Document 9 – Anonymised offender report Document 8 - cognitive assessment report Document 10 – Anonymised IPDE and PCL-R Psychology Assessment Report Documents 13 – Anonymised HCR-20 assessment report practice over the past 8 years and am able to distinguish applicability. Self-directed reading in test use to answer clinically relevant questions, e.g. malingering Module reference number 107.1 107.2 Evidence of how you have applied the standards An Assistant Test User should: Be able to distinguish between tests of ability, aptitude and My postgraduate study included a attainment. course on psychometric testing, which included training on the Be able to describe in general terms the distinction between different types of test available. tests which describe what someone is currently capable of doing, those that are intended to predict what someone will be able to learn or do in the future and those which measure their I have used each type of test in my current level of knowledge understanding or skill. Assistant practice over the past 8 years and Test Users should be able to provide examples of the am able to distinguish the difference appropriate use of each type of test. applicability. Be able to distinguish between different types of risk In my practice I have used a range assessment measures/tools and describe other tests frequency of assessment approaches which used in forensic contexts. include actuarial, clinical and structured professional judgement Be able to describe in general terms the distinction between to assess risk of violence, sexual different risk assessment approaches (e.g. actuarial, clinical, offending and domestic abuse. I SPJ) and other tests frequently used in forensic contexts (e.g. have also used tests to assess the PCL-R). Assistant Test Users should be able to provide personality difficulties and examples of the appropriate use of each type of test. psychopathy, following recognised training 3 Reference (if applicable) - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Document 4 – degree certificate Documents 8,9 10 – Anonymised reports Documents 8-11 – Anonymised reports demonstrating my use of SPJ assessments including the HCR-20, SVR-20, SAPROF, IPDE and PCL-R. 107.3 107.4 107.5 107.6 Be able to distinguish between questions/factors included in tests. different types of In my practice I have applied a range of approaches to gathering information to inform assessment. I Be able to describe in general terms different types of am experienced in the need to questions/factors used in tests, such as risk and protective distinguish the domains of risk factors, static, historic and dynamic factors. Assistant Test management planning. Users should be able to identify which types of questions/factors are assessed in a range of test examples. Be able to distinguish between open, controlled, supervised Whilst in my practice I have not and managed modes of test administration: delivered all four types, I have delivered 3 and am familiar with the Be able to explain the four modes of testing as defined by the provisions of the fourth. International Test Commission (ITC) guidelines on Computer based testing (CBT) and the Internet: open mode is free access (e.g. on the web); controlled mode requires the test taker to be identified (e.g. via unique login and password; often referred to as remote administration); supervised mode requires the presence of a test administrator; managed mode involves the use of a secure test centre with appropriately trained staff. Be able to demonstrate an understanding of the purpose of In my practice over the last 8 years testing within the overall context of assessment: I have used testing to inform risk management planning in a range of Be able to demonstrate an understanding of how assessment is contexts within the forensic field. undertaken in broad terms, that it involves a process and is not simply ’client centred’. Also show understanding that psychometric testing is only a possible part of this process and show appreciation for its usefulness and limitations. Demonstrate an understanding of how test results can be used to inform future intervention, determine type and level of intervention and assess intervention outcome. Be able to demonstrate an understanding of key theories I am familiar with the major testing relevant to testing in forensic contexts: theories and have attended Certificated Training to the previous Be able to demonstrate an understanding of key theories Level A in that pursuit. 4 Document 12 – p.12-18 Summaries of how 3 well known SPJ can be summarised in terms of their domain structure: HCR-20, Static-99J and SAVRY Document 16 - Summary of application of testing in three of the four areas required and a summary of how the 4th might be applied in a forensic context Document 18 - Summary scenarios of how I have applied forensic context testing to the purpose of client risk management planning. Document 24 - Certificate of competence in Occupational Testing Level A relevant to testing in forensic contexts such as concurrent widely accepted theories. Module reference number Module 4.108. Administering tests to one or more test takers, part 1 Category: Practitioner Skill Evidence of how you have applied the standards described in the previous column Module contents This module covers practical skills in preparing a face-to-face This was covered within DClinPsy test administration session, administering and scoring tests. teaching and supervision – e.g. being “passed out” on the WAIS Assistant Test Users should be able to demonstrate their assessment; specialist abilities to prepare the test taker, organise the test setting and neuropsychology clinical materials, and check and take account of any special placement; considerations that might affect the test taker’s performance. Assistant Test Users should be able to describe the In my practice over the past 8 appropriate processes and any specific issues related to years I have administered and online/computer based testing and assessments conducted scored tests in a range of using file/collateral information. They should also demonstrate situations with both groups and the practical skills of test scoring, converting raw scores into individuals. I have conducted standardised scores and making appropriate checks to numerous assessments clinically ensure the accuracy of these. using a range of neuropsychological, personality, and other clinical tests. This involved being trained in the administration of the tests, having my supervisor approve for me to administer the tests unsupervised and scoring the tests accurately. 5 Reference (if applicable) - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Document 4 – Degree certificate Document 27 – Summary of situations and approaches where I have applied testing to groups and individuals Document 25 – Certificate of training Module An Assistant Test User: Forensic Contexts should: Evidence of how you have applied the standards Reference (if applicable) - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 108.1 Ensure adequate preparation by studying the relevant sections of the test user manual and other relevant documents and becoming familiar with all relevant materials and procedures in advance of the session/assessment. I have a wide range of experience of specific tests in a forensic context and have used these regularly (e.g., WAIS IV, HCR-20). Document 22 – p. 2-3. I have presented a brief description of scenarios of applying 2 tests in forensic contexts Read and understand the administration requirements and instructions of specific tests. My supervisor and peers are familiar with my practice and can assert its quality. 108.2 Ensure that all test takers receive appropriate briefing and In my practice I have adopted a preparation materials a suitable time prior to the testing standardised basis for the session. provision of information to test takers to brief and prepare them. Provide appropriate briefing and preparation information for I have applied this across relevant tests and contexts. Assistant Test Users should situations in a forensic context as demonstrate awareness of the need to provide sufficient I believe it embodies the information for test takers with specific disabilities and/or requirements of best practice. needs and decide whether they may need accommodations. When administering supervised or managed mode I am familiar with the need to assessments: apply and administer tests in the manner intended, in order to Supervised and managed modes and those where a test obtain reliable and valid results. administrator is present during the test session. Essentially In my practice, I follow the they require the Assistant Test User to ensure that all the practical administrative practical administrative requirements of the test are followed requirements of the test or 6 Document 20 - Statement of my compliance with the standards from my colleague Ms XXX Document 16 - Basic protocol description that I use in my practice, with specific examples of how it would need to be adapted for service users with specific challenges Document – 18 p.2-4 Descriptions of how I have applied tests in 3 different situations, one of which contains a Caution regarding interpretation, due to a deviation in 108.3 108.4 to ensure that the results when obtained are both reliable and alternatively document deviations valid. from standardised use, noting possible impact on reliability and validity. Ensure that the location is suitable for the duration and type of In a Forensic Context this can be assessment, equipment required, numbers of test takers and in my experience a challenging safety of all present. element of applying tests. In my practice I have developed a Be able to arrange seating and desk space appropriately for checklist for requirements which the test whether for individuals or groups. Inform the test serves to meet the minimum takers of the time and place well in advance and ensure they standards to assure quality of are adequately prepared, where relevant, for what they will be testing environment. required to do and why. Ensure that those doing the test are not unduly disturbed or distracted and that the ambient qualities of the room are appropriate and suitable. Demonstrate an awareness of health and safety issues including where the test taking should be located, how the environment arranged etc. to ensure the safety of all test takers, Assistant Test User(s) and other people present. Ensure all necessary materials are available in sufficient In a Forensic Context this can be quantities and that materials are in good condition and in my experience another equipment in working order. challenging element of applying tests, as materials and equipment Ensure, where re-usable materials are being used, that they are used by many individuals. In are carefully checked for marks or notes that may have been my practice I have developed a made by previous candidates. Ensure that any equipment checklist for requirements which (e.g. computers) is operating correctly and sufficient test serves to meet the minimum materials are available for use by the test taker(s). Where standards to assure quality appropriate, test takers should be given the opportunity to testing, to minimise the possibility familiarise themselves with response mechanisms or other of effecting the reliability and special test equipment. validity of the results. 7 administration requirements. Document 15 p-1-3 - My checklist for quality and safety of environment, with specifics added for 3 different types of tests: WAIS IV, HCR – 20 MCMI III. It reflects consideration of the use of these tests in a forensic (as opposed to a clinical) setting. Document 15 – p.4-5 My checklist for assuring the quality of the testing materials and equipment, with specifics added for 3 different types of tests: WAIS IV, HCR – 20 and MCMI III. 108.5 Ensure that any necessary test accommodations for disabled I am familiar with the test takers are available, well understood and appropriately requirements of clients with provided. protected and other relevant characteristics. I have been Implement requirements and adjustments as arranged by the responsive to these in my holder of a Test User level qualification or other suitably practice. responsible and qualified Test User supervising the session. 108.6 Brief test takers on the purpose of the test session and key In my practice I have developed a rules and put them at their ease while maintaining an short generic briefing sheet for appropriate atmosphere. testing in a range of scenarios that I apply with test takers in Apply appropriate rules that might include some or all of Forensic Settings. Some issues following: not talking to or colluding with others during the are less pertinent such as mobile session; not having any recording devices; including mobile phones when I am working in a phones, which should be turned off and left with the test prison setting, where they are administrator; heeding any advice provided by the test manual excluded . on the content and wording of the briefing. Follow standard test procedures and instructions as specified In my practice I have developed a in the tests’ user manuals. short generic briefing sheet for testing in a range of scenarios Be able to follow all test instructions/requirements for all types that I apply with test takers in of testing sessions including tests completed at a distance Forensic Settings. . from the Test Users, of using file/collateral information. Where appropriate, Assistant Test Users should: provide test takers with sufficient time to work through example test items; make careful checks to ensure proper use of the answer sheets and response procedures; explain any time limits and ensure that during the test silence is maintained to avoid distraction; make clear that once the test or timed subtest has begun no further questions can be answered; adhere strictly to test-specific instructions concerning pacing and timing; deal appropriately with any questions that arise without compromising the 108.7 8 Document 23 - 2 short scenarios describing accommodation of someone with a Borderline IQ in PCL-R Assessment and a history of psychotic episodes in WAIS IV assessment. I have included (page x) examples of my briefing sheets for test takers for: WASI II HCR-20 PCL-R Document 28 – A copy of my briefing sheet that I use with test takers in forensic settings for the following tests: WAIS IV MCMI III SPSI-R purpose of the test. 108.8 108.9 Module reference number Monitor behaviour before and during the test to identify any In my practice I have developed a issues or problems that may arise. short generic monitoring sheet for testing in a range of scenarios Appropriately monitor test takers before and during the that I apply with test takers in session to check they have appropriate presentation/capacity Forensic Settings. for the test. They should ensure that appropriate invigilation of the test session is maintained to identify test takers who are confused, not following test instructions, etc., and avoid issues such as cheating and recording information about the test. Assistant Test Users should observe and record any notable issues to help interpret data when it comes to report writing or feedback. They should be able to outline when it is appropriate to make arrangements for a re-schedule testing session and how this would be arranged/managed. Ensure that all necessary information has been logged and In my practice I have developed a recorded including details of any provisions that were made short generic check sheet for for any special needs. ensuring that all these matters are assured in every testing Ensure that the test takers’ personal details have been session recorded, together with relevant details of what assessment instruments were used, what accommodations were made for any special needs and whether accommodations met their needs. Record any other relevant information, such as any particular problems that arose during the session that might have affected a candidate’s performance. Evidence of how you have applied the standards described in the previous Module contents 9 Document 28, p.13-15 Test-specific protocols developed by myself to assure effective process for: WAIS IV SPSI-R PAI Document 16 - Three examples (anonymised) of this check sheet used in last 12 months in a forensic setting Reference (if applicable) - Please indicate where this column Module 4.109. Administering tests to one or more test takers, part 2: Forensic Practitioner Skill Module 109.1 This practical module covers the skills of developing rapport In my practice over the past 8 with test takers and conducting the test session and scoring in years I have administered tests in accordance with test guidelines. a range of situations with both groups and individuals. Care is Assistant Test Users should be able to demonstrate abilities taken to only begin testing when to build rapport with test takers and administer tests according rapport has been established, to the instructions in the manuals whether this is by using then to conduct the testing computers, paper formats, in face-to-face testing sessions, or session and the scoring in testing completed at a distance or conducting assessments accordance with the test from file/collateral information. guidelines. In the case of individual testing, the Assistant Test User should be able to: Evidence of how you have applied the standards Establish a satisfactory rapport with the test taker prior to the I maintain accurate records in all commencement of testing and maintain this throughout the my interactions with test takers session. and these reflect and refer to my application of this standard. Establish and maintain a suitable relationship with the test taker such that the test taker performs to an optimum level of performance but in so doing the Assistant Test User must ensure that standard instructions are used and that the test remains valid and reliable. 10 is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Documents 1-4 – In these reports I make reference where to building rapport and conducting the testing session and scoring in accordance with guidelines on the following pages and paragraphs. Reference (if applicable) - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Document 8, p.13 – 14 Anonymised report with demonstrating that I have attended to rapport with the test taker. 109.2 109.3 109.4 109.5 Prompt the test taker where appropriate in accordance with I maintain accurate records in all the test instructions and without invalidating the test item. my interactions with test takers and these reflect and refer to my Ensure that where it is appropriate the test taker’s questions application of this standard. about the test are answered in such a way as to ensure the test is not invalidated in any way. Where doubt exists the Assistant Test User should normally explain that a question cannot be answered because to do so would invalidate the test. Address the test takers concerns and perhaps reluctance Where this occurs I note it in regarding test completion in an appropriate manner, ensuring client records and on the testing the test is not invalidated, and ethical practice is maintained. form where appropriate. Ensure that where it is appropriate the test taker’s questions about the purpose of the tests, how the results will be used, who will see the results, and the impact of completion and non-completion in an honest and appropriately ethical manner, ensuring that the test is not invalidated. Use appropriately discreet scoring procedures so that the test In my practice I ensure that taker does not become unduly conscious of failure. scoring is done in manner that the test taker is unable to view Be able to score the test accurately whilst ensuring that test the process. takers are not given inappropriate sight of the scoring and are not unduly discouraged by any wrong answers. Follow discontinuation procedures in line with the guidelines I ensure that I have and do in the test manual while ensuring that the test taker does not comply with administration become disheartened through obvious failure. instructions regarding the discontinuation of subtests and Be compliant with test instructions regarding discontinuation. tests. If judgment is such that a test has to be curtailed before discontinuation point is reached the Assistant Test User must have and demonstrate a suitable rationale for this and make appropriate reference and attach suitable caution to results in 11 Documents 15-17 Examples of anonymised notes of testing sessions in a forensic setting for 3 occasions. Documents 15-17 Examples of anonymised notes of testing sessions in a forensic setting for 3 occasions. Document 31-34 Testing notes and anonymised scored testing sheets from aSARA and an HCR-20 V3, with contemporaneous notes. Document 30 Anonymised WASI II from 3 cases and in addition testing notes describing reasons for discontinuation where relevant. feedback. Module 109.6 109.7 109.8 In the case of testing at a distance, the Assistant Test User should be able to: Evidence of how you have applied the standards Ensure that test takers are sent the necessary information In my working context we do not and log in details in good time. use computer based tests. We also do not test at a distance as it Present test takers with clear explanations about the is important to observe that the purpose(s) of the assessment, how the data will be treated, test taker is actually the person privacy and confidentiality, and what provisions are available who completes the test. for letting the Test User know if internet access is a problem for the candidate. Ensure that test takers understand what is required of them In forensic settings I do not and what will be happen after completion of the assessment currently administer tests in and that they have a means of raising queries. unsupervised situations. If I did I would use a short generic Brief test takers in a way that establishes an appropriate monitoring sheet to guide me as I honesty contract with them and explains that scores obtained brief the test takers. in unsupervised situations may be checked later in the process. In the case of testing via file and/or collateral information, the In my practice I have developed a Assistant Test User should ensure the test takers understand short generic monitoring sheet for the processes that are being completed, the purposes of the testing in a range of scenarios assessment and that appropriate consent has been given. that I apply with test takers in 12 Reference (if applicable) - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 N/A Document 29 - Generic monitoring sheet that I would use if I administered tests in unsupervised situations Documents 16-18 - Three anonymised examples of the monitoring sheet I have used in cases Forensic Settings. Be able to outline the appropriate procedures that should be followed when assessments are made using file/collateral information. They should be able to brief the assesses in an appropriate manner and present clear explanations of the purpose(s) of the assessment, how the data will be collected/used, privacy and confidentiality, how the results will be used and who will see these etc. Module reference number Module 4.110 Maintaining security and confidentiality of the test materials and the test data: Forensic Practitioner Skill Evidence of how you have applied the standards described in the previous column Module contents This module covers the ethical use of tests and test data This aspect was covered within including storage, confidentiality and compliance with relevant DClinPsy teaching; ongoing legislation. adherence to internal confidentiality procedures and Assistant Test Users should be able to demonstrate clear national NHS IG procedures; understandings of the ethics of testing, ethical advice and support given to issues/practices specific to testing in forensic contexts and importance of security of test that they will act in an ethical manner. Assistant Test Users materials (e.g. saved within should be able to demonstrate their abilities to provide test ‘break-glass’ system) in Trust’s takers and other stakeholders, where appropriate, with clear development of an electronic information of how test results will be used and show how patient record system (consulting they will make suitable arrangements for the storage of test BPS guidelines); ensuring all materials, data and reports. tests are safely and securely stored – only accessible to psychologists; taking responsibility for ordering test materials within the department; ensuring supervision of newly 13 where an HCR-20 has been completed by using file / collateral information only., to demonstrate that I have met the standards regarding data collection of this type. Reference (if applicable) - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 Document 4 – Degree certificate qualified/trainee status staff is adequate and appropriate procedures are in place to ensure clinical safety; written reports where the level of test data expressed is modulated to the relevant context (e.g. in malingering assessments) My organisation is recognised under the DPA (Registration number: xxxxx). Module An Assistant Test User: Forensic Contexts should: 14 I have been compliant with these requirements over the past 8 years. I have attached a summary of protocols I have utilised regarding test storage and use. Document 12 – page 2 Summary of protocol used for test storage and use I have also considered in my practice the particular ethical aspects of testing in forensic contexts and have provided a short summary of the issues I have faced in my practice. Document 11 - My reflections on ethical issues arising which pertain particularly to Forensic Context testing Evidence of how you have applied the standards Reference - Please indicate where this is evidenced in your portfolio, e.g. Document 3, p.34, para 3-6 110.1 110.2 110.3 Ensure that best practice is followed in giving clear descriptions to the test taker(s), or relevant others, prior to the assessment concerning: how the results are to be used; who will be given access to them; what they will be used for; for how long they will be retained etc. In my practice I have developed a short generic briefing sheet for test takers covering the data handling process in my organisation that I apply with test takers in Forensic Settings to Ensure that test takers receive clear and appropriate obtain informed consent. I do not information about the use and storage of their test results and use computer based tests in my access to them, so that informed consent is obtained, either in forensic practice writing or by clicking consent on computer administration. In some cases consent may be required from relevant others, such as parents or guardians. Ensure that all test data are stored in accordance with current In my practice I have developed a legislation (and the need to update knowledge in line with short generic briefing sheet for legislative/guidance updates/developments) and test takers covering data handling local/organisation rules/policies and guidance; store data in a processes in my organisation that secure place and that access is not given to unauthorised I apply with test takers in personnel. Forensic Settings. I abide by these guidelines. Ensure understanding of relevant aspects of Privacy, Digital Rights Management and the Equal Opportunities Commission (EOC) Legislation in the country of use, rules/guidance/policies for relevant organisations, and test takers’ rights and need to update knowledge in line with legislative/guidance changes. Assistant Test Users must know how and where data is stored, if in a digital environment. If Assistant Test Users delegate some part of the process to others, they must be competent to exercise appropriate responsibilities. Ensure that all test materials are kept in a secure place that is All relevant testing materials are not accessible to people other than authorised Assistant/Test stored as per the agreed protocol Users. for my organisation. Ensure appropriate measures and processes are in place so 15 Document 12 - Briefing sheet regarding data handling protocol Document 12 - Briefing sheet regarding data handling protocol Documents 25-26 - Copy of the data storage and Information Assurance protocols (updated 2015) with which I abide. 110.4 that all paper-based test materials are stored securely and access to computer-based tests is restricted to authorised Test Users. Ensure that potential test takers are not provided with prior Test takers do not have access to access to test materials other than those specifically designed the test storage area in my to help test takers prepare for their assessments. organisation. I maintain sealed copies of the materials until the Ensure that where available, test takers are given access to testing commences and do not appropriate preparation materials but that security policies leave testing materials and procedures prevent test takers accessing actual test unattended in the presence of the materials prior to testing. test taker.. 16 Documents 25-26 - Copy of the data storage and Information Assurance protocols (updated 2015) with which I abide.