Chapter 5 – Assessment Overview Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Assessment is the basis of the classification system The classification of phenomena into categories (e.g. anxiety disorders) is a central feature of all science Assessment is a process by which we collect the information that enables us to classify into such categories There are many examples of the processes of assessment and classification, e.g. In the school system, in the workplace, in clinical settings Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Psychological Assessment An iterative process Systematic Information about the person’s physical, social, and cultural environments Refining the question at hand before responding to a question or a goal of the assessment Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Psychological Assessment Overview We all constantly engage in assessment everyday Often it is an automatic activity that enables us to make small or big decisions Data such as facial expression, tone of voice, previous experience, or our own emotional state affect our assessment Psychological assessment is an iterative process, that is, repetitive and changeable Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Goals of Psychological Assessment Determining whether a child is eligible for special services Identifying relevant behaviors that can be the basis for an intervention plan Determining the extent to which a given behavior fits into the categorization of a mental disorder Determining if a person who committed a crime is legally insane Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Psychological Assessment Generating and refining hypotheses Importance of being informed about human diversity – Age – Gender – Sexual orientation – Culture – Religious beliefs – etc Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Competencies in Psychological Assessment Knowledge of: – psychometric theory – the scientific, theoretical, empirical, and contextual bases of assessment Knowledge, skills, and techniques to assess: cognitive, affective, behavioral, and personality Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Competencies in Psychological Assessment Ability to: – assess intervention outcomes – evaluate multiple roles that clients and psychologists function Understanding of the relation between assessment and intervention and intervention planning Technical assessment skills, including problem/goal identification and case conceptualization Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Assessment focused vs. Intervention focused Assessment-focused services: Information provided that addresses a person’s current or anticipated psychosocial deficits – E.g., child custody evaluations – Learning disabilities to identify strengths and weaknesses – Neuropsychological assessment to evaluate impairment after an accident Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Cont-d Assessment –focused services aim at providing information that can be used to address a person’s current or anticipated psychological deficits. Referral factors- that is- who initiated the assessment- are very important as they may influence the extent to which a person may want to cooperate with the assessment, Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Intervention-focused services: The first step in gathering information about appropriate treatment – E.g., Intake evaluation at a clinic – Whether a psychological intervention is warranted at all Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Additional Assessment Types Screening: A tool often developed to identify a disorder, condition or characteristic in a group of people, depending on the site – E.g., A measure that identifies mental health problems in adolescents – National screening days e.g. alcohol, depression Diagnosis/Case Formulation: The development of an understanding of the basis/etiology of the problem that informs treatment – E.g., early stages of therapy Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Diagnosis/Case Formulation Assessment data are used to compare the assessment findings with the DSM-5 criteria for diagnosis to determine eligibility for the diagnosis. Diagnosis is important for: _ Communication among professionals _ Identifying treatment options _ Asses etiology and prognosis The term Case Formulation is currently used to describe the comprehensive conceptualization of the person’s psychological functioning. Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Additional Assessment Types Prognosis/Prediction: An assessment used to see whether a problem will worsen without treatment – E.g., Whether one needs therapy for a given problem – Prediction errors – unfortunately common in clinical psychology – Base rate – frequency of a problem in the general population; The more cases, the better is the ability to predict Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Additional Assessment Types Prognosis/Prediction (cont): –Sensitivity – the number of times an event is predicted across cases compared to the total number of times the event actually occurs –That is: the proportion of “true positives” –Sensitivity of the assessment is determined by dividing the number of true positives (e.g. the number of children that were assessed as ADHD and later found to shown ADHD behaviors) by the combined number of all children assessed, true positive (see above0 and false negative (they were assessed as NOT ADHD whereas later found to be ADHD. Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Cont-d –Specificity – the number of times a nonevent is predicted across cases compared to the actual number of non-events Prediction Event Event (B) Non-Event (D) True Event True Non- True Positives (A) False Positives False Negatives (C) True Negatives Sensitivity: A / (A + C) Specificity: D / (D + B) Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Treatment Planning In treatment planning information about the client's context is used in combination with the scientific literature on psychotherapy to decide about a course of action that would benefit the client The plan establishes a standard against which treatment progress can be measured A formal treatment plan is the basis for the client’s informed consent for the procedures Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Treatment Planning (cont-d) The first step is to determine whether there are treatment options with established effectiveness for the types of problems the client presents Also the extent to which the characteristics of the client match those of the research participants in the relevant clinical trials Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. A Treatment Plan It must cover 3 general areas: 1. Problem identification 2. Treatment goals 3. Treatment strategies and tactics Goals can be long term and also immediate, short-term (such as stopping a self-injurious behavior) Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Treatment Monitoring This is a crucial element in assessing the success of the intervention It provides an opportunity to modify the treatment plan if needed Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Psychological Testing Psychological testing: A sample of a person’s behavior scored in a standardized process – Not the same as psychological assessment (which is often more multi-faceted and may not use tests per se) Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Psychological Testing: Important Concepts Standardization: Consistency across clinicians in the procedure used to administer and score a test Reliability: A measure of the consistency of the test – Internal consistency: whether all aspects of the test contribute meaningfully – Test-retest reliability: whether similar results would be obtained at 2 time points – Inter-rater reliability: whether similar results would be found by several raters Psychological Testing: Important Concepts Validity: whether a test measures what it is supposed to measure – Content validity: whether the test measures all aspects of the construct – Concurrent and predictive validity: whether the test data are consistent with other related constructs – Discriminant validity: whether the test is not measuring unrelated constructs – Incremental validity: whether the measure adds to other sources of data Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Psychological Testing: Important Concepts Norms: using a large sample to determine cut off scores on a test – Representative sample: importance of using a sample that matches the population – Percentile rank: percentage of those in the normative group that fell below a given test score Evidence-based assessment: using theory and research to guide the process of assessment Copyright © 2014 John Wiley & Sons, Inc. All rights reserved. Psychological Testing: Important Concepts Online testing: not the same as a psychological assessment – Research using standard tools: appears to be similar to traditional in person assessment Growing research work on internet assessment prior to individual meetings – Smith et al. (2011) -example of clinic use of instruments prior to initial visit Copyright © 2014 John Wiley & Sons, Inc. All rights reserved.