GORT-4 Gray Oral Reading Test What is the GORT: The GORT is a norm-referenced, reliable and valid test of oral reading rate, accuracy, fluency and comprehension. What is its purpose: Identify student with problems. Determine strengths and weaknesses. Document progress. Conduct research. Who is it used for: The GORT should only be used on individuals ages 6-18. It can be used on students 1st through 12th grade. The GORT is nonbiased, can be used on any gender, race and ethnicity. Norming: Sample Selection Procedures: The GORT was normed on a sample of 1,677 persons in 28 states. Standardized sites were selected in each of the four major geographic regions as designated by the U.S Bureau of the Census. A site coordinator was selected for each location to supervise test administration. All students tested attended general classes. Students with disabilities who were enrolled in general classes were included in the normative sample. Several hundred students in grades 1st through 12th were tested at each major site. Demographic Characteristics of the Sample: The characteristics of the sample were with regard to geographic region, gender, race, rural or urban residence, ethnicity, family income, educational attainment of parents and disability. To further demonstrate the representativeness of the sample, the following demographic categories were stratified by age: geographic region, gender, race, ethnicity, parental income and parental education. Equating Procedures: The GORT provides examiners with two forms of the test, which contain different reading passages to diminish the effects of practice. The two forms of the GORT were equated using a linear equating procedure. This method was chosen for three reasons: 1. Each examinee took both forms of the test. 2. The distribution of raw scores was nearly equivalent for both forms. 3. One form was not uniformly more difficult than the other. Have to use an equation to even out the scores. Normative Scores: Standard Score for the Subtest and Composite o Norms for the GORT subtests are presented in terms of standard scores having a mean of 10 and a standard deviation of 3. o This method uses polynomial regression to fit the progression of means, standard deviation, skewness, and kurtosis across age groups (6-0 through 18-11) o These fitted values were estimated at each 6 month age interval. o The resulting data across age levels were smoothed somewhat to allow for a consistent progression across age levels. o The standard score that corresponds to the Oral Reading Quotient was calculated by applying Guilford and Fruchter’s procedure for pooling variances. o This formula is used to pool the standard scores from fluency and comprehension, which make up the quotient. o The quotient has a mean of 100 and a standard deviation of 15. Percentiles o Examiners locate the student’s raw score in the appropriate table and then locate the corresponding percentile in the left-hand column. Age and Grade Equivalents o These values indicate the age or grade level that corresponds to a raw or converted score made by a student on one of the GORT subtests. o The average scores of all students in each school grade or age level between 1st and 12th grade were computed and plotted on a graph that had raw or converted scores on the x-axis and grade levels or age in months on the y-axis. Conversion Scores o The fluency score is used as a simple, uniform criterion for determining basals and ceilings throughout the test that is unaffected by the increasing length of the passages as they become more difficult. o The values that represent the fastest and most accurate readers in the top 25% (100-76%) were given a converted score of 5, the next quarter readers in the top 25% (75-51%) were given a converted score of 4, and the third quarter (50-26%) were given a converted score of 3. o The bottom quarter was given three separate values: scores representing 25-16% of the sample were given a converted score of 2, 15% through 6% were assigned 1 and values attained less than 6% of the sample were converted to 0. Cautions of the test: The GORT provides examiners with two forms of the test which contain different reading passages to diminish the effects of practice. No matter how carefully the reading passages have been controlled to be of equal difficulty, one form of the test will be somewhat more difficult than the other form. How the test works: Time Can be given in about 15-45 minutes, depending on the student’s reading ability. Best if given in one session, two sessions are sometimes required if reader becomes fatigued or uncooperative. Forms of the Test Form A Form B The two forms of the GORT were equated using a linear equating procedure. Only one form needs to be given. Starting Points Grades 1 and 2 start at story 1 Grades 3 and 5 start at story 3 Grades 5-8 start at story 5 Grades 9-12 start at story 9 Prompting and Timing The Reader Open both the profile/examiner record booklet and the student’s book to the first story that is to be read by the student. Have a stopwatch at hand. Read aloud the prompt found above the story in the profile/examiner record booklet. Point to the start of the story and say begin. Start timer and follow along as the student reads the story. When the reader is done reading the passage, stop the timer and record the number of seconds the student took to read the story in the space marked “Time (in seconds)”. Marking Deviations From Print Deviations may be marked in one of two ways in the profile/examiner record booklet. 1. A simple slash marking system. 2. A separate marking system for a miscue analysis. Slash marking system o Record each deviation within the story. o Place a slash (/) using the criteria that follows. o Place a slash on each word that is not read correctly. o Place a slash on the word if the student pauses for word providing. That is, if a student pauses for 5 seconds without making an audible attempt to read a word. o If the student attempts to sound out the word, give him or her 10 seconds to decode; then say the word, mark the deviation and continue. o For self-corrections, place a slash on the gap before the word corrected. o If the student reads, “Jon is a really neat and good boy”. Place a slash between the word where the addition is made: Jon is a / good boy. o For repetitions, place a slash after the word repeated. o If the reader skips a line, stop the timer, direct the student’s attention to the correct line and begin timing when the first word is said. This is scored as one deviation. o After a student completes a story, sum the number of slashes. o Record this total below each passage in the profile/examiner record booklet, on the line labeled, “Deviations from print”. Miscue Marking System o A more in-depth analysis can be done by supplementing the slash marking system by writing down each specific oral substitution miscue made by the student. o Self-corrections are noted by writing the miscue and an arrow (=>) pointing to the text word that was corrected. Determining Rate, Accuracy and Fluency Scores Under each story in the profile/examiner record booklet is a conversion table. The top row of the table is a 0-5 point conversion scare, each number having its own column. The second row contains the reading time values. To convert time to a rate score, simply find in the time row the time is seconds it took the student to read the story. The third row contains the deviations from print values. To convert deviations from print to an accuracy score, match the number of miscues made by the reader to its corresponding number in the column. Fluency score is derived by simply summing the rate and accuracy score for each story. Determining Comprehension Score The examiner reads the comprehension questions. As you read aloud the questions and response choices the student follows along in the student book. Students are not allowed to return to the passage to scan for the answers to the questions. Examiner reads everything that is in red. If the reader correctly answers the question, place a (1) in the space next to the item number on the profile/examiner record booklet. If they answer incorrectly, place a (0) in that space. After all questions have been administered, count the number of correct answers and record the sum in the comprehension score box at the end of the questions. Counting and Recording Specific Types of Miscues To use their system, examiners must analyze the student’s miscues on at least two different stories. A minimum of 25 miscues must be analyzed. The examiner’s worksheet in Section V of the profile/examiner record booklet is used to classify the reader’s miscues. A (1) is placed in the appropriate box on the right side of the worksheet to note that a miscue fits a particular category. A (0) is placed in the box if the miscue does not fit the category. Meaning Similarity o The examiner assesses meaning similarity to determine the extent of the student’s use of comprehension strategies in reading. Function Similarity o The examiner assesses function similarity to judge the extent to which the student uses appropriate grammar in reading. Graphic/Phonemic Similarity o The examiner decides whether the miscue has similar affixes, root and vowel sounds or consonant sounds. Multiple Sources o The examiner marks the multiple sources box for those miscues that fit more than one category to derive information about the student’s use of multiple reading strategies. Self-Correction o The examiner assesses self-correction to determine the extent to which the student uses strategies to correct miscues. Calculation Miscues o Once all miscues have been categorized sum the points and write the totals at the bottom of the appropriate columns in section V of the profile/examiner record booklet. Observing Reading Behaviors Space is provided in section VI of the profile/examiner record booklet to record other types of miscues and general impressions and observations of reading behaviors. How to determine basal and ceiling: Basal and Ceiling Only fluency and comprehension scores are used to determine basal and ceiling. To achieve a basal for the comprehension score, the examiner tests until the student misses at least three of five comprehension questions for one story (the ceiling) or until the final story is read. Once a ceiling is reached, the examiner goes back and establishes a basal if one has not been established on the way to reaching the ceiling. The basal is the point at which the student correctly answered all five questions for a story in reaching the ceiling, the examiner returns to the entry level (the first story that was read) and tests downward until a basal is achieved or until the first story has been read. What materials are needed: Stopwatch Examiner’s manual Student book Form A or B, whichever one you will be giving Pen or pencil Test Interpretation: Derived Scores The rate score and accuracy score are both derived using the converting time and deviations from print to rate and accuracy conversion table. In the conversion table, the top column is used to convert the time into the rate score. The bottom column is the deviation from print row, the deviations from print is used to convert into an accuracy score. The rate score is a score determined by the amount of time (in seconds) it took for the student to read one particular passage. The examiner can use the conversion table to find the amount of time it took for the student to read the passage and correlate it with the number located a row above to find the correct score. The derived accuracy score is also found using the conversion table. o The examiner counts the number of deviations the student had for the same particular passage and locates that number in the conversion chart. o At the top of the column where the deviation amount was found, will be a number. That number is the accuracy score. Once the rate and accuracy scores have been calculated, the fluency rate can be found by simply adding the rate and accuracy scores together. How to interpret results Scoring is broken into four main categories for this test. Time, deviations from print, comprehension score and converting time and deviations from print to rate and accuracy. Time: o Time is tracked in seconds; this score refers to the amount of time it takes for the student to read each story. Deviations from print: o The deviation from print score is a score calculated by the number of errors the student makes while reading the text. o Any time the student makes an alteration to a word, it is marked as one deviation. Comprehension score: o At the end of each story read, there are five comprehension questions asked. The student is given a score 0-5 by adding the number of correct answers together. Converting time and deviations from print to rate and accuracy. o For this score, time (in seconds) gets converted into a rate score and the deviations from print get converted into an accuracy score. o By adding the rate and accuracy score together a fluency score is calculated. Standard score o The standard score is found by using the total score (number correct) on a distribution with a mean of 1- and a standard deviation of 3 for each one of the three categories. o If a student scores 8 or above, that individual is considered to be average or above average. Percentile rank o Percentile rank is based on a score of 1-99. o If a student receives a percentile rank of 65, this means that 65% of their comparable peers scored the same or below. Age/Grade equivalent o This method is the least popular because the results are often misleading. o This score is calculated by using the normative group score at each age and grade level. The Results: The main purpose of the GORT is to identify individuals who are struggling with reading proficiency. By comparing a student’s oral reading ability to that of their peers, can help determine if a reading deficit is present. The GORT is also an excellent tool to identify a student’s strengths and weaknesses as a reader. Scores such as, rate, accuracy, fluency and comprehension can give administration an idea of how a student is doing and if help is needed. The results of the test are also very important for documentation purposes. If a child is struggling and needs an education plan, the GORT is a great source for tracking how a student is doing. The results of the GORT can lead to a diagnosis of a student’s reading problem and can also identify a student’s overall reading ability and skill. Psychometrics: Reliability Reliability is the amount of consistency that a test measures ability. The GORT is considered to have a high degree of reliability. There are three types of reliability that are looked at before determining how reliable a test is; content sampling, test-retest and scorer differences. o The GORT scored high in reliability across all three categories. There is a very low level of standard error of measurement when looking at the results of the GORT. o A low test error can give the examiner confidence that the results are reliable. When making a decision about an individual’s education, an assessment should have a test reliability score of .90 or above. o The GORT reliability numbers round to or exceed this expectation. Validity Validity is the amount of confidence we have that the rest is measuring what it is supposed to be measuring. The GORT is a valid way to measure an individual’s reading performance and this test can be used with confidence. To measure tests validity three categories should be assessed; content description, criterion prediction and construct identification. The content of the GORT is specifically chosen to be sure to meet the expectations of what the GORT is asking. The words and sequencing used in the stories throughout the GORT are written in such a way that will be normative across ages and demographics. The validity of the test grows with research done on about the test overtime. The results of the GORT are valid throughout subgroups and the general population. There have been multiple studies conducted on the GORT-R, GORT-3 and now the GORT-4. These studies show a high amount of test validity. Overall Quality of the GORT The overall quality of the GORT-4 is high; it is an effective way to measure an individual’s strength or weakness in reading. The GORT can be an objective way to help diagnosis a student’s reading difficulties and to monitor the growth of reading comprehension. Conclusion: Thoughts on the GORT The GORT is a reliable test to give students. It is easy to learn how to give the GORT. The test does not take much time to give so it won’t interfere with the student’s learning. It allows many different age groups and subgroups to be tested. Alternative tests that can be used Gray Silent Reading Tests (GDRT) Gray Diagnostic Reading Tests – Second Edition.