This report contains the results of studies conducted to measure the effectiveness of the PACE and Master the Code cognitive learning systems between 1995 and 2001. The research data is representative of the results obtained by providers located in over one hundred locations across the country. The SkillsRx and ReadRx cognitive training systems utilized by LearningRx are enhanced versions of PACE and Master the Code. STUDIES USING PACE AND MASTER THE CODE 2001 Studies The data presented in Charts 1 & 2 were collected via a pretest using the Gibson Cognitive Test Battery (GCTB) and a post-test using the same battery. Post-test scores were collected following 36 hours (over a 12-week period) of PACE (Processing and Cognitive Enhancement) training. Results are from 113 locations. CHART 1: Change in years when pre-test was two or more years below age level. 6.9 7 6 Processing Speed Change in Years 5 3.9 3.7 Working Memory Visual Processing 4 2.8 3 2.2 Word Attack Auditory Analysis 2.3 Logic & Reasoning 2 1 0 1 CHART 2: Change in years when pre-test was below age (regardless of number of years below age). 6.7 7 6 Processing Speed 5 Change in Years Working Memory 3.5 3.4 4 2.7 Word Attack Auditory Analysis 2.2 3 Visual Processing Logic & Reasoning 1.8 2 1 0 2 The data presented in Charts 3 & 4 were collected via a pre-test using the Detroit Tests of Learning Aptitude (DTLA-3) and a post-test using the same battery. Post-test scores were collected following 36 hours (over a 12-week period) of PACE (Processing and Cognitive Enhancement) training. CHART 3: Change in years when pre-test was two or more years below age level. Long-term Memory (DTLA-3 DS) 5.3 6 Logic & Reasoning (DTLA-3 SR) 5 Comprehension (DTLA-3 SS) 3.9 3.6 Visual-Motor (DTLA-3 DR) 3.3 4 Change in Years Short-term Memory/Attention (DTLA-3 SI) Visual Processing (DTLA-3 PF) 3 1.9 1.8 2 1 0 DS= Design Sequences; SI= Sentence Imitation; PF= Picture Fragment; SR= Symbolic Relations; SS= Story Sequences; DR= Design Reproduction CHART 4: Change in years when pre-test was below age (regardless of number of years below age) Long-term Memory (DTLA-3 DS) Short-term Memory/Attention (DTLA-3 SI) 4.6 5 Logic & Reasoning (DTLA-3 SR) 3.9 4.5 Visual Processing (DTLA-3 PF) Comprehension (DTLA-3 SS) 4 3.4 Visual-Motor (DTLA-3 DR) 3 Change in Years 3.5 3 2.5 1.9 1.7 2 1.5 1 0.5 0 DS= Design Sequences; SI= Sentence Imitation; PF= Picture Fragment; SR= Symbolic Relations; SS= Story Sequences; DR= Design Reproduction 3 The data presented in Charts 5 & 6 were collected via a pretest using the WoodcockJohnson Test of Cognitive Ability (WJ-R) and a post-test using the same battery. Posttest scores were collected following 36 hours (over a 12-week period) of PACE (Processing and Cognitive Enhancement) training. CHART 5: Change in years when pre-test was two or more years below age level. 8 8 7 5.9 5.5 Long-term Memory (TN) Short-term Memory (MS) Processing Speed (VM) Auditory Processing (IW) Visual Processing VC) Change in Years 6 5 4 2.9 3 1.7 2 1 0 MS= Memory for Sentences; VM= Visual Matching; IW= Incomplete Words; VC= Visual Closure CHART 6: Change in years when pre-test was below age (regardless of number of years below age) 6.6 7 5.2 6 5.2 Long-term Memory (TN) Short-term Memory (MS) Processing Speed (VM) Auditory Processing (IW) Visual Processing VC) Change in Years 5 4 2.9 3 2 1.4 1 0 MS= Memory for Sentences; VM= Visual Matching; IW= Incomplete Words; VC= Visual Closure 4 The data presented in Charts 7 & 8 were collected using a number of different Cognitive tests batteries, including the Gibson Cognitive Test Battery (GCTB), Woodcock-Johnson Reading Mastery Test (WRMT), or the Lindamood Auditory Conceptualization Test (LACT). All pre and post-tests were conducted using the same battery. Post-test scores were collected following 36 hours (over a 12-week period) of PACE (Processing and Cognitive Enhancement) Training. CHART 7: Change in years when pre-test was two or more years below age. 6.1 Selective Attention (GCTB) 7 Visual Auditory Processing (WRMT) 6 Lindamood Auditory Conceptualization Test (LACT) Change in Years 5 3.4 4 2.7 3 2 1 0 CHART 8: Change in years when pre-test was below age (regardless of number of years below age). 5.6 Selective Attention (GCTB) 6 Visual Auditory Processing (WRMT) Lindamood Auditory Conceptualization Test (LACT) 5 Change in Years 3.4 4 2.3 3 2 1 0 5 The data presented in Charts 9 & 10 were collected using a number of different Cognitive tests batteries, including the Gibson Cognitive Test Battery (GCTB), Woodcock-Johnson Reading Mastery Test (WRMT), Lindamood Auditory Conceptualization Test (LACT) or the Detroit Tests of Learning Aptitude. All pre and post-tests were conducted using the same battery. Post-test scores were collected following approximately 19 sessions (over approximately a 6-week period) of Master The Code (MTC) training that was given in conjunction with PACE. CHART 9: Change in years when pre-test was two or more years below age level. 9.8 10.0 9.0 Word Attack (GCTB) 8.0 Auditory Analysis (GCTB) 6.3 Change in Years 7.0 6.0 6.0 5.1 Logic & Reasoning (GCTB) Visual Auditory Learning (WRMT) 5.1 Word Attack (WRMT) 4.3 5.0 Passage Comprehension (WRMT) 3.4 4.0 3.0 Lindamood Auditory Conceptualization Test (LACT) Comprehension (DTLA-3 SS) 3.0 2.0 1.0 0.0 SS= Story Sequences CHART 10: Change in years when pre-test was below age (regardless of number of years below age). 9.8 10 9 Word Attack (GCTB) 8 6.8 Auditory Analysis (GCTB) Change in Years 7 Logic & Reasoning (GCTB) 5.3 6 5 4.8 4.5 4.1 3.9 Visual Auditory Learning (WRMT) Word Attack (WRMT) Passage Comprehension (WRMT) 4 2.7 Lindamood Auditory Conceptualization Test (LACT) Comprehension (DTLA-3 SS) 3 2 1 0 SS= Story Sequencing 6 1997 Study: The data in Charts11, 12, & 13 reflect pre and post-test data collected using the Detroit Tests of Learning Aptitude (DTLA-3). The post-test was administered after 30 hours of PACE training over a 10-week period. CHART 11: Change in years on a specific skill on the DTLA-3 test battery when the student was two or more years below age for that skill. 5.66 6 5 3.98 3.73 4 Change in Years 3.32 3.08 2.98 3 2.48 2.31 2.01 2 Long-term Memory (DS) Short-term Memory/Attention (SI) Processing Speed/Attention (VM) Auditory Processing (LACT) Visual Processing - Closure (PF) Logic & Reasoning (SR) Comprehension (SS) Visual - Motor (DR) Selective Attention (VT) 1 0 DS= Design Sequences; SI= Sentence Imitation; VM= Visual Memory, letters; LACT= Lindamood Auditory Conceptualization Test; PF= Picture Fragment; SR= Symbolic Relations; SS= Story Sequences; DR= Design Reproduction; VT= Visual Tracking CHART 12: Change in years on a specific skill on the DTLA-3 test battery when the student was below age for that skill (regardless of number of years below age). 4.32 4.34 4.5 4 3.38 3.5 3.11 3.09 Change in Years 3 2.50 2.15 2.5 1.88 2 1.61 1.5 1 0.5 0 7 Long-term Memory (DS) Short-term Memory/Attention (SI) Processing Speed/Attention (VM) Auditory Processing (LACT) Visual Processing - Closure (PF) Logic & Reasoning (SR) Comprehension (SS) Visual - Motor (DR) Selective Attention (VT) DS= Design Sequences; SI= Sentence Imitation; VM= Visual Memory, letters; LACT= Lindamood Auditory Conceptualization Test; PF= Picture Fragment; SR= Symbolic Relations; SS= Story Sequences; DR= Design Reproduction; VT= Visual Tracking CHART 13: Combined average (using two or more tests) change in years in a cognitive skill area when the pre-test score on the appropriate subtests of the DTLA-3 were two or more years below age. 3.78 4 3.29 3.5 2.87 3 2.46 Processing Speed Attention Visual Processing Memory Auditory Processing Change in Years 2.14 2.5 2 1.5 1 0.5 0 8 1996 Study: The study reported in Chart 14 reflects data collected on both children and adults in a clinical setting. Change in IQ scores were measured before and after receiving 30 hours of PACE training spread over a 10-week period. The TONI-2 is a test of nonverbal intelligence, which measures the ability to reason without words and to solve spatially defined problems. An IQ of 100 is considered normal. CHART 14. Change in IQ scores when the pretest nonverbal intelligence quotient was less than or equal to 100 and when the pretest nonverbal intelligence quotient was greater than 100. 28.15 30 Change in Years 25 <= 100 >= 100 20 15 9.89 10 5 0 9 The studies reported in Charts 15 -17 reflect data collected on both children and adults in a clinical setting. A series of subtests from the Woodcock Johnson Test of Cognitive Ability (WJ-R), Structure of Intelligence-Learning Abilities Test (SOI-LA), Gardner Test, and Gibson Cognitive Test Battery (GCTB) were given as a pre-test and the posttest consisted of the same tests given after 30 hours of PACE training over a 10-week period. CHART 15: Change in years in a cognitive skill area as measured by the Woodcock Johnson Test of Cognitive Ability when the pre-test score was two or more years below age level. 4.67 5.00 4.26 4.50 3.82 Change in Years 4.00 3.47 3.50 3.00 2.65 3.18 3.00 2.86 3.00 3.04 2.51 2.50 2.00 1.50 1.00 0.50 0.00 Processing Speed (fixv - GCTB?) Attention/Processing Speed (trck - GCTB?) Visual Processing/Memory (rfrq - Gardner) Visual Processing (Closure; cfu-SOI-LA) Short-term Memory/Attention (stvm-SOI-LA) Logic & Reasoning (logc-SOI-LA) Processing Speed (fixh - GCTB?) Attention/Processing Speed (wj3 - WJ-R) Visual Processing (visualization; visz-SOI-LA) Visual Processing (Manupliation; efu-SOI-LA) Visual-Motor (vmtr-SOI-LA) Fixv= calling out vertical column of numbers; fixh= calling out horizontal row of numbers; trck= tracking a line with other lines present; WJ3= Visual Matching from Woodcock Johnson Cognitive Test Battery; rfrq= reversal frequency test from Gardner; Visz= pictures set of ideas in the mind; cfu= visual closure; efu= evaluate and discriminate among complex figures; stvm= short-term visual memory; vmtr= eye-hand coordination; logc= logic 10 CHART 16: Change in years in a cognitive skill area when the pre-test score was below age level (regardless of number of years below age level). 4.17 4.50 3.64 4.00 Change in Years 3.00 3.26 3.10 3.50 2.85 2.28 2.50 2.79 2.93 2.81 2.13 1.81 2.00 1.50 1.00 0.50 0.00 Processing Speed (fixv - GCTB?) Attention/Processing Speed (trck - GCTB?) Visual Processing/Memory (rfrq - Gardner) Visual Processing (Closure; cfu-SOI-LA) Short-term Memory/Attention (stvm-SOI-LA) Logic & Reasoning (logc-SOI-LA) Processing Speed (fixh - GCTB?) Attention/Processing Speed (wj3 - WJ-R) Visual Processing (visualization; visz-SOI-LA) Visual Processing (Manupliation; efu-SOI-LA) Visual-Motor (vmtr-SOI-LA) Fixv= calling out vertical column of numbers; fixh= calling out horizontal row of numbers; trck= tracking a line with other lines present; WJ3= Visual Matching from Woodcock Johnson Cognitive Test Battery; rfrq= reversal frequency test from Gardner; Visz= pictures set of ideas in the mind; cfu= visual closure; efu= evaluate and discriminate among complex figures; stvm= short-term visual memory; vmtr= eye-hand coordination; logc= logic CHART 17: Combined average (using two or more tests) change in years in a cognitive skill area when the pre-test was two or more years below age level. 3.684 3.7 Attention Visual Processing Memory 3.6 Change in Years 3.5 3.4 3.3 3.162 3.141 3.2 3.1 3 2.9 2.8 11 1995-1996 Studies: The data in the studies reported in Charts 18-30 were collected from individual practitioner’s offices in the United States and Canada. Various test batteries were administered to show changes from pre to post-test-results, including the TONI-2 (test of nonverbal intelligence), the NSI (a subtest from the Structure of Intelligence-Learning Abilities Test (SOI-LA)), a modified Groffman Tracking Test, and the Woodcock Johnson Cognitive Test battery. Changes in scores from pre to post-test were measured after 30 hours of PACE training over a 10-week period. In those studies that used a control group, the control group received no PACE training for the 10-week period. CHART 18: Change in IQ scores when the pretest nonverbal intelligence quotient (TONI-2) was less than 100. 42 45 40 35 26 Change in Years 30 22 23 22 25 20 12 15 10 5 0 12 23 23 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland CHART 19: Change in IQ scores when the pretest nonverbal intelligence quotient (TONI-2) was equal to or greater than 100. 19 20 18 14 16 Change in Years 14 12 10 12 9 8 10 8 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland 6 3 4 1 2 0 CHART 20: Change in IQ when the pre-test score on the NSI (logic and reasoning) subtest of the Structure of Intelligence-Learning Abilities Test (SOI-LA) was 2 years or more below age level. 7 6.2 5.5 5.5 6 4.8 4.6 4.6 Change in Years 5 4.1 3.8 4 3 2 1 0 13 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland CHART 21: This represents the overall change in processing and cognitive skills when the pre-test scores were two or more years below age level. 4.6 5.0 4.5 4.0 3.8 3.7 4.0 3.6 3.5 3.6 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland Change in Years 3.5 3.0 2.5 2.0 2.0 1.5 1.0 0.5 0.0 CHART 22: This represents the average change in attention when the pre-test scores on the modified Groffman Tracking Test and the Visual Matching subtest of the Woodcock Johnson Cognitive Test Battery were two or more years below age level. 4.6 5.0 4.2 4.1 4.5 4.1 3.8 3.5 4.0 3.1 Change in Years 3.5 2.6 3.0 2.5 2.0 1.5 1.0 0.5 0.0 14 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland CHART 23: Average change in processing speed when the pre-test scores were two or more years below age level. 3.7 4.0 3.8 3.6 3.3 3.5 3.3 3.1 Change in Years 3.0 2.6 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland 2.5 1.7 2.0 1.5 1.0 0.5 0.0 CHART 24: Average change in visual processing when the pre-test scores were two or more years below age level. 4.4 4.5 3.8 4.0 3.2 3.5 3.0 2.7 Change in Years 3.0 2.4 2.5 2.0 2.0 1.5 1.0 0.5 0.0 15 2.6 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland CHART 25: Change in short-term visual memory when the pre-test score on the shortterm visual memory subtest of the Structure of Intelligence-Learning Abilities Test (SOILA) was two or more years below age level. 4.7 5.0 4.3 4.5 3.7 4.0 3.3 Change in Years 3.5 3.1 3.0 2.9 3.0 2.5 1.5 2.0 New York Ontario Georgia Montana North Dakota Tennessee Idaho Maryland 1.5 1.0 0.5 0.0 CHART 26: Change in comprehension as measured by subtests of the Structure of Intelligence-Learning Abilities Test (SOI-LA). 2.6 2.6 CMR (ability to see relations between words) CMU (vocab & verbal concepts) 2.5 ESC (ability to classify symbolic information) Change in Years 2.4 2.3 2.2 2.2 2.2 2.1 2 16 CHART 27: Changes in grade for four students as measured by the Woodcock Johnson Test of Cognitive Ability. 16 14.6 14 13.7 12.6 12.3 12.1 11.8 Change in Years 12 11.1 10.9 9.5 10 8.1 8 6.9 6.6 6 4.9 3.7 4 2 0 5.4 5.1 3.2 1.5 1.2 0.9 0 0 1.1 0 17 Long-term Memory Short-term Memory Processing Speed Sound Blending Visual Closure Visual Recognition CHART 28: Change in years in cognitive skill areas for students undergoing PACE training versus students receiving no special training in a clinical trial in Indiana. 2.8 3.0 Processing Speed (fixv) 2.6 Processing Speed (fixh) 2.4 2.3 2.5 2.0 Letter Reversal Frequency (RF) 1.9 2.0 Change in Years Processing Speed/Selective Attention (PS/SA) Short-term Memory (measured by SOI-LA) 1.7 1.6 Visualization (visz from SOI-LA) Logic & Reasoning (NSI from SOI-LA) 1.5 Eye-hand Coord (vmtr from SOI-LA) 0.9 1.0 0.5 0.3 0.5 0.2 0.0 0.0 0.0 -0.5 -1.0 -1.0 -1.0 Fixv= calling out vertical column of numbers; fixh= calling out horizontal row of numbers; Visz= pictures set of ideas in the mind; NSI= logic and reasoning; vmtr= eye-hand coordination; logc= logic CHART 29: Change in years in cognitive skill areas for students undergoing PACE training versus students receiving no special training in a clinical trial in Illinois. 4.0 3.6 3.6 3.7 Processing Speed (fixv) 3.5 Processing Speed (fixh) 2.8 3.0 2.9 Processing Speed/Selective Attention (PS/SA) Change in Years Letter Reversal Frequency (RF) Short-term Memory (measured by SOI-LA) 2.5 2.0 2.1 1.8 Visualization (visz from SOI-LA) Logic & Reasoning (NSI from SOI-LA) 1.7 Eye-hand Coord (vmtr from SOI-LA) 1.5 1.0 0.7 0.3 0.5 0.0 0.0 0.1 0.0 0.0 0.1 0.0 Fixv= calling out vertical column of numbers; fixh= calling out horizontal row of numbers; Visz= pictures set of ideas in the mind; NSI= logic and reasoning; vmtr= eye-hand coordination; logc= logic 18