Journal of Forensic Vocationology Vol. 7 (1) Monograph [Note from the Editors: Permission to Reprint this Monograph of selected materials from JOFV Volume 7(1), Fall 2002, © 2002 by Vocationology, Inc., granted by the Editors of the JOFV for inclusion on the IARP Fall Conference 2003 Disk]. 2003 by Vocationology, Inc. This JOFV Monograph includes the following Annotated Articles with minor updates: Page - Title - Author(s) 3 Product Peer Review of Course Disk 1: The Updating of the 5th Edition DOT - Grimley 4 Product Peer Review on MVQS2003 - Streater 5 Frequently asked questions regarding the MVQS 2001-2003 Programs - McCroskey 8 The McCroskey Vocational Quotient System (MVQS) Theory of Transferable Skills: Revised, Extended and Updated for the 21st Century - McCroskey, Grimley, Williams, Hahn, Lowe, Wattenbarger, Stein & Dennis 31 The MVQS Vocational Interest and Personality Reinforcer (VIPR) Job-based Personality Type Indicator and MTSP1 Jobs-Based Vocational Interest Personality Types Crosswalk to Jung People-Based Personality Types McCroskey, Hahn, Streater, Sinsabaugh, Mayer, Van de Bittner, Lowe & Dennis 91 Emotional Trauma: Its Impact on Vocational Analysis - McCroskey & Dennis 104 MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation - McCroskey, Hahn & Dennis 132 MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation Follow-Up Study – McCroskey, Hahn, Dennis & Wattenbarger Note from the Editors: The Journal of Forensic Vocationology is a private, copyrighted, scientific, research-oriented Journal, published periodically (typically 1 time per year) by Vocationology, Inc. Articles considered for inclusion are subject to Peer-Review and Editorial review prior to inclusion in the Journal. Co-Editors: Billy J. McCroskey, Ph.D. & William E. Wattenbarger, Ph.D. (763-569-0680) The primary purpose of the Journal of Forensic Vocationology is to disseminate scientific research and related information deemed relevant to the field of Vocationology (See definition in The Journal of Vocationology, Vol. (1) 1, 1995) and related disciplines including: Psychology, Student Personnel Services, Career Development, Rehabilitation Economics, Rehabilitation Counseling, Job Analysis, Worker TraitFactor Theory, Vocational Evaluation and Work Adjustment. From time to time, research & informational articles may be invited or solicited from recognized experts in Vocationology and Related fields. The Editorial Advisory Board and Peer Review Committee Kenneth Dennis, Ph.D., LP, LMFT, CRV, Associate Editor -MN - ken.dennis@juno.com Robert Male, Ph.D., CEA - OR - bobmale@home.com Steve Hahn, M.S., CVE, CRC, QRC, Associate Editor - MN - sjhahn1@aol.com David Stein, Ph.D., ABVE - NV - DBSPHD@aol.com Scott Streater, D.V.S, ABVE - NC – sesdvs@aginet.com Judith Harper-Haley, M.R.C., ABVE - TX - london_suede@email.msn.com Craig Feldbaum, Ph.D., LP, ABVE - LA - cfeldb@gulfsouth.verio.net Claude Peacock, M.S., ABVE - AL - cfpeacock@mindspring.com David Toppino, M.A., CVE, CEA, ABVE - CA - veala@aol.com John Williams, D.Ed., ABVE - FL - amwfl@myacc.net Lyndette Mayer, Ph.D., ABVE - NC - lindphd@aol.com Jan Lowe, MA, CRC, ABVE - MN - redfanjan@aol.com Cynthia Grimley, MS, ABVE - SC - cpgrimley@aol.com Nat Fentress, MS, ABVE - LA - nfrehab@worldnet.att.net Ron Smolarski, MS, CEA, CLCP - MI - ron@beaconrehab.com Larry L. Sinsabaugh, Ph.D., LMFT - l.l.sinsabaugh.phd@worldnet.att.net Billy J. McCroskey, Ph.D., CRE, CRC, CRV, ABVE, Co-Editor Dr. McCroskey is currently the President of Vocationology, Inc., located at 8209 Halifax Court North, Brooklyn Park, MN, 55443. He was the Founding Editor of the Northwest Georgia Rehabilitation Counselor Newsletter, The Vocationologist, the Journal of Vocationology, and the Journal of Forensic Vocationology. Dr. McCroskey spends approximately 50% of his time engaged in 1 McCroskey, B. J. (2003). The McCroskey Transferable Skills Program (MTSP 6.0). In: The McCroskey Vocational Quotient System 2003 (MVQS2003 – 6th Edition) Job-Person Matching Program. Brooklyn Park, MN: Vocationology, Inc. Page: 2 Journal of Forensic Vocationology Vol. 7(1) Monograph scientific research relating to the prediction starting and average wage. He was the original developer and senior author of the Vocational Diagnosis and Residual Employability (VDARE) Process. He has engaged in many years of research leading to development of the McCroskey Vocational Quotient (VQ), the DataMaster Job-Person Matching Program Series and the MVQS McDOT, McPLOT and MTSP 2001 series of Worker Trait Factor Job-Person Matching Programs and Earning Capacity Prediction Systems. In 2002 he received the David S. Frank ABVE Lifetime Achievement Award. Ph 763-569-0680, e-mail: bjmccroskey@juno.com. In his research, Dr. McCroskey has developed and updated more than 3,247 National, State, County, Parish, Province and Borough Job Bank Databases of frequently-hired-for jobs. Dr. McCroskey’s Job Person Matching and Earning Capacity Systems have been peer-reviewed in four Comparison of Job Person Matching Systems Publications (Botterbusch, 1983 & 1986; McDaniels, et. al., 1994; and Dennis & Dennis, 1998). Dr. McCroskey is a Lifetime Certified Diplomate Level ABVE Vocational Expert, a Certified Rehabilitation Counselor (CRC), a Certified Rehabilitation Vocationologist (CRV) and a Lifetime Certified Rehabilitation Economist (CRE). He is a graduate of the University of Georgia and a life member of both the American Board of Vocational Experts (ABVE) and the American Rehabilitation Economic Association (AREA). Dr. McCroskey has presented White Papers on the Predictive Validity of the Vocational Quotient at several National Conferences. He currently specializes in Pre/Post Injury Employability Evaluations and Earning Capacity Determinations. Dr. McCroskey has worked on 5,000+ cases involving Individualized Vocational Rehabilitation Planning, Medical Case Management, Job Placement, Job Analysis, Earning Capacity, Workers Compensation, Rehabilitation Economic Past Wage Loss and Future Diminution of Earning Capacity, Personal Injury, Wrongful Death, Harassment, Discrimination, Divorce and Social Security. E-mail bjmccroskey@juno.com William E. Wattenbarger, Ph.D., CRC, CRV, Co-Editor Dr. Wattenbarger hails from Epworth, GA. He has served as Co-Editor for The Vocationologist, the Journal of Vocationology and the Journal of Forensic Vocationology since their inception. He is President of Rehabilitation Innovation, Inc. He currently works as a Rehabilitation Counselor in North Central Georgia. In the past, he has worked as a Supervisor at the Roosevelt Warm Springs Institute, in Warm Springs, GA. Dr. Wattenbarger is a computer programmer extraordinaire. He provided the programming skills and consultation necessary to bring the original McDOT, McPLOT, and MTSP series of Programs to fruition. Dr. Wattenbarger co-developed and co-authored the VDARE Process. He designed the http://www.vocationology.com website. He enjoys family time and working quietly behind the scenes. Ph: 706-846-3470, email: wewatt@tds.net. Journal Motto: When worker capacities equal or exceed job demands, employability and earning capacity exist. (BJM, 1981). Abstracts for all articles in the first five issues of the Journal of Forensic Vocationology (JOFV) are available at our Internet Web Site: http://www.vocationology.com. If you would like to contribute to this scientific, research-oriented, national peer-reviewed Journal, let us know at our address below. Manuscripts submitted for peer-review and publication consideration should be provided to us on a 3 1/2 inch disk, or via e-mail attachment, in standard APA style, preferably in a Word for Windows 97, or Word 2000, word processing document file. Dr. Billy J. McCroskey, President Vocationology, Inc. 8209 Halifax Court North Brooklyn Park, MN 55443-2538 Phone: (763) 569-0680, or (763)-560-7072 e-mail: bjmccroskey@juno.com Past issues of the JOFV (Volumes 1-6) have been electronically published in Word-97 or Word 2000 format and are available for purchase (from Dr. Billy J. McCroskey) on the 30-Hour CEU Course Disk 1: The Updating of the Fifth Edition DOT (McCroskey & Dennis, 2000) as well as well as on three other training Course Disks available for purchase thru Vocationology, Inc., at $165.00 each, including S & H. However you got it, you are now reading from the Spring 2002 issue of the Journal of Forensic Vocationology Vol. (7), Issue 1. If you are intrigued with the research, theory and practice-related article in this issue and wish to obtain one or more of the electronically published back issues of the JOFV, let us know by e-mail at bjmccroskey@juno.com and we'll try to accommodate your wish. Enjoy. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 3 Sample Product Peer Reviews Product Peer Review By Cynthia P. Grimley, MS, CRC, CCM, ABVE On The Updating of the 5th Edition DOT A 30-Hour CEU Course Authors: Billy J. McCroskey Ph.D., CRC, CRE, CRV, ABVE Kenneth L. Dennis, Ph.D., LP, CRC, CRV, LMFT The U.S. Department of Labor, Employment and Training Administration published the Fourth Edition, Revised 1991 of the Dictionary of Occupational Titles (DOT). The U.S. Department of Labor has no scheduled plan to update the DOT again. The current research conducted by the U.S. Department of Labor is geared towards the O*NET, which currently has limitations as admitted by the government. The 4th Edition DOT is outdated. It is now up to the private sector to update and coordinate both of these resources. The McCroskey Vocational Quotient System Programs, (MVQS) McDOT, McPLOT and MTSP 2000) has done exactly this. The text to begin the training and understanding of the MVQS 2000 Program Series (McCroskey, 2000) has been developed. The 30 CEU Credit Course on The Updating of the 5th Edition DOT details data fusion research to produce updated job analysis profiles for all 12,775 specific jobs in the McDOT 2000 and related job-person matching software. The course also includes a fully developed, 45 page, Case Study Report with attachments. The course is copyrighted so you are unable to print any of the information except the Case Study Report. This is a CD-ROM based course, which runs off the DAC II Engine. This is compatible for all IBM PC’s and those with 100 percent compatibility. The DAC II Engine will require 12.6 mb on your hard drive. The course itself will take up 20 MB of hard drive space. The course installs with ease. After you enter your student registration data information and begin the course you may exit any time you wish. When you return, the course will automatically pick up where you left off. There are hypertext words underlined that enable you to click on to obtain the definitions and related information. The course features colorful and comical graphics that highlight the material. The course contains eleven chapters: 1) 2) 3) 4) 5) 6) 7) 8) 9) 10) 11) Introduction, Using McDOT, McPLOT, & MTSP 2000, Expert Testimony, Statistical Foundations Relating to Daubert, Part 1: O’NET Validity under Daubert, Part 2: O’NET Validity Under Daubert, VDARE, O’NET 98 & MVQS Theoretical Basis, O’NET 98 Transferable Skills (TS) Paradigm, MVQS McDOT 2000 Contributions, References & Bibliography: A-L, References & Bibliography: M-Z. As a bonus the CD-ROM Course contains the first five peer-reviewed Journals of Forensic Vocationology (Vols. 1-5), a $250.00 value, which serve as the course text. These Journals are full of scientific research articles, which vocational experts are increasingly in dire need of, when questioned under the Daubert Standards. The Updating of the 5th Edition DOT and the five peer-reviewed Journals of Forensic Vocationology are available for $150.00 plus $15 for shipping and handling. This course is the first in a five part series. For ordering information, contact Dr. Billy J. McCroskey, Vocationology, Inc., 8209 Halifax Court North, Brooklyn Park, MN 55443. Phone: 612-569-0680 or 763-569-0680. DLU: 08/7/2000 Page: 4 Journal of Forensic Vocationology Vol. 7(1) Monograph MVQS 2003, 6th Edition Product Peer-Review I recently purchased the McCroskey Vocational Quotient System (MVQS 6.0, McCroskey, 2003) and the accompanying 6th Edition Dictionary of Occupational Titles (McDOT 6.0). This system, which was developed and authored by Dr. Billy J. McCroskey, is a refreshing evolution from his former programs. I have owned McCroskey reference materials and have copies of all of his systems since 1980. I have also used the old manual system (VDARE), prior to the purchase of my first computer in 1983. I have seen the ROC, his first system, but have never utilized it in the field. All of these systems take the guesswork and much of the argument out of reasonable career choices, worker capacity, employability and earning capacity. My statement is based on the fact that they are all empirically based, and since their inception, have been able to meet the Daubert Standards, years before they were handed down from the US Supreme Court. Both McCroskey’s works and the Daubert Standards rely on scientific research and standardized measurement. With MVQS 6.0, you are able to produce solid findings that can lead to well researched opinions, which in turn aids in formulation of your opinions and conclusions to form a solid basis for good reports and sound testimony. This programs meet all of the requirements set forth for Judges by the 2000 reference entitled, Reference Manual on Scientific Evidence, published by the Federal Judicial Center and available on the internet. Structuring a report with the data from this program, according to the directions of this legal reference, will provide valid data on an empirical platform to make decisions, in language the Judges have been instructed to look for. What more of a winning combination would one want? McCroskey’s 6th Edition McDOT is masterfully conceived and constructed, accommodating the 1998-2002 O-Net data and all of the updated US DOL Crosswalks including the SOC, NAICS, CENOCC, OESSOC, ONETSOC, and the Canadian NOC. In my opinion, McCroskey 2003 programs can be used by Vocational Experts in: Social Security Hearings, Workers Compensation, Personal Injury, Divorce or Dissolution, or any other venue that requires reliable vocational measurement and earning capacity estimation. In contrast to his former programs, MVQS 2003 is still complex, yet far simpler to run and to interpret. It is a dream to load, as it is now totally contained on one computer disk (CD-Rom). The loading is a two-step process, involving the program and job bank databases all emanating from a single disk. Another of the real steps forward is the program has been adapted to a Microsoft Windows Access 2000 platform. This makes for truly simple to interpret screens and greatly simplified operation. The built in help screens, and the notes “stashed” behind the Help buttons are clearly instructive to the newcomer, both inexperienced and seasoned. In my opinion, the best visual aspect to this program are the screens, which are displayed in a simple-to-read format, without a myriad of confusing data to dazzle the eye and confuse the mind. The built in set of sample “client” cases gets things off and running with the easy introduction of a “person” into the system as a trial subject. These take the inputs out of the user's responsibility; yet still allow the flexibility of selected changes in values on worker trait inputs or test/subtest values. The relevant sections of the internal manual help screens can be “pulled up” and referenced without confusing eye and head movements. Everything is there on the screen, all in one place, with no distractions. There is an absence of the old “necessary savvy” to run the programs. I believe anyone can learn to operate the programs. One must know something about the inputs utilized and certainly one must know and understand and be able to explain basic measurement concepts to be able to put this information into a formal report or expert witness testimony. This is also true of the new MVQS Rehabilitation Economist. All in all, I think this is the best effort I have ever seen in a program such as this and I can’t wait to get a few cases under my belt and write one of the first technical articles on the McCroskey 2003. Bill McCroskey and those involved in “the backroom” should be commended on this magnificent undertaking. This was I’m sure, a massive task, at great expense, with much work and learning involved. To be available at the very competitive rate that it is selling for makes it an “absolute tool” if one is to provide vocational forensic opinions with reasonable certainty based on good science in this modern age. (DLU: 09/24/02) Scott Streater, D.V.S. 47 Skyline Road, Southern Shores, North Carolina 27949-3600 (252) 255-1854 Phone or FAX or email: : - sesdvs@aginet.com Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 5 Frequently Asked Questions (FAQ) Regarding MVQS 2001-2003 Programs 1. How do you identify the salient physical and mental requirements of jobs profiled in McDOT? Answer: We identify the salient physical and mental requirements of jobs from the McCroskey Dictionary of Occupational Titles – 6.0 Edition (McDOT, McCroskey, 2003). The computerized, Windows(TM) Access 2000 based, McDOT Program was modeled after the US DOT, 4th edition revised. The date of last update (DLU) for all profiles of job demands/worker trait requirements in McDOT 2003 was Year 2002. McDOT 2003 job requirement profiles were data mined from the 75 most vocationally significant O*NET identified worker trait job requirement element variables for which means data job requirement profiles were collected and provided for each of 1,122 Occupational Unit (OU) Classification Code Groups (ONET Code Groups). This was necessary in order to bridge the gap between the outdated US 4th edition and the updated job demand/worker trait requirement profiles in the McDOT 6th edition DOT. 2. What type scales, or ratings, exist for measuring these variables? Answer: The reference for the Job Analysis Scales used to profile jobs in the McDOT 2003 program is the 1991 US HAJ-R. The only major difference is that McDOT incorporates ascending, vs. descending Aptitude Scales (e.g., the higher the scale level, the greater the job demand; i.e., instead of 1=high & 5=low, McDOT aptitude scales are interpreted as 1=low & 5=high) otherwise the JA Scales are the same. 3. How do you address issues of validity and reliability? To bridge the gap from the outdated 4th edition US DOT to the updated McDOT 6th edition DOT, O*NET98 Mean job requirements data from the 75 most salient physical and mental worker trait requirement elements (52 ability elements on 8-point scales and 23 work context elements on 5 point scales), were data mined from the 483-variable O*NET ascending scale means data profiles. These data were converted, via multiple regression studies, to the more familiar 1972-91 HAJ-R job analysis scales, to reflect the 24 most vocationally salient physical, mental and environmental worker traits. The data were combined, through data fusion, from element level data, to the worker trait level data, for ease of understanding. In other words, job demand profiles in McDOT 2003 are presented in terms job requirement scales from the 1991 US Revised Handbook for Analyzing Jobs, which are most familiar to SSA ALJs and knowledgeable Vocational Experts, who have grown accustomed to the structure of the 1977 and 1991-Revised, US DOT. The SVP component, which was missing in the O*NET means data profiles, has been reconstructed and added back to the McDOT job specific data in order for Administrative Law Judges (ALJs) and Vocational Experts to continue to be able to differentiate between unskilled, semi-skilled, and skilled jobs, as well as complete reliable, valid transferable skills analyses (Grimley, et. al., 2000a, 2000b). 4. Has scientific research been published in professional peer-reviewed publications? Answer: Yes, in many journals, monographs and technical manuals (e.g., the MVQS 2001 Resource Manual) regarding the issues relating to validity and reliability for the MVQS programs employability and earning capacity predictions. The seven issues of the JOFV (Volumes 1-7) on the MVQS 2003 Program Installation Disk in the Journals Subdirectory contain a great deal of the scientific research, independent replication and cross-validation studies attesting to the reliability and validity of the MVQS programs. Other peer-reviewed journals in which some of the research has been published include: the American Board of Vocational Experts Journal of Forensic Vocational Analysis and The Earnings Analyst Journal of the American Rehabilitation Economics Association. Three-way & 5-way inter-rater reliability has been established for MVQS Programs to be very high (Rxxx=0.99). The transferable skills paradigm has been tested and found to be very valid relative to a criterion N of 93 Vocational Experts (Grimley, et. al., 2000a, 2000b). In our opinion, in the hands of a trained Vocational Expert, MVQS programs are underpinned with more than enough scientific research, which has been peer-reviewed and published, to meet or exceed the standards for expert witness testimony set fourth in the US Supreme Court in their Daubert Decision (1993), and reiterated in their Joiner and Kumho Decisions, in which they addressed the Federal Rules of Evidence (FRE 702), governing Expert Witness Testimony. Page: 6 Journal of Forensic Vocationology Vol. 7(1) Monograph The MVQS 2001 Resources (McCroskey, 2001) technical manual contains the technical data, including Statistical Tables with all of the Standard Errors of Measurement, Predictive Validity Coefficients and Standard Errors of Estimates, frequency counts and percentages of jobs at each level of job demand associated with job analysis data profiles in McDOT across all 12,974 specific 9-digit DOT Coded Occupations in McDOT. This technical manual covers the 75 most salient O*NET element variables, the 24 most vocationally salient physical, mental and environmentally significant worker traits, the Vocational Quotient (Job Difficulty Index; Mean=100, SD=15), and the reconstructed 9-point Specific Vocational Preparation (SVP) scale. 5. What methods do you use in collecting, updating and providing the data? Answer: Typically, as in the past, our methods of data collection and updating the DOT rely primarily on US Department of Labor data available in a variety of forms and cross-walked coded systems. Specifically, McDOT 2003 job requirement profiles were data mined from the 75 most vocationally significant O*NET98 identified worker trait job requirement element variables for which Means data job requirement profiles were constructed and provided for each of 1,122 Occupational Unit (OU) Classification Code Groups (O*NET OU Codes). This was necessary in order to bridge the gap between the outdated US 4th edition DOT and the updated job demand/worker trait requirement profiles in the McDOT 6th edition DOT. Since the inception of the McCroskey Series of Job-Person Matching, Transferable Skills, and Earning Capacity Estimation Programs, the programs and their databases have been periodically updated, approximately every two years. In the past, McCroskey Programs have been peer-reviewed in each of three University Comparison Studies of Job-Person Matching Systems (Botterbusch, 1983, 1986 and McDaniel, et. al, 1993). Course Disk 1 was peer-reviewed by Grimley (2000, 2002) in two Journals of Forensic Vocationology, and MVQS 2003 Programs were peer-reviewed, by Streater (2002), in this JOFV Issue. 6. What type of training is available regarding the development and use of MVQS Programs? Answer: There are four 30-Hour CEU Course Disks specifically designed as graduate-level Distance Education Learning courses for Administrative Law Judges, Vocational Experts, Psychologists, Rehabilitation Counselors, Vocational Evaluators, Social Workers and related professionals. The Course Disk CD- ROMs contain the first 5 Journals of Forensic Vocationology, which serve as text for the 4 Courses. The names of the four Courses are: Updating the 5th Edition Dictionary of Occupational Titles. This course covers the history, theory, theory extensions, research and systems leading up to the 1939, 1949, 1965, 1977 and 1991 revised US DOT, and culminates with the development of the McDOT 2001 5th edition DOT. MVQS Vocational Analysis. This course covers scientifically-based transferable skills analysis using the MTSP 2003 TSA program which is entirely based on the scientific foundation of the McDOT 6th edition DOT. O*NET DOT Database Introduction. This course covers the development of the O*NET-98, the Means data profiles they constructed and the 75 most salient physical, mental and environmental context job requirement elements which were incorporated into the McDOT 5 th and now the McDOT 6th Edition DOT and utilized to construct the 24 most vocationally significant worker trait level requirements of each of the 12,775 specific 9-digit DOT coded Occupational Profiles in McDOT 2001 and the 12,974 Occupational Profiles in the McDOT 6.0 DOT. And, Vocational Evaluation 001. This course covers the myriad of relevant vocational and mental abilities tests and work samples than are commonly used in vocational analyses by vocational professionals around the US to determine vocational functioning, transferable skills, employability and earning capacity. 7. Can one become certified as reliable in the use of the MVQS 2003 Programs? In addition to the 4 Training Course Disks, there are 7 sample practicum cases in MVQS 2003. Possession of a valid Masters or Doctoral Degree in Vocationology or a related field of studies (See Page 1 of this Journal for related fields of studies; See also, Vocationologist as defined in McDOT 2003) and two or more years of relevant field experience, along with successful completion of the 4 Course Disks, with 80% or better proficiency on the internal Course Disk Tests, and completion of written reports containing acceptable answers (80% or better proficiency) on the questions posed for each of the 7 sample cases, Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 7 entitles one to sit for the Certified Rehabilitation Vocationologist (CRV) Exam, which is designed to yield an individualized Inter-Rater Reliability Coefficient Score. All pre-requisites must be met along with an IRR Coefficient score of 0.80 or better to become CRV Board Certified. 8. What's on the foreseeable horizon as far as planned updates for MVQS 2001 Programs? In response to the need to incorporate the NAICS Codes, which have replaced the SIC Codes, and incorporate the updated SOC Codes, which have replaced the OES Codes in the form of OccCodes and the O*NET OU Codes in the form of O*NET SOC Codes, along with the identification of 199 new jobs in the US Labor Market, we have now completed developing the McDOT 6th Edition DOT & Related Programs slated for release in 2003. The McDOT 6th Edition DOT has been updated to include the 200 new jobs (i.e., McDOT 6.0 now contains 12,975 specific, fully described, profiled, and cross-walked 9-digit DOT-Coded jobs vs. the 12,775 jobs described, profiled, and cross-walked in the McDOT 5th Edition - Extended Dataset DOT). It includes all the new cross-walk codes and has updated report formats to choose from for screen outputs, editing - using Windows™ Office Links to Word for Windows™ 2000, and/or printing. The McPLOT 6th Edition TestPlot Program will include approximately 900 tests which can be selected from to build individualized batteries for use in the vocational analysis of individuals. It will continue to have two internal tests, the Occupational Values and Needs Inventory (OVNI) and the Vocational Interest and Personality Reinforcer (VIPR) for interest and personality type assessment relative to job matches. It will have 5 updated report formats to choose from for screen outputs, editing - using Windows™ Office Links to Word for Windows™, and/or printing. The MTSP 6th Edition TSA Program includes 3,291 Job Bank Databases of known frequently-hired-for jobs: One for each county, parish or borough, in each state in the US, One for each US State, One for each Province in Canada, One for each major city in Puerto Rico, and Job Banks for American Samoa, Guam and the Virgin Islands (St. Croix, St. John and St. Thomas) along with several national-level job banks and one job bank containing all 12,974 specific jobs in the McDOT 6th edition DOT. It has 32 updated report formats to choose from for screen outputs, editing - using Windows™ Office Links to Word for Windows™ 2000, and/or printing. MTSP 6.0 includes a new curvilinear regression earning capacity paradigm, which is more accurate (i.e., with higher predictive validity & smaller Standard Errors of Estimate) than its predecessor. The curvilinear regression earning capacity paradigm was necessary to more closely follow the positively skewed curvilinear line of best fit associated with worker wages in the US economy. (McCroskey, MVQS 2001 Resources Technical Manual, page 92). The three MVQS 6.0 Edition Programs described above are seamlessly integrated in the Windows™ Access 2000 based platform, which requires a relatively newer and faster computer with approximately 350 megabytes of hard disk space free on an IBM(TM) or IBM compatible PC, with a Windows 95, 98, 2000 ME, or XP based operating system. To insure full installation compatibility on your computer, users need an installed version of MS Office™ 2000 - Professional Edition, which includes Access 2000, prior to installing MVQS 2001 Programs. MVQS 2003 can also be installed on a Laptop Computer and used for those last minute adjustments, which often have to be made to allow for different hypothetical questions posed by an ALJ, or other interested parties, to Vocational Experts during Expert Witness testimony. The rule of thumb for installing and using MVQS 2003 Programs: the faster the computer, the more efficiently relevant data can be retrieved to answer the myriad of questions which the vocational expert may need to answer with reasonable certainty. Finally, MVQS 2003 Programs and the MVQS Rehabilitation Economist, which was developed to use Earning Capacity outputs from MTSP 6.0, are empirically based tools, which can efficiently and effectively suggest vocational possibilities and estimates of earning capacity and diminished earning cap city. The programs are wonderful for use in vocational analysis and occupational exploration. However, reserved clinical judgments, made with reasonable vocational and rehabilitation economic certainty, are an absolute necessity if they are to be used effectively in expert witness testimony. Billy J. McCroskey, Ph.D., Co-Editor, 09/24/02 Page: 8 Journal of Forensic Vocationology Vol. 7(1) Monograph The McCroskey Vocational Quotient System (MVQS) Theory of Transferable Skills: Revised, Extended and Updated for the 21st Century By Billy J. McCroskey, Ph.D., CRE, CRC, CRV, ABVE, Cynthia P. Grimley, MS, CRC, ABVE, John M. Williams, D.Ed., ABVE, CRC, NCC, ABDA, CCM, Steven J. Hahn, MS, CRC, QRC, CRV, CVE, Jan Lowe, MS, CRC, QRC, ABVE, William E. Wattenbarger, Ph.D., CRC, CRV, David B. Stein, Ph.D., CRC, CDMS, LPC, LRC, and Kenneth L. Dennis, Ph.D., LP, LMFT, CRC, CRV Abstract The McCroskey Vocational Quotient System 2001 (MVQS 2001) Transferable Skills Program (MTSP 2001; McCroskey, 2001) provides Transferable Skills Analysis (TSA) based on an equal interval Transferable Skills Percent (TSP) scale. Theoretically, this interval scale ranks job matches in relevant labor markets of interest in terms of suitable employability, from 0 to 97% in terms of Transferable Skills (TS), Occupational Values and Needs Inventory (OVNI), Vocational Interests and Personality Reinforcer (VIPR) Type, Vocational Quotient (VQ), Specific Vocational Preparation (SVP) and Earning Capacity. MVQS TS Theory expands and extends the Minnesota Theory of Work Adjustment [Dawis, England & Lofquist (1964); Dawis, Lofquist & Weiss (1968); Dawis (1976);] with practical applications based on mathematical models underlying a wide variety of vocational databases including the McCroskey Dictionary of Occupational Titles-5th Edition DOT (McDOT 2000/2001; McCroskey: 2000, 2001), the US DOT (US DOL: 1977 & 1991) and O*NET (US DOLETA: 1998) The intent of here is to examine the underlying theory, methodology and rational of MVQS MTSP TSA TSP, its theoretical underpinning and implications for reliable, valid measurement and quantification of MVQS 2001 MTSP TSA TSP Levels, Earning Capacity Estimates and related Analyses. Introduction The theoretical model underlying MVQS 2001 Transferable Skills Analysis (TSA) assumes the following key concepts: 1) Work Skills are those skills (knowledge and abilities) acquired by a worker through successfully demonstrated specific vocational preparation (past relevant college, technical, vocational, apprenticeship, and/or on-the-job training) for past, current, and/or future, specific suitable semi-skilled or skilled jobs in the worker's ongoing, evolving career development. 2) Transferable Work Skills are those work skills (knowledge and abilities) acquired through successfully demonstrated specific vocational preparation, required by one or more specific suitable semi-skilled or skilled job matches, to varying Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 9 degrees of transferability, either in an upward, lateral or downward direction, depending on qualifications (DOQ), in relevant labor markets of interest.2&3 3) Residual Transferable Work Skills are those work skills (knowledge and abilities) successfully demonstrated through past relevant work history and associated specific vocational preparation, which are retained from past relevant work history based on the clients Residual Employability Evaluative Data Profile, following injury or disability, and required by one or more specific suitable semiskilled or skilled post-injury or post-disability job matches, to varying degrees of transferability, in one or more relevant geographic labor markets of interest. The core databases, from which the MVQS 2000/2001 TSA TSP equal interval scale was derived, are included in the McCroskey Dictionary of Occupational Titles 2000/2001 - 5th Edition DOT Updates (McDOT 2000/2001, McCroskey, 2000/2001). McDOT 2000 and McDOT 2001 were updated based on selected transformed O*NET 984 DOT replacement worker-trait-element-level data variables (N=75), the United States Dictionary of Occupational Titles-Revised 4th Edition (DOT; US DOL, 1991), post-1991 DOT errata changes and additions and the 28 cluster analysis variables and mathematical models [including outlier reclassification based on Ward's Minimum Variance Method5 (Ward, 1963)], used to produce the O*NET 98 Occupational Unit (OU) Classification Coded DOT replacement Transferable Skills Groups (N=1,172). Prior to 1998, when the O*NET 98/OU Codes were adopted for use in MVQS MTSP TSA, all earlier MVQS, including the DataMaster, Program series had used GOE6 codes in place of O*NET 98/OU Codes. The MVQS 2001 TSA TSP scale expanded the O*NET 98 OU Transferable Skills Groups database DOT replacement TS grouping paradigm (based on 28 grouping variables) to include job-person matching on the 24 most vocationally significant worker traits, along with an identified transferable skills gradient on an overall 5-point equal interval scale across and a 0 to 97% equal interval scale within transferable skills groups. 2 Using the classic Vocational Diagnosis and Assessment of Residual Employability (VDARE; McCroskey, Wattenbarger, Field & Sink, 1977) approach to developing the client's Residual Employability Profile (REP) with appropriate modifications to the High Across Work History Profile [the Unadjusted Vocational Profile (UVP)] based on expected permanent vocational limitations stemming from expected permanent medical, psychiatric and/or psychological restrictions, MTSP TSA typically yields jobperson matches with varying degrees of transferability, with lateral and below TS Analysis for jobs with VQs at, or below, those levels of overall job difficulty demonstrated by successful past relevant work history. This approach is most often used in the analysis of SSDI and SSI applications for purposes of determining employment potential and earning capacity status. 3 The classic VDARE approach (when combined with a full or partial battery of vocational tests and ratings covering the 24 most vocationally significant worker traits) enhances MTSP TSA by allowing for job-person matches with varying degrees of upward Transferable Skills Analysis, as well as job matches with lateral and below TS Analysis. Under these conditions, MTSP TSA job-person matches may include job matches with VQs above, at, or below, those levels of overall job difficulty demonstrated by successful past relevant work history. This approach is most often used in Worker's Compensation, Personal Injury, Divorce and related cases with litigation potential. 4 O*NET 98 - The Occupational Information Network Version 1.0 [United States Department of Labor Employment and Training Administration (US DOLETA), 1998)]. 5 Ward's Method. This method is distinct from all other methods because it uses an analysis of variance approach to evaluate the distances between clusters. In short, this method attempts to minimize the Sum of Squares (SS) of any two (hypothetical) clusters that can be formed at each step. In general, this method is regarded as very efficient, however, it tends to create clusters of small size. 6 Guide for Occupational Exploration (GOE) Codes were six-digits: interest area (1st 2), work group (1st 4), work group sub-group (1st 6). Page: 10 Journal of Forensic Vocationology Vol. 7(1) Monograph Literature Review Decision-making about loss of earning capacity in civil litigation as well as appropriate job placement for persons with or without disabilities for vocational experts, vocational rehabilitation and other vocational counselors has been based, at least in part, on transferable skills analysis (Maze & Williams, 1993; Williams and Maze, 1994). This has been realistic and helpful to understanding and planning during vocational counseling. The McCroskey Vocational Quotient System (MVQS) TSA TSP Programs have been empirically tested and found to be extremely reliable (3-way inter-rater reliability: Rxxx=0.9864; McCroskey, Haskins & Smolarski, 1995) and valid [i.e., the MVQS TSA TSP 5-point scale was found to be in agreement with 5-point scale ratings from a national sample of Vocational Experts (N=93; Rxy=0.96; SEE=0.357; Grimley, Williams, Hahn & Dennis 2000a, 2000b)]. MVQS TSA TSP information can reliably and validly increase the effectiveness and efficiency of vocational experts and rehabilitation service providers seeking to provide realistic occupational counseling to their clients. Landsea (1994) pointed out that it is individual-specific factors (e.g. age, education, gender, occupation, industry, and geographical location), which impact the growth of lifetime earnings. This suggests a linkage between acquired knowledge and skills and lifetime earnings. Vocational experts have long viewed transferable skills analysis as a way of determining suitability of specific occupations for a given individual and the impact of occupational choices on earning capacity. Cutler, Cutler and Ramm (1995) indicated that transferable skills analysis methodologies offered in job-person matching software are commonly used by vocational experts and rehabilitation counselors to identify specific occupations and earnings without any real understanding of the limitations of the data. Cutler, et al opined that using the Dictionary of Occupational Titles (U.S. Department of Labor, 1991) as the basis for identifying the skills and functional capacities associated with jobs was problematic. There were too many problems with the age and aggregate nature of the data. Cutler, et al (1995) said that frequency of jobs by occupation (as a basis for determining loss of number of jobs to which one may have access pre-/post-injury) was not considered to be entirely accurate. It required too much reliance on aggregate census data. In response, Grimley, et al (2000a, 2000b) reported that Cutler, et al failed to address the fundamental issue regarding validity of the concept of transferable skills by comparing construct validity along with content validity. In theory and in practice, assessment of transferable skills acquired through work and education has been seen as an effective method for identifying what occupations a worker can perform (assuming their worker trait capacities profile meets or exceeds the job requirement profiles) and what occupations an employer believes an individual has the ability and transferable skills to perform. This forms the basis for suggesting a person can reasonably be successfully placed in a specific job type and can reasonably be expected to earn a reasonable level of income estimated for selected job types in the relevant geographic labor market of interest (Grimley, et al, 2000a, 2000b). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 11 Earlier research involving VDARE7 profiling of client vocational capacities based on work history requirements, and modified using counselor judgment following a review of written case notes and general medical information, yielded inter-rater reliability estimates as high as Rxxx=0.9944 (McCroskey, 1979, McCroskey & Perkins, 1981). Research comparing counselor produced VDARE Profiles of Client Vocational Capacities with those generated through Rehabilitation Facility Vocational Evaluation results, counselor produced VDARE profiles with placement outcome profiles, facility evaluation produced client profiles with previous facility evaluation results, and facility evaluation produced client capacities profiles with placement outcomes based on VDARE profiles of worker requirements yielded very high validity coefficients ranging from R xy=0.93 - 0.95 (Burge, 1978; McCroskey, 1979; McCroskey & Perkins, 1981). Other related research (using job requirements/client capacities comparison profiling) provides additional support for the rationale underlying the MVQS 2001 worker trait factor approach to better understanding individual vocational potential and work history related transferable skills, as a means to improving the quality of basic human services by vocational rehabilitation counselors and evaluators (Colvin, 1972, Field, McCroskey, Grimes & Wattenbarger, 1978; Hanman, 1951; Knowles, 1978; McCroskey, 1979, Reinhardt, 1978; Teal, 1978, Tratner, Fine & Kubis, 1955; Wattenbarger & McCroskey, 1978 and Wattenbarger, 1981.) Most of these articles were cited with research summaries and a full set of references in Chapter 3, Matching People with Jobs: Perspectives on Job Analysis and the Typical Job in the United States (McCroskey & Perkins, 1981, The Manual for the McCroskey Vocational Quotient System, pp 40-56). Predictive validity of the MVQS MTSP 2000/2001 TSA TSP scale has been empirically tested by comparing the MTSP 2000/2001 TSA TSP rankings with averaged rankings of American Board of Vocational Experts (ABVE, N=93), through the use of the ABVE Transferable Skills Evaluation Test8. Specifically, Grimley, et al, (2000a, 2000b) found the MVQS McCroskey Transferable Skills Program (MTSP 2000/2001) Transferable Skills Percent scale to be a valid predictor of averaged Vocational Expert responses on the ABVE Transferable Skills Evaluation Test (TSET; McCroskey & Dennis, 2000). The ABVE TSET instrument was developed based on the MTSP 2000/2001 TSA algorithm. It incorporated O*NET 98 Transferable Skills groups and a series of related job analysis codes to create and stratify transferable skills on a per cent scale ranging from 0 to 97% across, and within, the updated O*Net 98 Transferable Skills Groupings. In Grimley, et al, (2000a, 2000b), the ABVE TSET was subdivided into five broadly defined ascending Transferable Skills Levels ranging from 1 to 5 across the TSP 0 to 97% continuum, and administered to 93 Vocational Experts at the ABVE 2000 Spring 7 Vocational Diagnosis and Assessment of Transferable Skills (VDARE, McCroskey, Wattenbarger, Field & Sink, 1977). 8 The ABVE Transferable Skills Evaluation Test (McCroskey & Dennis, 2000) was specifically developed for studies designed to empirically determine the reliability, predictive validity and error rate for the MTSP 2000/2001 Transferable Skills Percent relative to the opinions of Vocational Experts (N=93) through scientific research. Predictive validity (Rxy) between the two variables was 0.96; the coefficient of determination (R2) was 0.92, and the standard error of estimate (SEE) was 0.357. Page: 12 Journal of Forensic Vocationology Vol. 7(1) Monograph Conference in New Orleans, LA. The Predictive Validity Coefficient between the MTSP 2000 TSP rankings and the criterion-referenced Prediction Estimates of the Vocational Experts (N=93) was extremely high (Rxy=0.96). Correspondingly, the Coefficient Of Determination (R2=0.92) was extremely high, and the Standard Error of Estimate (SEE=0.357) was found to be well within reason. The Outdated Transferable Work Skills Definition Williams (1998) stated that computer programs based on DOT (1991) ran the risk of not controlling for methodological error variance if not basing the sorting functions of the software on the appropriate factors. He went on to explain that the Revised Handbook for Analyzing Jobs (HAJ-R, 1991) listed three variables that were relevant to assessment of transferable skills: Work Fields, MPSMS and Specific Vocational Preparation (SVP). 1. Work Fields are Machine, Tools, Equipment and Work Aids (MTEWA) grouping codes that reflect how work gets done, the result of work, and the purpose of the job. Although these categories range from specific to general, they represent homogeneous groups related to technologies or objectives. It is easy to justify the inclusion of Work Fields into a Transferable Skills Analysis. People can acquire skills in getting work done, and these skills can be transferred to another job. 2. Materials, Products, Subject Matter, and Services (MPSMS) grouping codes describe what a worker does and what gets done to what. This coding structure is similar to the Work Fields structure, and its use in Transferable Skills Analysis appears logical. Skills related to what the worker does and how this work is completed can realistically be transferred to another job. 3. Specific Vocational Preparation (SVP) is the amount of lapsed time required for a typical worker to learn the techniques, acquire the information, and develop the facility needed for average performance in a specific job-worker situation. Use of SVP as a selection variable in Transferability of Skills Analysis (TSA) assumes that the individual can perform all occupations, which have the same or lower SVP, and that jobs requiring an SVP of no more than 2 (up to 1 month), are unskilled jobs. Since SVP represents time required to learn a job (though on-thejob training, formal vocational or academic training) and not any inherent knowledge or skill associated with the job, SVP cannot be transferred from job to job; instead, it is used primarily in differentiating between unskilled jobs (with an SVP level of either 1 or 2) and semi-skilled or skilled jobs. However, SVP is highly correlated with Overall Job Difficulty as measured by the McCroskey Vocational Quotient (VQ), Reasoning (R), Math (M) and Language (L) Development, that can be identified in terms of individual capacities and job requirements. Therefore, these factors may be more predictive of ability to perform specific job tasks than SVP alone. Use of SVP as a discriminator of what jobs are screened out during a TSA may not make sense when VQ, R, M and L development are not considered. This is particularly true when injured persons are limited by physical or mental impairments to sedentary or light work where the preponderance of jobs requires higher SVP levels than many medium or higher Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 13 exertion level occupations. SVP alone may be overly exclusive. However, SVP may have significant value in determining those jobs which are more likely to be available to a given individual based on employer perception of minimum demonstrated knowledge and/or skills required for being hired. This is a different issue than transferable skills, but an important part of any earning capacity analysis. Prior to the vastly improved O*Net Transferable Work Skills Groupings coupled with the MVQS TSA TSP scale replacement data, the outdated SSA Transferable Work Skills Definition stated in the Code of Federal Regulations (20CFR404.1568, 383-385), as it related to Social Security Disability Insurance (SSDI) eligibility decision-making, was generally accepted as the fundamental basis for most transferable skills analyses. Restated for clarity, it said: (1) What we mean by transferable skills. We consider you to have skills that can be used in other jobs, when the skilled or semi-skilled work activities you did in past work can be used to meet the requirements of skilled or semi-skilled work activities of other jobs or kinds of work. This depends largely on the similarity of occupationally significant work activities among different jobs. (2) How we determine skills that can be transferred to other jobs. Transferability is most probable and meaningful among jobs in which- The same or a lesser degree of skill is required; The same or similar tools and machines are used; and The same or similar raw materials, products, processes, or services are involved. (3) Degrees of transferability. There are degrees of transferability of skills ranging from very close similarities to remote and incidental similarities among jobs. A complete similarity of all three factors is not necessary for transferability. However, when skills are so specialized or have been acquired in such an isolated vocational setting (like many jobs in mining, agriculture, or fishing) that they are not readily usable in other industries, jobs, and work settings, we consider that they are not transferable. (4) Transferability of skills for individuals of advanced age. If you are of advanced age (age 55 or older), and you have a severe impairment(s) that limits you to sedentary or light work, we will find that you cannot make an adjustment to other work unless you have skills that you can transfer to other skilled or semiskilled work (or you have recently completed education which provides for direct entry into skilled work) that you can do despite your impairment(s). We will decide if you have transferable skills as follows. If you are of advanced age and you have a severe impairment(s) that limits you to no more than sedentary work, we will find that you have skills that are transferable to skilled or semiskilled sedentary work only if the sedentary work is so similar to your previous work that you would need to make very little, if any, vocational adjustment in terms of tools, work processes, Page: 14 Journal of Forensic Vocationology Vol. 7(1) Monograph work settings, or the industry. (See Sec. 404.1567(a) and Sec. 201.00(f) of appendix 2.) If you are of advanced age but have not attained age 60, and you have a severe impairment(s) that limits you to no more than light work, we will apply the rules in paragraphs (d)(1) through (d)(3) of this section to decide if you have skills that are transferable to skilled or semiskilled light work (see Sec. 404.1567(b)). If you are closely approaching retirement age (age 60-64) and you have a severe impairment(s) that limits you to no more than light work, we will find that you have skills that are transferable to skilled or semiskilled light work only if the light work is so similar to your previous work that you would need to make very little, if any, vocational adjustment in terms of tools, work processes, work settings, or the industry. (20CFR404.1568, 383-385) Updating the Outdated Transferable Skills Definition Specific Vocational Preparation (SVP) is by definition on an ordinal (rank ordered) scale of measurement which is highly correlated with overall job difficulty as measured by the interval scale Vocational Quotient (VQ; McCroskey, 1981). Inclusion and use of more appropriate equal-interval-scale variables, like the VQ, as an index of overall job difficulty/work capacity, along with MVQS TSA TSP equal-interval-scale data, helps overcome SVP ordinal scale limitations, and has strongly impacted conventional thinking of many experts in our field about the theory and practice of Transferable Skills Analysis. The McCroskey Transferable Skills Program (MTSP 2001) uses the Vocational Quotient (VQ) to define vocationally significant worker trait job demands/requirements and corresponding worker capacities. The VQ weights the complexity and difficulty of Job Types based on their profiles of job demands, providing an appropriate control on academic, intellectual, attending, physical capacity, environmental tolerance and related worker trait job demands/requirements and people worker trait capacities covered under the four most vocationally significant worker trait factors and their 24 most vocationally significant worker traits. Primary Considerations should first be given to the 24, Most Vocationally Significant MVQS VQ Variables, before any other Transferable Skills Indicator Variables are considered The Worker's Four-Factor by 24 most vocationally significant MVQS Worker Trait Level Evaluative Data Capacities Profile must match or exceed the updated McDOT 2001 5th ed. DOT Job Demands Profile relative to any given jobs before Transferable Skills should be considered relative to a worker's past relevant work history. These include: 1. General Educational Development (GED) / Intellectual Functioning (R) - Reasoning Development; Replaces (G) - General Intellectual Aptitude, which was inappropriately truncated at the low end. (M) - Math Development; Replaces (N) - Numerical Aptitude, and (L) - Language Development; Replaced (V) - Verbal Aptitude; 2. Aptitudes Perception Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 15 (S) - Spatial Perception, (P) - Form Perception, and (Q) - Clerical Perception, Dexterity (K) - Motor Coordination/Bimanual dexterity Aptitude, (F) - Finger Dexterity Aptitude, and (M) - Manual Dexterity, Other (E) - Eye-Hand-Foot Coordination, and (C) - Color Discrimination; 3. Physical Demands (PD1) - Lift, carry, push, pull, sit, stand, walk, (PD2) - Climbing, balancing, (PD3) - Bend, stoop, crouch, squat, kneel, crawl, (PD4) - Reaching, handling, fingering, feeling, (PD5) - Talking, hearing, writing, (PD6) - See up-close and see far-away; and, 4. Environmental Tolerances (EC1) - Work location (EC2) - Extreme cold, (EC3) - Extreme Heat, (EC4) - Dampness, wetness, humidity, (EC5) - Noise, vibrations, (EC6) - Hazards: machinery, electrical, chemical, unprotected heights, and (EC7) - Adverse Atmosphere: dusts, fumes, odors, mists or gases. VQ Research: Implications for Transferable Skills Analysis VQ has been frequently validated (and cross-validated) as a reliable, valid and very high predictor of Wages Offered on Job Service Work Orders as well as Workers (McCroskey & Hahn, 1997; Mayer, 1998). VQ has also been found to be a reliable, valid, and a very high predictor of earning capacity, as measured by reported Occupational Employment Statistics (OES) income data at the Mean as well as at the 10th, 25th, 50th (Median), 75th and 90th Percentile Wage Distributions (McCroskey, Hahn & Dennis, 2000). The VQ (and all the scientific research data underpinning it) combined with SVP and related considerations shores up the testimony of Vocational Experts. This combination shores up their testimony foundation with much more defendable scientifically underpinned explanations for TSA and Earning Capacity predictions along with known error rates. For example, knowing that SVP has been established to have very high predictive validity along with known very low error rates (Rxy=0.90, SEM=0.02, SEE=0.92, McCroskey, 20019) and that VQ has been established to have even higher predictive validity along with known very low error rates (Rxy=0.97, SEM=0.13, 9 McCroskey, Billy J. (2001). Statistical Analysis: Section 1. MVQS 2001Resources. Brooklyn Park, MN: Vocationology, Inc. beginning page 45 (subsection - fifth page of the Statistical Analysis tables in Section 1). Page: 16 Journal of Forensic Vocationology Vol. 7(1) Monograph SEE=3.81), it would be much easier to defend a job match with an SVP of 1 or 2, which also has a VQ of 84 or less (in the below average job difficulty range at less than the 16th percentile of overall job difficulty), as being unskilled, than a job with an SVP of 1 or 2 and a VQ of 100 (the 50th percentile of Overall Job Difficulty in the United States). In MVQS Transferable Skills Analysis, this is a major consideration. The O*NET Viewer and Transferable Skills Analysis The O*NET Viewer contained its own, very crudely defined, transferable skills analysis module (Related Occupations Module Option), which did not represent actual occupations (Dennis & McCroskey, 1999). Instead, it represents fairly large groupings of possibly related (and often unrelated) O*NET OU coded groups of jobs. Suitably related jobs can be found in the O*NET data, but the information provided in the Related Occupations module can only be used in the most general terms. For example, the OU code of 34002E is Managing Editors. Related Occupations listed Book Editors (34002G), Program Directors (34056H), Audiovisual Specialists (31508), Producers (31511C), Technical Writers (34005), and Museum Research Workers (31511C). The connection between some of the above-listed OU cluster analysis groupings is fairly clear. However, it also listed (as part of its up to 10 groupings) Employee Relations Specialist (21511C) as being related. It can be seen that the OU code changed from starting with a 3, to starting with a 2. It would be hard to explain how the skills could be easily transferred. Other occupations included were First Line Supervisors, Administrative Support (51002B) and Appraisers, Real Estate (43011). Except for getting people to draw pictures of houses for the newspaper, it is difficult to understand what skills would transfer from a Managing Editor to a Real Estate Appraiser. O*NET 98 transferable skills groups were created based on cluster analyses by mathematically grouping jobs that had similar requirements on 28 variables, and excluding other job groupings that were not similar enough based on these 28 variables. The O*NET 98 Transferability Of Skills Grouping Paradigm10 The Job Analysis Variables (N=28) selected and used by O*NET 98 in their cluster analyses and development of Transferable Skills Groups (N=1,172) included: 1) Primary Materials, Products, Subject Matter and Services (MPSMS) code, 2) Secondary Materials, Products, Subject Matter and Services (MPSMS) code, 3) Tertiary Materials, Products, Subject Matter and Services (MPSMS) code, 4) Primary Work Field: Machines, Tools, Equipment and Work Aids (MTEWA) code, 5) Secondary Work Field: Machines, Tools, Equipment and Work Aids (MTEWA) code, 6) Tertiary Work Field: Machines, Tools, Equipment and Work Aids (MTEWA) code, 10 Farr, J. M., Ludden, L. & Mangin, P. (1998). Appendix C, Phase I: Developing Homogeneous Occupations for O*NET. In: The O*NET Dictionary of Occupational Titles. Indianapolis, IN: JIST Works, Inc., pp. 573-579. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 17 7) Specific Vocational Preparation (SVP), 8) (D)ata Complexity, 9) (P)eople Complexity, 10) (T)hings Complexity, 11) General Educational Development: (R)easoning, 12) General Educational Development: (M)athematical, 13) General Educational Development: (L)anguage, 14) (G)eneral Learning Ability Aptitude, 15) (V)erbal Aptitude, 16) (N)umerical Aptitude, 17) (S)patial Perception Aptitude, 18) (P) Form Perception Aptitude, 19) (Q) Clerical Perception Aptitude, 20) (K) Motor Coordination Aptitude, 21) (F)inger Dexterity Aptitude, 22) (M)anual Dexterity Aptitude, 23) (E)ye-Hand-Foot Coordination Aptitude 24) (C)olor Discrimination Aptitude 25) (D)irecting Temperament, 26) (P)eople Temperament, 27) (I)nfluencing Temperament, and 28) (E)xpressing Temperament. O*NET 98 originally grouped 12,761 DOT occupations into 852 Occupational Employment Statistics (OES) occupations. This number was considered too small, and statistical clustering was employed to divide the OES codes into sub-categories. Ultimately, this resulted in 1,122 rated and viewable OU groupings that were considered to have more homogeneous skills that represented meaningful differences between occupations. The OU groupings were structured to display Belongingness (matching occupational definitions) and Homogeneity (more similar skills within groups than between groups) for the purpose of determining skill transferability. As a result of the Cluster Analyses which were completed and finalized for the new O*NET 98 Transferable Skills Groupings, 1,172 Occupational Unit Classification (OUC) Groups, or, as they have become better known, O*NET Code Transferable Skills (TS) Groups were created. O*NET Code TS Groups were based on USDOL Occupational Employment Statistics (OES) Code Groups, which were identified by the first 5 digits, of each 5-digit or 6character O*NET 98 Code TS Group. Thus, OU Classification/O*NET 98 Coded TS Groups were more highly refined, empirically derived, Transferable Skills (TS) Subgroups, within the OES Code Group Classification Structure. Of the 1,172 identified O*NET 98 Coded TS Groups, Means Data Profiles on 483 worker trait elements for 1,122 groups were reported in the US DOLETA O*NET 98 Version 1.0 Program. Researchers at Vocationology, Inc. constructed Means Data Profiles with 483 Page: 18 Journal of Forensic Vocationology Vol. 7(1) Monograph worker trait elements for the remaining 50 O*NET 98 Coded Groups (not reported in the O*NET 98 Vers. 1.0 Program) and added two new groups (each containing only 1 job), bringing the total N to 1,174 TS groups. Vocationology researchers also reconstituted 12 jobs which were reclassified with different 9-digit DOT Codes by O*NET 98 researchers. In the O*NET 98 Version 1.0 Viewer Program, there were 1,122 OU TS Groups for which means data element profiles were viewable in the O*NET 98 Viewer. There were 12,761 9-digit DOT-Coded Job Types contained in the O*NET 98 DOT Crosswalk of unduplicated jobs, and 12,797, 9-digit DOT-Coded Jobs contained in the O*NET 98 DOT Crosswalk when duplicated jobs are included. No specific job analysis worker trait profiles were included for any job types listed in any of the O*NET 98 databases. In the McDOT 2000/2001 programs, there are 12,775 specific unduplicated 9-digit DOTCoded Jobs and 12,811, 9-digit DOT-Coded Job Types contained in the McDOT 2000/2001 Crosswalk when duplicated jobs are included. In McDOT 2001, each job has a specific worker traits/job requirements profile, with respect to the 24 most vocationally significant worker traits and 3 aggregate variables (VQ, SVP and ZONE). Many O*NET 98 OU codes were either too broad, or too narrow (on their own), to use as stand-alone transferable skills groups. However, coupling together the 1,172 O*NET 98 database Occupational Unit (OU) transferable skills groups with the MVQS TSA TSP scale, as major components of the MVQS MTSP 2000/2001 transferable skills analysis algorithm, significantly improved the TSA TSP capabilities of the MVQS McCroskey Transferable Skills Programs (MTSP 2000/2001; McCroskey, 2000, 2001), in terms of distinguishing occupations most reasonably related via true transferability of skills. Face, Content and Construct Validity became much more apparent in the MTSP 2001 program than in the stand-alone O*NET 98 OU code groups themselves. The clarity of the MVQS MTSP transferable skills algorithm allowed the MTSP transferability scale to be converted from its previous 1 to 46 level Raw Score Scale to its 5-point standardized interval scale, Transferability of Skills Percent (TSP; 0-97%)scale. MTSP 2001 users have found the percentage based TSP rated outputs for MTSP Job Matches much more intuitive, understandable, easier to interpret, easier to defend and easier to explain. TSA software programs are now faced with the challenge of integrating O*NET data with traditional DOT data to predict actual jobs an individual can perform and the level of expected earnings associated with these selected occupations. Traditional thinking about TSA improvements offered via use of the Vocational Quotient (VQ; Williams, 1998; McCroskey and Hahn 1997; 1998a; 1998b) and the 24 most vocationally significant worker trait requirements from which it is constructed, must lead vocational experts and counselors to ask the less technical and possibly more initially critical questions of whether or not the construct of transferable skills has been sufficiently understood and explained to the professional community and whether or not sufficient consensus on what this construct means and how it should be used in TSA software has been developed. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 19 Without construct validity, TSA software will have little value to predict suitable jobs and associated earnings. To the end of determining if transferable skill is a meaningful construct that can be used reliably to predict suitable occupations for individuals (i.e., predictive validity), the Grimley, et al (2000a, 2000b) was a meaningful first step. In that study, it was hypothesized that if Vocational Expert opinion and the TSA TSP results of MVQS MTSP 2000/2001 software were shown to be consistent, one could argue the concurrent validity of the software and vocational expert opinion. To that end, the Grimley, et al, study assessed the concurrent validity between vocational expert opinions and the results of the McCroskey Transferable Skills Program (MTSP 2000/2001). Specifically, in the Grimley, et al, study, the McCroskey Transferable Skills Program (MTSP 2000/2001) Transferable Skills Percent (TSP) scale was found to be a valid predictor of the averaged responses of 93 Vocational Experts tested using the ABVE Transferable Skills Evaluation Test instrument. The Predictive Validity Coefficient between the MTSP 2000/2001 TSP rankings and the criterion-referenced Prediction Estimates of the Vocational Experts (N=93) was extremely high (Rxy = 0.96). Correspondingly, the Coefficient Of Determination (R2 = 0.92) was extremely high. Finally, the Standard Error of Estimate (SEE = 0.357) was found to be very reasonable. In essence, the Grimley, et al, study found strong support for concurrent, predictive, and underlying construct validity of the McCroskey Vocational Quotient System (MVQS) Theory of Transferable Skills and the resulting MTSP TSA TSP algorithm embodied in the MTSP 2000 and 2001 Programs. The MVQS Transferable Skills Algorithm MTSP 2001 first looks at VQ and then matches people with jobs on the 24 most vocationally significant worker trait variables. Job-person matches with VQs of 85 or greater (the semi-skilled to skilled work range), which match the worker's evaluative data profile relative to profiles of job demands (in the geographically selected MTSP 2001 job bank database of choice) on the 24 most vocationally significant variables extracted from McDOT 2001 are first considered for potential TS level assignment during the MTSP 2001 TSA process. Job-person matches with VQs less than 85 are assumed to be unskilled jobs and are therefore considered last during MTSP 2001 TSA process. The MVQS McCroskey Transferable Skills Program (MTSP, McCroskey, 2000; 2001) use a combination model to produce the TSA Transferable Skills Percent (TSP) values for each job-person evaluative data profile match relative to similarities between selected cross-walks associated with job person matches and successfully demonstrated past relevant client work history. Numerical TSA TSP values are accumulated in the MTSP 2001 Program to produce a theoretical representation of the relative percent of total skills that are transferable from past relevant work history to each identified job-person match. Following comparison on the O*NET Occupational Unit Classification (OUC) Code which produces a similar comparison on 28 vocational variables, the TSP Scale is incorporated to produce a much more refined TSA Scale Ranking. Briefly, an overview of the MTSP TSA TSP Scale Rankings Algorithm is described below. Page: 20 Journal of Forensic Vocationology Vol. 7(1) Monograph The MVQS MTSP TSA TSP Algorithm Overview TSP Level TSP Range Verbal Scale Level 5 80 - 97% = semi-skilled or skilled job(s) with high transferable skills Level 4 60 - 79% = semi-skilled or skilled job(s) with moderate transferable skills Level 3 40 - 59% = semi-skilled or skilled job(s) with low transferable skills Level 2 20 - 39% = semi-skilled or skilled job(s) with few if any transferable skills Level 1 0 - 19% = unskilled job(s) with no significant transferable skills The Highest MVQS Transferable Skills Percent (TSP) Level Jobs in the highest overall level of Transferable Skills (TS) fall in the 80 to 97 percent TS range. These TS levels are reached when a worker returns to a past relevant work history job, or a job-person match with the same (or highly similar) DOT Code (first 3 digits must match exactly), OU Classification/O*Net Code (all 5 or 6 characters must match exactly) and Work Duties. Job-person matches at the highest TS level (97%)11 must also exactly match work history on six TS relevant Crosswalk Codes, (i.e., SIC, SOC, CEN, IND, MPSMS & Work Field/MTEWA codes) to achieve a TS level of 97%. The Semi-Skilled to Skilled Work Range For each job-person match with a VQ of 85 or greater (the 16th to 99th+ Percentile range), MTSP 2001 assumes the job match to be in the semi-skilled to skilled work range and evaluates the cumulative number of all possible crosswalk code matches between the person's identified work history set of jobs relative to each individually identified jobperson match. Following this, the Transferable Skills Percent (TSP) algorithm accumulates a two-digit TS value. The first digit (tens value) of each TS value represents job match similarities between work history and job-person matches on the DOT and O*NET coding systems. The Lowest MVQS Transferable Skills Percent (TSP) Level If a job-person match has a Vocational Quotient (VQ) less than 85, that job is considered unskilled and the MTSP 2001 TSA Transferable Skills Percent level is automatically restricted to the 0 to 19 % unskilled TS range, depending on the number of crosswalk code matches for that job relative to the client's past relevant work history. In the Grimley et al, study, the verbal rating levels (from highest to lowest possible TSA level) were attributed to the objective MTSP TSA TSP rankings, and they matched the 5point overall ranking scale on the ABVE Transferable Skills Evaluation Test instrument. This scale was derived directly from and based specifically on the MVQS MTSP TSP algorithm. 11 The 97 Percent TS level assumes a three percent potential error rate, even when the person takes a job with the same title as one of the jobs in their past relevant work history. This top TS level represents the theoretical concept that while no two jobs are ever 100 percent identical, they should approach unity. Theoretically, this allows for less than perfect TS due to possible subtle differences, either temporally (over time), or between job demands or work duties, given the way the job may be set up at different companies or work sites, that need to be bridged through new, typically short-term learning or accommodation, before the worker can be expected to perform all essential job tasks, with or without, reasonable accommodation. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 21 The total MTSP TSA TSP TS value (Range = 0 to 46) was mathematically transformed to produce a total percent of all available TSP TS scale points (Range = 0 to 97%). This transformation does not exceed a total possible percent of 97. Theoretically, this top level represents the theoretical assumption that no two job-worker situations are 100 percent identical, but that they may approach such unity. MTSP 2001 TSP TS Levels are transformed to a percent based scale based on 65 comparison variables. Variable 1: Relative to VQ, only those job person matches with a VQ of 85 or greater are considered relevant for TS analysis relative to the five-point, 0-97 Percent, MVQS 2001 TS analysis scale: 1. No Significant TS Rating (0-19 Percent TS Range). Job-person matches with a VQ of less than 85 are assumed to fall in the unskilled work range and automatically receive the lowest possible TS Range Rating. 2. Few, If Any, TS Rating (20-39 Percent TS Range), 3. Low TS Rating (40-59 Percent TS Range) 4. Moderate TS Rating (60-79 Percent TS Range) or 5. High TS Rating (80-97 Percent TS Range). Variables 2-25: Relative to the 24 McDOT 2001 most vocationally significant job-person matching variables, all 24 values in the person's evaluative data profile must equal, or exceed, the 24 corresponding values in the job demands profile, before any job-person matches can occur in a specific geographic job bank database and be considered for a TS level assignment based on the degree of similarity between job-person matches and jobs in past relevant work history. Variables 26-28: Relative to the 9-digit McDOT DOT Code, three codes are considered incrementally in sets: 1. The 1st McDOT Code digit, or DOT Occupational Category, 2. The 1st two McDOT Code digits, or DOT Occupational Division, and 3. The 1st three McDOT Code digits, or DOT Occupational Group. Variables 29-31: Relative to the 5 or 6 digit OU Classification/O*Net Code, three codes are considered incrementally in sets: 1. The 1st two digits of the OU Classification/O*Net Code, 2. The 1st four digits of the OU Classification/O*Net Code, and 3. All 5 or 6 digits of the OU Classification/O*Net Code). Variables 32-59: The 28 O*NET TS grouping variables at the tens level, and Variables 60-65: The 6 vocational crosswalk database codes at the ones or units level (i.e., SIC, SOC, CEN, IND, MPSMS and Work Field/MTEWA Codes). Page: 22 Journal of Forensic Vocationology Vol. 7(1) Monograph MTSP 2001 TSA TSP Scale: High, Moderate & Low TS Levels MTSP 2001 TSA TSP High, Moderate & Low Level TS points accumulate as follows: The First Digit (Tens Value) The highest TSP levels (80 - 97%) require the target job to match the reference job on the first 3 digits of the McDOT 2000/2001 code and all 5 or 6 of the O*NET code. The next TSP level (60 - 79%), the two jobs must match either the first 3 digits of the McDOT 2000 code or all 5 or 6 digits of the O*NET code. Or, match the first 2 digits on the McDOT 2000/2001 code and the first 4 digits of the O*NET code. To acquire the third level of TSP (40 - 59%), the jobs must match either the first 2 digits of the McDOT 2000/2001 code or the first 4 digits of the O*NET code. Or, match the first digit of McDOT 2000/2001 code and the first 2 digits of the O*NET code. The Second Digit (Ones or Units Value) The second digit (ones value) is of the Transferable Skills (TS) value for each job match is a direct accumulation for matching on primary codes from six crosswalk code databases. This digit is incremented for each match of the two jobs on the following primary crosswalk codes: Standard Industrial Classification (SIC) Code Standard Occupational Classification (SOC) Code Census (CEN) Code Materials, Product, Subject Matter and Services (MPSMS) Code Work Field (MTEWA) Code Industry (IND) Code Discussion, Conclusions and Recommendations Research results cited in this article support very high Reliability, along with, very high Face, Content, Construct, Predictive and Concurrent Validity for the MVQS MTSP Transferability Skills Percent (TSP) Algorithm in the McCroskey Transferable Skills Programs (MTSP 2000 & 2001). Professional consensus about what the construct of transferability of skills entails and methodological consensus between experts and software about TSA results has been found and reported in peer-reviewed research12. Dennis and Dennis (1998) asked if any TSA software would stand the scrutiny of the Daubert standard for admissibility of expert testimony in federal court. Collaterally they asked if any TSA software, with its strengths and limitations, was a valuable tool for making decisions about jobs and earning capacity in life and in courtrooms. They found 12 In 2003, the MVQS TSA Algorithm was modified to include 7 additional updated Crosswalks to the USDOL SOC Code. At that time, MVQS TSA Levels 1 - 5 were modified to remove all range restrictions. Specifically, the 5 modified levels now allow unskilled jobs to flow throughout the entire MVQS TSA distribution (See MVQS TSA.ppt Presentation; McCroskey, 2003). The net result: improved scientific prediction with more rungs within and across the MVQS TSA scale ladder. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 23 MVQS 2000/2001 programs to fit the bill. If TSA software methodologies are to meet the standard of science that is possible (given that the behavioral sciences typically lack the inherent control of error variance found in the natural sciences) and are to be recognized as a valid predictors of realistic job options and earning capacity for persons with or without disabilities, more research on the validity of TSA methodologies needs to occur. In the Grimley et al, study, 92% of the variance in TSA Expert Responses was controlled or accounted for by the MVQS MTSP TSA TSP Algorithm. Vocational Expert consensus has been reached about the theoretical constructs and the standardized MVQS MTSP TSP algorithm embodied within the MTSP 2000 & 2001 TSA programs. In a nutshell, that study empirically demonstrated that the opinions of vocational experts agree with and are highly reflected in the parameters and outcomes embodied in the MTSP 2000/2001 TSA TSP theory and methodology. Those findings clearly cross-validate and enhance the credibility of clinical judgments made by vocational experts employing MTSP TSA TSP theory and methodology in terms of assisting a Trier of Facts, an individual or other interested parties, as they seek to make sound decisions regarding employability and earnings capacity based on objective, reliable and accurate Transferable Skills Analyses. Transferable skills (TS) are acquired through Specific Vocational Preparation Training as well as On-The-Job Training during on-going successful Job Tenure. Thirty years ago, the Minnesota Theory of Work Adjustment (MTWA) provided an excellent model for Job-Person Matching leading to reasonable expectations of Job Satisfaction and successful Job Tenure. It seems to have stopped there and needs to be revised, extended and updated for the 21st Century. The Minnesota Theory of Work Adjustment should be revised, extended and updated to allow it to be viewed from the perspective of an on-going, reiterative, career development process, leading from one job to the next over time during normal individual career development, for it to adequately account for Transferable Skills Building and Transferable Skills Analysis, and Earning Capacity Estimation. This article presents strong support that theoretical expansion of the MTWA should be based on the content and implications of this article, which reflect what has already been theoretically developed, programmed, successfully demonstrated in the MVQS 2001 MTSP TSA TSP approach to Transferable Skills Analysis and Earning Capacity Estimation. This approach has been shown through scientific research to be leading edge technology in terms of jobperson matching, transferable skills analysis and earning capacity estimation. It has also been shown through numerous scientific research articles to be highly reliable and highly valid with very reasonable, relatively low error rates (See References and Bibliography). REFERENCES AND BIBLIOGRAPHY American Psychological Association. (1993). Standards for Educational and Psychological Tests and Manuals-Revised. American Psychological Association.. Brethauer, M. (2000). New Orleans Conference a rousing success. The Vocational Expert, 17(1), p. 1. Burge, M. J. (1978). Comparing 1977 Evaluations at Goodwill Industries of the Southern Piedmont, Inc., with VDAREs. Unpublished Masters Research Project, Athens GA: University of Georgia. Page: 24 Journal of Forensic Vocationology Vol. 7(1) Monograph Cutler, F., Cutler, G., & Ramm, A. (1995) Vulnerable points and unresolved issues of computer models for determining lost earning capacity. Journal of Applied Rehabilitation Counseling, 26(4), pp. 53-55. Dawis, R. V. (1976). The Minnesota Theory of Work Adjustment. In Bolton (ed.) Handbook of Measurement and Evaluation in Rehabilitation. Baltimore: University Park Press, 227-248 Dawis, R. V., England, G. W. & Lofquist, L. H. (1964). A Theory of Work Adjustment. Minnesota Studies in Vocational Rehabilitation, No. XV. Industrial Relations Center, Minneapolis, MN: University of Minnesota. Dawis, R. V., Lofquist, L. H. & Weiss, D. J. (1968). A Theory of Work Adjustment: A Revision. Minnesota Studies in Vocational Rehabilitation, No. XXIII. Industrial Relations Center, Minneapolis, MN: University of Minnesota. Dennis, K. L. & Tichauer, G. (1998). Replicating Vocational Quotient (VQ) Wage Earning Capacity Predictions in Nebraska. Journal of Forensic Vocationology, 4(1), pp. 85-92. Dennis, K. L., Feldbaum, C. L. & Hahn, S. J. (2000). Louisiana State McDOT 2000 VQ1-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. (TBD). Dennis, K.L. & McCroskey, B.J. (1999). O*NET validity under Daubert. Journal of Forensic Vocationology, 5(1), pp. 49-74. Dennis, M. L. & Dennis, K. L. (1998). Job Search Software Under Daubert: Will It Withstand Scrutiny as Part of Expert Opinion? Journal of Forensic Vocational Assessment, Vol. 1(3), pp. 19-28. Dennis, M. L. & Dennis, K. L. (1998). Replicating Vocational Quotient (VQ) Earning Capacity Predictions In Wisconsin. Journal of Forensic Vocationology, 4(1), pp. 61-68. Federal Judicial Center. (1994 & 2000) Reference Manual on Scientific Evidence. [Manual 2000 had US Supreme Court rulings on Daubert, Joiner & Kumho]. Washington DC: Federal Judicial Center. Author. Feldbaum, C. L. & McCroskey, B. J. (1995). Expert Testimony: Evolving Vocational & Rehabilitation Economic Technologies, Federal Rules of Evidence & the Daubert Decision. J. of Vocationology, 1(1), pp. 1-5. Field, T. F., McCroskey, B. J., Grimes, J. W. & Wattenbarger, W. E. (1978). A Comparison of Vocational Recommendations of the RCEP Masters Students Receiving VDARE Training with those of Vocational Experts and Certified Rehabilitation Counselors. Submitted to VEWAA Bulletin, November, 1978. Grimley, C. P. & Wulz, S.V. (1987). Placement: The Return of Independence. California Workers’ Compensation Enquirer, 5(2), pp.20-23. Grimley, C. P. (2000). Editor's Note: Standards and Information for the Workplace. The Vocational Expert, 17(1), p. 3. Grimley, C. P., Williams, J. M., Hahn, S. J. & Dennis, K. L. (2000a). Scientific Prediction of Transferable Skills. Journal of Forensic Vocationology Vol. 6(1), Fall, 2000, pp. 7-16. Grimley, C. P., Williams, J. M., Hahn, S. J. & Dennis, K. L. (2000b). A Scientific Approach to Transferable Skills. (2000). Journal of Forensic Vocational Analysis. Vol. 3(1), pp. 47-54. Hahn, S. J. & Wells-Moran, J. (1998). Washington State VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 4(1), pp. 79-84. Hahn, S. J. (1997). An Independent Replication of the McCroskey Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Forensic Vocationology, 3(1), pp. 29-33. Hahn, S. J., Larkin, S. & Dennis, K. L. (2000). Florida State McDOT 2000 VQ1-Wage Earning Capacity Predictive Validity Generalization Follow-up Study. Journal of Forensic Vocationology, 6(1), pp. (TBD). Hahn, S. J., Larkin, S. & Williams, J. M. (2000). Florida State McDOT 1998 VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. (TBD). Knowles, P. S. (1978). The Utilization of Vocational History in the Vocational Evaluation Process. Unpublished Masters Research Project, Athens GA: University of Georgia. Landsea, W. F. (1994). Projecting the benefits of earning capacity. Journal of Legal Economics, Winter, pp. 73-83. Mayer L. L. (1998). Admissibility of Vocational Expert Testimony Post-Daubert: A Statistical Validation of the Vocational Quotient as a Predictor of Labor Market Entry Wage. Journal of Forensic Vocational Assessment. Vol. 1(3), pp. 3-17. Mayer, L. L. (1995). Effects of the sources of evaluative data upon wage of Status 26 rehabilitative clients. (Ann Arbor, MI: UMI Microfilm, No. 0526513). Walden University, 1994/1995, Minneapolis, MN. Maze, M. & Williams, J. M. (1993). Using computerized transferable skills databases in court. The Vocational Expert, 10(2), pp. 1-3. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 25 McCroskey, B. J. & Dennis, K. L. (1999). O*Net Issues for Rehabilitation Economists. The Earnings Analyst Journal of the American Rehabilitation Economics Association, Vol. 2(1), pp. 23-34. McCroskey, B. J. & Dennis, K. L. (2001). Emotional Trauma: Its Impact on Vocational Analysis. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J. & Feldbaum, C. L. (1995). Statistical Basics Revisited for Vocational Evaluation and Earning Capacity Analysis under Daubert: A Need for Forensic Standards. Journal of Vocationology, 1(1), pp. 6-8. McCroskey, B. J. & Hahn, S. J. (1995). The Validity of the Vocational Quotient as a predictor of Calendar Year (CY) 1994 starting wages in Minnesota: Study #1. Journal of Vocationology, 1(1), pp. 9-13. McCroskey, B. J. & Hahn, S. J. (1997). The Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Vocationology, 3(1), pp. 1-27. McCroskey, B. J. & Hahn, S. J. (1997, 1998) Linear Regression Analysis of United States Trends in Average Annual Pay: 1984 to 2001. Unpublished Research. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. & Hahn, S. J. (1998). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Validity Follow-up Studies. Journal of Forensic Vocationology, 4(1), pp. 11-52. McCroskey, B. J. & Hahn, S. J. (1998). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Follow-up Validity Studies. The Earnings Analyst Journal of the American Rehabilitation Economics Association, 1(1), pp. 39-80. McCroskey, B. J. & Lowe, J. K. (1985). Linear Regression Analysis of the Relationship Between Job VQs and Job Wages in the US Economy: Using Job VQs to Predict Job Values. Unpublished Research, Authors. McCroskey, B. J. & Lowe, J. K. (1986). How Much Is Your Job Worth? Limited Edition. Minneapolis: Money Pot. McCroskey, B. J. & Lowe, J. K. (1987) Linear Regression Analysis of the Relationship Between Job VQs and Job Wages in the US Economy: Using Job VQs to Predict Job Values. Unpublished Research, Authors. McCroskey, B. J. & Lowe, J. K. (1987). How Much Is Your Job Worth? Revised Edition. Minneapolis: Money Pot. McCroskey, B. J. & Perkins, E. (1981). Manual for the McCroskey Vocational Quotient System, pp. 28-31, 37, 63. McCroskey, B. J. (1979). The Effects Of Source Of Evaluative Data, Severity Of Client Disability, And Client Age Group On The Degree To Which Clients’ Residual Employability Profiles Match Their Actual Employment Outcome Profiles. Unpublished Doctoral Dissertation, University of Georgia, Athens. McCroskey, B. J. (1979a, 1979b, 1979c, 1979d). The Encyclopedia of Job Requirements (EOJR, Volumes 14). Mississippi State: Mississippi State University Computer Science Center. McCroskey, B. J. (1980). Multiple Regression and Frequencies Data on 1977 USDOL Job Analysis Data. Mississippi State, MS: Unpublished Post-Doctoral Research, Author. McCroskey, B. J. (1980, 1981, 1983, 1986, 1990, 1992, 1994, 1995, 1996, 1997, 1998, 2000, 2001). The Encyclopedia of Job Requirements (Volumes 1-4). Reprinted, (1981); Reprinted, (1983, 1986). Revised and reprinted, (1990, 1992). EOJR Volume 1, revised and electronically reprinted within the McDOT 6.1– 7.1 Program Series, (1994, 1995). Revised and electronically stored in McDOT 7.11R – 2001 Program Series, Brooklyn Park, MN: Vocationology, Inc. (1996, 1997, 1998, 2000 & 2001, respectively). McCroskey, B. J. (1982, 1983, 1985, 1987, 1989 & 1990). Manuals for the Datamaster I, II, III, IV & 4p2g Programs (Microcomputer-Assisted Job-Person Matching System Specifically Designed for Use with the McCroskey Vocational Quotient System). Minneapolis, Minnesota: Vocationology, Inc. Program Series, Brooklyn Park, MN: Vocationology, Inc. (1996, 1997, 1998, 2000 & 2001, respectively). McCroskey, B. J. (1982,1983, 1985, 1987, 1989 & 1990). The MVQS Datamaster Job-Person Matching System (Versions 1.0, 2.0, 3.0, 3.0+, 4.0+ and 4p2g). Minneapolis & St. Paul, MN: Vocationology, Inc. McCroskey, B. J. (1991, 1992a, 1992b, 1995, 1996, 1997, 1998, 2000 & 2001). The McCroskey TestPlot Program (McPLOT) Vers. 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0 with McDOT 7.0 and McPLOT 7.0 Program Components, (4/92). Revised to Vers. 7.11, (4/13/95). Revised to Vers. 7.11/R, (8/95). Revised and upgraded to Vers. 7.11R, (6/96). Revised and upgraded to Version 8.0, 8.0R, 2000 & 2001, Brooklyn Park, MN: Vocationology, Inc., (06/97, 10/15/98, 01/01/2000 & 01/01/2001, respectively). McCroskey, B. J. (1991, 1992a, 1992b, 1995, 1997, 1998, 2000, & 2001). The McCroskey Dictionary of Occupational Titles (McDOT). Vers. 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. Page: 26 Journal of Forensic Vocationology Vol. 7(1) Monograph 7.0, (4/92). Revised to Vers. 7.11, (4/95). Revised to Vers. 7.11/R, (8/95). Revised to Vers. 7.11R, (7/96). Revised and upgraded to Vers. 8.0, 8.0R, 2000 & 2001, Brooklyn Park, MN: Vocationology, Inc., (6/97, 10/15/98, 01/01/2000 & 01/01/2001, respectively). McCroskey, B. J. (1991, 1992a, 1992b, 1995a, 1995b, 1996, 1997, 1998, 2000 & 2001). The McCroskey Transferable Skills Program (MTSP) Versions 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0, (4/92). Revised to Vers. 7.11, (4/95). Revised to Vers. 7.11/R, (8/95). Revised to Vers. 7.11R, (7/96). Revised and upgraded to Vers. 8.0, (6/97). Revised to Vers. 8.0R, Brooklyn Park, MN: Vocationology, Inc., (01/01/98). Revised to Vers. 2000, Brooklyn Park, MN: Vocationology, Inc., (01/01/2000). Revised to Vers. 2001, Brooklyn Park, MN: Vocationology, Inc., (01/01/2001). McCroskey, B. J. (1992). The Validity of the Vocational Quotient as a Predictor of Starting Wage Earning Capacity. The Vocationologist, 1(1), pp. 23-24. McCroskey, B. J. (1995). Emergence of Standards in Vocational Technology. The Vocationologist, 2(1), pp. 4-12. McCroskey, B. J. (1995). McDOT, McPLOT and MTSP 7.0 Arrive for 1995. The Vocationologist, 2(1), pp. 1-4. McCroskey, B. J. (1995). The Validity of the Vocational Quotient as a Predictor of Pre-and Post-Injury Earning Capacity. White paper presented at the American Rehabilitation Economic Association, Atlanta, GA, 5/7/95. McCroskey, B. J. (1995). White Paper Re: MN CY 1994 VQ-Wage Data presented at the American Rehabilitation Economics Association National Conference in Atlanta, GA, Fall, 1995. McCroskey, B. J. (1996). 1977-1987 SIC Code to 9-Digit McDOT Code Crosswalk Database. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1996a). The ECLRBOOK. Minneapolis, MN: Vocationology, Inc. McCroskey, B. J. (1996b). The SIC CODEBOOK: MTSP 7.11R SIC CODE Links To US Yellow Page Business/Industry Headings. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0: Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997). The McPLOT 8.0 Program Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997). The MTSP 8.0 Mini-Manual for the Full and Demo Versions of the McCroskey Transferable Skills Program (MTSP) Version 8.0. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997a) The 1996-1998 ECLRBOOK. Brooklyn Park, MN: Vocationology, Inc. Revised (11/27/97) to The Revised 1996-1998 ECLRBOOK. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997b). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0: Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997c). The McPLOT 8.0 Program Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997d). The MTSP 8.0 Mini-Manual for the Full and Demo Versions of the McCroskey Transferable Skills Program (MTSP) Version 8.0. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998) The 1998-2000 ECLRBOOK. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998). The MTSP 8.0R Mini-Manual for the Full and Demo Versions of the McCroskey Transferable Skills Program Version 8.0R. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2000). The Encyclopedia of Job Requirements 2000 (EOJR-2000). [Electronic Computer Program Version 2000, within the McDOT 2000 Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2000). The McCroskey Dictionary of Occupational Titles Program (McDOT) Extended 5th Edition DOT Dataset, Version 2000 [Computer Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2000). The McCroskey Transferable Skills Program (MTSP) Version 2000 [Computer Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2001) MVQS 2001 Resources: Selected Resources for the MVQS 2001 Dataset Edition. Brooklyn Park, MN: Vocationology, Inc. (pp. 45-61). McCroskey, B. J. (2001). Classification of 12,775 McDOT Jobs into 16 MVQS Vocational Interest and Personality Reinforcer (VIPR) Types with Jung-based Personality Type Correspondents Cross-Walk. Electronically published in the McCroskey 5th Ed. Dictionary of Occupational Titles - Extended Data Set Edition. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2001). The Encyclopedia of Job Requirements 2001 (EOJR-2001). [Electronic Computer Program Version 2000, within the McDOT 2001 Program]. Brooklyn Park, MN: Vocationology, Inc. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 27 McCroskey, B. J. (2001). The McCroskey Dictionary of Occupational Titles Program (McDOT) Extended 5th Edition DOT Dataset, Version 2001 [Computer Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2001). The McCroskey Transferable Skills Program (MTSP) Version 2001 [Computer Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J., Bohlke, D. & Streater, S. E. (1995). Re-calibrated Earning Capacity Link Relatives (ECLRs) For the MTSP 7.11R Program: Study #4. Journal of Vocationology, 1(1), pp. 36-45 & pp. 5663. McCroskey, B. J., Dennis, M. L. & Dennis, K. L. (1998). Geographic Location and the Vocational Quotient (VQ) Prediction of Earning Capacity. Journal of Forensic Vocationology, 4(1), pp. 69-78. McCroskey, B. J., Feldbaum C. L., Dennis, K. L. & Hahn, S. J. (1998). Statistical Foundations for Human Services Assessment in Light of the Daubert Decision. Journal of Forensic Vocationology, Vol. 4(1), pp. 93-100. McCroskey, B. J., Hahn, S. J., Dennis, K. L. & Streater, Scott E. (1995). VQ as a Predictor of FY 1994 Wisconsin Starting Wages: Study #3. Journal of Vocationology, 1(1), pp. 26-27, 35. McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). The McCroskey Vocational Quotient System (MVQS) Vocational Interest and Personality Reinforcer (VIPR) Job-based Personality Type Indicator and MTSP Jobs-Based Vocational Interest Personality Types Crosswalk to Jung People-Based Personality Types. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). The McCroskey Vocational Quotient System (MVQS) Theory of Transferable Skills: Revised, Extended and Updated for the 21st Century. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). Design and Development of the MVQS VIPR Type Indicator for inclusion in McPLOT 2001. White Paper Presentation at the Canadian National and Provincial Rehabilitation Counselor Conference, Ottawa, CAN held on November 1, 2001. Submitted for peer-review and publication in Journal of Forensic Vocational Analysis. (2002 issue). McCroskey, B. J., Male, R. & Frank, D. (1995). A Curvilinear Approach for Estimating Present Value Benefits-to-Pay Ratios from US Income Trends 1959-91: Study #5. Journal of Vocationology, 1(1), pp. 46-49. McCroskey, B. J., Male, R. & Frank, D. (1995). A Curvilinear Approach for Estimating Present Value Benefits-to-Pay Ratios from US Income Trends 1959-91: Study #5. Journal of Vocationology, 1(1), pp. 46-49. McCroskey, B. J., Smolarski, R., & Haskins, R. D. (1995). Three-Way Inter-Rater Reliability Using MVQS McDOT, McPLOT & MTSP Computerized Job-Person Matching Program Components: Parts 1 & 2. Journal of Vocationology. 1(1), pp. 67-68. McCroskey, B. J., Streater, S. E., Timming, R. C., Wattenbarger, W. & Lowe, J. K. (1989, 1991a, 1991b, 1992). Job-Person Matching Inputs From the Portable Assessment System-1, Simulated Work Environment Ability Tester: Safety Aspects, Content, and Construct Validity Monograph. Minneapolis, MN: Vocationology, Inc. Reprinted 1991, in: The American Journal of Physical Therapy, pp. 30-76. Reprinted 1991, in: The Vocational Expert, Vol. 8(1), pp. 5-10. Reprinted 1992, in: The American Board of Vocational Experts Monograph, pp. 40-86. McCroskey, B. J., Wattenbarger, W. E., Field T. & Sink, J. (1977). The Vocational Diagnosis and Assessment of Residual Employability (VDARE) Process Worksheet. Athens, GA: Authors. McCroskey, B. J., Wattenbarger, W., Field, T. F. & Sink, J. M. (1977, 1979). The Vocational Diagnosis and Assessment of Residual Employability Handbook. Athens, Ga.: Authors. In: the McCroskey Dissertation, 1979. Reprinted in The VDARE Training Manual, Roswell, GA: VDARE Services Bureau, 1979. McCroskey, B. J.; Streater, S. E.; Wattenbarger, W. E.; Feldbaum, C. L. & Dennis, K. L. (1997). Analyzing employability using worker trait factors: Past, present and future. The Journal of Forensic Vocational Assessment, 1(1), pp. 7-39. McCroskey, B.J. & Dennis, K.L. (2000). ABVE Transferable Skills Evaluation Test (ABVE TSET). [Test Instrument]. Brooklyn Park, MN: Vocationology, Inc. Miller, G. A. (1956). The magical number seven, plus or minus two, or some limits on our capacity to process information. Psychological Review, 63(2), 555-564. Page: 28 Journal of Forensic Vocationology Vol. 7(1) Monograph Minnesota Department of Economic Security. (1996). Minnesota Calendar Year (CY) 1996 (01/01/9612/31/96) Job Service Work Orders 9-Digit DOT Coded Position Openings and Wage Offers Data by County. Saint Paul, MN: Office of Research and Statistical Analysis. Minnesota Department of Economic Security. (1997). Minnesota Fiscal Year (FY) 1997 (09/01/96-08/31/97) Job Service Work Orders 9-Digit DOT Coded Position Openings and Wage Offers Data by County. Saint Paul, MN: Office of Research and Statistical Analysis. Mumford, M. D. & Peterson, N. G. (1995). Chapter 3: Skills. In Development of Prototype Occupational Information Network (O*NET) Content Model by Peterson, N. G.; Mumford, M. D.; Borman, W. C.; Jeanneret, P. R. & Fleishman, E. A. eds. UT Dept. of Workforce Svcs, 3-8, 3-59. Mumford, M. D., Peterson, N. G. & Childs, R. A. (1997). Chapter 3: Basic and cross-functional skills: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume I, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 3-1 to 3-34. Paoli Railroad Yard PCB Litigation No., 92-1995 (3rd Cir, 8/31/94). Parsons, F. (1909). Choosing a Vocation. (1st ed.); Boston: Houghton-Mifflin. People v. Leahy, 882 P.2d 321, 331 (Cal. 1994). People v. Wesley, 633 N.E.2d 451, 456 (NY Ct. App. 1994). Peterson, N. G, Mumford, M. D. Levin, K. Y., Green, J. & Waksberg, J. (1997). Chapter 2: Research method: Development and field testing the content model.. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, & K. Y. Levin eds. UT Dept of Workforce Svcs, 2-1 to 2-51. Psychological Corporation. (1974). Test Service Bulletin Number 48. Chart Comparing Various Test Scores and Their Correspondence to Each Other [Under the Normal or Bell Curve]. New York: The Psychological Corporation. Reinhardt, B. (1978). A Correlation Study Between Jobs Recommended for Clients and Jobs Actually Held by the Clients. Unpublished Masters Research Project, Athens GA: University of Georgia. Ross, D. R. (1990). An Early Intervention Assessment Model for the Vocational Rehabilitation of Social Security Disability Benefit Applicants. Social Security Administration R & D Project (Grant No.: 13-P10017-9-02). Sager, C. E. (1997). Chapter 10: Occupational interests and values: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 10-1 to 10-31. Schuh, A. J. (1967). The Predictability of employee tenure: A review of the literature. Pers. Psych. 20:133152. Shartle, C. L. (1964). Occupations, workers, and classification systems. In: H. Borow (Ed.). Man in a World at Work. Boston: Houghton Mifflin Co. Stern, P. (1994). Science in the Courtroom: From the Frye-Pan to the Fire. Violence Update, Vol. 4(12). Streater, S. E. (1987). A Comparative Analysis of Subtest Results: the 1978 Wide Range Achievement Test (WRAT) Versus the 1984 Wide Range Achievement Test-Revised (WRAT-R). Unpublished Dissertation. American College of Vocational Experts, Nashville, TN. Streater, S. E. (2000). People Who Don't Count Won't Count. The Vocational Expert, 17(1), [Middle Insert]. Strong, M. H., Jeanneret, P. R., McPhail, S. M. & Blakley, B. R. (1997). Chapter 7: Generalized work activities: Evidence for the reliability and validity of the measures. In: O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 7-1 to 7-32. Sparks v Consolidated Rail Corporation No. 94-CV-1917 (E.D. PA. 1995). State v Carter, 524 N.W.2d No. S-93-777 (NE, l994). State v Cauthron, 846 P.2d 502, 505 (Wash. 1993). State v. Alt, 504 N.W.2d 38, 45-46 (Minn. Ct. App. 1993) State v. Bible, 858 P.2d 1152, 1183 (Ariz. 1993) StatSoft, Inc. (1992). Complete Statistical System: STATISTICA (CSS/3), Addendum, Release 3.1. Tulsa, OK: StatSoft, Inc. StatSoft, Inc. (1995). STATISTICA for Windows [Computer program manual]. Tulsa, OK: StatSoft, Inc., 2300 East 14th Street, Tulsa, OK, 74104-4442, (918) 749-1119, fax: (918) 749-2217, e-mail: info@statsoft.com, WEB: http://www.statsoft.com. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 29 StatSoft, Inc. (1998). STATISTICA, Kernel Release 5.1. Tulsa, OK: StatSoft, Inc. Stern, P. (1994). Science in the Courtroom: From the Frye-Pan to the Fire. Violence Update, Vol. 4(12). Stoelting, C. (1990). A study of the construct validity of the MESA. Vocational Evaluation and Work Adjustment Bulletin, 23(3), Fall, 1990, pp. 85-91. Streater, S. E. (1987). A Comparative Analysis of Subtest Results: the 1978 Wide Range Achievement Test (WRAT) Versus the 1984 Wide Range Achievement Test-Revised (WRAT-R). Unpublished Dissertation. American College of Vocational Experts, Nashville, TN. Streater, S. E. (2000). People Who Don't Count Won't Count. The Vocational Expert, 17(1), [Middle Insert]. Strong, M. H., Jeanneret, P. R., McPhail, S. M. & Blakley, B. R. (1997). Chapter 7: Generalized work activities: Evidence for the reliability and validity of the measures. In: O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 7-1 to 7-32. Table B-22. (1992). National Income by type of income, 1959-91. Economic Report of the President. (Transmitted to the Congress, Feb. 1992). Washington, DC: GPO. Reprinted (1995): Journal of Vocationology 1(1), p. 47. Taylor, K. E., & Weiss, D. J. (1972) Prediction of individual job termination from measured job satisfaction and biographical data. J. Vocat. Behav. 2:123-132. Teal, R. A. (1978). Comparison of the VDARE Technique with the Hester Evaluation System. Unpublished Masters Research Project, Athens GA: University of Georgia. The Testifying Expert. LRP Publications, Horsham PA., l993-95, Author. Thorndike, R. L. & Hagen, E. (1969). Measurement and Evaluation in Psychology and Education, 3rd Edition. New York: John Wiley & Sons, p. 173. Trattner, M., Fine, S. A. & Kubis, S. F. (1955). A comparison of worker requirement ratings made by reading job descriptions and by direct job observation. Personnel Psychology, 8(3), 181-194. US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1987). Per Capita Income In Current & 1987 Dollars. News. Washington, DC: Government Printing Office. US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1993). Table B-28 Total And Per Capita Disposable Personal Income And Personal Consumption Expenditures In Current And 1987 Dollars, 1959 - 1993. Washington, DC: Government Printing Office. US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1992). County Business Patterns: US National and Sub-National Wage Earnings Data by two-, three-, and four-digit levels of the Standard Industrial Classification (SIC) System. Washington, DC, US Govt. Printing Office. (VI updated for wage inflation from 1993 - 1998). US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1972). Standard Industrial Classification Codes. Washington, DC, US Govt. Printing Office. Revised, 1977. Revised, 1987. US Department of Commerce, Economics and Statistics Administration, Bureau of the Census. (1987, 1990, 1992, 1993, 1994, 1995, 1996 and 1997). Selected Average Annual Pay Tables: 1984-2001. And, Appendix III: Limitations of Data. In: Statistical Abstract(s) of the United States. Washington, DC: Govt. Printing Office. US Department of Labor, Bureau of Employment Security. (1939a, 1939b). Dictionary Of Occupational Titles (Vols. I & II). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1949a, 1949b). Dictionary Of Occupational Titles (Vol. I & II, 2nd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1956, 1961). Estimates Of Worker Trait Requirements For 4,000 Jobs As Defined In The Dictionary Of Occupational Titles: An Alphabetical Index (Note: the Original HAJ was in the Appendices). Washington, DC: US Govt. Printing Office. US Department of Labor, Bureau of Employment Security. (1965a, 1965b). Dictionary Of Occupational Titles (Vol. I & II, 3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1966). A Supplement for the Dictionary of Occupational Titles (3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1968). Supplement 2 for the Dictionary of Occupational Titles (3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1972). Handbook For Analyzing Jobs (Revised edition). Washington, DC: US Government Printing Office. Reprinted, Menomonie, WI: Materials Page: 30 Journal of Forensic Vocationology Vol. 7(1) Monograph Development Center, University of Wisconsin-Stout, (1976). Re-revised & Reprinted, Washington, DC US Government Printing Office, (1991). US Department of Labor, Bureau of Employment Security. (1977). Dictionary Of Occupational Titles (Vol. I, 4th ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1991a, 1991b). Dictionary of Occupational Titles (Vols. I & II, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Labor Statistics. (1990, 1992, 1994, 1996, 1998 & 2000). Occupational Outlook Handbook 1990-91, 1992-93. 1994-95, 1996-97, 1998-99 & 2000-01 Editions. Washington, DC: US Government Printing Office. US Department of Labor, Employment & Training Administration (US DOLETA). (1998). The Occupational Information Network-98 (O*NET-98, CD-ROM Vers. 1.0). Washington, DC: US Govt. Printing Office. US Department of Labor, Employment and Training Administration (US DOLETA). (1998). O*NET 98 - The Occupational Information Network CD-ROM Vers. 1.0. Washington, DC: Government Printing Office. US Department of Labor, US Employment Service. (1979). Guide for Occupational Exploration.. Washington, DC: US Government Printing Office. US Department of Labor. (1970a). Manual for the USES General Aptitude Test Battery (GATB). Washington, DC: US Government Printing Office. US Department of Labor. (1970b). Manual for the USES Non-Reading Aptitude Test Battery (NATB). Washington, DC: US Government Printing Office. US Department of Labor. (1982). A Guide to Job Analysis. Washington, DC: Government Printing Office. US Department of Labor. (1991). Revised Handbook for Analyzing Jobs. Washington, DC: US GPO. US Department of Labor. (1998). O*NET 98 R&D Viewer: User's Guide. Utah Dept. of Workforce Services. US Department of Labor. Bureau of Employment Security. (1982). Supplement 1 for the Dictionary of Occupational Titles (4th ed.). Washington, DC: Government Printing Office. US Department of Labor. Bureau of Employment Security. (1986). Supplement 2 for the Dictionary of Occupational Titles (4th ed.). Washington, DC: Government Printing Office. US v Starzecpyzel No. 93 CR. 553 (LMM), ( S.D.N.Y., 4/3/95). Vadala v. Teledyne Indus., Inc., 44 F.3d 36, 39 (1st Cir. 1995 holding that Daubert is limited to cases involving scientific law and not accidents). War Manpower Commission, Bureau of Manpower Utilization. (1944). Dictionary Of Occupational Titles, Part IV: Entry occupational classification. Washington, DC: US GPO. War Manpower Commission, US Employment Service. (1943, 1945). Selective Placement For The Handicapped (Rev. ed.). Washington, DC: US GPO. Ward, J. H. (1963). Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association, 58, 236. Wattenbarger W. E. (1981). A Comparison of the Transferable of Skills Analysis of Residual Employability Using the Social Security Administration’s Grid System and the VDARE Process. Unpublished Doctoral Dissertation, University of Georgia, Athens. Wattenbarger W. E., Braswell, S., Dennis, H. & McCroskey, B. J. (1992) Three Employability Indices For Experimental And Programmatic Analysis In Rehabilitation. The Vocationologist, 1(1). Minneapolis, MN: Vocationology, Inc., pp. 2-11. Weiss, D. J., Dawis, R. V., Lofquist, L. H. and England, G. W. (1966). Instrumentation for the theory of work adjustment. Minnesota Studies in Vocational Rehabilitation, (No. XXI). Industrial Relations Center, University of Minnesota, Minneapolis. West Law Books. (1993). Americans with Disabilities Act of 1990. 42 U.S.C.A. SS 12101 et. seq. Williams, J. M. & Maze, M. (1994) The role of the rehabilitation expert in administrative and civil proceedings. Iowa City: Iowa: American College Testing. Williams, J. M. (1998). Transferability of Skills Methodologies Used in Computerized Job Matching Systems: Sufficient or Insufficient Control of Methodologically Induced Error Variance? The Journal of Forensic Vocational Assessment, 1(3), pp. 29-41. Woodside III, B. P., Wiggins, D., & Venn, J J. (1991). Assessing lost earning capacity for the injured minor. Journal of Legal Economics, December, pp. 95-102. Wright, J. W. (1984). The American Almanac of Jobs and Salaries. New York, NY: Avon Books. Wulz, S.V. & Patrizi, C. (1987). Job Analysis: A Diplomats Task, California Workers’ Compensation Enquirer, 4(8), 26-29. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 31 The MVQS13 Vocational Interest and Personality Reinforcer (VIPR) Job-based Vocational Personality Type Indicator and MTSP14 Jobs-Based Vocational Interest Personality Types Crosswalk to Jung People-Based Personality Types By Billy J. McCroskey, Ph.D., Steven J. Hahn, M.S., Scott E. Streater, D.V.S., Larry L. Sinsabaugh, Ph.D., Lyndette L. Mayer, Ph.D., Eugene E. Van de Bittner, Ph.D., Janet K. Lowe, M.S. and Kenneth L. Dennis, Ph.D. Abstract According to Personality Theorist Carl Jung15, human motivation to act or behave in predictable ways may be explained in terms of creative energy and classified into a variety of Jung People-based Personality Types based on different combinations of four dimensions of opposing personality trait continuums: Extravert vs. Introvert, Sensing vs. iNtuiting, Thinking vs. Feeling, and Judgment vs. Perception. Combining opposing personality dimensions by selecting one end of each of the four continuums (E or I, and S or N, and T or F and J or P) yields 16 four-letter MVQS Vocational Interest and Personality Reinforcer (VIPR) Job-based Personality Types16. Each of these have a corresponding Jung People-based Personality Types (e.g., ESTJ, ISTJ, ENTJ, INTJ, . . . ENFP, INFP). The 16 VIPR Job-based Personality Types can be helpful in terms of describing and explaining vocational aspects of complex human behavior. They can also be helpful in matching individuals with Specific Job Types, via the MVQS2001 VIPR Job-based Personality Type Crosswalk, which optimally reinforce (correspond with) their Vocational Interests, Occupational Values, Needs, and General Jung People-based Personality Type. © 2001 by Billy J. McCroskey, Ph.D. All Rights Reserved. Filename: C:\My Documents\VIPRART.doc 13 McCroskey, B. J. (2001). The McCroskey Vocational Quotient System (MVQS2001) Job-Person Matching Program. Brooklyn Park, MN: Vocationology, Inc. 14 McCroskey, B. J. (2001). The McCroskey Transferable Skills Program (MTSP). In: The McCroskey Vocational Quotient System 2001 (MVQS2001) Job-Person Matching Program. Brooklyn Park, MN: Vocationology, Inc. 15 Jung, Carl Gustav - Swiss-born Personality Theorist (1875-1961). 16 VIPR Job Types are 16 General Job-based Personality Types. Each Job-based Personality Type corresponds with one of the 16 General Jung People-based Personality Types. In 2001, the US world of work as we know it has 12,775 Specific Job Types. Each Specific Job Type fits best within one General VIPR Job-based Personality Type and it's correspondent General Jung People-based Personality Type. Page: 32 Journal of Forensic Vocationology Vol. 7(1) Monograph Purpose of the Study The purpose of this study was: 1) To reasonably order the 12,775 Specific Job Types described in the McDOT2001 into 16 General Vocational Interest and Personality Reinforcement (VIPR) Jobbased Personality Types. These General Job-based Personality Types would include seemingly Independent, yet Dependent, Specific Job Types, within and across, the 16 General VIPR Job-based Personality Types, when ordered by Percent of Transferable Skills Valence17 across all 12,775 Specific Job Types. Note: Retaining Specific Job Types with the highest TS Valence in each single best General VIPR Job-based Personality Type, and eliminating all other duplicate, or lower TS Valence Specific Job Types, within and across, the 16 General VIPR Jobbased Personality Types, brings more independent order to the world of work. By forging a link between General Jung People-based Personality Types and their single-best most correspondent General VIPR Job-based Personality Types, we can better match people with jobs based on relevant Personality attributes. The 16 corresponding Job-Person Personality-based Job-Person Matching Types were developed so Career Guidance and Counseling Professionals could provide Personality-based career guidance and counseling to their clientele. How so? By considering which General Jung People-based Personality Type best fits which General VIPR Job-based Personality Type as defined by the set of Specific Job Types nested within each VIPR Job-based Personality Type. 2) To develop an MVQS Vocational Interests & Personality (VIPR) Job-based Personality Type Indicator (both a Paper and Pencil, and a Machine version) which classifies all 12,775 Specific McDOT2001 Job Types into 16 General VIPR Job-based Personality Types, corresponding with the 16 General Jung People-based Personality Character Types18 identified in the literature. 17 Percent of Transferable Skills Valence is defined as the level of Transferable Skills (TS) between two or more Specific Job Types. This is on an MVQS Percent Scale ranging from 0 to 97%. The higher the TS Valence between two or more Specific Job Types, the greater the probability of skills transferability between those Job Types. Valence between two or more seemingly independent Job Types, in any General VIPR Job-based Personality Type, is defined in terms of similarities of occupational interests, values, needs, and other personality attributes common to People Personality Types drawn to Specific Job Types in that same General VIPR Job-based Personality Type. Valence between two or more People in the same General Jung People-based Personality Type is correspondingly defined in terms of similarities of occupational interests, values, needs, and other personality attributes common across individuals in that same General Jung People-based Personality Type. 18 Source Web Site: http://www.doi.gov/octc/typescar.html Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 33 Review of Literature The Origins of Job-Person Matching In the early 1930s, the United States Department of Labor (US DOL) began widespread studies of the requirements of jobs in America. These studies were initially prompted by the need to understand job requirements to better match disabled veterans with jobs. The goal was to reduce or eliminate the impact of vocationally handicapping conditions (McCroskey, 1979; McCroskey & Lowe, 1986, 1987; McCroskey, Streater, Timming, Wattenbarger & Lowe, 1989, 1991). In 1933, the United States War Manpower Commission received congressionallyauthorized funding for job analysis research, which later produced the first edition of the Dictionary of Occupational Titles (DOT, US DOL, 1939). That book was an attempt to objectively describe all jobs in the United States. Eventually, the US DOT served as a model copied by many countries around the world [(McCroskey & Lowe, 1986, 1987); Shartle (1964)]. Subsequent editions of the DOT, Volumes II, III and IV, were researched using objective, behaviorally-anchored Job Analysis Scales and Techniques, described, quantified and published in 1949, 1965, and 1977, respectively. In 1991, instead of researching and updating to a 5th edition DOT, the 1977 4th edition DOT was simply revised and became known as the 1991 revised 4th edition DOT. In 1998, the O*NET 98 Viewer (Version 1.0) was put out, not as an updated DOT, but as a replacement for the DOT. It contained far too much general information and not nearly enough specific to be of much use to Vocational Experts, Career Guidance Counselors, Vocational Rehabilitation Counselors or Consultants, Vocational Evaluators, Psychologists, Psychometrists, or similar professionals. In 2000, since the USDOL had abandoned updating US DOT to a 5th edition, the McCroskey Dictionary of Occupational Titles (McDOT) was updated to a 5th Edition DOT by Vocationology, Inc., a private sector firm in Brooklyn Park, MN. The methods used included a great deal of data mining of the O*NET 98 DOT replacement data along with the data fusion necessary to rebuild the 24 most vocationally significant worker trait profiles for the 12,775 Specific Job Types in McDOT2001. Page: 34 Journal of Forensic Vocationology Vol. 7(1) Monograph The Jung Connection to VIPR Type Indicators The VIPR code was determined from Jung, C.G. (1971). Myers-Briggs resources from Consulting Psychologist Press (CPP) were noted, but not used. We went back to the original source (Jung, 1971). The VIPR types are numbered in order of frequency in the McDOT. Number 1 is the most common type and number 16 is the least common type. While a person may have a personality type (or Conceptual Type as we would describe it), the desired VIPR type is specific to employment. VIPR does not say what type you are. It says what type of job you prefer to have. For many people, personality type is the same as the employment preference type. This cannot be assumed, however, for all workers. Since the VIPR test asks the person to rate jobs on the basis of desirability, it focuses on work preference rather than general personality. Therefore, in its development, focus and prediction, VIPR is not related to Myers-Briggs. Carl Jung remains the theoretical base for the 16 VIPR Type Indicators. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 35 Evaluative Data Profiling The 24 Most Vocationally Significant Worker Traits for Manual and Computerized Job-Person Matching Since the introduction of the formal Minnesota Theory of Work Adjustment in 1964, the US DOL has collected a myriad of worker trait / job requirement element-level data, and utilized that data to develop worker trait / job requirement traits-level data. McCroskey (1982,1983, 1985, 1987, 1989 & 1990) and McCroskey & Lowe (1986, 1987) described the 24, most vocationally significant, traits-level worker traits, which should be measured, or rated, and used for evaluative data profiling in McCroskey Vocational Analysis. This 24 worker traits-level characteristics evaluative data profile should be developed using the McPLOT TestPlot Program and then transferred to the McCroskey Transferable Skills Program (MTSP; McCroskey, 2000) for the best, most reliable and most well validated Job-Person Matching, Employability Determination, and Earning Capacity Prediction Estimates. All of these worker traits have been operationally defined on behaviorally anchored job analysis scales in the Handbook for Analyzing Jobs-Revised (USDOL 1972, 1976, 1991). These 24, most vocationally significant, worker trait characteristics are listed below: Page: 36 Journal of Forensic Vocationology Vol. 7(1) Monograph The 24 Most Vocationally Significant Worker Traits For MVQS2001 Job-Person Matching General Educational Development Worker Traits R - Reasoning M - Math L - Language Aptitude Worker Traits S - Spatial Perception P - Form Perception Q - Clerical Perception K - Motor Coordination F - Finger Dexterity M - Manual Dexterity E - Eye-Hand-Foot Coordination C - Color Discrimination Physical Capacity Worker Traits PD1 - Lifting/Carrying/Pushing/Pulling/Sitting/Standing/Walking PD2 - Climbing/Balancing PD3 - Stooping/Bending/Crouching/Squatting/Kneeling/Crawling PD4 - Reaching/Handling/Fingering/Feeling PD5 - Talking/Hearing PD6 - Seeing Environmental Tolerance Worker Traits EC1 - Work Location (Indoors/Both/Outdoors) EC2 - Extreme Cold EC3 - Extreme Heat EC4 - Dampness/Humidity EC5 - Noise/Vibrations EC6 - Hazards (Mechanical/Electrical/Chemical/Heights) EC7 - Fumes/Dusts/Mists/Gases/Odors Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 37 Updating the Year 2000 Vocational Quotient (VQ1) Relationship between the Old VQ versus the Year 2000 VQ1 The most comprehensive approach to bring order to the world of work and work adjustment, in terms of understanding Overall Job Difficulty and Maximum Vocational Potential, is the McCroskey Vocational Quotient (VQ). The Vocational Quotient was developed from the U.S. Department of Labor (US DOL) Job Analysis behavioral anchor ratings. There were 51 worker traits listed in the 1972 Handbook for Analyzing JobsRevised. In 1979, the 12,099 Job Titles described in the 1977 Dictionary of Occupational Titles (DOT; USDOL, 1977) were arranged by VQ, based on those 51 worker traits (McCroskey & Perkins, 1981), and published in the original four volumes of the Encyclopedia of Job Requirements (McCroskey, 1979a, 1979b, 1979c, 1979d). The 51 worker trait raw scores for each nine-digit DOT job type were added together to produce a total or sum of scores. Some of these raw scores (N=20) had several possible scale values. For example, Reasoning (R), Math (M), and Language (L) had scores that ranged from one to six, and Spatial (S), Form Perception (P) and other aptitudes had scores ranging from one to five. Other worker traits (N=31) such as Seeing (Physical Demand #6) had only two possible values at the worker-trait level: a significant "1" or not significant "0" job requirement. The original Vocational Quotient (VQ) distribution had a mean of 57.1999 and a standard deviation of 14.4558 points. The raw scores were divided into two groups based on whether they had three or more possible values (scalar; N=20), or two possible values (dichotomous; N=31). After recoding all worker trait profile values to place them on ascending scales, a multiple Page: 38 Journal of Forensic Vocationology Vol. 7(1) Monograph regression analysis was completed on the scalar variables to predict the Total Raw Score VQ (TRS-VQ). A second multiple regression was then completed using only the dichotomous variables to predict the TRS-VQ. The relevant acquired regression weights for each worker trait profile were multiplied by their corresponding worker trait profile values and summed to produce the Scalar Variables Vocational Quotient (SVVQ). The relevant acquired regression weights for each worker trait profile were also multiplied by their corresponding worker trait profile values and summed to produce Dichotomous Variables Vocational Quotient (DVVQ) estimates of overall job difficulty, as measured by the TRS-VQ criterion, for each job described in the 1977, 4th ed. DOT. The final SVVQ (Rxy=0.99+ with TRS-VQ) distribution had a mean of 57.1998 and a standard deviation of 14.3741 points. The final DVVQ (Rxy=0.92+ with TRS-VQ) distribution had a mean of 57.2299 and a standard deviation of 13.3208 points. When the final sets of three Vocational Quotients (VQs) were printed to five decimal points, each unique worker trait / job requirements profile pattern was found to be associated with a unique and empirically precise set of VQs (McCroskey & Perkins, 1981). Since 1979, all worker trait profiles and their VQs published in the original four volume edition of the Encyclopedia of Job Requirements (McCroskey, 1979a, 1979b, 1979c, 1979d) have been updated several times. They are now electronically incorporated in the McCroskey Dictionary of Occupational Titles (McDOT) and related McPLOT and MTSP programs. The final product of the first regression analysis (the SVVQ) was ultimately selected as the more robust and more precise estimate of the overall TRS-VQ. The SVVQ was therefore selected as the final, single-best, most representative, Vocational Quotient (VQ) estimate of overall job difficulty for each job. In 1992, the VQ distribution was updated, recalculated, and transformed to produce a distribution with a mean of 100 and a standard deviation of 15 to provide consistency with the WAIS IQ distribution. People have IQs, Jobs have VQs. Put another way, VQ can be thought of as an IQ for work. When the final transformed VQ was printed to five decimal points, each unique job requirement pattern was found to be associated with a unique and empirically precise VQ. In 1995, 2,408 internal DOT inconsistencies identified through research were corrected. This effected 1,913 of the 12,741 worker trait profiles for jobs described in the 1991 DOT. The VQ was re-calculated to adjust for these profile changes. Again, as expected, when the final VQ was printed to five decimal points, each unique job requirement pattern was again found to be associated with a unique and empirically precise VQ. In 2000, the 12,775 worker trait profiles for jobs described in the McDOT2000 were recalculated based on data fusion of 75 selected O*NET 98 worker trait elements with the 24, most vocationally significant, McDOT 8.0R worker traits to reconstitute the McDOT 2000 5th edition DOT - Extended Dataset Edition. Both SVP and VQ aggregate variables were then re-calculated to adjust for the new, updated, Year 2000 worker trait level profile changes. In these re-calculations, only the 24, most vocationally significant (regardless of their scalar or dichotomous nature), worker trait values were used to Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 39 determine the final SVP1 and VQ1 for each job. Again, as expected, when the final VQ1 was printed to five decimal places, each unique job requirement profile pattern was again found to be associated with a unique and empirically precise Vocational Quotient VQ1. VQ (or VQ1), represents the Overall Job Difficulty level of Adaptive or Accommodative Behavior (in terms of Satisfactoriness and Satisfaction) required for people to accomplish meaningful Work Adjustment and develop Tenure for each of the 12,775 jobs described in the McCroskey Dictionary of Occupational Titles (McDOT2001; McCroskey, 2001). Many studies have reviewed the use of the Vocational Quotient based on both the DOT and the O*NET. These studies included McCroskey & Lowe (1986, 1987), McCroskey (1991, 1992), McCroskey & Hahn (1995, 1997, 1998), (McCroskey, Hahn, Dennis & Streater (1995), McCroskey, Bohlke & Streater (1995), Hahn (1997), Dennis & Dennis (1998), McCroskey, Dennis & Dennis(1998), Hahn & Wells-Moran (1998), Dennis & Tichauer, (1998), Dennis & McCroskey (1999), McCroskey & Dennis (1999), Mayer (1998), and Dennis & McCroskey, (2000). The Vocational Quotient (VQ) has been shown repeatedly to be a valid predictor of average starting and overall wages in California, Florida, Louisiana, Michigan, Minnesota, Idaho, Indiana, Iowa, Nebraska, North Carolina Virginia, Wisconsin, Washington, and other states. The Vocational Quotient (VQ) has been shown to be reliable and valid within and across independent cross-validation replication studies, longitudinal time frames (15+ years), and numerous geographic locations. VQ has been repeatedly studied as a predictor of starting wages offered on Job Service Work Order Openings, overall average wages across all workers in the US, and average starting wages achieved by randomly selected rehabilitation clients at time of Status 26 closure in Indiana. VQ has been found to be highly predictive of average starting wages [(Rxy=0.91; SEE=$0.50/hr; McCroskey & Hahn (1998)], overall average wages across all workers in the United States [(Rxy=0.99+; SEE=$0.01/hr; McCroskey & Hahn (1998)], and average post-rehabilitation services starting wages of clients at time of Status 26 closure in Indiana [Mayer (1998, Rxy=0.68; SEE=$1.25/hr) and Dennis & McCroskey (2000, independent replication study Rxy=0.83; R2=0.70; SEE=$1.12/hr)]. Dennis & McCroskey (2000) independently replicated, expanded and updated Mayer’s (1998) Indiana labor market wage research, which was an update of her original study19 of 132 randomly selected people that received State of Indiana Division of Disability, Aging, and Rehabilitation services and were placed in jobs in 1993 (Mayer, 1995). All clients in these studies met the criteria of being successfully rehabilitated. Mayer's 1998 MTSP 7.11R follow-up of her original study was replicated and expanded using MTSP 8.0R Program Earning Capacity Estimates. 19 The authors wish to thank Dr. Lindette Mayer for providing raw data and permission to replicate her 1998 study. Page: 40 Journal of Forensic Vocationology Vol. 7(1) Monograph Mayer (1998) found a gain of about $1.00 above the predicted average return-towork wage for Indiana Rehabilitation clients based on MTSP 7.11R Program Earning Capacity Estimates. That gain was due in part to a small group of people with exceptionally high incomes. When those Outliers were removed in the Dennis & McCroskey (2000) follow-up study (Rxy=0.83; R2=0.70; SEE=$1.12 per hour), average return-to-work wage for Indiana Rehabilitation clients was about $1.00 below what had been predicted. McCroskey & Dennis (2000), in an expansion of Mayer's 1998 study, included an analysis of Temperaments. The expanded study of Indiana Job Services openings and starting wages data from March, 1995 through February, 1996 compared income predictions when Temperaments or Personality variables were added to the MTSP VQ-Wage prediction formula. In the expanded study, Temperaments or Personality variables did not improve the VQ-Wage prediction sufficiently to overcome the increased variance inherent in these measures. Building on previous research which assessed the validity of Vocational Quotient (VQ1) as a predictor of criterion referenced Job Service work order wages to be very positive, McCroskey, Hahn & Dennis (2000) established a new, expanded criterion-reference point distribution for MVQS2001 earning capacity estimation: six-point earning capacity prediction estimates. In their study20, McCroskey, Hahn & Dennis (2000) evaluated the ability of the VQ1 to predict income reported for Occupational Employment Statistics (OES) job groups. Linear regression was used to predict reported income at the Mean, 10th, 25th, 50th, 75th and 90th percentile of the OES-Wage distributions. When VQ1 was used to predict to the middle of these six criterion-referenced distributions, it was found to be a very accurate predictor of each of these OES-Wage distributions reported by the US Department of Labor. Predictive Validity (Rxy) Coefficients were found to be 0.970, 0.973, 0.975, 0.974, 0.972 and 0.966, respectively. Standard Errors of Estimate (SEE) were found to be $1.19, $0.45, $0.69, $1.08, $1.65 and $2.66 per hour, respectively. McCroskey, Hahn & Dennis (2000) recommended the expanded 6-point VQ1-OES Wage Algorithm, based on specific McDOT-VQ121 OES Wage Prediction, be used in the MVQS2001 Program to expand the range of predicted earning capacity estimates, increase overall reliability of predicted earning capacity estimates and reduce aggregate SEEs associated with prediction estimates. Their recommendations were peer-reviewed, found to be empirically sound, and subsequently implemented in the MVQS2001 Program (McCroskey, 2001). 20 McCroskey, B. J., Hahn, S. J. & Dennis. (2000). MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation. The Journal of Forensic Vocationology, Vol. 6(1), pp. 107-134. 21 McCroskey Dictionary of Occupational Titles (McDOT; McCroskey, 2001) 5th Edition DOT: VQ-VQ1 Replacement Data. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 41 Informal vs. Formal Job-Person Matching Theory In his book entitled Choosing a Vocation, Frank Parsons22 (1909), known by many as the father of vocational guidance, postulated three primary requirements for effective vocational guidance: 1. A knowledge of the requirements and conditions for success in different lines of work, as well as related advantages and disadvantages, compensation, opportunities and prospects (knowledge of the world of work); 2. A clear understanding of the aptitudes, interests, ambitions, resources and limitations of the individual (self-knowledge and insight); and, 3. Systematic techniques for integrating these two sources of information in the vocational decision-making process (bringing the first two conditions together). Parsons’ informal, yet profound, three-part theory for vocational guidance continues to guide the efforts of many theoreticians, researchers and clinical practitioners working to develop and refine the methodologies, techniques and tools necessary to provide better vocational counseling. The Minnesota Theory of Work Adjustment (Dawis, England and Lofquist, 1964) provided formal (testable) foundational underpinning for all worker trait factor job person matching systems which later emerged. Many of these had their beginning in the late 1970s with the development of the Vocational Diagnosis and Assessment of Residual Employability [VDARE; (McCroskey, Wattenbarger, Field & Sink, 1977)], and continuing through the 1980s and 90s. These worker-trait-factor job-person matching TSA systems were all developed and computerized based on data describing job requirements in terms of the objectively defined behaviorally- anchored rating scales found in the Handbook for Analyzing Jobs-Revised (HAJ-R; USDOL, 1972; Reprinted, 1976; Re-revised 1991). From 1900 to 1976, more than 20,000 mental and physical tests, covering a multitude of worker traits, had been developed and utilized in an effort to better understand individual differences in terms of basic human capacities and tolerances (Buros, eds. 1-8, 19381978). While many of these tests have been used as lone predictors of employability, 22 Parsons, F. (1909). Choosing a Vocation. (1st ed.); Boston: Houghton-Mifflin. Page: 42 Journal of Forensic Vocationology Vol. 7(1) Monograph research clearly supports the administration of a battery of vocationally relevant tests used in combination for better prediction of the multifaceted criteria known as individual employability (Anastasi, 1958, Anastasi, 1976, Bolton, 1976). Flexible test batteries designed to allow for the systematic measurement of vocationally significant worker traits, remain a priority. Continuing efforts should focus on developing, refining and updating Ability and Work Context instruments and measures of Worker Traits/Job Requirements primarily in these four, vocationally-significant Worker Trait Factor areas: 1) General Educational Development, (3 worker traits) 2) Vocational Aptitudes, (8 worker traits) 3) Physical Capacities (6 worker traits, and 4) Environmental Tolerances (7 worker traits). It is important that such measures be standardized with well-defined behavioral anchors, which are reliable, valid and interpreted in terms of relevant job requirements relative to general adult worker norms. Well-developed tests and measures with reasonable approximations of general adult worker norms can subsequently be combined into a test battery with their results combined and effectively utilized to accomplish Parsons’ (1909) third recommendation for matching people with jobs (McCroskey, Streater, Timming, Wattenbarger & Lowe, 1989; 1991). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 43 The Minnesota Theory of Work Adjustment While informal Job-Person Matching Theory dates back to Parsons (1909), the Minnesota Theory of Work Adjustment (Dawis, England and Lofquist, 1964) provided the first formal foundational underpinning for all worker-trait-factor job person matching systems. These later emerged, beginning in the late 1970s with the development of the Vocational Diagnosis and Assessment of Residual Employability [VDARE; (McCroskey, Wattenbarger, Field & Sink, 1977)], and continuing through the 1980s and 90s. These worker-trait-factor job-person matching TSA systems were all developed and computerized based on data describing job requirements in terms of the objectively defined behaviorally-anchored rating scales found in the Handbook for Analyzing JobsRevised (HAJ-R; USDOL, 1972; Reprinted, 1976; Re-revised 1991). Formal Propositions and Corollaries of the Minnesota Theory of Work Adjustment The following was excerpted from The Minnesota Theory of Work Adjustment by Rene V. Dawis (Bolton, 1976). The following propositions, designed by the authors [(Dawis, Lofquist & Weiss (1968), pp. 9-11)] to serve as a basis for research, state the Theory of Work Adjustment more formally: Proposition I. An individual's work adjustment at any point in time is indicated by his concurrent levels of satisfactoriness and satisfaction. Proposition II. Satisfactoriness is a function of the correspondence between an individual's abilities and the ability requirements of the work environment, provided that the individuals needs correspond with the reinforcer system of the work environment. Corollary IIa. Knowledge of an individual's abilities and of his satisfactoriness permits the determination of the effective ability requirements of the work environment. Corollary IIb. Knowledge of the ability requirements of the work environment and of an individual's satisfactoriness permits the inference of an individual's abilities. Page: 44 Journal of Forensic Vocationology Vol. 7(1) Monograph Proposition III: Satisfaction is a function of the correspondence between the reinforcer system of the work environment and the individual's needs, provided that the individual's abilities correspond with the ability requirements of the work environment. Corollary IIIa. Knowledge of an individual's needs and of his satisfaction permits the determination of the effective reinforcer system of the work environment for the individual. Corollary IIIb. Knowledge of the reinforcer system of the work environment and of an individual's satisfaction permits the inference of an individual's needs. Proposition IV. Satisfaction moderates the functional relationship between satisfactoriness and ability-requirement correspondence. Proposition V. Satisfactoriness moderates the functional relationship between satisfaction and need-reinforcer correspondence. Proposition VI. The probability of an individual being forced out of the work environment is inversely related to his satisfactoriness. Proposition VII. The probability of an individual voluntarily leaving the work environment is inversely related to his satisfaction. Combining Propositions VI and VII, we have: Proposition VIII. Tenure is a joint function of satisfactoriness and satisfaction. Given Propositions II, III, and VIII, this corollary follows: Corollary VIIIa. Tenure is a function of ability-requirement and need-reinforcer correspondence. Proposition IX. Work personality-work environment correspondence increases as a function of tenure. (pp. 234-235). Basic Concepts of the Minnesota Theory of Work Adjustment In an effort to simplify and further explain The Minnesota Theory of Work Adjustment, Dawis (In: Bolton, 1976), said: Speaking at a simple level, a theory is an account of what is happening or what has happened. The Theory of Work Adjustment, then, is an account of what is Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 45 happening or what has taken place in work adjustment. As an account, the theory is itself, quite simple. Tenure, Satisfaction, and Satisfactoriness When a person goes to work, one of the first objective observations that can be made is that he/she continues on the job for a certain length of time. Tenure, length of time on a job, is a basic concept of the Theory of Work Adjustment. Tenure implies a minimal level of work adjustment in terms of correspondence between Satisfactoriness and Satisfaction. If an employee's work adjustment were to drop below this level, then it is presumed that he/she would be let go (fired) from, or would otherwise leave (quit), the job. ... Tenure, satisfaction, and satisfactoriness, then, are the basic outcomes, or dependent variables, of work adjustment. To the extent that work adjustment has taken place, tenure, satisfaction, and satisfactoriness would be manifested to some commensurate extent. That is, they are indicators of work adjustment. These indicators point to the basic factors involved in work adjustment. Satisfaction suggests factors on the individual side, while satisfactoriness suggests factors on the work side (viewing work adjustment as what happens when a person goes to work)...." (pp. 229-230). Concepts Linked to Measures Under the Minnesota Theory of Work Adjustment The Minnesota Theory of Work Adjustment provided formal foundational underpinning for all worker-trait-factor job person matching systems which later emerged. Worker Trait Factors, Worker Traits and Worker Trait Elements are operationalized as Worker Characteristic/Job Requirement component elements on the Job Satisfactoriness, Abilities, Ability Requirements and Occupational Aptitude Pattern (OAP) side of the Minnesota Theory of Work Adjustment equation. Worker Interests, Temperaments, Attitudes, Satisfaction, Needs, Values and Occupational Reinforcer Patterns (ORP) are operationalized as Worker Characteristic/Job Requirement component elements on the Job Satisfaction, Worker Needs and Work Reinforcer Systems side of the Minnesota Theory of Work Adjustment equation. Perhaps Dawis (Ch. 13, In: Bolton, 1976, pp. 227-248) said it best: A formal test of a theory requires that the theory's concepts be operationalized, i.e., stated in terms precisely and specifically describing the operations by which observations are to be made in order to confirm or to disconfirm the theory or any Page: 46 Journal of Forensic Vocationology Vol. 7(1) Monograph part of it. This requirement is usually fulfilled through the use of instruments in data collection. (p. 235). For the Theory of Work Adjustment, six instruments would be needed to make the requisite observations, measures of the following six concepts (p. 234-240): Concepts 1) Satisfactoriness, Instruments/Measures* Minnesota Satisfactoriness Scales (MSS) 2) Satisfaction, Minnesota Satisfaction Questionnaire (MSQ) 3) Abilities, General Aptitude Test Battery (GATB) Related Extensions *Maximum Least Demonstrated Worker Traits Functioning across Successfully Demonstrated Work History, extracted using the Vocational Diagnosis and Assessment of Residual Employability (VDARE) Process which was based on Worker Traits/Job Requirements Profiles rated on HAJ behaviorally anchored Job Analysis Scales identified in the Realistic Occupational Counseling (ROC) Handbook, or the Encyclopedia of Job Requirements (EOJR). *Many Aptitude, Achievement, & Ability test results crunched with the McPLOT Program. *Physical Capacities, Environmental Tolerances rated on Handbook for Analyzing Jobs (HAJ) behaviorally anchored Job Analysis Scales. 4) Ability Requirements, Occupational Aptitude Patterns (OAPs) Related Extensions *Worker Traits/Job Requirements Profiles rated on HAJ behaviorally anchored Job Analysis Scales identified using the Realistic Occupational Counseling (ROC) Handbook, or the Encyclopedia of Job Requirements (EOJR). 5) Needs, and Related Extensions MN Importance Questionnaire (MIQ) MVQS Occupational Values & Needs Inventory 6) Reinforcer Systems MN Job Description Questionnaire (MJDQ) ~Occupational Reinforcer Patterns (ORPs) Related Extensions MVQS Vocational Interest & Personality Reinforcer (VIPR) Type Indicator Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 47 Measures of satisfactoriness and satisfaction would be the outcome or criterion measures. (Tenure is an outcome variable, too, but this can be observed without the need for instrumentation.) Measures of abilities and needs would be required to describe the person, while measures of ability requirements and reinforcer systems would be needed to describe the work environment. To enable the measurement of correspondence, one approach would be to develop parallel measures of people and work environments; that is, measures of abilities and ability requirements should utilize the same set of ability dimensions, and likewise, measures of needs and reinforcers should utilize the same set of reinforcement dimensions. This approach was followed in the Work Adjustment Project. . . . (pp. 234~240). * [Selected emphases and Instruments/Measures added]. Original Extensions of the Minnesota Theory of Work Adjustment Work adjustment (i.e., the achieving and maintaining of individual- environmental correspondence) is an interactive process. Work adjustment mechanisms involving Correspondence, Discorrespondence, Flexibility, Activeness, Reactiveness, and Rate of Work Adjustment, on the part of both the individual and the work environment, were early extensions of the theory, which were present, operationally definable, and observable, relative to testable hypotheses regarding their impact on work adjustment over time. The Realistic Occupational Counseling (ROC) Handbook (Wattenbarger & McCroskey, 1978) was the first private sector supplement to the 1965 Dictionary of Occupational Titles. It provided the original modal worker trait factor profiles used for work history analysis and post-injury residual employability job-person matching using the VDARE Process. The 114 modal worker trait job requirement profiles in the ROC Handbook provided the original database for the Realistic Occupational Counseling Computerized Job-Person Matching Transferable Skills Analysis (TSA) Program. The ROC TSA Program was the first worker trait factor job-person-matching program developed for use on mainframe computers at the University of Georgia (Wattenbarger & McCroskey, 1978). Other Extensions of the Theory Research on other Minnesota Theory of Work Adjustment Extensions (e.g., concepts, constructs, link relatives, occupational values and needs, vocational interests and personality reinforcer type indicators) impacting on our understanding of work adjustment have been operationally defined, studied and found supportive of Propositions identified in the Minnesota Theory of Work Adjustment. Page: 48 Journal of Forensic Vocationology Vol. 7(1) Monograph Other Minnesota Theory of Work Adjustment Extensions include, but are not limited to, Differential: 1) VDARE Residual Employability Profiling (McCroskey, Wattenbarger, Field & Sink, 1977. 2) Vocational Potential Profiling in SSA Disability Determination (Wattenbarger, 1981). 3) The Vocational Quotient (VQ) as a Differential Measure of Overall Job Difficulty and Maximum Vocational Potential (McCroskey & Perkins, 1981). 4) Job Value (McCroskey & Lowe, 1986, 1987). 5) Test Validity (McCroskey & Perkins, 1981; McCroskey, Streater, Timming, Wattenbarger & Lowe, 1989; 1991). 6) Job Service Work Orders Starting Wage Prediction (McCroskey & Lowe, 1987). 7) Rehabilitation Clients Return-to-Work Wage Prediction (Mayer, 1995). 8) Overall Average and Typical Starting Wage Prediction (McCroskey, 1992) 9) Earning Capacity Link Relatives (ECLRs) to Enhance Pre-Injury Earning Capacity Prediction at the Local Labor Market Level (McCroskey, 1992, 1997, 1998, 2000). 10) Earning Capacity Link Relatives (ECLRs) to Enhance Post-Injury Earning Capacity Prediction at the Local Labor Market Level. (McCroskey, 1992). 11) Six point (Mean, 10th, 25th, 50th [Median], 75th and 90th Percentile) wage earning capacity criterion-referenced relative to National Occupational Employment Statistics (OES) prediction estimates (McCroskey, Hahn & Dennis, 2001). 12) The Occupational Values and Needs Inventory (McCroskey, 2001 - modeled after the original Minnesota Importance Questionnaire and criterion-referenced relative to specific 9-digit McDOT 5th Edition DOT Job Types). 13) The Vocational Interest and Personality Reinforcer (VIPR) Job Type Indicator (McCroskey, 2001 - modeled after Jung-based People Personality Types and criterion-referenced relative to specific 9-digit McDOT 5th Edition DOT Job Types, cross-walked from corresponding Jung-based People Personality Types). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 49 From Manual to Computerized Job-Person Matching Job-Person Matching Systems initially began with manual matching systems. Botterbusch (1986) informed us that efforts to develop job-person matching systems as we know them today, actually began in the mid-1950s when Job Service personnel developed several manual systems for matching General Aptitude Test Battery (GATB) test results with jobs. By the late 1970s, all three of Parsons (1909) informal tenets had been achieved in much detail with the arrival of the Vocational Diagnosis and Assessment of Residual Employability (VDARE) Process (McCroskey, Wattenbarger, Field & Sink, 1977). The VDARE Process was based squarely on Proposition II and Corollary IIb with reliance on Proposition III and Corollary IIIb of the Minnesota Theory of Work Adjustment (Dawis, England and Lofquist, 1964; Formally restated and expounded on through supporting research by Dawis, R.V., 1976, In: Bolton, 1976). VDARE became an effective tool in the hands of vocational experts around the country. This was especially true for Expert Witness testimony in Social Security Disability Claims, where reference to previously demonstrated work history, residual functioning, and transferable skills were major considerations [Botterbusch (1986)]. In 1978, the zeitgeist was ready for improvement and better utilization of existing jobperson-matching systems through the much more efficient use of computers (McCroskey, Streater, Timming, Wattenbarger & Lowe, 1989; 1991). In 1978, the ROC TSA became the first mainframe computerized job person matching system. It was developed at the University of Georgia (Wattenbarger & McCroskey, 1978). It was used primarily as a tool for reliable vocational expert analysis of Social Security Disability Insurance (SSDI) applicant appeal cases. Primary considerations for these analyses included age, education, past relevant work history and work restrictions stemming from medical and/or psychological disabilities. Page: 50 Journal of Forensic Vocationology Vol. 7(1) Monograph With the advent of personal computers in the early 1980s, the Datamaster Transferable Skills Analysis (TSA) Program (McCroskey, 1982) was developed, with many revisions and updates to follow (McCroskey, 1982,1983, 1985, 1987, 1989 & 1990). It was the first micro-computerized worker-trait-factor job-person matching TSA system designed specifically for use on Personal Computers. Others soon followed. Comparing Computerized Job-Person Matching Systems Botterbusch (1983) identified, described and compared eight computerized worker-traitfactor job-person-matching systems. In his update, Botterbusch (1986) identified, described and compared 15 such programs. Brown, McDaniel, Couch and McClanahan (1994) expanded on the earlier works of Botterbusch in their publication entitled: Vocational Evaluation Systems and Software: A Consumer’s Guide. Dennis & Dennis (1998) in their article, Job Search Software under Daubert, informed us that: In the 1993 Daubert decision, the United States Supreme Court established scientific knowledge as the standard for admissibility for expert testimony (Feldbaum & McCroskey, 1995, Feldbaum, 1997). This standard can be anticipated to have a significant impact on psychological, rehabilitation, vocational and economic experts. One general expectation is that the instruments used to assess disabilities and predict their consequence will need to be reliable (provide consistent results), valid (measure what it is expected to measure) and accurately predict outcomes with reasonable certainty and known acceptable error rates (accuracy of predictions). The developers of Job Search Software listed by Brown, McDaniel, Couch and McClanahan (1994) were interviewed by phone to determine the scientific attributes of their software. Where available, relevant research to their products was reviewed as well. The responses of the vendors to the possibility of Daubert restricting the use of their software were varied. All the respondents were aware of the 1993 Daubert decision. Only two programs were found to have any research regarding reliability, validity and error rate issues addressed in the Daubert decision. Some expected there to be major upheavals in the future. Others took a more conservative or wait-and-see attitude. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 51 Dennis & Dennis (1998) found one program, the McCroskey Vocational Quotient System Transferable Skills Analysis Program (MVQS MTSP) to have 50+ validity research publications, since 1986 to date and continuing. MTSP was underpinned with on-going scientific research designed to address vitally important issues. These included Reliability, Predictive Validity, and Standard Error of Estimate rates, identified by the US Supreme Court in the Daubert decision, as being the key criteria to be used by judges in their roles as gatekeepers for determining admissibility of expert witness testimony. Clearly, many decades of patience, research and development have begun to produce a fruitful realization of Parson’s intuitive direction. Efforts must continue with the collection, analysis and synthesis of on-going research, into renewed development of vocational theory and practice. Theories must be refined through research. New tools for more efficiently and effectively matching workers with jobs must continue to be developed and updated. New hypotheses must be empirically tested through research on those tools. Results of those studies must be published in peer-reviewed journals to keep our peers abreast of the research evidence if we are to continue understanding, refining and providing evidence of the reliability and validity of our theories to the courts and other interested parties. The O*NET 98 Transferable Skills (TS) Paradigm The 1998 USDOLETA-O*NET 98 Transferability of Skills Paradigm in the MVQS MTSP 1998/2000/2001 Transferable Skills Analysis (TSA) Super Sort? In 1998, 5- or 6-character Occupational Unit Classification (OUC) Coded Transferable Skills Groups (often referred to as O*NET 98 TS Code Groups) were developed for O*NET 98. The O*NET 98/OUC TS Code Groups were derived from USDOL Occupational Employment Statistic (OES) Codes (which are identified by the first 5 digits, of the 5-digit or 6-character OUC Codes, found in Section 7, Part 2, of the MTSP 8.0R and MTSP 2000/2001 TSA Program Job Profile Reports). OES Codes were empirically studied using Cluster Analysis for purposes of establishing O*NET 98 Transferable Skill (TS) Groups. Outliers (jobs which didn't belong) were statistically identified using Euclidean Distance Measures coupled with Ward's Minimum Page: 52 Journal of Forensic Vocationology Vol. 7(1) Monograph Variance Method (Ward, 1963) and reclassified into OES groups or subgroups, or reassigned to other groups or subgroups, as necessary to assure: 1) Belongingness (where the work activities of each 9-digit DOT coded occupation had to match the definition of the occupational category under which it was grouped), 2) Homogeneity (where differences within a single category had to be less than differences between categories and all 9-digit DOT coded occupations within a single category had to be less than differences between categories and all the 9-digit DOT coded occupations within a single category had to show consistency of skill transferability), To accomplish Belongingness and Homogeneity, the three lone variables (MPSMS, METWA and SVP), previously used by the United States Department of Labor Employment and Training Administration (USDOLETA) to conceptually define their Old Transferability Of Skills Paradigm, were, in 1998, operationally redefined with 28 Occupational Classification Codes, Worker Traits, Temperaments and Aggregate variables in their New Expanded Transferability Of Skills Paradigm. O*NET 98 Transferable Skills Groups As a result of the Cluster Analyses which were completed and finalized for the new O*NET 98 Transferable Skills Groupings, 1,172 Occupational Unit Classification (OUC) Groups, or, as they have become better known, O*NET 98 Code Transferable Skills (TS) Groups, were created. O*NET Code TS Groups were based on USDOL Occupational Employment Statistics (OES) Code Groups, which are identified by the first 5 digits, of each 5-digit or 6character O*NET 98 Code TS Group. Thus, OUC/O*NET Code TS Groups are highly refined, empirically derived Transferable Skills Subgroups, within the OES Code Group Classification Structure. Of the 1,172 identified O*NET 98 Code TS Groups, Means Data Profiles for 1,122 were reported in the US DOLETA O*NET 98 Version 1.0 Program. Researchers at Vocationology, Inc. constructed Means Data Profiles for the remaining 50 O*NET 98 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 53 Code Groups (not reported in the US DOLETA O*NET 98 Version 1.0 Program), and added two new groups (each containing only 1 job), bringing the total N to 1,174 groups. Vocationology researchers also reconstituted 12 jobs which were reclassified with different 9-digit DOT Codes by O*NET 98 researchers. In the McDOT2001 program, there are 12,775 specific unduplicated 9-digit DOTCoded Jobs and 12,811, 9-digit DOT-Coded Jobs contained in the McDOT 2000 Crosswalk when duplicated jobs are included. In McDOT2001 each job has a specific worker traits/job requirements profile with respect to the 24 vocationally significant worker traits and 3 aggregate variables (VQ, SVP and ZONE). In the O*NET 98 Version 1.0 Viewer Program, there were 12,761, 9-digit DOTCoded Jobs contained in the O*NET 98 DOT Crosswalk of unduplicated jobs (1,124 of which means data element profiles are not viewable in the O*NET 98 Viewer) and 12,797, 9-digit DOT-Coded Jobs contained in the O*NET 98 DOT Crosswalk, when duplicated 9-digit DOT-Coded Jobs are included. A total of 1.3 percent of the OUC/O*NET Code TS groups (N=15) constitute 38 percent (N=4,889) of the 12,811 (counting all duplications), 9-digit DOT coded jobs. Such a large collection of jobs within so few OU Code groups drastically limits how precise you can be about specific jobs, job tasks, or work sites. The O*NET 98 Occupational Unit (OU) Code by DOT job count distribution is a grossly skewed distribution, which clearly requires job-person matching be accomplished at the job specific worker traits/job requirements profiles level, if we are to avoid overstating transferable skills for any given client. The type of downsizing accomplished in the development of O*NET 98 (Version 1.0) Program by failing to reanalyze specific 9-digit DOT-Coded jobs was neither theoretically nor practically sound. Analyzing O*NET TS groups of jobs and reporting group means data only, may have been cost-efficient for O*NET, but their failure to collect and deliver specific job analysis data has not been good for vocational experts and related vocational professionals, who need job specific, not grouped means, data. While their development of O*NET TS Groups deserves a great deal of credit, they should have stuck with the original plan and developed a 5th edition DOT versus trying to replace it. Page: 54 Journal of Forensic Vocationology Vol. 7(1) Monograph Figure 1: Counts of 9-Digit DOT Codes w/Duplicates (N=12,797) Across All 1,172 O*NET 98 Occupational Units (OUs) Including the 50 All Other OUs 800 9-Digit DOT Codes at each O*NET OU Code Group 700 600 500 DOTCOUNT 400 300 200 100 81 260 32 5 14 3 4 1 1 1 1 1 1 1 1 1 1 1 1 1 0 Number of O*NET 98 OU Code Groups (N=1,172) at each DOT Count MVQS2001 MTSP Transferable Skills Analysis (TSA) Valence Levels The 1998 US DOLETA-O*NET 98 Transferability of Skills Paradigm was expanded to include Percent of Transferability (Valence) and incorporated in the MTSP 8.0R Program on 10/15/98. It was included in the MTSP 2000 Transferable Skills Analysis (TSA) Super Sort on 01/01/2000. Following the very high validity findings identified in the Grimley, Williams, Hahn & Dennis (2000) validation study23, it was included as a part of the MVQS2001 MTSP Transferable Skills Analysis (TSA) Super Sort on 01/01/2001. Percent of Transferable Skills Valence 80 - 97% 60 - 79% 40 - 59% 20 - 39% 00 - 19% 23 Level of Transferable Skills 5 - High Percentage of Skills 4 - Moderate Percentage of Skills 3 - Low Percentage of Skills 2 - Skills Required Not Available 1 - Skills Not Required Grimley, Williams, Hahn & Dennis. (2000). Scientific Prediction of Transferable Skills. Journal of Forensic Vocationology Vol. (6)1, pp. 7-16. Simultaneously printed for broader distribution as: A Scientific Approach to Transferable Skills. (2000). Journal of Forensic Vocational Analysis. Vol. 3(1), pp. 47-54. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 55 The Expanded MVQS2001 MTSP Transferable Skills (TS) Paradigm The Expanded MVQS2001 Transferability of Skills Paradigm includes consideration of the same 28 codes and scales used for developing the 1,172 O*NET TS Groups: 1) Primary Materials, Products, Subject Matter and Services (MPSMS) code, 2) Secondary Materials, Products, Subject Matter and Services (MPSMS) code, 3) Tertiary Materials, Products, Subject Matter and Services (MPSMS) code, 4) Primary Work Field: Machines, Tools, Equipment and Work Aid (MTEWA) code, 5) Secondary Work Field: Machines, Tools, Equipment & Work Aid (MTEWA) code, 6) Tertiary Work Field: Machines, Tools, Equipment and Work Aids (MTEWA) code, 7) Specific Vocational Preparation (SVP), 8) (D)ata Complexity, 9) (P)eople Complexity, 10) (T)hings Complexity, 11) General Educational Development: (R)easoning, 12) General Educational Development: (M)ath, 13) General Educational Development: (L)anguage, 14) (G)eneral Learning Ability Aptitude, 15) (V)erbal Aptitude, 16) (N)umerical Aptitude, 17) (S)patial Perception Aptitude, 18) (P) Form Perception Aptitude, 19) (Q) Clerical Perception Aptitude, 20) (K) Motor Coordination Aptitude, 21) (F)inger Dexterity Aptitude, 22) (M)anual Dexterity Aptitude, 23) (E)ye-Hand-Foot Coordination Aptitude 24) (C)olor Discrimination Aptitude 25) (D)irecting Temperament, 26) (P)eople Temperament, 27) (I)nfluencing Temperament, and 28) (E)xpressing Temperament. Page: 56 Journal of Forensic Vocationology Vol. 7(1) Monograph Theory, Reliability, Predictive Validity and Error Rates Associated with the VDARE Process and MVQS Vocational Analysis Theoretical Underpinning: VDARE Vocational Analysis Under the VDARE Vocational Analysis Process, Proposition I of the Minnesota Theory of Work Adjustment is assumed to be true, therefore: The VDARE Vocational Analysis Process is based squarely on Proposition II and Corollary IIb with reliance on Proposition III and Corollary IIIb of the Minnesota Theory of Work Adjustment (Dawis, England and Lofquist, 1964; Formally restated and expounded on through supporting research by Dawis, R.V., 1976, In: Bolton, 1976). Theoretical Underpinning: MVQS Vocational Analysis The MVQS Vocational Analysis Process relies heavily on the VDARE Vocational Analysis Process, and thus, under MVQS Vocational Analysis Process, Proposition I of the Minnesota Theory of Work Adjustment is also assumed to be true, therefore: The MVQS Vocational Analysis Process is also based squarely on Proposition II and Corollary IIb with reliance on Proposition III and Corollary IIIb of the Minnesota Theory of Work Adjustment (Dawis, England and Lofquist, 1964; Formally restated and expounded on through supporting research by Dawis, R.V., 1976, In: Bolton, 1976). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 57 Reliability, Validity and Error Rates for the VDARE Process Research supports the following Reliability, Validity and Error Rate statistics as applicable to the VDARE Process and to the MVQS Vocational Analysis Process (which incorporates and expands VDARE using the McDOT, McPLOT and MTSP Programs), with reasonable vocational, rehabilitation economic and statistical certainty: Inter-Rater Reliability Using the VDARE Vocational Analysis Process Three-Way Inter-Rater Reliability for using the VDARE Process for Residual Employability Profiling has been found to be in the Extremely High range at Rxxx=0.9944 (McCroskey, 1979). Predictive Validity & Known Error Rates Using the VDARE Process - In a dissertation level validation study on the VDARE Process, McCroskey (1979), found support for the implications in Proposition II, Corollary IIb, Proposition III and Corollary IIIb, that maximum least demonstrated satisfactoriness and satisfaction assumptions, reliably derived and implied (Rxxx = 0.9944) from residual employability worker traits/job requirements profiles of successful client work history, modified by medical restrictions, provided excellent prediction [(93.3% (without testing) and 96.1% (with testing) agreement, with an error rate from 3.8% (with testing) and 8.4% (without testing)] of post rehabilitation services job requirement profiles of jobs at time of placement, in which tenure ensued. A series of follow-up validation studies (Burge, 1978; Field, McCroskey, Grimes & Wattenbarger, 1978; Knowles, 1978; Reinhardt, 1978; Teal, 1978; and Wattenbarger, 1981) with similar findings regarding the validity of the VDARE Process were described in [McCroskey & Perkins (1981), pp. iii-iv & 41-44]. Vocational Potential in SSA Disability Determination Using VDARE - In a second dissertation level validation study of the VDARE Process, Wattenbarger (1981), found support for Proposition II, Corollary IIb, Proposition III, and Corollary IIIb of the theory, that maximum least demonstrated satisfactoriness and satisfaction assumptions, reliably derived Page: 58 Journal of Forensic Vocationology Vol. 7(1) Monograph and implied from residual employability worker traits/job requirements profiles of successful client work history, modified by medical restrictions, provided excellent prediction of Social Security Administration (SSA) eligibility decisions made using the SSA Grid System. In his case review research, Wattenbarger compared independent hypothetical findings based on the VDARE Process, with actual eligibility decisions made by Georgia Disability Determination Unit (DDU) examiners. He found 67% agreement with DDU examiners Grid System based decisions and 33% disagreement with their decisions. Reliability, Validity and Error Rates for the MVQS Vocational Analysis Process Inter-Rater Reliability Using the MVQS Vocational Analysis Process: ThreeWay Inter-Rater Reliability for using the MVQS McDOT, McPLOT and MTSP Programs in tandem has been found to be in the Extremely High range at Rxxx=0.9864 (McCroskey, Smolarski & Haskins, 1995). Predictive Validity and Known Error Rate Using VQ-Wage Data: Predictive Validity associated with Pre- and Post-Injury VQ-Wage Earning Capacity Predictions relative to Job Service Work Order Openings and Wage Offered data has been found to be Extremely High at around Rxy=0.91, with an error rate (SEe=$0.50/hr) of plus or minus $0.50/hr with 67% confidence and plus or minus $1.00/hr with 95% confidence. (McCroskey & Hahn, 1998, McCroskey, 2000). Predictive Validity & Known Error Rate Using VQ-OES Wage Data: Predictive Validity associated with Occupational Employment Statistics (OES) Employment and Wage Estimates has been found to be Very High at Rxy=0.68, with a known error rate (SEe=$1.01/hr) of plus or minus $1.01/hr with 67% confidence and plus or minus $2.02/hr with 95% confidence (Dennis & McCroskey, 1999; McCroskey & Dennis, 1999). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 59 Validity Studies: The MVQS Vocational Quotient (VQ) as a Predictor of Earning Capacity In their study, Dennis & Dennis (1998) identified one program (MVQS MTSP) with 50+ validity research publications, since 1986 to date and continuing (See graphic representations below). Researchers at Vocationology, Inc., are aggressively moving forward with on-going scientific research to address the vitally important issues pertaining to Inter-Rater Reliability, Predictive Validity, and known Standard Error of Estimate rates identified by the US Supreme Court in the Daubert decision, as being the key criteria, to be used by judges in their gatekeeper role, for determining admissibility of expert witness testimony. Graphically displayed below are three figures summarizing the results from the majority of the 50+ studies which have been completed and presented in white paper presentations at national conferences, workshops, seminars, and/or published in books or national peerreviewed journals between 1986 and 1999: Page: 60 Journal of Forensic Vocationology Vol. 7(1) Monograph MTSP Rxy Studies of VQ as a Predictor of Earning Capacity 1.00 0.90 0.80 Rxy Predictive Validity Coefficient 0.70 0.60 0.50 0.40 0.30 0.20 0.10 1997 w 1997t 1997q 1997n 1997k 1997h 1997e 1997b 1995d 1995a 1991d 1991a 1987b 1987b 1987b 1986 0.00 Year Removal of Outliers As reflected in the above graph, in 1997 these regression analysis studies began removing statistical Outliers (standard method, where the Actual Wage was greater than + or - 2 Standard Deviations of the Predicted Wage) from the VQ-Wage data distributions. This resulted in significant improvements in predictive validity coefficients (Rxy) and coefficients of determination (R2), along with corresponding decreases in standard errors of estimates (SEE) for prediction estimates within the + or - two standard deviations of the regression line of best fit (95% Confidence Level). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 61 MTSP Rxy & R2 Studies of VQ as a Predictor of Earning Capacity 1.00 0.90 0.80 0.70 0.60 Rxy 0.50 R2 0.40 0.30 0.20 0.10 0.00 0 10 20 30 40 50 The above graph depicts the improvements in Predictive Validity (Rxy) and Coefficients of Determination (R2) achieved over time. Page: 62 Journal of Forensic Vocationology Vol. 7(1) Monograph Standard Error of Estimate (SEE) Results in Chronological Order from MTSP VQ-Wage Data Earning Capacity Studies: 1984-1997 $7.00 $6.00 US Dollars Per Hour $5.00 $4.00 SEE67 SEE95 $3.00 $2.00 $1.00 $0 10 20 30 40 50 SEE Plots at the 67% and 95% Levels of Confidence In reviewing the above graphical representations of 50+ Predictive Validity research studies, it is clear that VQ-Wage Predictive Validity Coefficents (Rxy), Coefficients of Determination (R2), and Standard Errors of Estimate (SEE) have improved over time (from High-Level in 1986, to Extremely High-Level Validity by the late 1990s). The most recent MVQS MTSP combined 7-state (California, Florida, Louisiana, Minnesota, Virginia, Washington & Wisconsin) studies confirm these trends as continuing patterns. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 63 Using MTSP2001 Job Bank Filters to Predict State Job Types and Job Openings: Reliability, Validity and Error Rates Data used in the analysis of the reliability, validity and error rates of using MTSP2001 Job Bank Filters to Predict State Job Types and Job Openings was collected from Work Force Development Centers covering seven States. Only the most current data available was used to assure reasonable timeliness of the prediction. The Seven State Job Bank databases containing specific MVQS 9-digit McDOT Coded Job Types and Job Openings used in this study were compiled from the seven Database Sets indicated below: 1. 2. 3. 4. 5. 6. 7. California Data = Fiscal Year 1999. Florida Data = Program Year 1999. Idaho Data = 4th quarter 1999, 1st, 2nd and 3rd quarters 2000. Louisiana Data = Fiscal Year 1999. Minnesota Data = 4th quarter 1997, 1st, 2nd and 3rd quarters 1998. North Carolina Data = Program Year 1999. Virginia Data = Fiscal Year 1999. Tabled Summary Data Table 124 Table 1: Actual DOTCodes vs. Predicted DOTCodes - Accuracy & Error in MVQS2001 Job Banks CA Actual DOTCodes: FL ID LA MN NC VA 5,650 4,147 2,318 2,022 2,861 4,716 3,060 Predicted DOTCodes: 3,033 2,399 1,686 1,350 1,898 1,956 1,963 Percent Accuracy: 53.68 57.85 72.74 66.77 66.34 41.48 64.15 Percent Error: 46.32 42.15 27.26 33.23 33.66 58.52 35.85 Mean Percent of DOT Codes Accurately Predicted: 60.43 Mean Percent of DOT Codes Not Predicted (Error): 39.57 Table 2 Table 2: Actual Openings vs. Predicted Openings - Accuracy & Error in MVQS2001 Job Banks CA Actual Openings: FL ID LA MN NC VA 1,908,434 240,961 152,721 76,887 105,625 308,025 182,733 Predicted Openings: 1,899,700 221,543 149,321 69,525 102,800 242,964 149,853 Percent Accuracy: 99.54 91.94 97.77 90.42 97.33 78.88 82.01 Percent Error: 0.46 8.06 2.23 9.58 2.67 21.12 17.99 24 Mean Percent of Job Openings Accurately Predicted: 91.13 Mean Percent of Job Openings Not Predicted (Error): 8.87 Yearly sets of Work Order Job Openings Data from these seven states were incorporated, along with data from 8 other states covering c. 42.6% of the yearly work order openings in the US during the time frame 1996-2000, were used in combination with data from the Job Openings Labor Turnover (JOLT; US DOL, 2002) Study, the SOC Employment and Wage data (JOLT; US DOL, 2002) and US Geo-Location Population from the US Census (US Census Bureau, 2000) in the derivation of MVQS Volcano III and IV (McCroskey, 2003-2004) Occupational Density Estimates for specific jobs in 3,298 MVQS Geo-Location Job Banks. Page: 64 Journal of Forensic Vocationology Vol. 7(1) Monograph Table 3: MVQS MTSP2001 Job Banks Accuracy CA FL ID LA MN NC VA Opens 99.54 91.94 97.77 90.42 97.33 78.88 82.01 Titles 53.68 57.85 72.74 66.77 66.34 41.48 64.15 Figure 1: MTSP2001 Job Banks Accuracy MTSP2001 Job Banks Accuracy 120 Percent Accuracy 100 80 60 40 20 0 CA FL ID LA MN NC VA The Seven States Compared Opens Titles Conclusions On average, MTSP2001 State Job Banks captured 60.43% of the 9-digit McDOT Coded DOT Job Types (See above, Table 1), which, on average, represented 91.13% of the Job Openings (See above, Table 2) found in the Seven State Job Banks used in this study. These findings fit normal expected representation patterns quite well and lend strong support for predictive validity generalization of the identified very high levels of validity, reliability and representative content of all MVQS MTSP2001 Job Banks. Filename: C:\My_Documents\States7.doc Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 65 The Four Jung People-based Personality Scales and Preferences typically associated with those Scales: 1. Energizing - How a person is energized25 Extroversion (E): Preference for drawing energy from the outside world of people, activities or things. Introversion (I): Preference for drawing energy from one's internal world of ideas, emotions, or impressions. 2. Attending - What a person pays attention to Sensing (S): Preference for using the five senses to determine what is real. Intuition (N): Preference for using the imagination to envision what is possible - to look beyond the five senses26. 3. Deciding - How a person decides Thinking (T): Preference for organizing and structuring information to decide in a logical, objective way. Feeling (F): Preference for organizing and structuring information to decide in a personal, value-oriented way. 4. Living - What Lifestyle a person prefers27 Judgement (J): Preference for living a planned and organized life. Perception (P): Preference for living a spontaneous and flexible life. Interpreting VIPR Vocational Personality Types Relative to Jung-based People Types The sixteen Vocational Interest and Personality Reinforcer (VIPR) Types represent clusters of jobs, which Jung People-Based Personality Types of the same or similar persuasion tend to enjoy doing. The VIPR Type job reinforcers are similar to the personality reinforcer preference tendencies of the various Jung People-Based Types. It is important to remember that MTSP Job Profile Reports do not list all possible jobs under the headings, only those which match the client's post vocational potential profile. It is very important to remember that people can, and frequently do, fill jobs in VIPR Type clusters that are dissimilar to their Jung People Personality Type... this happens all the time... and sometimes works out quite well. VIPR Type Job Clusters are sorted in descending order of Client Values Agreement (VA) to provide clients of the same Jung People-based Personality Type, ordered lists of job matches they would typically tend to enjoy. Put another way, the Job at the top of any given VIPR Type list not only matches client Vocational Potential Profile on the 24 most vocationally significant worker traits, but would also tend to satisfy client Occupational Values and Needs more than any other job down the list. Energizing is only one facet of this scale. It is also a measure of an individual's whole orientation towards either the Inner world (I) or the External world (E). 26 Jung called this unconscious perceiving. 27 Alternatively, this scale may be defined in terms of Closure - whether or not a person prefers an openended lifestyle. 25 Page: 66 Journal of Forensic Vocationology Vol. 7(1) Monograph Excerpts from the US Department of the Interior (DOI) Web Site28 Describing Personality Instruments and their Potential Vocational Uses "Personality instruments are tools that give continuing insight into ourselves and others. They are frequently used to help individuals see their preferences, potential strengths and weaknesses, and how they relate to different occupations. They can be a powerful tool in helping an individual select a potentially satisfying occupation and/or field of study. Two of the most well-known personality instruments are the Keirsey Temperament Sorter29 and the Myers-Briggs Type Indicator®30. Both deal with four very strong categories for taking in and processing information, plus interacting with the world31. These instruments are based on the work of the Swiss psychiatrist, Carl Jung. This unit uses the Keirsey Temperament Sorter to identify a basic personality type. You may then use this information to direct you to different careers. Before completing the Keirsey, it is important to be aware of some important points: The Keirsey measures preferences, not skills. We can all do things we do not prefer. This is about what you do when you have your druthers. There are no right or wrong responses, only those that fit you and those that do not! One personality type is not better than another. Each has a richness and potential as great as the others. You are the final judge. After you receive your 4-letter type, you'll be able to weigh whether the description fits you and make changes. Read an explanation of what the letters represent." (See next Page). 28 http://www.doi.gov/octc/personal.html 29 http://www.keirsey.com/ 30 Myers-Briggs Type Indicator® is a Registered Trademark of Consulting Psychologists Press (CPP). 31 Keirsey Temperament Sorter® & AdvisorTeam FAQ #1 (Source: http://www.keirsey.com/faq/html) Question 1: Is the Myers-Briggs Type Indicator the same as the Keirsey Temperament Sorter. No. The Myers-Briggs Type Indicator is trademarked and copyrighted by Consulting Psychological Press. The Keirsey Temperament Sorter is trademarked and copyrighted by Prometheus Nemesis Book Company Inc. They are different personality inventories. However, they are very similar in result (approximately .80 correlation) because they are both based on the work of the Psychologist, Carl Jung. The MBTI measures 4 scales of personality and categorizes individuals into 1 of 16 types using a 4 letter score. Each scale is viewed independently of the others. Dr. Keirsey believes that these four scales are not independent of each other and that the most important feature of Jung's Character Types are the two letter pairings that make up what Keirsey has popularized as Temperament. Dr. Keirsey coined the terms Artisan, Guardian, Rational and Idealist to describe these 4 main personality types. He then further subdivided the 4 temperaments into four character variants [each] and popularized the terms used to describe them [the 16 character variants]. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 67 Definitions Relating to Personality Type (P-Type) Letter Designations What Do Those Letters Represent...?32 Refers to how a person is energized Extraversion Introversion Shows a preference for drawing energy Shows a preference for drawing energy from the outside word of people, from one's internal world of emotions activities or things. or impressions. Refers to what a person pays attention to Sensing Shows a preference for trusting information received through the five senses and noticing what is actual. iNtuition Shows a preference for trusting information received through a "sixth sense" and noticing what might be. Refers to what a person most trusts when making a decision Thinking Feeling Shows a preference for trusting Shows a preference for trusting logical personal and value-oriented and objective information. information. Refers to the life style a person adopts Judgment Shows a preference for living a planned and organized life. 32 Perception Shows a preference for living a spontaneous and flexible life. Source: Department of Interior Web Site: http://www.doi.gov/octc/scales/htm Page: 68 Journal of Forensic Vocationology Vol. 7(1) Monograph Selected Additional Background Information, Insight and Recommendations Posted on the US Department of the Interior (DOI) Web Site Regarding Connecting Personality Types With Careers and Jobs Connecting Personality Types With Careers and Jobs33 Before looking at the lists below... The lists represent careers and jobs people of various types tend to enjoy doing. The job requirements are similar to the personality tendencies of the various types. It is important to remember that these do not list all the jobs possible under the headings. And it is very important to remember that people can, and frequently do, fill jobs that are dissimilar to their personality... this happens all the time... and sometimes works out quite well. Why then should we even consult these lists? The lists are just another tool to give you ideas about careers and jobs you might enjoy. Use the lists as [a] tool, not a box! Source: careerwebmaster@ios.doi.gov U.S. Department of the Interior Revised: Monday, 06-Nov-2000 09:42:48 EST (Source Web Site: http://www.doi.gov/octc/typescar.html) 33 Source: U.S. Department of the Interior Web Site: http://www.doi.gov/octc/typescar.html Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 69 Partial Lists of Extravert Reinforcer Careers and Jobs from the US Department of the Interior (DOI) Web Site ESTP ESFP ENFP ENTP real estate broker chef land developer physical therapist stock broker news reporter fire fighter promoter entrepreneur pilot budget analyst insurance agent management consultant franchise owner electrical engineer aircraft mechanic technical trainer EEG technologist radiological technician emergency medical tech. corrections officer flight attendant veterinarian flight attendant floral designer real estate agent child care provider social worker fundraiser athletic coach musician secretary receptionist special events producer teacher: preschool teacher: elementary emergency room nurse occupational therapist exercise physiologist team trainer travel sales public relations specialist waiter/waitress labor relations mediator conference planner speech pathologist HR development trainer ombudsman clergy journalist newscaster career counselor housing director character actor marketing consultant musician/composer artist information-graphics ...designer human resource manager merchandise planner advertising account manager dietitian/nutritionist speech pathologist massage therapist editor/art director systems designer venture capitalist actor journalist investment broker real estate agent real estate developer strategic planner political manager politician special projects developer literary agent restaurant/bar owner technical trainer diversity manager art director personnel systems developer computer analyst logistics consultant outplacement consultant advertising creative director radio/TV talk show host ESTJ ESFJ ENFJ ENTJ government employee pharmaceutical sales auditor computer analyst technical trainer project manager officer manager factory supervisor credit analyst electrical engineer stockbroker regulatory compliance ...officer chief information officer construction worker general contractor paralegal industrial engineer budget analyst data base manager funeral director cook security guard dentist nurse social worker caterer flight attendant bookkeeper medical/dental assistant exercise physiologist elementary school teacher minister/priest/rabbi retail owner officer manager telemarketer counselor special education teacher merchandise planner credit counselor athletic coach insurance agent sales representative massage therapist medical secretary child care provider bilingual education teacher professional volunteer entertainer recruiter artist newscaster writer/journalist recreation director librarian facilitator politician psychologist housing director career counselor sales trainer travel agent program designer corporate/team trainer child welfare worker social worker (elderly ...services) interpreter/translator occupational therapist executive: small business alcohol/drug counselor sales manager program designer attorney administrator office manager chemical engineer sales manager logistics consultant franchise owner new business developer personnel manager investment banker labor relations management trainer credit investigator mortgage broker corporate team trainer environmental engineer biomedical engineer business consultant educational consultant personal financial planner network integration ...specialist media planner/buyer careerwebmaster@ios.doi.gov U.S. Department of the Interior Revised: Monday, 06-Nov-2000 09:42:48 EST (Source Web Site: http://www.doi.gov/octc/typescar.html) Page: 70 Journal of Forensic Vocationology Vol. 7(1) Monograph Partial Lists of Introvert Reinforcer Careers and Jobs from the US Department of the Interior (DOI) Web Site ISTJ ISFJ INFJ INTJ management accounting auditing efficiency expert engineer geologist bank examiners organization development electricians dentists pharmacist school principals school bus drivers file clerk stock broker legal secretary computer operator computer programmer technical writer chief information officer police officer real estate agent counseling ministry library work nursing secretarial curators bookkeepers dental hygienists computer operator personnel administrator paralegal real estate agent artist interior decorator retail owner musician elementary school teacher physical therapist nurse social worker personnel counselor alcohol/drug counselor career counselor psychologist educational consultant special education teacher librarian artist playwright novelist/poet editor/art director information-graphics ...designer HRM manager merchandise planner environmental lawyer marketer job analyst mental health counselor dietitian/nutritionist research educational consultant architects interpreter/translator management consultant economist scientist computer programmer environmental planner new business developer curriculum designer administrator mathematician psychologist neurologist biomedical researcher strategic planner civil engineer intellectual properties attorney designer editor/art director inventor informational-graphics ...designer financial planner judge ISTP ISFP INFP INTP surveyor fire fighter private investigator pilot police officer purchasing agent chiropractor medical technician securities analyst computer repair person race car driver computer programmer electrical engineer legal secretary coach/trainer commercial artist carpenter paralegal dental assistant radiological technician marine biologist software developer bookkeeper clerical supervisor dental assistant physical therapist mechanic radiology technologist surveyor chef forester geologist landscaper designer crisis hotline operator teacher: elementary beautician typist jeweler gardener potter painter botanist marine biologist social worker information-graphics ...designer college professor researcher legal mediator social worker holistic health ...practitioner occupational therapist diversity manager human resource ...development specialist employment development ...specialist minister/priest/rabbi missionary psychologist writer: poet/novelist journalist editor/art director organizational development ...specialist strategic planning writer staff development lawyer architect software designer financial analyst college professor photographer logician artist systems analyst neurologist physicist psychologist research/development ...specialist computer programmer data base manager chemist biologist investigator careerwebmaster@ios.doi.gov U.S. Department of the Interior Revised: Monday, 06-Nov-2000 09:42:48 EST (Source Web Site: http://www.doi.gov/octc/typescar.html) Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 71 Excerpts from the Kelly Web Site34 Describing Five Personality Typologies (PTypes) and Corresponding Crosswalks of those Five Personality Typologies PType Personality Types PTypes Anyone is free to use any part of this chart with or without credit. Noteworthy Examples Correspondence of five personality typologies PTypes personality type1 Keirsey's/ MyersBriggs’ type2 Riso's Enneagram type3 PTypes personality disorder4 Brau's astrological type5 Conscientious Sensitive Vigilant Dramatic ENFJ INFJ ENFP INFP 1 4+(5) 6+(5) 4+(3) Obsessive-Compulsive Avoidant Paranoid Histrionic Aquarius Pisces Scorpio Leo Aggressive Idiosyncratic Inventive Solitary ENTJ INTJ ENTP INTP 8 5+(4) 3+(4) 5+(6) Sadistic Schizotypal Compensatory Narcissistic Schizoid Aries Aries Gemini Gemini Leisurely Serious Self-sacrificing Devoted ESTJ ISTJ ESFJ ISFJ 9+(8) 9+(1) 2 6+(7) Passive-Aggressive Depressive Masochistic Dependent Taurus Taurus Cancer Virgo Self-confident Adventurous Mercurial Artistic ESTP ISTP ESFP ISFP 3+(2) 7+(8) 7+(6) 7+(6) Narcissistic Antisocial Borderline Cyclothymic Capricorn Sagittarius Libra Libra References35 Cited on Kelley's Web Site for the above listed Crosswalks 34 35 http://www.geocities.com/HotSprings/Resort/5446/correspondence.html Reference 1. Cf. Oldham, John M., and Lois B. Morris. The New Personality Self-Portrait: Why You Think, Work, Love, and Act the Way You Do. Rev. ed. New York: Bantam, 1995. 2. Keirsey, David, and Marilyn Bates. Please Understand Me: Character and Temperament Types. 3rd ed. Del Mar: Prometheus Nemesis, 1978. 3. Riso, Don Richard, and Russ Hudson. Personality Types: Using the Enneagram for Self-discovery. Rev. ed. New York: Houghton, 1996. 4. Cf. Millon, Theodore, and Roger Davis. Disorders of Personality: DSM-IV and Beyond. 2nd ed. New York: Wiley, 1996. 5. Brau, Jean Louis, Helen Weaver, and Allan Edmands. Larousse Encyclopedia of Astrology. New York: McGraw-Hill, 1980. Page: 72 Journal of Forensic Vocationology Vol. 7(1) Monograph Vocational Interest and Personality Reinforcer (VIPR) General Job-based Personality Types with Correspondent Crosswalks to General Jung People-based Personality Type ORD36 TYPE37 DESCRIPT38 01 ESTJ Vocational Interest and Personality Reinforcer Type: ESTJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 5,063 (39.63%) were classified ESTJ. 01 ESTJ Jung-based Personality Type Correspondent: ESTJ. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 689,423 (11.01%) were classified ESTJ as of 12/15/2000. 02 ISFP Vocational Interest and Personality Reinforcer Type: ISFP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 3,690 (28.88%) were classified ISFP. 02 ISFP Jung-based Personality Type Correspondent: ISFP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 187,154 (2.99%) were classified ISFP as of 12/15/2000. 03 ESFP Vocational Interest and Personality Reinforcer Type: ESFP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 919 (7.19%) were classified ESFP. 03 ESFP Jung-based Personality Type Correspondent: ESFP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 300,792 (4.80%) were classified ESFP as of 12/15/2000. 04 ESTP Vocational Interest and Personality Reinforcer Type: ESTP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 541 (4.23%) were classified ESTP. 04 ESTP Jung-based Personality Type Correspondent: ESTP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 169,604 (2.71%) were classified ESTP as of 12/15/2000. 05 ISTJ Vocational Interest and Personality Reinforcer Type: ISTJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 474 (3.71%) were classified ISTJ. 05 ISTJ Jung-based Personality Type Correspondent: ISTJ. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 662,915 (10.58%) were classified ISTJ as of 12/15/2000. 06 ESFJ Vocational Interest and Personality Reinforcer Type: ESFJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 439 (3.44%) were classified ESFJ. 06 ESFJ Jung-based Personality Type Correspondent: ESFJ. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 763,261 (12.19%) were classified ESFJ as of 12/15/2000. 07 ISTP Vocational Interest and Personality Reinforcer Type: ISTP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 377 (2.95%) were classified ISTP. 07 ISTP Jung-based Personality Type Correspondent: ISTP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 135,786 (2.17%) were classified ISTP as of 12/15/2000. 08 ENTJ Vocational Interest and Personality Reinforcer Type: ENTJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 237 (1.86%) were classified ENTJ. 08 ENTJ Jung-based Personality Type Correspondent: ENTJ. Out of 6,263,334 people taking the 36 Order of VIPR Job Type Categories based on Frequencies of Specific Job Types within VIPR Categories. 37 VIPR General Job-based Personality Types to Jung People-based General Personality Types. 38 Descriptive Statistics for VIPR Job-based Types & Corresponding Jung People-based Personality Types. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 73 Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 198,653 (3.17%) were classified ENTJ as of 12/15/2000. Vocational Interest and Personality Reinforcer (VIPR) General Job-based Personality Types with Correspondent Crosswalks to General Jung People-based Personality Type ORD TYPE DESCRIPT 09 ISFJ Vocational Interest and Personality Reinforcer Type: ISFJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 235 (1.84%) were classified ISFJ. 09 ISFJ Jung-based Personality Type Correspondent: ISFJ. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 605,759 (9.67%) were classified ISFJ as of 12/15/2000. 10 ENTP Vocational Interest and Personality Reinforcer Type: ENTP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 215 (1.68%) were classified ENTP. 10 ENTP Jung-based Personality Type Correspondent: ENTP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 139,331 (2.22%) were classified ENTP as of 12/15/2000. 11 INTJ Vocational Interest and Personality Reinforcer Type: INTJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 173 (1.35%) were classified INTJ. 11 INTJ Jung-based Personality Type Correspondent: INTJ. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 328,426 (5.24%) were classified INTJ as of 12/15/2000. 12 INTP Vocational Interest and Personality Reinforcer Type: INTP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 120 (0.94%) were classified INTP. 12 INTP Jung-based Personality Type Correspondent: INTP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 193,629 (3.09%) were classified INTP as of 12/15/2000. 13 ENFJ Vocational Interest and Personality Reinforcer Type: ENFJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 91 (0.71%) were classified ENFJ. 13 ENFJ Jung-based Personality Type Correspondent: ENFJ. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 465,565 (7.43%) were classified ENFJ as of 12/15/2000. 14 INFP Vocational Interest and Personality Reinforcer Type: INFP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 90 (0.70%) were classified INFP. 14 INFP Jung-based Personality Type Correspondent: INFP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 426,896 (6.82%) were classified INFP as of 12/15/2000. 15 ENFP Vocational Interest and Personality Reinforcer Type: ENFP. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 70 (0.55%) were classified ENFP. 15 ENFP Jung-based Personality Type Correspondent: ENFP. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 538,008 (8.59%) were classified ENFP as of 12/15/2000. 16 INFJ Vocational Interest and Personality Reinforcer Type: INFJ. Out of the 12,775 specific 9-digit DOT-Coded Job Types in the MVQS2001 McDOT 5th Edition Dictionary of Occupational Titles, 40 (0.31%) were classified INFJ. 16 INFJ Jung-based Personality Type Correspondent: INFJ. Out of 6,263,334 people taking the Temperament Sorter and the Character Sorter on the http://www.keirsey.com/ Temperament Web Site, 458,132 (7.31%) were classified INFJ as of 12/15/2000. Page: 74 Journal of Forensic Vocationology Vol. 7(1) Monograph Methodology To accomplish the purposes of this study required the reduction of 16 sets of General Careers and Job Type lists to 16 Most Appropriate, Independent, Mutually Exclusive, sets of Specific Vocational Interest and Personality Reinforcer (VIPR) Job Types The 16 DOI lists referred to General sets of Careers and Jobs (around 21 or 22 per list). They were non-specific and contained duplicate Careers and Jobs listings within and across the 16 lists. Since duplicates were unclassifiable to a single, most appropriate, Specific Vocational Interest and Personality Reinforcer (VIPR) Job Type Lists, they were eliminated. This left 11-12 non-duplicated General sets of Careers and Jobs. Eliminating duplicate Careers and Jobs from the 16 General Careers and Jobs lists transformed them into 16 Tip of the Iceberg lists of Careers and Jobs Clusters. These Tip of the Iceberg lists were reviewed for purposes of identifying the 16 most reasonable center-of-the-cluster, mutually exclusive sets of Specific 9-digit McDOT Coded VIPR Job Types (N=23 - 43). These sets were required to re-expand each list to include up to 35 Specific VIPR Job Types with very high Transferable Skills (TS level 97) Valences. These 16 very high TS Valence VIPR lists were then processed through MTSP using the MTSP2000 Transferable Skills (TS) Algorithm (Grimley, Williams, Hahn, & Dennis, 2000). The purpose was to establish and rank order all possible Specific VIPR Job Type lists (N=12,775 each) in descending order by TS Valence by VQ1 by SVP1 and in ascending order by McDOT Code, for the 16 lists. The final sort for Vocational Interest and Personality Reinforcer (VIPR) Job-based Personality Types was completed prior to the removal of duplicates to reduce the 16 VIPR Sets of Job Types to a final N of 12,775 Specific Job Types, across the 16 Independent, Mutually Exclusive, VIPR Job Types. Put another way, after removal of initially identified duplicates, all Specific jobs were duplicated 16 times each, with variable Transferable Skills (TS) Valence levels, relative to each of the 16 VIPR Sets of Job Types. Then, the final 16, most appropriate Vocational Interest and Personality Reinforcer (VIPR) lists of Job Types were constructed by retaining only those Specific Job Types with the highest possible TS Valence across each set of 16 job duplicates. After eliminating the 15 other jobs with duplicate or lesser TS Valences across the 16 VIPR lists, the goal of establishing the final 16 most appropriate, seemingly independent & mutually exclusive, VIPR lists of Job Types was accomplished. Design and Development of the MVQS VIPR Job-based Type Indicator: A Criterion-Referenced, Paired Associates Jobs Typology Instrument In designing the MVQS VIPR Job-based Type Indicator Instrument, it was decided that 108 sets of optimally balanced, paired associate VIPR Job-based Specific Job Types would be required to assure reasonable expectations of moderate to very high Test-Retest Reliability (i.e., in the Rxx=0.80-0.99 range). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 75 Therefore, from each of the final 16 VIPR Job-based Personality Type Lists, 13-16 Specific Job Types with TS Valences of 97 were selected for inclusion in the MVQS VIPR Job-based Type Indicator sets of optimally balanced, paired associates (N=213). The final N of 108 sets of optimally balanced, paired associates required that three additional Specific VIPR Job Types from the VIPR INFJ Set of Job Types, with slightly lower TS Valences (two with TS Valences of 94 and one with a TS Valance of 91), be incorporated. The addition of these three Specific VIPR INFJ Job Types completed the list of 216 Specific VIPR Job Types (selected across all 16 VIPR Job Types lists) required to finalize the 108 sets of optimally balanced, paired associates for the MVQS VIPR Job-based Personality Type Indicator. Following the development of 108 sets of optimally balanced, paired associates, the MVQS VIPR Job-based Personality Type Indicator instrument was placed in an MS Excel Spreadsheet complete with instructions and scoring formulas designed to yield an individualized, single-best VIPR Type for each person completing the MVQS VIPR Jobbased Personality Type Indicator. This instrument was then sent via e-mail attachment to a number of Expert Vocational Practitioners for peer-review and field-testing. Results Face and Content Validity were established by Expert Vocational Practitioners to be in the very high range for the paper and pencil version of the MVQS VIPR Job-based Personality Type Indicator during the peer-review and field-testing phase. Suggestions for improvements were solicited from Expert Vocational Practitioners completing peer-review and field-testing of the Instrument. All recommendations from Expert Vocational Practitioners completing peer-review and field-testing of the paper and pencil version of the instrument, as well as the programming format suggestions for the MVQS VIPR Job-based Personality Type Indicator instrument to be included in the MVQS2001 McPLOT Sub-Program were reviewed and considered. The best suggestions were selected, incorporated and implemented in the final versions of both MVQS VIPR Job-based Personality Type Indicator instruments. The paper and pencil version was printed for distribution (See next 5 pages). Programming for the MVQS VIPR Job-based Personality Type Indicator instrument to be included in the MVQS2001 McPLOT Sub-Program was initiated and completed. Page: 76 Journal of Forensic Vocationology Vol. 7(1) Monograph The MVQS VIPR Job-Based Vocational Personality Type Indicator MVQS Vocational Interest and Personality Reinforcer (VIPR) Type Indicator (A McCroskey 5th Ed Dictionary of Occupational Titles (McDOT) Paired-Associates, Criterion-Referenced Test) © 2001 by Billy J. McCroskey, Ph.D. All Rights Reserved. NAME: DATE: Instructions: Review each Pair of Jobs and Indicate your Preference by Placing a "1" in either the "E" or "I" box. E TITLES 1 Teacher, Industrial Arts 2 Production Engineer 3 Machinist 4 Business-Enterprise Officer 5 Director, Labor Standards 6 Teacher, Secondary School 7 Zoo Veterinarian 8 Aerodynamicist 9 Field-Service Engineer 10 Cardiopulmonary Technologist, Chief 11 Special Procedures Technologist, CT Scan 12 Radiologic Technologist 13 Nurse Anesthetist 14 Teacher, Adventure Education 15 Speech Pathologist 16 Biomedical Engineer 17 Tax Attorney 18 Lawyer 19 Electrical Engineer, Power System 20 Induction-Coordination Power Engineer 21 Mechanical-Design Engineer, Facilities 22 Optometrist 23 Dietitian, Teaching 24 Dietitian, Consultant 25 Teacher, Art 26 Musician, Instrumental 27 Manager, Advertising E Score: E I TITLES 1 Plant Pathologist 2 Botanist 3 Forester 4 Supervisor, Transcribing Operators 5 Jeweler 6 Jeweler Apprentice 7 Periodontist 8 Pediatric Dentist 9 Accountant, Tax 10 Electrical-Prospecting Engineer 11 Electrical Test Engineer 12 Electrical Engineer 13 Internist 14 Ophthalmologist 15 Family Practitioner 16 Animal Scientist 17 Airport Engineer 18 Hydraulic Engineer 19 Aquatic Biologist 20 Radiopharmacist 21 Statistician, Mathematical 22 Illustrator, Medical and Scientific 23 Acupuncturist 24 Sociologist 25 Occupational Therapist 26 Educational Specialist 27 Writer, Prose, Fiction and Nonfiction I Score: I Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 77 MVQS Vocational Interest and Personality Reinforcer (VIPR) Type Indicator NAME: DATE: Instructions: Review each Pair of Jobs and Indicate your Preference by Placing a "1" in either the "S" or "N" box. S TITLES 1 Documentation Engineer 2 Contractor 3 Industrial Engineer 4 Tool Planner 5 Production Planner 6 Economic Development Coordinator 7 Landscape Architect 8 Experimental Aircraft Mechanic 9 Supervisor, Personnel Clerks 10 Veterinarian, Laboratory Animal Care 11 Aeronautical Engineer 12 Aeronautical-Design Engineer 13 Radiologic Technologist, Chief 14 Special Procedures Technologist, Angiogram 15 Echocardiograph Technician 16 Dentist 17 Quality Control Engineer 18 Management Analyst 19 Nurse Practitioner 20 Nurse Supervisor, Evening-or-Night 21 Nurse, School 22 Chiropractor 23 Electronics Technician 24 Athletic Trainer 25 Radiologist 26 Pediatrician 27 Proctologist S Score: S N TITLES 1 Environmental Analyst 2 Reliability Engineer 3 Computer Systems Hardware Analyst 4 Lawyer, Admiralty 5 Manager, Personnel 6 Director, Industrial Relations 7 Chemical Engineer 8 Protection Engineer 9 Illuminating Engineer 10 Materials Scientist 11 Irrigation Engineer 12 Sanitary Engineer 13 Physicist 14 Electro-Optical Engineer 15 Nematologist 16 Home Economist 17 Clergy Member 18 Dietitian, Clinical 19 Psychiatrist 20 Medical Physicist 21 Hearing Officer 22 Arranger 23 Faculty Member, College or University 24 Composer 25 Consultant, Education 26 Broker-and-Market Operator, Grain 27 Industrial Therapist N Score: N Page: 78 Journal of Forensic Vocationology Vol. 7(1) Monograph MVQS Vocational Interest and Personality Reinforcer (VIPR) Type Indicator NAME: DATE: Instructions: Review each Pair of Jobs and Indicate your Preference by Placing a "1" in either the "T" or "F" box. T TITLES 1 Manufacturing Engineer 2 Chef De Froid 3 Welder Apprentice, Arc 4 Welder, Arc 5 Machine Setter 6 Pharmaceutical Detailer 7 Magnetic Resonance Imaging (MRI) Techo 8 Technologist, Cardiac Catheterization 9 Polysomnographic Technician 10 Endodontist 11 Pharmacist 12 Writer, Technical Publications 13 Electrolysis-and-Corrosion-Control Engineer 14 Automobile Racer 15 Electronics Mechanic 16 Maintainability Engineer 17 Title Attorney 18 Lawyer, Criminal 19 Electrical-Design Engineer 20 Applications Engineer, Manufacturing 21 Power-Distribution Engineer 22 Architect 23 Poultry Scientist 24 Civil Engineer 25 Biologist 26 Physicist, Theoretical 27 Plant Engineer T Score: T F TITLES 1 Physical Therapist 2 Painter 3 Landscape Gardener 4 Automobile Mechanic 5 Bookkeeper 6 General-Ledger Bookkeeper 7 Aeronautical Project Engineer 8 Aeronautical-Research Engineer 9 Stress Analyst 10 Nurse, Head 11 Nurse, Supervisor 12 Mohel 13 Urologist 14 Obstetrician 15 Physiatrist 16 Nurse, Instructor 17 Photojournalist 18 Sales-Promotion Representative 19 Illustrator 20 Patent Agent 21 Appeals Referee 22 Orchestrator 23 Psychologist, Chief 24 Clinical Therapist 25 Occupational Analyst 26 Supervisor, Education 27 Humorist F Score: F Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 79 MVQS Vocational Interest and Personality Reinforcer (VIPR) Type Indicator NAME: DATE: Instructions: Review each Pair of Jobs and Indicate your Preference by Placing a "1" in either the "J" or "P" box. J TITLES 1 Time-Study Engineer 2 Factory Lay-Out Engineer 3 Real-Estate Agent 4 Director, Arts-and-Humanities Council 5 Director, Unemployment Insurance 6 Director, Consumer Affairs 7 Public-Health Dentist 8 Manager, Quality Control 9 Manager, Records Analysis 10 Nurse, General Duty 11 Nurse-Midwife 12 Nurse, Staff, Occupational Health Nursing 13 Chemical-Test Engineer 14 Director, Media Marketing 15 District Attorney 16 Allergist-Immunologist 17 Cardiologist 18 Gynecologist 19 Railroad Engineer 20 Dairy Scientist 21 Transportation Engineer 22 Director of Institutional Research 23 Community Dietitian 24 Social Worker, School 25 Job Analyst 26 Playwright 27 Screen Writer J Score: J P TITLES 1 Printmaker 2 Airframe-and-Power-Plant Mechanic 3 Supervisor, Dairy Farm 4 Assembler and Tester, Electronics 5 Typing Section Chief 6 Sample Maker I 7 Veterinarian 8 Nurse, Private Duty 9 Fashion Designer 10 Emergency Medical Technician 11 Ultrasound Technologist 12 Battalion Chief 13 Electrical-Research Engineer 14 Motorcycle Racer 15 Electronics-Mechanic Apprentice 16 Power-Transmission Engineer 17 Mechanical-Design Engineer, Products 18 Mechanical Engineer 19 Chemist 20 Chemist, Food 21 Statistician, Applied 22 Doctor, Naturopathic 23 Graduate Assistant 24 Counselor, Nurses' Association 25 Planner, Program Services 26 Clinical Psychologist 27 Counselor P Score: P Page: 80 Journal of Forensic Vocationology Vol. 7(1) Monograph MVQS-VIPR Type Indicator Results NAME: DATE: (E)xtroversion Score: (I)ntroversion Score: (S)ensing Score: I(N)tuiting Score: (T)hinking Score: (F)eeling Score: (J)udgement Score: (P)erception Score: MVQS-VIPR TYPE <-:Insert Highest Letter Scores from each above pair (e.g. INTJ). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 81 Discussion, Conclusions and Recommendations Clearly, many decades of patience, research and development have begun to produce a fruitful realization of Parson’s informal, yet intuitive, direction. Efforts must continue with the collection and synthesis of on-going research into renewed development and refining of our tools, methods, procedures, theories and standards for vocational practice. 1. Theories must be refined through research. 2. New tools for more efficiently and effectively matching workers with jobs must continue to be developed and updated. 3. New hypotheses must be empirically tested through research on those tools. 4. The results of our studies must be published in peer-reviewed journals to keep our peers abreast of mounting research evidence and the need to update our standards for vocational practice. As we increase our own understanding through scientific research: Developing and refining our tools, methods, procedures, theories and standards for vocational practice will become more routine, and Providing credible evidence of the reliability and validity of our tools, methods, procedures, theories and standards for vocational practice, to the courts and other interested parties, will become more second nature. Face and Content Validity were established by Expert Vocational Practitioners to be in the very high range for the paper and pencil version of the MVQS VIPR Job-based Personality Type Indicator during the peer-review and field-testing phase. Additional studies to more firmly establish expected moderate to high level Test-Retest Reliability and Predictive Validity for both the paper and pencil and machine versions of the MVQS VIPR Job-based Personality Type Indicator instruments are recommended. Studies are currently in the research design phase and should be completed in the near future. Page: 82 Journal of Forensic Vocationology Vol. 7(1) Monograph REFERENCES AND BIBLIOGRAPHY Allan, Ross. (1999). Connecting Personality Types With Careers and Jobs. US Dept. of the Interior: http://www.doi.gov/octc/typescar.html. Americans with Disabilities Act of 1990. 42 U.S.C.A. SS 12101 et. seq. (West, 1993). Anderson, L. E. (1997). Chapter 5: Education, training, experience, and licensure/ certification: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume I, N. G. Peterson, M.D. Mumford, W.C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 5-1 to 5-25. Anderson, L. M. (1969). Longitudinal changes in level of work adjustment. Unpublished doctoral dissertation, University of Minnesota, Minneapolis. Arad, S., Hanson, M. A. & Schneider, R. J. (1997). Chapter 8: Organizational context: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 8-1 to 8-38. Benjamin, D. M. (1995). Preparing to Testify. Experts Quarterly, Issue No. 1. Chestnut Hill, Mass: Author. Bertram v. Wunning 417 S.W.2d. 120 (MO. App. 1967). Bolton B. F. (ed.). (1976). Handbook of Measurement and Evaluation in Rehabilitation. Baltimore: University Park Press. Borland International. (1994). Borland Paradox for Windows 5.0. Scotts Valley, CA: Borland International, Inc. Borman, W. C. & Kubisiak, U. C. (1997). Chapter 11: Work Styles: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 11-1 to 11-17. Borman, W.C., Jeanneret, P. R., Kubisiak, U. C. & Hanson, M. A. (1997). Chapter 6: Generalized work activities: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume I, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, & K. Y. Levin eds. UT Dept. of Workforce Svcs, 6-1 to 6-27. Borow, H. (1964). An integral view of occupational theory and research. In: H. Borow (Ed.). Man in a World at Work. Boston: Houghton Mifflin Company. Borow, H. (Ed.). (1964). Man In a World of Work. Boston: Houghton Mifflin Company. Botterbusch, K. F. & Michael, N. (1985). Testing and test modification in vocational evaluation. Menomonie, WI: Materials Development Center, University of Wisconsin-Stout. Botterbusch, K. F. (1982). A Manual of DOT Related Codes. Menomonie, WI: Materials Development Center, University of Wisconsin-Stout. Botterbusch, K. F. (1983). A Comparison of Computerized Job Matching Systems (1st ed.). Menomonie, Wisconsin: University of Wisconsin-Stout, Rehabilitation Institute, Materials Development Center. Botterbusch, K. F. (1986). A Comparison of Computerized Job Matching Systems (2nd ed.). Menomonie, Wisconsin: University of Wisconsin-Stout, Rehabilitation Institute, Materials Development Center. Botterbusch, K. F. (1987). Vocational assessment and evaluation systems: A comparison. Menomonie, WI: University of Wisconsin-Stout, Rehabilitation Institute, Materials Development Center. Brau, Jean Louis, Helen Weaver and Allan Edmands (1980). Larousse Encyclopedia of Astrology. New York: McGraw-Hill. Brown, C., McDaniel, R., Couch, R. & McClanahan, M. (1994). Vocational Evaluation Systems and Software: A Consumer’s Guide. Menomonie, WI: Materials Development Center. 69-124. Burge, M. J. (1978). Comparing 1977 Evaluations at Goodwill Industries of the Southern Piedmont, Inc., with VDAREs. Unpublished Masters Research Project, Athens GA: University of Georgia. Buros, O. K., (Ed.). (1938, 1941, 1949, 1953, 1959, 1965, 1972, 1978). Mental Measurements Yearbook, Editions 1-8. Lincoln, NE: Buros Institute on Mental Measurement. Campbell, D. T. and Stanley, J. C. (1966). Experimental and Quasi-experimental Designs for Research. Chicago: Rand McNally. Canada Department of Labor, Bureau of Labor Statistics. (1980) Standard Industrial Classification Codes for Canada. Ontario, Canada, Govt. Printing Office. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 83 Canada Department of Labor, Bureau of Labor Statistics. (1996) Canada Wages by SIC CTI Industry: 1980-83, 84, 85, . . . 94. Ontario, Canada, Govt. Printing Office (Electronic File Date: 2/29/96). Christerson, B. B. (1997). COMPASS. Tucson, AZ: Valpar, Inc. Colvin, C. R. (1972). The role of a vocational expert in the Social Security Administration's Bureau of Hearings and Appeals. In: U.S. DHEW, SSA, BHA (SSA #72-10284), Forensic Psychology and Disability Adjudication: A Decade of Experience. Washington DC: US Government Printing Office, pp. 197-198. Costanza, E. P., Fleishman, E. A. & Marshall-Mies, J. C. (1997). Chapter 4: Knowledges: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume I, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 4-1 to 4-26. Cronbach, L. J. (1960). Essentials of Psychological Testing, 2nd edition. New York: Harper & Row. Cronbach, L. J. (1970). Essentials of Psychological Testing, 3rd edition. New York: Harper & Row. Daubert v. Merrell Dow Pharmaceuticals, Inc. (113 S. Ct. 2786, 1993). Dawis, R. V. (1976). The Minnesota Theory of Work Adjustment. In Bolton (ed.) Handbook of Measurement and Evaluation in Rehabilitation. Baltimore: University Park Press, 227-248 Dawis, R. V., England, G. W. & Lofquist, L. H. (1964). A Theory of Work Adjustment. Minnesota Studies in Vocational Rehabilitation, No. XV. Industrial Relations Center, Minneapolis, MN: University of Minnesota. Dawis, R. V., Lofquist, L. H. & Weiss, D. J. (1968). A Theory of Work Adjustment: A Revision. Minnesota Studies in Vocational Rehabilitation, No. XXIII. Industrial Relations Center, Minneapolis, MN: University of Minnesota. Dennis, K. L. & McCroskey, B. J. (1997). The Occupational Information Network (O*NET). Journal of Forensic Vocationology, 2(1), 1-29. Dennis, K. L. & McCroskey, B. J. (1999). O*NET validity under Daubert. Journal of Forensic Vocationology, 5(1), 49-74. Dennis, K. L. & McCroskey, B. J. (2000). Predicting Earning Capacity in Indiana. Journal of Forensic Vocationology, 6(1), 97-106. Dennis, K. L. & Tichauer, G. (1998). Replicating Vocational Quotient (VQ) Wage Earning Capacity Predictions in Nebraska. Journal of Forensic Vocationology, 4(1), pp. 85-92. Dennis, M. L. & Dennis, K. L. (1998). Job Search Software under Daubert. Journal of Forensic Vocationology, 4(1), pp. 1-10. Dennis, M. L. & Dennis, K. L. (1998). Job Search Software under Daubert: Will It Withstand Scrutiny as Part of Expert Opinion. Journal of Forensic Vocational Assessment, 1(3), pp. 19-28. Dennis, M. L. & Dennis, K. L. (1998). Replicating Vocational Quotient (VQ) Earning Capacity Predictions in Wisconsin. Journal of Forensic Vocationology, 4(1), pp. 61-68. Dennis, M. L., McCroskey, B. J. & Dennis, K. L. (1998). Work Release, Meaningful Employment and Reasonable Earning Capacity. Journal of Forensic Vocationology, 4(1), pp. 53-60. Dillman, E. G. (1990). Earnings by Education: 1987. Economic Insights. (03/90). El Paso, TX: Author, pp. 1-4. E. I. Du Pont De Nemours and Company, Inc. v. C. R. Robinson Et Al. (1995). No. 94-0843, 38, 852-861 Tex. S. Ct, 1995, (excluded expert testimony from a Horticulturist, holding that Rule 702 requires expert testimony to be relevant and reliable, and that the Horticulturist's testimony and opinions were not reliable). Farr, J. M., Ludden, L. & Mangin, P. (1998). Appendix C, Phase I: Developing Homogeneous Occupations for O*NET. In: The O*NET Dictionary of Occupational Titles. Indianapolis, IN: JIST Works, Inc., pp. 573-579. Federal Civil Judicial Procedure and Rules. (1995). St. Paul, Minnesota: West Publishing Company. Federal Courts Study Committee. (1990). Report of the Federal Courts Study Committee 97. Washington DC: GPO. Feldbaum, C. L. & McCroskey, B. J. (1995). Expert Testimony: Evolving Vocational and Rehabilitation Economic Technologies, Federal Rules of Evidence and the Daubert Decision. Journal of Vocationology, 1(1), pp. 1-5. Feldbaum, C. L. (1997). The Daubert Decision and Its Interaction with the Federal Rules. Journal of Forensic Vocational Assessment, 1(1), pp. 9-73. Page: 84 Journal of Forensic Vocationology Vol. 7(1) Monograph Field, T. F., McCroskey, B. J., Grimes, J. W. & Wattenbarger, W. E. (1978). A Comparison of Vocational Recommendations of the RCEP Masters Students Receiving VDARE Training with those of Vocational Experts and Certified Rehabilitation Counselors. Submitted to VEWAA Bulletin, November, 1978. Fishback v. People, 851 P.2d 884, 889 (Colo. 1993). Flanagan v. State, 625 So. 2d 827, 829-29 (Fla. 1993). Fleishman, E. A., Costanza, D. P. & Marshall-Miles, J. C. (1997). Chapter 9: Abilities: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 9-1 to 9-21. Flynn, J. R. (1984). The mean IQ of Americans: Massive gains 1932 - 1978. Psychological Bulletin, 95(1), 29-51. Flynn, J. R. (1987). Massive IQ gains in 14 nations: What IQ tests really measure. Psychological Bulletin, 101(2), 171-191. Fredlund, M. C. (1997). Advocate Software: Personal Injury-Economist Series for Windows. Walnut Creek, CA. Frye v. United States. (1923). 54 App. DC 46, 293 F. 1013. Ghiselli, E. E. (1966). The Validity of Occupational Aptitude Tests. Wiley, New York. Grimley, Williams, Hahn & Dennis. (2000a). Scientific Prediction of Transferable Skills. Journal of Forensic Vocationology Vol. 6(1), Fall, 2000, pp. 7-16. Grimley, Williams, Hahn & Dennis. (2000b). A Scientific Approach to Transferable Skills. Journal of Forensic Vocational Analysis. Vol. 3(1), pp. 47-54. Hahn, S. J. & Wells-Moran, J. (1998). Washington State VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 4(1), pp. 79-84. Hahn, S. J. (1997). An Independent Replication of the McCroskey Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Forensic Vocationology, 3(1), pp. 29-33. Hahn, S. J., Larkin, S. & Dennis, K. L. (2000). Florida State McDOT 2000 VQ1-Wage Earning Capacity Predictive Validity Generalization Follow-up Study. Journal of Forensic Vocationology, 6(1), pp. (TBD). Hahn, S. J., Larkin, S. & Williams, J. M. (2000). Florida State McDOT 1998 VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. (TBD). Heaton, R. K., Marcotte, T. D., White, D. A., Ross, D., Meredith, K., Taylor, M. J., Kaplan, R. & Grant, I. (1996). Nature and Vocational Significance of Neuropsychological Impairment Associated with HIV Infection. The Clinical Neuropsychologist, 10(1), pp. 1-14. Iacobelli Construction, Inc. v. County of Monroe, 32 F.3d 19, 25 (2d Cir. 1994) (concluding that Daubert addressed only junk science cases and is inapplicable to construction litigation). Janikowski, T. P., Bordieri, J. E. & Musgrave, J. R. (1990). Construct Validation of the Academic Achievement and General Educational Development Subtests of the Microcomputer Evaluation Screening and Assessment (MESA). Vocational Evaluation and Work Adjustment Bulletin, Spring, 1990, pp. 11-16. JOBQUEST. (1996). JOBQUEST Data References and Updates. Spokane, WA: JobQuest. Jung, C.G. (1971). Psychological Types. (A Revision by R.F.C. Hull of the Translation by H.G. Baynes). Princeton, NJ: Princeton University Press. Keirsey, David M. (1998). Please Understand Me II: Temperament Character Intelligence. Del Mar, CA: Prometheus Nemesis Book Company. Keirsey, David M. (2000). Keirsey Temperament Distributions: Distribution of Types taking the Temperament Sorter and the Character Sorter on Keirsey Temperament Web Site. http://www.keirsey.com/ DLU: 12/15/2000. Keirsey, David, and Marilyn Bates (1978). Please Understand Me: Character and Temperament Types. 3rd ed. Del Mar: Prometheus Nemesis. Kelly, Dave. (1999). Correspondence of Five Personality Typologies. http://www.geocities.com/ptypes/. Knowles, P. S. (1978). The Utilization of Vocational History in the Vocational Evaluation Process. Unpublished Masters Research Project, Athens GA: University of Georgia. Kumho Tire Co., Ltd., et al v Carmichael et. al, No., 97-1709, 131 F.3d 1433, reversed, S. Ct. (1999). Lappe v. American Honda Motor Co., 857 F. Supp. 222, 228 (N.D.N.Y. 1994) (admitting expert testimony in products liability action because Daubert only prescribes judicial intervention for expert testimony approaching the outer boundaries of traditional scientific and technological knowledge). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 85 Loch, C. (1994). Compute-A-Match: Manual of Research and Norm Studies. Pleasantville, NY: Progressive Evaluation Systems. Lofquist, L. H. & Dawis, R. V. (1969). Adjustment to Work: A Psychological View of Man's Problems in a Work-oriented Society. Appleton-Century-Crofts, New York. LRP Publications. (1993, 1994, 1995). The Testifying Expert. Horsham PA: LRP Publications. Matarazzo, J. D. (1972). Wechsler's measurement and appraisal of adult intelligence (5th ed.). Baltimore: Williams & Wilkins. Mayer L. L. (1998). Admissibility of Vocational Expert Testimony Post-Daubert: A Statistical Validation of the Vocational Quotient as a Predictor of Labor Market Entry Wage. Journal of Forensic Vocational Assessment. Vol. 1(3), pp. 3-17. Mayer, L. L. (1995). Effects of the sources of evaluative data upon wage of Status 26 rehabilitative clients. (Ann Arbor, MI: UMI Microfilm, No. 0526513). Walden University, 1994/1995, Minneapolis, MN. McCroskey, B. J. & Dennis, K. L. (1999). O*Net Issues for Rehabilitation Economists. The Earnings Analyst Journal of the American Rehabilitation Economics Association, Vol. 2(1), pp. 23-34. McCroskey, B. J. & Dennis, K. L. (2001). Emotional Trauma: Its Impact on Vocational Analysis. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J. & Feldbaum C. L. (1995). Statistical Basics Revisited for Vocational Evaluation and Earning Capacity Analysis under Daubert: A Need for Forensic Standards. Journal of Vocationology, Vol. 1(1), pp. 6-8. McCroskey, B. J. & Hahn, S. J. (1995). The Validity of the Vocational Quotient as a predictor of Calendar Year (CY) 1994 starting wages in Minnesota: Study #1. Journal of Vocationology, 1(1), pp. 9-13. McCroskey, B. J. & Hahn, S. J. (1997). The Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Forensic Vocationology, 3(1), pp. 1-27. McCroskey, B. J. & Hahn, S. J. (1997, 1998) Linear Regression Analysis of United States Trends in Average Annual Pay: 1984 to 2001. Unpublished Research. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. & Hahn, S. J. (1998). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Validity Follow-up Studies. Journal of Forensic Vocationology, 4(1), pp. 11-52. McCroskey, B. J. & Lowe, J. K. (1985). Linear Regression Analysis of the Relationship between Job VQs and Job Wages in the US Economy: Using Job VQs to Predict Job Values. Unpublished Research, Authors. McCroskey, B. J. & Lowe, J. K. (1986). How Much Is Your Job Worth? Limited Edition. Minneapolis: Money Pot. McCroskey, B. J. & Lowe, J. K. (1987) Linear Regression Analysis of the Relationship Between Job VQs and Job Wages in the US Economy: Using Job VQs to Predict Job Values. Unpublished Research, Authors. McCroskey, B. J. & Lowe, J. K. (1987). How Much Is Your Job Worth? Revised Edition. Minneapolis: Money Pot. McCroskey, B. J. & Perkins, E. (1981). Manual for the McCroskey Vocational Quotient System, pp. 28-31, 37, 63. McCroskey, B. J. & Wattenbarger, W. E. (1977). The Vocational Diagnosis and Assessment of Residual Employability (VDARE) Process Worksheet. Athens, GA: Authors. McCroskey, B. J. (1979). The Effects Of Source Of Evaluative Data, Severity Of Client Disability, And Client Age Group On The Degree To Which Clients’ Residual Employability Profiles Match Their Actual Employment Outcome Profiles. Unpublished Doctoral Dissertation, University of Georgia, Athens. McCroskey, B. J. (1979, 1980). Multiple Regression and Frequencies Data on 1977 USDOL Job Analysis Data. Mississippi State, MS: Unpublished Post-Doctoral Research, Author. McCroskey, B. J. (1979a, 1979b, 1979c, 1979d). The Encyclopedia of Job Requirements (EOJR, Volumes 1-4). Mississippi State: Mississippi State University Computer Science Center. McCroskey, B. J. (1980). Multiple Regression and Frequencies Data on 1977 USDOL Job Analysis Data. Mississippi State, MS: Unpublished Post-Doctoral Research, Author. McCroskey, B. J. (1980, 1981, 1983, 1986, 1990, 1992, 1994, 1995, 1996, 1997, 1998, 2000). The Encyclopedia of Job Requirements (Volumes 1-4). Reprinted, (1981); Reprinted, (1983, 1986). Revised and reprinted, (1990, 1992). EOJR Volume 1, revised and electronically reprinted within the McDOT Page: 86 Journal of Forensic Vocationology Vol. 7(1) Monograph 6.1–7.1 Program Series, (1994, 1995). Revised and electronically stored in McDOT 7.11R – 2000 Program Series, Brooklyn Park, MN: Vocationology, Inc. (1996, 1997, 1998 & 2000, respectively). McCroskey, B. J. (1982, 1983, 1985, 1987, 1989 & 1990). Manuals for the Datamaster I, II, III, IV & 4p2g Programs (Microcomputer-Assisted Job-Person Matching System Specifically Designed for Use with the McCroskey Vocational Quotient System). Minneapolis, Minnesota: Vocationology, Inc. Program Series, Brooklyn Park, MN: Vocationology, Inc. (1996, 1997, 1998 & 2000, respectively). McCroskey, B. J. (1982,1983, 1985, 1987, 1989 & 1990). The MVQS Datamaster Job-Person Matching System (Versions 1.0, 2.0, 3.0, 3.0+, 4.0+ and 4p2g). Minneapolis & St. Paul, MN: Vocationology, Inc. McCroskey, B. J. (1991, 1992a, 1992b, 1995, 1996, 1997, 1998 & 2000). The McCroskey TestPlot Program (McPLOT) Vers. 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0 with McDOT 7.0 and McPLOT 7.0 Program Components, (4/92). Revised to Vers. 7.11, (4/13/95). Revised and upgraded to Vers. 7.11R, (6/96). Revised and upgraded to Version 8.0, 8.0R & 2000, Brooklyn Park, MN: Vocationology, Inc., (06/97, 10/15/98 & 01/01/2000, respectively). McCroskey, B. J. (1991, 1992a, 1992b, 1995, 1997, 1998, 2000). The McCroskey Dictionary of Occupational Titles (McDOT). Vers. 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0, (4/92). Revised to Vers. 7.11, (4/95). Revised and upgraded to Vers. 8.0, 8.0R & 2000, Brooklyn Park, MN: Vocationology, Inc., (6/97, 10/15/98 & 01/01/2000, respectively). McCroskey, B. J. (1991, 1992a, 1992b, 1995a, 1995b, 1996, 1997, 1998 & 2000). The McCroskey Transferable Skills Program (MTSP) Versions 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0, (4/92). Revised to Vers. 7.11, (4/95). Revised to Vers. 7.11, (8/95). Revised to Vers. 7.11R, (7/96). Revised and upgraded to Vers. 8.0, (6/97). Revised to Vers. 8.0R, Brooklyn Park, MN: Vocationology, Inc., (01/01/98). Revised to Vers. 2000, Brooklyn Park, MN: Vocationology, Inc., (01/01/2000). McCroskey, B. J. (1992). The Validity of the Vocational Quotient as a Predictor of Starting Wage Earning Capacity. The Vocationologist, 1(1), pp. 23-24. McCroskey, B. J. (1995). Emergence of Standards in Vocational Technology. The Vocationologist, 2(1), pp. 4-12. McCroskey, B. J. (1995). McDOT, McPLOT and MTSP 7.0 Arrive for 1995. The Vocationologist, 2(1), pp. 1-4. McCroskey, B. J. (1995). The Validity of the Vocational Quotient as a Predictor of Pre-and Post-Injury Earning Capacity. White paper presented at the American Rehabilitation Economic Association, Atlanta, GA, 5/7/95. McCroskey, B. J. (1995). White Paper Re: MN CY 1994 VQ-Wage data presented at the American Rehabilitation Economics Association National Conference in Atlanta, GA, Fall, 1995. McCroskey, B. J. (1996). 1977-1987 SIC Code to 9-Digit McDOT Code Crosswalk Database. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1996a). The ECLRBOOK. Minneapolis, MN: Vocationology, Inc. McCroskey, B. J. (1996b). The SIC CODEBOOK: MTSP 7.11R SIC CODE Links To US Yellow Page Business/Industry Headings. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0: Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997). The McPLOT 8.0 Program Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997). The MTSP 8.0 Mini-Manual for the Full and Demo Versions of the McCroskey Transferable Skills Program (MTSP) Version 8.0. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997a) The 1996-1998 ECLRBOOK. Brooklyn Park, MN: Vocationology, Inc. Revised (11/27/97) to The Revised 1996-1998 ECLRBOOK. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997b). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0: Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997c). The McPLOT 8.0 Program Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1997d). The MTSP 8.0 Mini-Manual for the Full and Demo Versions of the McCroskey Transferable Skills Program (MTSP) Version 8.0. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998) The 1998-2000 ECLRBOOK. Brooklyn Park, MN: Vocationology, Inc. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 87 McCroskey, B. J. (1998). The MTSP 8.0R Mini-Manual for the Full and Demo Versions of the McCroskey Transferable Skills Program Version 8.0R. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2001). Classification of 12,775 McDOT Jobs into 16 MVQS Vocational Interest and Personality Reinforcer (VIPR) Types with Jung-based Personality Type Correspondents Cross-Walk. Electronically published in the McCroskey 5th Ed. Dictionary of Occupational Titles - Extended Data Set Edition. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J., Bohlke, D. & Streater, S. E. (1995). Re-calibrated Earning Capacity Link Relatives (ECLRs) For the MTSP 7.11R Program: Study #4. Journal of Vocationology, 1(1), pp. 36-45 & pp. 5663. McCroskey, B. J., Dennis, M. L. & Dennis, K. L. (1998). Geographic Location and the Vocational Quotient (VQ) Prediction of Earning Capacity. Journal of Forensic Vocationology, 4(1), pp. 69-78. McCroskey, B. J., Feldbaum C. L., Dennis, K. L. & Hahn, S. J. (1998). Statistical Foundations for Human Services Assessment in Light of the Daubert Decision. Journal of Forensic Vocationology, Vol. 4(1), pp. 93-100. McCroskey, B. J., Hahn, S. J., Dennis, K. L. & Streater, Scott E. (1995). VQ as a Predictor of FY 1994 Wisconsin Starting Wages: Study #3. Journal of Vocationology, 1(1), pp. 26-27, 35. McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). The McCroskey Vocational Quotient System (MVQS) Vocational Interest and Personality Reinforcer (VIPR) Job-based Personality Type Indicator and MTSP Jobs-Based Vocational Interest Personality Types Crosswalk to Jung People-Based Personality Types. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). The McCroskey Vocational Quotient System (MVQS) Theory of Transferable Skills: Revised, Extended and Updated for the 21st Century. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J., Male, R. & Frank, D. (1995). A Curvilinear Approach for Estimating Present Value Benefits-to-Pay Ratios from US Income Trends 1959-91: Study #5. Journal of Vocationology, 1(1), pp. 46-49. McCroskey, B. J., Smolarski, R., & Haskins, R. D. (1995). Three-Way Inter-Rater Reliability Using MVQS McDOT, McPLOT & MTSP Computerized Job-Person Matching Program Components: Parts 1 & 2. Journal of Vocationology. 1(1), pp. 67-68. McCroskey, B. J., Streater, S. E., Timming, R. C., Wattenbarger, W. & Lowe, J. K. (1989, 1991a, 1991b, 1992). Job-Person Matching Inputs from the Portable Assessment System-1, Simulated Work Environment Ability Tester: Safety Aspects, Content, and Construct Validity Monograph. Minneapolis, MN: Vocationology, Inc. Reprinted 1991, in: The American Journal of Physical Therapy, pp. 30-76. Reprinted 1991, in: The Vocational Expert, Vol. 8(1), pp. 5-10. Reprinted 1992, in: The American Board of Vocational Experts Monograph, pp. 40-86. McCroskey, B. J., Wattenbarger, W. E., Field T. & Sink, J. (1977). The Vocational Diagnosis and Assessment of Residual Employability (VDARE) Process Worksheet. Athens, GA: Authors. McCroskey, B. J., Wattenbarger, W., Field, T. F. & Sink, J. M. (1977, 1979). The Vocational Diagnosis and Assessment of Residual Employability Handbook. Athens, Ga.: Authors. Reprinted in the VDARE Training Manual, Roswell, GA: VDARE Services Bureau, 1979. McCroskey, B. J.; Streater, S. E.; Wattenbarger, W. E.; Feldbaum, C. L. & Dennis, K. L. (1997). Analyzing employability using worker trait factors: Past, present and future. The Journal of Forensic Vocational Assessment, 1(1), pp. 7-39. Miller, G. A. (1956). The magical number seven, plus or minus two, or some limits on our capacity to process information. Psychological Review, 63(2), 555-564. Millon, Theodore, and Roger Davis (1996). Disorders of Personality: DSM-IV and Beyond. 2nd ed. New York: Wiley. Minnesota Department of Economic Security. (1996). Minnesota Calendar Year (CY) 1996 (01/01/9612/31/96) Job Service Work Orders 9-Digit DOT Coded Position Openings and Wage Offers Data by County. Saint Paul, MN: Office of Research and Statistical Analysis. Minnesota Department of Economic Security. (1997). Minnesota Fiscal Year (FY) 1997 (09/01/9608/31/97) Job Service Work Orders 9-Digit DOT Coded Position Openings and Wage Offers Data by County. Saint Paul, MN: Office of Research and Statistical Analysis. Page: 88 Journal of Forensic Vocationology Vol. 7(1) Monograph Mumford, M. D. & Peterson, N. G. (1995). Chapter 3: Skills. In Development of Prototype Occupational Information Network (O*NET) Content Model by Peterson, N. G.; Mumford, M. D.; Borman, W. C.; Jeanneret, P. R. & Fleishman, E. A. eds. UT Dept. of Workforce Svcs, 3-8, 3-59. Mumford, M. D., Peterson, N. G. & Childs, R. A. (1997). Chapter 3: Basic and cross-functional skills: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume I, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 3-1 to 3-34. Oldham, John M., and Lois B. Morris (1995). The New Personality Self-Portrait: Why You Think, Work, Love, and Act the Way You Do. Rev. ed. New York: Bantam. Paoli Railroad Yard PCB Litigation No., 92-1995 (3rd Cir, 8/31/94). Parsons, F. (1909). Choosing a Vocation. (1st ed.); Boston: Houghton-Mifflin. People v. Leahy, 882 P.2d 321, 331 (Cal. 1994). People v. Wesley, 633 N.E.2d 451, 456 (NY Ct. App. 1994). Peterson, N. G, Mumford, M. D. Levin, K. Y., Green, J. & Waksberg, J. (1997). Chapter 2: Research method: Development and field-testing the content model.. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, & K. Y. Levin eds. UT Dept of Workforce Svcs, 2-1 to 2-51. Psychological Corporation. (1974). Test Service Bulletin Number 48. Chart Comparing Various Test Scores and Their Correspondence to Each Other [Under the Normal or Bell Curve]. New York: The Psychological Corporation. Reference Manual on Scientific Evidence. (2000) Washington DC: Federal Judicial Center. Reinhardt, B. (1978). A Correlation Study between Jobs Recommended for Clients and Jobs Actually Held by the Clients. Unpublished Masters Research Project, Athens GA: University of Georgia. Riso, Don Richard, and Russ Hudson (1996). Personality Types: Using the Enneagram for Self-discovery. Rev. ed. New York: Houghton. Ross, D. R. (1990). An Early Intervention Assessment Model for the Vocational Rehabilitation of Social Security Disability Benefit Applicants. Social Security Administration R & D Project (Grant No.: 13-P10017-9-02). Rubinfeld, D.L. (1994). Reference guide on multiple regression. In: Reference Manual on Scientific Evidence. (1994). New York: Federal Judicial Center & Carnegie Corporation of New York, 417-469. Sager, C. E. (1997). Chapter 10: Occupational interests and values: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 10-1 to 10-31. Schuh, A. J. (1967). The Predictability of employee tenure: A review of the literature. Pers. Psych. 20:133152. Shahnasarian, M. and Lassiter, D. (2002). Attorney perceptions of vocational evaluation methodologies. The Rehabilitation Professional 10(1), pp. 38-43. Shartle, C. L. (1964). Occupations, workers, and classification systems. In: H. Borow (Ed.). Man in a World at Work. Boston: Houghton Mifflin Co. Stern, P. (1994). Science in the Courtroom: From the Frye-Pan to the Fire. Violence Update, Vol. 4(12). Streater, S. E. (1987). A Comparative Analysis of Subtest Results: the 1978 Wide Range Achievement Test (WRAT) Versus the 1984 Wide Range Achievement Test-Revised (WRAT-R). Unpublished Dissertation. American College of Vocational Experts, Nashville, TN. Streater, S. E. (2000). People Who Don't Count Won't Count. The Vocational Expert, 17(1), [Middle Insert]. Strong, M. H., Jeanneret, P. R., McPhail, S. M. & Blakley, B. R. (1997). Chapter 7: Generalized work activities: Evidence for the reliability and validity of the measures. In: O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 7-1 to 7-32. Sparks v Consolidated Rail Corporation No. 94-CV-1917 (E.D. PA. 1995). Standards for Educational and Psychological Tests and Manuals-Revised. (1993). American Psychological Association. State v Carter, 524 N.W.2d No. S-93-777 (NE, l994). State v Cauthron, 846 P.2d 502, 505 (Wash. 1993). State v. Alt, 504 N.W.2d 38, 45-46 (Minn. Ct. App. 1993) State v. Bible, 858 P.2d 1152, 1183 (Ariz. 1993) Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 89 StatSoft, Inc. (1992). Complete Statistical System: STATISTICA (CSS/3), Addendum, Release 3.1. Tulsa, OK: StatSoft, Inc. StatSoft, Inc. (1995). STATISTICA for Windows [Computer program manual]. Tulsa, OK: StatSoft, Inc., 2300 East 14th Street, Tulsa, OK, 74104-4442, (918) 749-1119, fax: (918) 749-2217, e-mail: info@statsoft.com, WEB: http://www.statsoft.com. Stern, P. (1994). Science in the Courtroom: From the Frye-Pan to the Fire. Violence Update, Vol. 4(12). Stoelting, C. (1990). A study of the construct validity of the MESA. Vocational Evaluation and Work Adjustment Bulletin, 23(3), Fall, 1990, pp. 85-91. Streater, S. E. (1987). A Comparative Analysis of Subtest Results: the 1978 Wide Range Achievement Test (WRAT) Versus the 1984 Wide Range Achievement Test-Revised (WRAT-R). Unpublished Dissertation. American College of Vocational Experts, Nashville, TN. Strong, M. H., Jeanneret, P. R., McPhail, S. M. & Blakley, B. R. (1997). Chapter 7: Generalized work activities: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 7-1 to 7-32. Table B-22. (1992). National Income by type of income, 1959-91. Economic Report of the President. (Transmitted to the Congress, Feb. 1992). Washington, DC: GPO. Reprinted (1995): Journal of Vocationology 1(1), p. 47. Taylor, K. E., & Weiss, D. J. (1972) Prediction of individual job termination from measured job satisfaction and biographical data. J. Vocat. Behav. 2:123-132. Teal, R. A. (1978). Comparison of the VDARE Technique with the Hester Evaluation System. Unpublished Masters Research Project, Athens GA: University of Georgia. The Testifying Expert. LRP Publications, Horsham PA., l993-95. Thorndike, R. L. & Hagen, E. (1969). Measurement and Evaluation in Psychology and Education, 3rd Edition. New York: John Wiley & Sons, p. 173. US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1987). Per Capita Income In Current & 1987 Dollars. News. Washington, DC: Government Printing Office. US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1993). Table B-28 Total And Per Capita Disposable Personal Income And Personal Consumption Expenditures In Current And 1987 Dollars, 1959 - 1993. Washington, DC: Government Printing Office. US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1992). County Business Patterns: US National and Sub-National Wage Earnings Data by two-, three-, and four-digit levels of the Standard Industrial Classification (SIC) System. Washington, DC, US Govt. Printing Office. (VI updated for wage inflation from 1993 - 1998). US Department of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1972). Standard Industrial Classification Codes. Washington, DC, US Govt. Printing Office. Revised, 1977. Revised, 1987. US Department of Commerce, Economics and Statistics Administration, Bureau of the Census. (1987, 1990, 1992, 1993, 1994, 1995, 1996 and 1997). Selected Average Annual Pay Tables: 1984-2001. And, Appendix III: Limitations of Data. In: Statistical Abstract(s) of the United States. Washington, DC: Govt. Printing Office. US Department of Labor, Bureau of Employment Security. (1939a). Dictionary of Occupational Titles (Vol. I). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1939b). Dictionary of Occupational Titles (Vol. II). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1949a). Dictionary of Occupational Titles (Vol. I, 2nd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1949b). Dictionary of Occupational Titles (Vol. II, 2nd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1956, 1961). Estimates of Worker Trait Requirements for 4,000 Jobs as Defined in the Dictionary of Occupational Titles: An Alphabetical Index. Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1965a). Dictionary of Occupational Titles (Vol. I, 3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1965b). Dictionary of Occupational Titles (Vol. II, 3rd ed.). Washington, DC: US Government Printing Office. Page: 90 Journal of Forensic Vocationology Vol. 7(1) Monograph US Department of Labor, Bureau of Employment Security. (1966). A Supplement for the Dictionary of Occupational Titles (3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1968). Supplement 2 for the Dictionary of Occupational Titles (3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1972). Handbook For Analyzing Jobs (Revised edition). Washington, DC: US Government Printing Office. Reprinted, Menomonie, WI: Materials Development Center, University of Wisconsin-Stout, (1976). Re-revised & Reprinted, Washington, DC US Government Printing Office, (1991). US Department of Labor, Bureau of Employment Security. (1977). Dictionary Of Occupational Titles (Vol. I, 4th ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1991a). Dictionary of Occupational Titles (Vols. I, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1991b). Dictionary of Occupational Titles (Vols. II, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Labor Statistics. (1990). Occupational Outlook Handbook 1990-91 Edition Washington, DC, US Government Printing Office. US Department of Labor, Bureau of Labor Statistics. (1992). Occupational Outlook Handbook 1992-93 Edition Washington, DC, US Government Printing Office. US Department of Labor, Bureau of Labor Statistics. (1994). Occupational Outlook Handbook 1994-95 Edition Washington, DC, US Government Printing Office. US Department of Labor, Bureau of Labor Statistics. (1996). Occupational Outlook Handbook 1996-97 Edition Washington, DC, US Government Printing Office. US Department of Labor, Bureau of Labor Statistics. (1998). Occupational Outlook Handbook 1998-99 Edition Washington, DC, US Government Printing Office. US Department of Labor, Employment and Training Administration (US DOLETA), (1998). O*NET The Occupational Information Network Data Dictionary, Release 1.0. Washington D.C.: US GPO. US Department of Labor, US Employment Service. (1979). Guide for Occupational Exploration. Washington, DC, US Government Printing Office. US Department of Labor. (1970a). Manual for the USES General Aptitude Test Battery (GATB). Washington, DC: US Government Printing Office. US Department of Labor. (1970b). Manual for the USES Non-Reading Aptitude Test Battery (NATB). Washington, DC: US Government Printing Office. US Department of Labor. (1982). A Guide to Job Analysis. Washington, DC: Government Printing Office. US Department of Labor. Bureau of Employment Security. (1982). Supplement 1 for the Dictionary of Occupational Titles (4th ed.). Washington, DC: Government Printing Office. US Department of Labor. Bureau of Employment Security. (1986). Supplement 2 for the Dictionary of Occupational Titles (4th ed.). Washington, DC: Government Printing Office. US v Starzecpyzel No. 93 CR. 553 (LMM), ( S.D.N.Y., 4/3/95). Vadala v. Teledyne Indus., Inc., 44 F.3d 36, 39 (1st Cir. 1995 holding that Daubert is limited to cases involving scientific law and not accidents). War Manpower Commission, Bureau of Manpower Utilization. (1944). Dictionary of Occupational Titles, Part IV: Entry occupational classification. Washington, DC: US GPO. War Manpower Commission, US Employment Service. (1943, 1945). Selective Placement for the Handicapped (Rev. ed.). Washington, DC: US GPO. Ward, J. H. (1963). Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association, 58, 236. Wattenbarger W. E. (1981). A Comparison of the Transferable of Skills Analysis of Residual Employability Using the Social Security Administration’s Grid System and the VDARE Process. Unpublished Doctoral Dissertation, University of Georgia, Athens. Wattenbarger W. E., Braswell, S., Dennis, H. & McCroskey, B. J. (1992) Three Employability Indices For Experimental And Programmatic Analysis In Rehabilitation. The Vocationologist, 1(1). Minneapolis, MN: Vocationology, Inc., pp. 2-11. Weiss, D. J., Dawis, R. V., Lofquist, L. H. and England, G. W. (1966). Instrumentation for the theory of work adjustment. Minnesota Studies in Vocational Rehabilitation, No. XXI. Industrial Relations Center, University of Minnesota, Minneapolis. West Law Books. (1993). Americans with Disabilities Act of 1990. 42 U.S.C.A. SS 12101 et. seq. Williams, J. M. (1998). Transferability of Skills Methodologies Used in Computerized Job Matching Systems: Sufficient or Insufficient Control of Methodologically Induced Error Variance? Journal of Forensic Vocational Assessment, 1(3), pp. 29-41. Wright, J. W. (1984). The American Almanac of Jobs and Salaries. New York, NY: Avon Books. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 91 Emotional Trauma: Its Impact on Vocational Analysis By Billy J. McCroskey, Ph.D., CRC, CRE, CRV, ABVE, and Kenneth L. Dennis, Ph.D., LP, LMFT, CRC, CRV Abstract Emotional Trauma may be defined to include the effects of external events, which can produce undesirable physical changes in the brain. Emotional Trauma causes symptoms that produce measurable declines in occupational performance and represent vocational deficits, which can be tracked and identified by way of and in terms of diminished capacities on 10 of the 24 most vocationally significant worker trait variables. Introduction Emotional Trauma may be defined to include the effects of external events, which can produce undesirable physical changes in the brain. In this respect, emotional trauma is a type of learning. If there is a small information gap between what is known and what is observed, very little learning can be expected to occur. If this gap is moderate, however, intense curiosity is produced that either results in long-term memory or frustration (Lawrence & Nohria, 2002, pp. 112-113). Learning associated with emotional trauma occurs when the gap is perceived to be large or when a very large gap is not perceived. The learning (single event) produces fear or possible repression. In emotional trauma, the extreme of no response becomes emotional blockage. Learning from curiosity expands behavior. Learning from emotional trauma narrows and restricts the range of behaviors. Time is lost to re-experiencing past traumatic events. Response numbing produces avoidance of stimuli. Concentration is impaired by persistent and increased arousal to traumatic events. Symptoms commonly include sleep problems, fatigue, irritability, emotional outbursts, depression, hypervigilance, exaggerated startle response, and difficulty concentrating (American Psychiatric Association, 1994, pp. 424-429). Emotional Trauma causes symptoms that produce measurable declines in occupational performance and represent vocational deficits, which can be tracked and identified by way of and in terms of selected diminished worker trait capacity levels. Review of Literature Goodwin (1987) specified what can be expected when a person has posttraumatic stress disorder (PTSD). While he focused his research on Vietnam Veterans, he presented symptoms common across a wide variety of people with this disorder. These included: 1. Chronic and Delayed Depression. Most people with PTSD are depressed, and many of them have been depressed for a long period of time. Symptoms include sleep disturbance, psychomotor retardation, feelings of worthlessness, difficulty concentrating, etc. Along with depression is a very well developed sense of helplessness. Substance abuse may be present during depressive periods. Self- Page: 92 2. 3. 4. 5. 6. 7. Journal of Forensic Vocationology Vol. 7(1) Monograph medication may be a coping response, with alcohol often being the drug of choice. Isolation. People with PTSD have few friends. They report feeling isolated and distant from other people. Rage. Extreme emotions such as rage are frightening to people with PTSD. They may strike out for no apparent reason. Avoidance of Feelings and Alienation. Loved ones often complain of emotional coldness, uncaring and distance. People with PTSD may report an inability to experience the joys of life and feeling emotionally dead. Anxiety Reactions. People with PTSD often describe themselves as being very vigilant. They are tuned to anything out of the ordinary. Unexpected noises, sights, etc. can produce dramatic and unexpected responses. Sleep Disturbance. People with PTSD might find the hours before sleep very comfortable. They stay awake as long as possible. Activities that keep them awake might include drinking or smoking cannabis to dull uncomfortable thoughts. When there is nothing to occupy their minds, thoughts wander and traumatic thoughts can easily intrude. Intrusive Thoughts. Traumatic memories often play a role in daytime functioning. Obsessive thoughts might be triggered by common, everyday experiences (sights, smells, touches, sounds, etc.). There are evolutionary advantages to learning from threatening experiences. When danger is perceived, it is a good idea to avoid it in the future. Emotional trauma, however, can result in changes to a person’s functioning to the point that response becomes more debilitating than the original trauma. A person can be unable to function in the community, family, or at work in response to trauma even after the other physical damage has healed. These physical alterations in brain processes (structure and functioning) become a diagnosable condition. A simple model for the destructive impact of trauma could include the following components. 1. External information is perceived that is greatly different from what the person expects to receive. The information is difficult to understand and process. 2. The value placed on this information is of imminent destruction to the person’s emotional, spiritual, intellectual, or physical existence. 3. The information and its value represent state-based learning. The emotional value of the information causes the person to narrow and restrict cognitive processing. Instead of thinking about a variety of responses, explanations options, the person’s perception, association, memory, and response options are very narrowly constricted. 4. Cues from the external environment or within the person’s internal cognitive process can reinitiate or access this state-based learning in the future. A sight, sound or other stimulus causes the person to relieve the trauma again and again. The vocational limitations of emotional trauma cannot be directly measured; although, new brain imaging and matching techniques are increasing the chance of this occurring in the future. Vocational Evaluation can assess and document changes in cognitive processes following emotional trauma by carefully comparing pre- and post-measures of Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 93 functioning. Cognitive capacity is most likely documented by measuring the ability to abstract information, attend to detail, and to stay on task and well as more common limitations to concentration associated with emotional and physical fatigue. Previous Trauma Following its classification as a psychiatric diagnosis in 1980, posttraumatic stress disorder (PTSD) has been given as a legal defense of murders and other crimes committed by war veterans, battered wives, or abused children. It is uncertain why some people develop severe psychiatric symptoms following traumatic experiences that limit their lives and employment, when others seem relatively unimpaired. Gurvits, Gilbertson, Lasko, Tarhan, Simeon, Macklin, Orr, and Pitman, (2000) compared 21 women (sexually abused as children) with 38 Vietnam Veterans. Both groups had people with and without PTSD symptoms. Neurological and psychological tests indicated, people with symptoms "reported more neurodevelopmental problems and more childhood attention deficit hyperactivity disorder symptoms and had lower IQs, all of which were significantly correlated with neurologic soft signs." These results remained true after the researchers accounted for alcoholism or head injury. The conclusion was that, "Neurologic compromise is evident from subject history and findings from physical examination in both women and men with chronic PTSD who had experienced different kinds of traumatic events in childhood and adulthood." Early abuse increases the symptoms of PTSD. The "diminished ability to cope with a traumatic event and its consequences owing to lower intelligence may increase the likelihood of the PTSD outcome." It was also noted that neurological soft signs might be associated with psychiatric disorders such as schizophrenia or obsessive-compulsive disorder. Schnurr, Friedman, and Rosenberg (1993) found high pre-combat levels of neurological dysfunction related to paranoia, depression, psychopathology, and other psychiatric problems predicted PTSD symptom development or severity. Brain Functioning It is estimated there are 23 million Americans with anxiety disorders (Lawrence & Nohria, 2002, p. 134). Research indicates that anxiety is sometimes related to alarm messages moving from sense organs directly to the cognitive centers of the cortex and then to the amygdala. Other messages appear to move directly to the amygdala. Patients with panic disorders seem to benefit from medications that weaken the amygdala’s action combined with cognitive therapy. Experienced threats activate a pain avoidance reflex from the amygdala. People then experience intense fear or anger (fight or flight) in a state of temporary irrationality. As a fundamental, inborn reflex mechanism, the ability of the cortex to operate rationally is temporarily shut down. "It can be thought of as a coping mechanism of last resort." Amen (1998) reported on a patient (Mark) that was tormented by past memories. A SPECT study was ordered because of a head injury in Vietnam. There was increased activity on the left side of his basal ganglia. After being prescribed Depakote, Mark’s headaches disappeared and he was able to benefit from therapy for his posttraumatic Page: 94 Journal of Forensic Vocationology Vol. 7(1) Monograph stress disorder. There was no indication that the activity on the left side of his basal ganglia was associated with his stress reaction, only that it impeded therapy. Teicher (2002) suggested that early trauma might stimulate the left side of the amygdala to the point of damaging it and the left side of the hypocampus through excessive exposure to stress hormones. He reported findings that the left side of the hippocampus of patients with PTSD was 12 percent smaller than for non-PTSD patients. EEG research found a higher percentage of anomalies in people with PTSD compared to Controls, and the left hemisphere of the frontal and temporal lobes were most involved. The brain research by Harry F. Harlow at the University of Wisconsin – Madison showed a similar pattern for monkeys raised with a wire and terrycloth surrogate mothers. The impact of a surrogate mother was less severe if the mother swung from side to side. This movement appeared to be transferred to the middle part of the cerebellum (cerebullar vermis). This structure is located at the back of the brain just above the brain stem. Abnormalities in the vermis have been found related to bipolar disorder, schizophrenia, autism and attention deficit disorder. The impact of back and forth movement on ameliorating the impact of emotional trauma was noted in the treatment of PTSD reported by Shapiro (1995). She discovered Eye Movement Desensitization and Reprocessing (EMDR) while moving her eyes back and forth during a walk in the park. The eye movement appeared to stop her continuous disturbing thoughts. This therapeutic approach has become a standard treatment for PTSD, and it utilizes eye movement, lateral touch or lateral sounds to stop looping traumatic thoughts from controlling a person’s experience. EMDR appeared to be an expansion of Neurolinguistics Programming (NLP) originally presented by Bandler & Grinder (1975). Employment Problems Anxiety is often experienced as both an emotional and a physical state. A person suffering from anxiety experiences intense dread and racing thoughts, along with heart pounding and increased breathing rate. The person suffering from PTSD may experience acute anxiety when presented with a stimulus similar to those associated with the original traumatic situation (Cavaiola & Lavender, 2000). The sound of a helicopter, loud noise or the smell of diesel fuel may result in the worker hitting the ground in response to a past trauma. The smell of burning food may trigger a worker to scream hysterically in reaction to past sexual assault when a similar smell was present. There have been cases when workers have panicked from feelings of suffocation when placed in a MRI or CT Scan as part of a Worker’s Compensation Evaluation. Past traumas can seem so real that workers become terrified to return to work. Physical injury can make PTSD and other stressrelated disorders worse. Specifically, life-threatening injuries combined with chronic pain can produce more devastating symptoms (Meek, 1990). Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 95 Faking Emotional Trauma It is difficult to diagnosis an emotional trauma. Clients provide most of the evidence for its existence, and considerable secondary gain may be present when there is litigation. Being a detective is not part of the evaluation process (Early, 1990). Data provide the best documentation of client abilities. The major focus is the level of match between the test results and self-reports. Test results should be consistent across concepts. Lack of concentration from fatigue would be more likely on longer rather than shorter tests; or, likewise, at the end of testing compared to the beginning. Concentration should be better earlier in the day compared to later in the day. It is not an inconsistency for a short Clerical test early in the process to yield higher results compared to a longer Clerical test completed after 3.5 to 4.5 hours of testing. Reactions to emotional trauma differ a great deal between people. Test results that do not make clinical sense (given expected abilities and responses) should be reported as inconsistencies rather than assuming they represent imagined or exaggerated emotional trauma or malingering. Emotional Trauma: Primary Impact is on 10 Worker Traits There are 24 Vocationally Significant Variables (VSV), or worker traits, which have been found highly related to overall job difficulty, as measured by the Vocational Quotient (VQ, McCroskey & Perkins, 1981; McCroskey & Lowe, 1986, 1987). These 24 VSV are used to construct a worker's Four-Factor by 24 most vocationally significant worker trait level Post-Injury Evaluative Data Profile. That profile must match, or exceed, updated McCroskey 5th ed. Dictionary of Occupational Titles 2001 (McDOT 2001 5th ed. DOT, McCroskey, 2001) Job Demands Profile to identify Post-Injury jobperson matches in the McCroskey Transferable Skills Program 2001 (MTSP 2001; McCroskey, 2001). Relevant MTSP geographic Job Bank Databases are used for Transferable Skills Analysis (TSA) of job-person matches relative to a worker's past relevant work history. Of the 24 VSV listed below, the first 10 Worker Trait, under Worker Trait Factors 1 and 2, are most likely to be affected by emotional trauma. 1. Worker Trait Factor 1: General Educational Development (GED R, M & L) Reasoning Development (R), Math Development (M), and Language Development (L). 2. Worker Trait Factor 2: Aptitudes (S, P, Q, K, F, M, & E) Perception Spatial Perception (S), Form Perception (P), and Clerical Perception (Q). Dexterity Motor Coordination (K), Finger Dexterity Aptitude (F), Manual Dexterity (M), and Eye-Hand-Foot Coordination (E). Other Aptitudes (C) (C) - Color Discrimination. Page: 96 Journal of Forensic Vocationology Vol. 7(1) Monograph 3. Worker Trait Factor 3: Physical Demands (PD1-PD6) (PD1) - Lift, carry, push, pull, sit, stand, walk, (PD2) - Climbing, balancing, (PD3) - Bend, stoop, crouch, squat, kneel, crawl, (PD4) - Reaching, handling, fingering, feeling, (PD5) - Talking, hearing, writing, (PD6) - See up-close and see far-away; and, 4. Worker Trait Factor 4: Environmental Tolerances (EC1) - Work location (EC2) - Extreme cold, (EC3) - Extreme Heat, (EC4) - Dampness, wetness, humidity, (EC5) - Noise, vibrations, (EC6) - Hazards39: machinery, electrical, chemical, unprotected heights, and (EC7) - Adverse Atmosphere: dusts, fumes, odors, mists or gases. General Educational Development (GED R, M & L) variables are likely to show a drop in ability from fatigue and concentration problems associated with emotional trauma. These variables are on an ascending scale of 1 to 6 (1 < 7th percentile, 6 > 81st percentile, and 4 ranges from the 42nd to the 57th percentiles). Being distracted makes it more difficult to perform well on Reasoning, Math and Language tests. The single GED variable that is expected to show the greatest drop, however, is Math or Arithmetic (written and verbal), as it requires the highest level of abstract thought of the three GED variables. Perception (S, P and Q) variables become impaired when a person is distracted and depressed. These variables are on an ascending scale of 1 to 5 (1 < 5th percentile, 5 > 79th percentile, and 3 and 4 range from the 39th to the 79th percentiles). Diminished Clerical (Q) stemming from diminished attention to detail in written and tabular material is the single Perception variable typically expected to show the most impairment as a result of emotional trauma. Similarly, like falling dominoes, as a result of emotional trauma affecting GED and Perception Variables, Motor Coordination (K), Finger Dexterity (F), Manual Dexterity (M) and Eye-Hand-Foot Coordination (E) tend to drop measurably. Case Study of an Emotional Trauma Client In this example case study, the Emotional Trauma Client (TC) was a female employed in the medical field as a Registered Nurse (RN). TC was in her early 30s with a graduate degree at the time of an automotive accident that left her with scars, lifting restrictions, chronic pain (partially controlled by medication) and symptoms of posttraumatic stress disorder (including fatigue and impaired concentration). At the time of evaluation, TC had reached Maximum Medical Improvement and had returned (with significant accommodation) to her previous employment with her previous employer. TC was able to work a two to three hours per day at her previous employment prior to exhibiting a decrease in concentration and an increase in fatigue. Her workday was split between her duties as a Nurse (between two and four hours per work day) and other work tasks 39 Hazards (0=No; 1=Yes) was also dropped in the TC's Post-Injury Evaluative Data Profile, based on clinical judgment regarding her diminished levels of Concentration and Attention-to-Detail. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 97 involving training and supportive duties that did not require medication management or strenuous physical activity. Partially due to her ongoing litigation, her employer made no change in her job description or salary following her return to work. However, it was well documented that she was not able to fulfill the essential duties of her employment. Her immediate supervisor was supportive of her efforts and position. However, he was scheduled to retire in a couple of years. Vocational Analysis of the 10 VSV Most Affected by Emotional Trauma Comparing TC's previous jobs and plotting the highest job demands across all of these jobs produced Table 1. Reasoning, Math and Language were above average (5) as were other ability scales (4). Her work history included a variety of job tasks that combined to produce the below listed High Across Jobs Profile on the 10 VSV most likely to be affected by Emotional Trauma, along a Vocational Quotient of 156.61 across all 24 VSV. TABLE 1 Pre-Injury High Across Jobs Profile R M L S P Q K F M E 5 5 5 4 4 4 4 4 4 4 When the Evaluative Data Profile of TC was adjusted to include worker trait functioning derived from reported pre-injury college grades, the resulting High Across Jobs Profile (Table 1) combined with academic grades produced significantly higher levels of ability (Table 2). Her Academic Pre Profile showed a substantial improvement compared to her High Across Jobs Profile. TC was not only a dedicated worker across multiple jobs in her work history; she had also been an exceptional student. Her resulting Vocational Quotient was noted to be 176.93. TABLE 2 Pre Injury Profile (from Pre-Injury Academics) R M L S P Q K F M E 6 6 6 5 5 5 5 5 5 4 TC's Pre-Injury Academic Profile (Table 2) provided a more complete indication of her maximum vocational potential prior to her injury than did her High Across Work History Profile of successfully demonstrated worker trait functioning. Post-Injury Vocational Testing on the 10 VSV of interest (Table 3) for TC showed several interesting findings in terms of diminished worker trait level functioning. Since she had been successful in her past employment, her High Across Jobs Profile (Table 1) represented the baseline (at Page: 98 Journal of Forensic Vocationology Vol. 7(1) Monograph least minimum levels) of demonstrated worker trait functioning prior to her injuries. Her Pre-Injury Academic grades expanded the at least minimums to likely maximum levels. As noted earlier, mathematical ability is a skill that is vulnerable to trauma. It represents the highest level of abstract thought, and it is easily destroyed. Significant brain injury, chemical dependency, depression, or emotional trauma can all be expected produce a decline in mathematical ability. Unfortunately, many people are math phobic. They lock up or become anxious when they do math problems. It is not always easy to distinguish fear of math from a decline in functioning associated with emotional trauma. In this case, TC had a drop from successfully demonstrated well above average to tested low average or below math ability (Table 3). Pre-Injury, TC had to have above average math skills, because that level of functioning was an essential work history job demand and her math ability was well documented by Pre-Injury undergraduate and graduate school grades. Except for Form Perception (P) and Finger Dexterity (F), the other Evaluative Data (Table 3) showed a decline from her expected ability, if not injured, to a lower skill level following her injuries. Manual Dexterity and Eye-Hand-Foot Coordination appeared to show the greatest change because these variables were heavily influenced by residual physical limitations and pain. However, the nature of her vocational impairments was not fully disclosed by her test scores. Test patterns across tests also needed to be considered. TABLE 3 Initial Post-Injury Evaluative Data Profile R M L S P Q K F M E 5 3 5 4 5 4 4 5 3 2 Order of testing is very important in cases involving emotional trauma. For example, if Clerical or other tests requiring intense concentration are given at the start of the testing day, results may be quite higher than results of tests requiring intense concentration obtained later in the testing day (especially near the end of the testing day). Fatigue and concentration problems typically begin to affect test results more during the 4th or 5th hour of testing and continue to affect results to the end of the day. Placing tests requiring more intense concentration (e.g., the MCT, MMPI-2, WAIS-III, or ANAM), toward the end of the testing day will likely provide more accurate vocational information for emotional trauma clients than placing such tests at the start of the testing day. TC was able to maintain concentration on short tasks as evidenced by her Automated Neuropsychological Assessment Metrics (ANAM; Dennis & McCroskey, 1995, 1997) Continuous Performance Task scores, which were at the 60th and 75th percentile levels. This was a short test (about three minutes) given near the start of testing and TC was able to do well on it. However, her across-tests temporal patterns showed TC significantly less Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 99 effective on the Minnesota Clerical Test (MCT), a classic test of concentration and attention to detail, which was given later in the testing day. On the MCT, which takes 15 minutes to complete, TC's performance declined significantly to the 30th and 40th percentile levels compared to the earlier ANAM results (60th and 75th percentile levels). The full impact of emotional trauma on TC became clearer on the WAIS-III Digit Span subtest results. Digit Span was also a short test, but the need to concentrate was stressed more on it, than on any of the other short tests she was administered. Her performance on Digit Span fell to the 27th percentile. The WAIS-III Arithmetic subtest was extremely sensitive to her ability to manipulate abstract symbols in her mind. On it, TC scored her lowest results: Arithmetic was at the 2nd percentile. It was clinically judged as probably the best predictor of her ability to fulfill the medication administration and management requirements of her RN job, where other information indicated she did poorly in her return to RN work. The most telling result was on the WAIS-III Working Memory where her composite score for Working Memory was found to be at the 9th percentile. Clerical (Q) skills tend to be a part of many tests. Therefore, the ability to concentrate on Clerical tasks can become artificially elevated for some clients, when they do well on short tests that do not adequately reflect lengths of time found in actual job environments. One such case is when a client displays concentration problems due to emotional trauma. Adjusting her Evaluative Data Profile (Table 4) due her inability to work for more than a few hours per day and low scores on relevant tests produced a more consistent picture of the true work capacity of TC. Access to the labor market dropped from about 88 percent Pre-Injury to 1 percent Post-Injury. Inability to concentrate reduced her ability to benefit from new training from above average (Pre-Injury), to well below average (Post-Injury). She had few (if any) transferable skills for any job in the McDOT. She was not qualified for any jobs related by transferable skills to her work as a Registered Nurse. TABLE 4 Final Adjusted Post-Injury Evaluative Data R M L S P Q K F M E 5 1 5 4 5 1 4 5 3 2 Note: Math (M1) and Clerical Perception (Q), which were averaged across indicators from Post-Injury Test Results were clinically lowered to enhance profile accuracy relative to RN job requirements, based on differential across-test patterns over time. Post Return To Work Follow-Up Three years post-injury, TC was still employed at the same position with the same employer as before her injury. Her yearly post-injury wage was approximately 20% higher than her yearly pre-injury wage despite the fact that she could not perform approximately two-thirds of the essential duties of RN position. She had reached Page: 100 Journal of Forensic Vocationology Vol. 7(1) Monograph Maximum Medical Improvement (MMI). Her overall test results and across-test patterns (along with the fact she had reached MMI), made it clear that the impairments caused by the emotional trauma suffered by TC, which were evidenced in her significantly suppressed post-injury worker trait profile of employability and earning capacity, were permanent and stable. Given the fact there were no likely indicators to suggest she would improve her concentration in the future and re-establish her pre-injury employability, the most likely outcome of her injury (after the litigation is finished) was estimated to be at least re-assignment to a job more in line with TC's post-injury employability and earning capacity range, or termination with cause, based on the increased likelihood of patient endangerment in the area of patient care tasks dealing with administering and managing medication which require good concentration and close attention-to-detail. REFERENCES AND BIBLIOGRAPHY Amen, D.G. (1998). Change your brain: Change your life. New York: Three Rivers Press, pp 90-91. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed. rev.). Washington, DC: Author. Bandler, R. & Grinder, J. (1975). The structure of magic, Vol. I. Palo Alto: Science and Behavior. Cavaiola, A.A. & Lavender, N.J. (2000). Toxic coworkers: How to deal with dysfunctional people on the job. Oakland: New Harbinger, pp.183-184. Dennis, K.D. & McCroskey, B.J. (1995), Automated Neuropsychological Assessment Metrics (ANAM) in vocational evaluation. Journal of Vocationology, 1(1), 50-55. Reprinted in: Journal of Forensic Vocational Assessment, 2(1), 3139. Dennis, K.L. & McCroskey, B.J. (1999). O*NET validity under Daubert. Journal of Forensic Vocationology, 5(1), pp. 4974. Dennis, M. L. & Dennis, K. L. (1998). Job Search Software Under Daubert: Will It Withstand Scrutiny as Part of Expert Opinion? Journal of Forensic Vocational Assessment, Vol. 1(3), pp. 19-28. Early, E. (1990). Imagined, exaggerated and malingered post-traumatic stress disorder. In C.L. Meek (Ed.), Posttraumatic stress disorder: Assessment, differential diagnosis and forensic evaluation (pp. 137-156). Sarasota: Professional Resources Exchange. Federal Judicial Center. (1994 & 2000) Reference Manual on Scientific Evidence. [Manual 2000 had US Supreme Court rulings on Daubert, Joiner & Kumho]. Washington DC: Federal Judicial Center. Author. Feldbaum, C. L. & McCroskey, B. J. (1995). Expert Testimony: Evolving Vocational & Rehabilitation Economic Technologies, Federal Rules of Evidence & the Daubert Decision. J. of Vocationology, 1(1), pp. 1-5. Field, T. F., McCroskey, B. J., Grimes, J. W. & Wattenbarger, W. E. (1978). A Comparison of Vocational Recommendations of the RCEP Masters Students Receiving VDARE Training with those of Vocational Experts and Certified Rehabilitation Counselors. Submitted to VEWAA Bulletin, November, 1978. Goodwin, J. (1987). The etiology of combat-related post-traumatic stress disorders (pp.1-18). In T. Williams (Ed.), Post-traumatic stress disorders: A handbook for clinicians, pp. Cincinatti: Disabled American Veterans. Graham, J.R. (1990). MMPI-2 assessing personality and psychopathology. New York: Oxford University Press. Grimley, C. P. & Wulz, S.V. (1987). Placement: The Return of Independence. California Workers’ Compensation Enquirer, 5(2), pp.20-23. Grimley, C. P. (2000). Editor's Note: Standards and Information for the Workplace. The Vocational Expert, 17(1), p. 3. Grimley, C. P., Williams, J. M., Hahn, S. J. & Dennis, K. L. (2000a). Scientific Prediction of Transferable Skills. Journal of Forensic Vocationology Vol. 6(1), Fall, 2000, pp. 7-16. Grimley, C. P., Williams, J. M., Hahn, S. J. & Dennis, K. L. (2000b). A Scientific Approach to Transferable Skills. (2000). Journal of Forensic Vocational Analysis. Vol. 3(1), pp. 47-54. Gurvits, T.V., Gilbertson, M.W., Lasko, N.B., Tarhan, A.S., Simeon, D., Macklin, M.L., Orr, S.P. & Pitman, R.K. (2000). Neurologic soft signs in chronic posttraumatic stress disorder, Archives of General Psychiatry, 57(2), 181186. Keller, L.S. & Butcher, J.N. (1991). Assessment of chronic pain patients with the MMPI-2. Minneapolis: University of Minnesota Press. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 101 Lawrence, P.R. & Nohria, N. (2002). Driven: How human nature shapes our choices. San Francisco: Jossey-Bass, pp. 112-113 & p. 134. Mayer L. L. (1998). Admissibility of Vocational Expert Testimony Post-Daubert: A Statistical Validation of the Vocational Quotient as a Predictor of Labor Market Entry Wage. Journal of Forensic Vocational Assessment. Vol. 1(3), pp. 3-17. Mayer, L. L. (1995). Effects of the sources of evaluative data upon wage of Status 26 rehabilitative clients. (Ann Arbor, MI: UMI Microfilm, No. 0526513). Walden University, 1994/1995, Minneapolis, MN. McCroskey, B. J. & Dennis, K. L. (2001). Emotional Trauma: Its Impact on Vocational Analysis. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J. & Lowe, J. K. (1986). How Much Is Your Job Worth? Limited Edition. Minneapolis: Money Pot. McCroskey, B. J. & Lowe, J. K. (1987). How Much Is Your Job Worth? Revised Edition. Minneapolis: Money Pot. McCroskey, B. J. & Perkins, E. (1981). Manual for the McCroskey Vocational Quotient System (MVQS), pp. 28-31, 37, 63. McCroskey, B. J. (1979). The Effects Of Source Of Evaluative Data, Severity Of Client Disability, And Client Age Group On The Degree To Which Clients’ Residual Employability Profiles Match Their Actual Employment Outcome Profiles. Unpublished Doctoral Dissertation, University of Georgia, Athens. McCroskey, B. J. (1980, 1981, 1983, 1986, 1990, 1992, 1994, 1995, 1996, 1997, 1998, 2000, 2001). The Encyclopedia of Job Requirements (Volumes 1-4). Reprinted, (1981); Reprinted, (1983, 1986). Revised and reprinted, (1990, 1992). EOJR Volume 1, revised and electronically reprinted within the McDOT 6.1–7.1 Program Series, (1994, 1995). Revised and electronically stored in McDOT 7.11R – 2001 Program Series, Brooklyn Park, MN: Vocationology, Inc. (1996, 1997, 1998, 2000 & 2001, respectively). McCroskey, B. J. (1991, 1992a, 1992b, 1995, 1996, 1997, 1998, 2000 & 2001). The McCroskey TestPlot Program (McPLOT) Vers. 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0 with McDOT 7.0 and McPLOT 7.0 Program Components, (4/92). Revised to Vers. 7.11, (4/13/95). Revised to Vers. 7.11/R, (8/95). Revised and upgraded to Vers. 7.11R, (6/96). Revised and upgraded to Vers. 8.0, 8.0R, McPLOT 2000 & McPLOT 2001, Brooklyn Park, MN: Vocationology, Inc., (06/97, 10/15/98, 01/01/2000 & 01/01/2001, respectively). McCroskey, B. J. (1991, 1992a, 1992b, 1995, 1997, 1998, 2000, & 2001). The McCroskey Dictionary of Occupational Titles (McDOT). Vers. 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0, (4/92). Revised to Vers. 7.11, (4/95). Revised to Vers. 7.11/R, (8/95). Revised to Vers. 7.11R, (7/96). Revised and upgraded to Vers. 8.0, 8.0R, McDOT 2000 & McDOT 2001, Brooklyn Park, MN: Vocationology, Inc., (06/97, 10/15/98, 01/01/2000 & 01/01/2001, respectively). McCroskey, B. J. (1991, 1992a, 1992b, 1995a, 1995b, 1996, 1997, 1998, 2000 & 2001). The McCroskey Transferable Skills Program (MTSP) Versions 6.0 and 6.1, (1991). Revised to Vers. 6.2, (1/92). Upgraded to Vers. 7.0, (4/92). Revised to Vers. 7.11, (4/95). Revised to Vers. 7.11/R, (8/95). Revised to Vers. 7.11R, (7/96). Revised and upgraded to Vers. 8.0, 8.0R, MTSP 2000 & MTSP 2001, Brooklyn Park, MN: Vocationology, Inc., (06/97, 10/15/98, 01/01/2000 & 01/01/2001, respectively). McCroskey, B. J. (1995). Emergence of Standards in Vocational Technology. The Vocationologist, 2(1), pp. 4-12. McCroskey, B. J. (2001) MVQS 2001 Resources: Selected Resources for the MVQS 2001 Dataset Edition. Brooklyn Park, MN: Vocationology, Inc. (pp. 45-61). McCroskey, B. J. (2001). Classification of 12,775 McDOT Jobs into 16 MVQS Vocational Interest and Personality Reinforcer (VIPR) Types with Jung-based Personality Type Correspondents Cross-Walk. Electronically published in the McCroskey 5th Ed. Dictionary of Occupational Titles - Extended Data Set Edition. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J., Bohlke, D. & Streater, S. E. (1995). Re-calibrated Earning Capacity Link Relatives (ECLRs) For the MTSP 7.11R Program: Study #4. Journal of Vocationology, 1(1), pp. 36-45 & pp. 56-63. McCroskey, B. J., Dennis, M. L. & Dennis, K. L. (1998). Geographic Location and the Vocational Quotient (VQ) Prediction of Earning Capacity. Journal of Forensic Vocationology, 4(1), pp. 69-78. McCroskey, B. J., Feldbaum C. L., Dennis, K. L. & Hahn, S. J. (1998). Statistical Foundations For Human Services Assessment in Light of the Daubert Decision. J. Forensic Vocationology, Vol. 4(1), pp. 93-100. McCroskey, B. J., Feldbaum C. L., Dennis, K. L. & Hahn, S. J. (1998). Statistical Foundations for Human Services Assessment in Light of the Daubert Decision. Journal of Forensic Vocationology, Vol. 4(1), pp. 93-100. McCroskey, B. J., Hahn, S. J., Dennis, K. L. & Streater, Scott E. (1995). VQ as a Predictor of FY 1994 Wisconsin Starting Wages: Study #3. Journal of Vocationology, 1(1), pp. 26-27, 35. McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). The McCroskey Vocational Quotient System (MVQS) Vocational Interest and Personality Reinforcer (VIPR) Job-based Personality Type Indicator and MTSP Jobs-Based Vocational Interest Personality Types Crosswalk to Jung People-Based Personality Types. An article submitted simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). The McCroskey Vocational Quotient System (MVQS) Theory of Transferable Skills: Revised, Extended and Updated for the 21st Century. An article submitted Page: 102 Journal of Forensic Vocationology Vol. 7(1) Monograph simultaneously for broader Peer-Review and Publication consideration to: The ABVE Journal of Forensic Vocational Analysis and the Journal of Forensic Vocationology (Winter, 2001). McCroskey, B. J., Hahn, S. J., Lowe, J. K. & Dennis, K. L. (2001). Design and Development of the MVQS VIPR Type Indicator for inclusion in McPLOT 2001. White Paper Presentation at the Canadian National and Provincial Rehabilitation Counselor Conference, Ottawa, CAN held on November 1, 2001. Submitted for peer-review and publication in Journal of Forensic Vocational Analysis. (2002 issue). McCroskey, B. J., Male, R. & Frank, D. (1995). A Curvilinear Approach for Estimating Present Value Benefits-to-Pay Ratios from US Income Trends 1959-91: Study #5. Journal of Vocationology, 1(1), pp. 46-49. McCroskey, B. J., Smolarski, R., & Haskins, R. D. (1995). Three-Way Inter-Rater Reliability Using MVQS McDOT, McPLOT & MTSP Computerized Job-Person Matching Program Components: Parts 1 & 2. Journal of Vocationology. 1(1), pp. 67-68. McCroskey, B. J., Wattenbarger, W. E., Field T. & Sink, J. (1977). The Vocational Diagnosis and Assessment of Residual Employability (VDARE) Process Worksheet. Athens, GA: Authors. McCroskey, B. J., Wattenbarger, W., Field, T. F. & Sink, J. M. (1977, 1979). The Vocational Diagnosis and Assessment of Residual Employability Handbook. Athens, Ga.: Authors. In: the McCroskey Dissertation, 1979. Reprinted in The VDARE Training Manual, Roswell, GA: VDARE Services Bureau, 1979. McCroskey, B. J.; Streater, S. E.; Wattenbarger, W. E.; Feldbaum, C. L. & Dennis, K. L. (1997). Analyzing employability using worker trait factors: Past, present and future. The Journal of Forensic Vocational Assessment, 1(1), pp. 7-39. Meek, C.L. (1990). Evaluation and assessment of post-traumatic and other stress-related disorders, pp. 24-25. In: C.L. Meek (Ed.), Post traumatic stress disorder: Assessment, differential diagnosis and forensic evaluation (pp. 9-61). Megargee, E.I. (1995). The California Psychological Inventory handbook. San Francisco: Jossey-Bass Publishers. Mumford, M. D. & Peterson, N. G. (1995). Chapter 3: Skills. In Development of Prototype Occupational Information Network (O*NET) Content Model by Peterson, N. G.; Mumford, M. D.; Borman, W. C.; Jeanneret, P. R. & Fleishman, E. A. eds. UT Dept. of Workforce Svcs, 3-8, 3-59. Mumford, M. D., Peterson, N. G. & Childs, R. A. (1997). Chapter 3: Basic and cross-functional skills: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume I, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 3-1 to 3-34. Peterson, N. G, Mumford, M. D. Levin, K. Y., Green, J. & Waksberg, J. (1997). Chapter 2: Research method: Development and field testing the content model.. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, & K. Y. Levin eds. UT Dept of Workforce Svcs, 2-1 to 2-51. Psychological Corporation. (1974). Test Service Bulletin Number 48. Chart Comparing Various Test Scores and Their Correspondence to Each Other [Under the Normal or Bell Curve]. New York: The Psychological Corporation. Reeves, D.; Kane, R.; Winter, K & Goldstone, A. (1995). ANAM V3.11 clinical and neurotoxicology subsets. San Diego, CA: National Cognitive Recovery Foundation. Sager, C. E. (1997). Chapter 10: Occupational interests and values: Evidence for the reliability and validity of the measures. In O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 10-1 to 10-31. Schnurr, P., Friedman, M. & Rosenberg, S. (1993). Premilitary MMPI scores as predictors of combat related PTSD symptoms, American Journal of Psychiatry, 150(3). Schuh, A. J. (1967). The Predictability of employee tenure: A review of the literature. Pers. Psych. 20:133-152. Shapiro, F. (1995). Eye Movement Desensitization and Reprocessing: Basic principles, protocols, and procedures. New York: Guilford, pp. 2-3. Shartle, C. L. (1964). Occupations, workers, and classification systems. In: H. Borow (Ed.). Man in a World at Work. Boston: Houghton Mifflin Co. Stern, P. (1994). Science in the Courtroom: From the Frye-Pan to the Fire. Violence Update, Vol. 4(12). Streater, S. E. (1987). A Comparative Analysis of Subtest Results: the 1978 Wide Range Achievement Test (WRAT) Versus the 1984 Wide Range Achievement Test-Revised (WRAT-R). Unpublished Dissertation. American College of Vocational Experts, Nashville, TN. Streater, S. E. (2000). People Who Don't Count Won't Count. The Vocational Expert, 17(1), [Middle Insert]. Strong, M. H., Jeanneret, P. R., McPhail, S. M. & Blakley, B. R. (1997). Chapter 7: Generalized work activities: Evidence for the reliability and validity of the measures. In: O*NET Final Technical Report, Volume II, N. G. Peterson, M. D. Mumford, W. C. Borman, P. R. Jeanneret, E. A. Fleishman, and K. Y. Levin eds. Utah Department of Workforce Services, 7-1 to 7-32. Teicher, M.H. (2002). Scars that won’t heal: The neurobiology of child abuse. Scientific American 286(3), pp. 68-75. Thorndike, R. L. & Hagen, E. (1969). Measurement and Evaluation in Psychology and Education, 3rd Edition. New York: John Wiley & Sons, p. 173. Trattner, M., Fine, S. A. & Kubis, S. F. (1955). A comparison of worker requirement ratings made by reading job descriptions and by direct job observation. Personnel Psychology, 8(3), 181-194. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 103 U.S. Department of Labor. (1991). The revised handbook for analyzing jobs. Washington, DC: Government Printing Office. US Department of Labor, Bureau of Employment Security. (1939a, 1939b). Dictionary Of Occupational Titles (Vols. I & II). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1949a, 1949b). Dictionary Of Occupational Titles (Vol. I & II, 2nd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1956, 1961). Estimates Of Worker Trait Requirements For 4,000 Jobs As Defined In The Dictionary Of Occupational Titles: An Alphabetical Index (Note: the Original HAJ was in the Appendices). Washington, DC: US Govt. Printing Office. US Department of Labor, Bureau of Employment Security. (1965a, 1965b). Dictionary Of Occupational Titles (Vol. I & II, 3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1966). A Supplement for the Dictionary of Occupational Titles (3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1968). Supplement 2 for the Dictionary of Occupational Titles (3rd ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1972). Handbook For Analyzing Jobs (Revised edition). Washington, DC: US Government Printing Office. Reprinted, Menomonie, WI: Materials Development Center, University of Wisconsin-Stout, (1976). Re-revised & Reprinted, Washington, DC US Government Printing Office, (1991). US Department of Labor, Bureau of Employment Security. (1977). Dictionary Of Occupational Titles (Vol. I, 4th ed.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1991a, 1991b). Dictionary of Occupational Titles (Vols. I & II, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Labor Statistics. (1990, 1992, 1994, 1996, 1998 & 2000). Occupational Outlook Handbook 1990-91, 1992-93. 1994-95, 1996-97, 1998-99 & 2000-01 Editions. Washington, DC: US Government Printing Office. US Department of Labor, Employment & Training Administration (US DOLETA). (1998). The Occupational Information Network-98 (O*NET-98, CD-ROM Vers. 1.0). Washington, DC: US Govt. Printing Office. US Department of Labor, Employment and Training Administration (US DOLETA). (1998). O*NET 98 - The Occupational Information Network CD-ROM Vers. 1.0. Washington, DC: Government Printing Office. US Department of Labor, US Employment Service. (1979). Guide for Occupational Exploration.. Washington, DC: US Government Printing Office. US Department of Labor. (1970a). Manual for the USES General Aptitude Test Battery (GATB). Washington, DC: US Government Printing Office. US Department of Labor. (1970b). Manual for the USES Non-Reading Aptitude Test Battery (NATB). Washington, DC: US Government Printing Office. US Department of Labor. (1982). A Guide to Job Analysis. Washington, DC: Government Printing Office. US Department of Labor. (1991). Revised Handbook for Analyzing Jobs. Washington, DC: US GPO. US Department of Labor. (1998). O*NET 98 R&D Viewer: User's Guide. Utah Dept. of Workforce Services. US Department of Labor. Bureau of Employment Security. (1982). Supplement 1 for the Dictionary of Occupational Titles (4th ed.). Washington, DC: Government Printing Office. US Department of Labor. Bureau of Employment Security. (1986). Supplement 2 for the Dictionary of Occupational Titles (4th ed.). Washington, DC: Government Printing Office. Page: 104 Journal of Forensic Vocationology Vol. 7(1) Monograph MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation40 By Billy J. McCroskey, Ph.D., CRE, CRC, CRV-Diplomate, ABVE-Diplomate Steven J. Hahn, MS, CRC, CVE, QRC, CRV-Diplomate Kenneth L. Dennis, Ph.D., LP, LMFT, CRC, CRV-Diplomate Abstract Previous research has assessed the validity of the Vocational Quotient (VQ) as a predictor of income. This study evaluated the ability of the VQ1 to predict income reported by Occupational Employment Statistics (OES) groups. Linear regression was used to predict reported income at the Mean, 10th, 25th, 50th, 75th and 90th percentile of the OES-Hourly Wage distribution. VQ1 was used to predict to the middle of these six distributions, and was found to be a very accurate predictor of the OES-Wage distribution as reported by the US Department of Labor. Relative Predictive Validity (Rxy) Coefficients were determined to be 0.970, 0.973, 0.975, 0.974, 0.972 and 0.966, respectively. Relative Coefficients of Determination were 0.950, 0.948, 0.951, 0.948, 0.944 and 0.934, respectively. Relative Standard Errors of Estimate (SEE) were $1.19, $0.45, $0.69, $1.08, $1.65 and $2.66 per hour, respectively. It was recommended that specific McDOTVQ141 Wage Prediction be used to increase overall reliability and reduce aggregate SEEs. This was done, and the subsequent Follow-Up Study Addendum (at the end of this study) was completed in 2002 with similar recommendation for MVQS 2003. Literature Review From 1996 through 1999, there were a series of predictive validity studies that used the Vocational Quotient (VQ) to predict income. These were regression studies that used the VQ as the independent variable and Job Service work orders or actual income of Vocational Rehabilitation clients as the dependent variable. When the Vocational Quotient was used as a predictor to the middle of the income distribution, it was found to predict 80 to over 90 percent of the variance in actual income data. In 1999, the Vocational Quotient (VQ) was grouped by O*NET code subgroups. Again, the VQ was found to be an accurate predictor of Job Service work order income. This study expanded earlier research by grouping linking the new McDOT VQ1 (McCroskey, 2000) mean for each Occupational Information Network (O*NET) Occupational Unit Classification (OUC) Occupational Employment Statistics (OES) code subgroup with the six mean OES Hourly Wage distribution data points. The McDOT VQ1 means were then used to predict Mean OES Hourly Wages (1998 US DOL) at the Mean, the 10th, 25th, 50th, 75th and 90th percentiles. 40 This study led to the follow-up study, presented at the end of this study, with minor editing, is a repeat of the original study by McCroskey, Hahn & Dennis (2000), originally published in the Journal of Forensic Vocationology, Vol 6(1), 2000, pp. 107-134. The follow-up extended the linear regression findings presented in the first study, using a curvilinear regression VQ-Wage prediction model. The MVQS Rehabilitation Economist presented at the end of the second study was developed as a tool for Vocational Experts, Vocational Rehabilitation Counselors and related Consultants for use in their work with clients. Based on the scientific research from the first two studies, regarding the relationship between employment potential and earnings capacity prediction, it bridges the gap between vocational rehabilitation and rehabilitation economics. As with any tool, the quality of the inputs determines the quality of the outputs. 41 McCroskey Dictionary of Occupational Titles (McDOT; McCroskey, 2000) 5th Edition DOT VQ replacement data. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 105 OES Wage Data Overview Occupational Employment Statistics (OES) Information provided by: Occupational Employment Statistics Bureau of Labor Statistics http://www.oesinfo@bls.gov. The Occupational Employment Statistics (OES) survey is an annual mail survey measuring occupational employment and wage rates for wage and salary workers in nonfarm establishments, by industry. The survey samples approximately 400,000 establishments per year, taking 3 years to fully collect the sample of 1.2 million establishments. BLS and the Employment and Training Administration (ETA) provide the funding for the survey. BLS provides the procedures and technical support, while the State Employment Security Agencies (SESAs) collect the data. The SESAs produce occupational estimates by detailed industries for local areas and the states. BLS produces similar industry-specific estimates for the nation as well as employment and wage estimates for 750 occupations across all industries for the nation, each of the 50 states plus the District of Columbia, and Metropolitan Statistical Areas (MSAs). Selected OES Survey Definitions and Concepts Many of the concepts and definitions used in the OES Survey are comparable to those in the Current Employment Statistics survey (a monthly BLS payroll survey of nonagricultural establishments). Others, however, are unique to this survey. Key definitions are as follows: An establishment is an economic unit (factory, mine, or store) which produces goods or services. It is generally a single location and engaged predominantly in one economic activity. Employment is the number of workers who can be classified as follows: Full time or part-time Employees on paid vacations or other type of leave Workers on unpaid short-term absences Salaried officers or executives and staff members of incorporated firms Employees temporarily assigned to other units Employees for whom the reporting unit is their permanent duty station regardless of whether that unit prepares their paycheck. Self-employed, owners or partners of unincorporated firms, and unpaid family workers. Employees are reported in the occupation in which they are working, not necessarily for which they were trained. Employment represents the estimate of total wage and salary employment in an occupation across the industries in which it was reported. The OES survey form sent to an establishment contains between 50 and 225 OES occupations. The number of occupations listed on a form depends on the industry classification and size class of the sampled establishments. To reduce paperwork and respondent burden, no survey form contains every OES occupation. Page: 106 Journal of Forensic Vocationology Vol. 7(1) Monograph The OES classification system uses seven occupational divisions to categorize workers in one of 750 detailed occupations. The seven divisions are as follows: 1. 2. 3. 4. 5. 6. 7. Managerial and administrative occupations Professional, paraprofessional, and technical occupations Sales and related occupations Clerical and administrative support occupations Service occupations Agriculture, forestry, fishing, and related occupations Production, construction, operating, maintenance, and material handling occupations Wages for the OES survey are straight-time, gross pay, exclusive of premium pay. Included are base rate, cost-of-living allowances, guaranteed pay, hazardous-duty pay, incentive pay including commissions and production bonuses, and on-call pay. Excluded are back pay, jury duty pay, overtime pay, severance pay, shift differentials, nonproduction bonuses, and tuition reimbursements. The OES survey collects wage data in 11 intervals. Employers report the number of employees in an occupation per each wage range. The wage intervals used for the 1998 survey were as follows: Interval Range A Range B Range C Range D Range E Range F Range G Range H Range I Range J Range K Hourly Wages Under $6.75 $6.75 to $8.49 $8.50 to $9.99 $10.00 to $11.24 $11.25 to $13.24 $13.25 to $15.74 $15.75 to $19.24 $19.25 to $24.24 $24.25 to $43.24 $43.25 to $60.00 $60.01 and over Annual Wages Under $14,040 $14,040 to $17,659 $17,660 to $20,779 $20,780 to $23,399 $23,400 to $27,559 $27,560 to $32,759 $32,760 to $40,039 $40,040 to $50,439 $50,440 to $89,959 $89,960 to $124,820 $124,821 and over Hourly versus annual wage reporting: For each occupation, respondents are asked to report the number of employees paid within specific wage intervals. The intervals are defined both as hourly rates and the corresponding annual rates, where the annual rates are constructed by multiplying the hourly wage rate for the interval by the typical work year of 2,080 hours. In reporting, the respondent can reference either the hourly or the annual rate, but is instructed to report the hourly rate for part-time workers. Annual wage: Most of the annual mean wage estimates in this release are calculated by multiplying the mean wage by a year-round, full-time hours figure of 2,080 hours per year (52 weeks by 40 hours). Most employees are paid at an hourly rate by their employers and may work less than or more than 40 hours per week. Thus, the annual Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 107 wage estimates may not represent the actual annual pay received by the employee. There are a small number of occupations where only an annual wage figure is provided. The workers in these occupations generally work less than the usual 2,080 hours per year. Since the survey does not collect the actual hours worked, the hourly rate cannot be calculated with a reasonable degree of confidence from the annual wages. For these occupations, therefore, only the annual salary is reported, which has been calculated directly from the data (rather than by multiplying an hourly figure by 2,080 hours). Occupations that typically have a work-year of less than 2,080 hours include musical and entertainment occupations, pilots and flight attendants, and teachers. The Unemployment Insurance (UI) Address File is a micro-level employer file prepared quarterly by each State's Employment Security Agency and submitted to the Bureau of Labor Statistics. For 1998, the file from the second quarter of 1997 is used as a sampling frame while the fourth quarter of 1998 is used as a source of population values for employment (the second quarter of 1998 is used as a source of population employment values for New Jersey). Industry classifications are based on the 1987 Standard Industrial Classification Manual, Office of Management and Budget, 1987. Industry is classified on the basis of the major product or activity of the establishment, as determined by total sales or receipts of the calendar year prior to classification. Scope of the OES Survey The survey included private establishments in SIC codes 07, 10, 12-17, 20-42, 44-65, 67, 70, 72, 73, 75, 76, 78-84, 86, 87, and 89 covering agricultural services; mining; construction; manufacturing; transportation and public utilities; wholesale and retail trade; finance, insurance, and real estate; and services. The survey also covered private and government establishments in SIC codes 806, 821, 822, 824, and 829, the Postal Service (SIC 43), as well as all remaining state and local government establishments. Data for the Postal Service are universe counts obtained from the United States Postal Service (USPS). Federal government data are obtained from the Office of Personnel Management (OPM); these data exclude information from selected agencies. The reference date of the 1998 survey was the week that included October 12, November 12, or December 12 of 1998. The reference date for a particular establishment in this survey is dependent on its two-digit SIC code. See below. Reference Date October 12 November 12 December 12 Industries Surveyed 07, 15-17, 41, 46, 50-62, 67, 70, 73, 79, 84 26-28, 30, 35, 36, 40, 42, 45, 47, 48, 63-65, 75, 76, 78, 80, 81, 83, 86, 87, 89 10, 12-14, 20-25, 29, 31-34, 37-39, 44, 49, 72, 82, and state and local governments Survey Sampling Procedures The sampling frame for this survey was the list of establishments which reported to the state Unemployment Insurance (UI) files for the two-digit SICs listed above. For the Page: 108 Journal of Forensic Vocationology Vol. 7(1) Monograph 1998 survey, the frame's reference date was the second quarter of 1997. This frame was supplemented with a list supplying establishment information on Railroads (SIC 401). Establishments in the universe were stratified by Metropolitan Statistical Area (MSA), three-digit SIC, and size of firm (i.e., size class). Size classes were defined as follows: Size class 1 2 3 4 5 6 7 8 9 Number of employees 1 to 4 5 to 9 10 to 19 20 to 49 50 to 99 100 to 249 250 to 499 500 to 999 1,000 or more In 1996 and 1997, establishments in size classes 2 to 6 were selected based on a probability sample. The sampling weights in size class 2 were adjusted to account for the employment in size class 1. In 1998, the OES Survey began sampling establishments in size class 1; thus, establishments in all size classes are now represented in the probability sample. UI reporting units with 250 or more employees are sampled with certainty across the three year cycle of the survey. Approximately one third of these units are selected within each MSA/SIC/Size class each year. The above allocation resulted in a total initial sample size of 409,347, 408,805, and 400,405 UI reporting units or establishments for 1996, 1997, and 1998. The combined initial sample size for 1996, 1997, and 1998 is 1,206,964 UI reporting units or establishments. (Note that the combined sample size is not a simple sum of the three year's samples. Some State government establishments are included in the survey each year. In the tabulations for the combined survey these establishments are only included once, from the most recent year. Federal government units are also included in the combined tabulation.) Method of Collection Survey schedules were initially mailed to virtually all sampled establishments. Personal visits, however, were made to some of the larger establishments. Two additional mailings were sent to nonresponding establishments at approximately three week intervals. Telephone follow-ups and, in some cases, personal visits were made to nonrespondents considered critical to the survey because of their size. Response Subsequent to the close-out date for National estimates, additional data were collected by the states and used to prepare their own estimates. Consequently, the response rates in most states are higher than the response rate used to develop estimates of all-industry wage rates for each MSA. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 109 Estimation Methodology The OES survey samples approximately 400,000 establishments each year and, over a 3year period, contacts approximately 1.2 million establishments. Each single-year sample represents one-third of both the certainty and non-certainty strata for the full 3-year sample plan. While estimates can be made from a single year of data, the OES survey has been designed to produce estimates using the full 3 years of data. The full 3-year sample allows the production of estimates at fine levels of geography, industry, and occupational detail, while estimates using any one year of data would be subject to a higher sampling error (due to the smaller sample size) and the limitations associated with having only 1/3 of the certainty units. Producing estimates using the 3 years of sample data provides significant sampling error reductions (particularly for small geographic areas and occupations); however, it also has some quality limitations in that it requires the adjustment of earlier years' data to the current reference period--a procedure referred to as wage updating. The 1996 OES survey estimates, which were published in December 1997, were from the first year of the new OES wage survey and were developed using only a single year (i.e., 400,000 sample units) of data. The initial estimation methodology used a weighting-class adjustment procedure for nonrespondents and an employment benchmark at the state/industry level. Since multiple years of data were not available for the 1996 estimates, the estimation procedure did not involve wage updating. The 1997 OES survey estimates represent the second year of OES estimates and have been developed using both the 1996 and 1997 surveys. The 1997 estimates also represent the first year of using a wage-updating methodology in developing the OES survey estimates. In addition to the wage-updating procedure, the 1997 estimates used an improved estimation methodology, utilizing a nearest neighbor imputation approach for nonrespondents and applying employment benchmarks at a detailed MSA by 3-digit industry and broad size-class level. A variant of the imputation procedure is also used to account for item nonresponse. Note: Because of the difference in estimation methods for these first 2 years of OES estimates, the data from 1997 are not strictly comparable with those published from 1996. The 1998 OES survey estimates are developed from the full three years of the OES sample. The combined 1996, 1997, and 1998 data cover approximately 1.2 million sample units. The 1998 estimates use the wage-updating methodology introduced in 1997, which uses the over-the-year fourth-quarter wage changes from the Bureau's Employment Cost Index to adjust prior years' data before combining them with data from the current year. In addition, the 1998 estimates use the estimation methodology introduced in 1997, which uses a nearest neighbor imputation approach for nonrespondents and applies employment benchmarks at a detailed MSA by 3-digit industry and broad size class level. The wage-updating procedure is used to adjust prior year wages to reflect increases between the previous data and current year data. For wage-updating purposes, the Bureau has used the national over-the-year wage changes from the fourth quarter of 1996 to the Page: 110 Journal of Forensic Vocationology Vol. 7(1) Monograph fourth quarter of 1997 and from the fourth quarter of 1997 to the fourth quarter of 1998 for the nine occupational divisions for which ECI estimates are available. These factors are applied to both the 1996 and 1997 survey data to update them to the fourth-quarter 1998 level before combining them with the 1998 survey data. Such a procedure assumes that each occupation's wage, as measured in the earlier years, moves according to the average movement of its occupational division and that there are no major geographic or detailed occupational differences--and this may not be the case. Research is being conducted to develop procedures that may account for differences in the rate of change at more detailed levels, than the nine ECI occupational divisions. The hot deck (nearest neighbor) imputation procedure imputes for unit nonresponse. This type of nonresponse occurs when a unit reports no employment data. In hot decking, units in the sample are stratified into 'year/State/4-digit industry/size class' cells. Within each cell, a donor (i.e., responding unit) is selected to represent each nonrespondent under the proviso that a donor can not be selected twice. The sampling frame employment is used to match donors with nonrespondents. Once a donor and nonrespondent are matched, the occupational employment totals from the donor are copied over to the nonrespondent. In the event that a donor is not available at the 'year/State/4-digit industry/size class' cell level, the procedure advances to succeeding higher level cells until a donor is found. Occasionally a responding establishment may provide employment information, but omit wage distribution information for selected occupations. The OES survey currently uses a variation of the mean imputation procedure to impute for item nonresponse. This type of nonresponse occurs when a unit reports the total-employment for its occupations but not the corresponding employment by wage intervals. In this procedure, units in the sample are stratified into 'year/MSA/3-digit industry/size class' cells. A wage-employment distribution is then calculated for those occupations with missing wage-employment based on the usable data in the cell. Missing wage-employment is imputed using the just calculated wage-employment distribution to prorate the total-employment of those occupations with missing wage-employment. A separate ratio estimator is used to develop estimates of occupational employment in each wage interval. The auxiliary variable is the population value of total employment obtained from the refined Unemployment Insurance files for the 1998 reference month. Within each MSA, the estimated employment for an occupation at the reported threedigit SIC/wage interval level was calculated by multiplying the weighted employment by its ratio factor. The estimated employment for an occupation at the all-industry level was obtained by summing the occupational interval employment estimate across all industries within an MSA reporting that occupation. A further adjustment to each occupational employment total was made as described in the Reliability of the Estimates section. This adjustment did not affect the mean or median wage rates. The employment and wage data for federal government workers in each occupation were added to the survey derived data. A mean wage and a median wage are calculated using wage data from establishments in the industries that reported employment for an occupation. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 111 Mean wage is the estimated total wages for an occupation divided by its weighted survey employment. For the upper open-ended wage interval, a Winsorized mean procedure is used to estimate the mean wage. That is, the mean wage value for the upper open-ended wage interval is set at its lower bound ($60.01). For the other intervals, a mean wage value was calculated based on occupational wage data collected by the Office of Compensation and Working Conditions. These interval mean wage values are then attributed to all workers reported in the interval. For each occupation, total weighted wages in each interval (i.e., mean wages times weighted employment) are summed across all intervals and divided by the occupation's weighted survey employment to obtain a mean wage. Median wage is the estimated 50th percentile of the distribution of wages; 50 percent of workers in an occupation earn wages below, and 50 percent earn wages above the median wage. The wage interval containing the median wage is located using a cumulative frequency count of employment across wage intervals. After the targeted wage interval is identified, the median wage rate is then estimated by a linear interpolation procedure Reliability of the Estimates The occupational wage rates in this report are estimates derived from a sample survey. Two types of errors are possible in an estimate based on a sample survey - sampling error and nonsampling error. Sampling error occurs because the observations are based on a sample, not on the entire population. Nonsampling error is due to response, nonresponse, and operational errors. Nonsampling Errors: Estimates are subject to various response, nonresponse, and operational errors during the survey process. Sources of possible errors are data collection, response, coding, transcription, data editing, nonresponse adjustment, and estimation. These errors would also occur if a complete census was conducted under the same conditions as the sample survey. Explicit measures of their effects are not available. However, it is believed that the important response and operational errors were detected and corrected during the review and validation process. The employment total and wage data for the occupation reflects only those industries that reported the occupation. This occurs primarily in those industries where the occupation appeared on the survey form. Since every occupation does not appear on every industryspecific form, there may be a bias in the employment and wage data for some occupations. The extent of this bias is unknown. Another source of potential bias is the limitations placed on the size of the benchmark factors. A benchmark factor is the ratio of a known employment value to a samplederived employment estimate. This factor is used to make a post-stratification adjustment that makes the total weighted employment estimate at the state / three-digit SIC industry / Metropolitan Statistical Area (MSA) / employment size class level match the population employment at that level. The source of the population employment data is the states' Quarterly Unemployment Insurance files for the reference period of the survey. In cases Page: 112 Journal of Forensic Vocationology Vol. 7(1) Monograph where a small sample was taken, the ratio factor can become large or small. In order to prevent an establishment from contributing either too much or not enough to an MSA's wage rate estimates, the benchmark factor was not allowed to exceed a predetermined value. The total employment count for those MSAs where the benchmark factor was limited by this ceiling will be biased to a small degree in those strata. The employment not assigned to those strata because of this ceiling was then distributed across the other MSAs in the state / three-digit industry, so that the estimated employment of the State / three-digit industry would match the known employment totals at that level. Sampling Errors: The particular sample used in this survey is one of a large number of possible samples of the same size that could have been selected using the same sample design. For example, occupational wage rate estimates derived from the different samples will differ from one another. The deviation of a sample estimate from the average of all possible sample estimates is called the sampling error. The standard error of an estimate is a measure of the variation of estimates across all possible samples and thus is a measure of the precision with which an estimate from a particular sample approximates the average result of all possible samples. Quality Control Measures Quality control measures implemented in the OES survey include: review of the specific occupations to be collected for each industry, and those to be collected in residual categories creating and validating the sample frame for all states at BLS-Washington allocating and selecting the sample for all states at BLS-Washington follow up solicitations of nonrespondents (especially critical nonrespondents) review of survey schedules to verify the accuracy and reasonableness of the reported data adjustments of atypical reporting units on the data file validation of the nonresponse adjustment factors validation of the population employment and ratio factors standardized data processing programs and activities Employment Estimates Employment represents the estimate of total wage and salary employment in an occupation across the industries in which it was reported. The OES survey form sent to an establishment contains between 50 and 225 OES occupations. The number of occupations listed on a form depends on the industry classification and size class of the sampled establishments. To reduce paperwork and respondent burden, no survey form contains every OES occupation. Wage Estimates Wages for the OES survey are straight-time, gross pay, exclusive of premium pay. Included are base rate, cost-of-living allowances, guaranteed pay, hazardous-duty pay, incentive pay including commissions and production bonuses, and on-call pay. Excluded Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 113 are back pay, jury duty pay, overtime pay, severance pay, shift differentials, nonproduction bonuses, and tuition reimbursements. Annual Wage Most employees are paid at an hourly rate by their employers and may work less than or more than 40 hours per week. The annual wage estimates on this website are calculated by multiplying the hourly wage estimates by a year-round, full-time hours figure of 2,080 hours per year (52 weeks by 40 hours). Thus, the annual wage estimates may not represent the actual annual pay received by the employee. There are a small number of occupations where hourly wages are not published. For these occupations the annual wages have been directly calculated from the reported survey data. The workers in these occupations are paid based on an annual amount, but generally work less than the usual 2,080 hours per year. Since the survey does not collect the actual hours worked, the hourly rate cannot be calculated with a reasonable degree of confidence from the annual wages. Occupations that typically have a work-year of less than 2,080 hours include musical and entertainment occupations, flight attendants and pilots, and teachers. Mean Hourly Wage The mean hourly wage is the estimated total wages for an occupation divided by its weighted survey employment. Median Hourly Wage The median hourly wage is the estimated 50th percentile of the distribution of wages; 50 percent of workers in an occupation earn wages below, and 50 percent earn wages above the median wage. Relative Standard Error (RSE) The particular sample used in this survey is one of a large number of all possible samples of the same size that could have been selected using the same sample design. Estimates derived from different samples would differ from each other. The variance of a survey estimate is a measure of the variation among the estimates from all possible samples. The standard error of a survey estimate is the square root of its variance The relative standard error is the ratio of the standard error to the estimate itself. The sample estimate and its standard error allows the construction of an interval estimate with a prescribed level of confidence. The interval will include the mean value of the estimates from all possible samples. To illustrate, if all possible samples were selected, and if each of these were surveyed under essentially the same conditions, and an estimate and its estimated sampling error were calculated from each sample, then: Approximately 90 percent of the intervals from 1.6 standard errors below to 1.6 standard errors above the derived estimate would include the average value of the Page: 114 Journal of Forensic Vocationology Vol. 7(1) Monograph estimates from all possible samples. This interval is called a 90-percent confidence interval. Approximately 95 percent of the intervals from two standard errors below to two standard errors above the derived estimate would include the average value of the estimates from all possible samples. This interval is called a 95-percent confidence interval. For example, suppose that an estimated occupational employment total is 5,000 with an associated relative standard error of two percent. Based on this data, the standard error of the estimate is 100 (= 5,000 X 0.02) and the 95-percent confidence interval for the estimate is (5,000 + 200) or (4,800 to 5,200). This confidence interval is one of many that could be constructed based on the same sample design. Approximately 95 percent of these confidence intervals would encompass the average value of the estimates from all possible samples. Methodology All 12,775 McDOT 2000 DOT codes were grouped into OES code groups. One regression formula was derived for each of the six 1998 data points of interest (the Mean, 10th, 25th, 50th (Median) 75th, and 90th percentiles reported by the government). The OES code groups were averaged for each whole number Vocational Quotient. The small number of mean wage estimates not provided in the OES data were derived using linear regression. Wage estimates not provided for jobs with incomes larger than $60.00 per hour were likewise extrapolated using straight-line regression incorporating available OES wage estimates. For the final analysis, there were no missing wage estimates. Each regression formula predicted the average wage for each of the six OES code group data points for each whole number Vocational Quotient (N=88). Therefore, each percentile distribution represented a different study. Since the goal of this research was to predict to the middle of each distribution, outliers (wages beyond two standard deviations from the mean) were removed using standard outlier removal analyses in each study. Results Initial VQ-Wage Data (Tables 1-15) and Final VQ-OES Wage Data (Tables 16-33) results are tabled and graphed below. Journal of Forensic Vocationology Vol. 7(1) Monograph Initial Results: Tables 1-15 (No Outliers Removed) Table 1: Raw Data Inputs For Descriptive Statistics (vqhn88.sta): No Outliers Removed VQ1 HMEAN WPCT10 WPCT25 HMEDIAN WPCT75 WPCT90 1 68 9.73 6.1 7.225 9.1 11.245 14.25 2 70 9.2136 5.89 6.8445 8.4009 10.4173 13.4773 3 71 10.1758 6.1875 7.4117 9.3583 11.8875 15.4567 4 72 9.6165 6.0081 7.0486 8.7651 11.0198 14.3572 5 73 9.7253 5.9693 6.9777 8.785 11.243 14.9907 6 74 9.7012 6.0158 7.0714 8.8378 11.1974 14.6823 7 75 9.7267 6.0228 7.1029 8.8715 11.2115 14.6391 8 76 10.0996 6.177 7.3737 9.2536 11.7497 15.2629 9 77 9.8701 6.131 7.2433 9.0611 11.4777 14.8331 10 78 10.0346 6.1617 7.3264 9.1961 11.6958 15.159 11 79 10.1153 6.2326 7.4305 9.3165 11.8127 15.1396 12 80 10.3125 6.309 7.5462 9.4924 12.062 15.5826 13 81 10.412 6.3366 7.6237 9.5887 12.221 15.7806 14 82 10.6157 6.4363 7.7825 9.7753 12.4872 16.053 15 83 10.6261 6.437 7.7784 9.7794 12.5174 16.1456 16 84 10.7048 6.4429 7.8037 9.8588 12.6369 16.2885 17 85 10.6504 6.434 7.7884 9.8195 12.5368 16.1243 18 86 10.6184 6.4341 7.7916 9.8138 12.5073 16.0178 19 87 10.7278 6.472 7.8298 9.8723 12.6535 16.3139 20 88 10.8312 6.5501 7.9226 9.9896 12.7547 16.3724 21 89 10.7139 6.5283 7.9041 9.9182 12.6003 16.1303 22 90 10.8296 6.5488 7.9464 10.0261 12.7798 16.3418 23 91 10.8929 6.5663 7.9678 10.0628 12.8765 16.493 24 92 11.3422 6.7205 8.2668 10.4803 13.5009 17.2667 25 93 11.0943 6.668 8.1141 10.2426 13.1578 16.8283 26 94 10.9059 6.7375 8.0999 10.1439 12.9004 16.309 27 95 11.5393 6.9519 8.5043 10.7343 13.7185 17.3213 28 96 11.8409 7.0502 8.735 11.0258 14.1364 17.9488 29 97 11.991 7.1098 8.7741 11.1406 14.3294 18.2302 30 98 11.8345 7.0438 8.6603 10.9845 14.0585 17.9407 31 99 11.9257 7.0509 8.6963 11.0405 14.2635 18.2101 32 100 12.1313 7.2131 8.9128 11.3045 14.451 18.3139 33 101 12.4593 7.3283 9.0539 11.566 15.0011 19.4077 34 102 12.802 7.544 9.3582 11.8902 15.3347 19.8597 35 103 13.5012 7.8776 9.8631 12.5727 16.2175 20.9602 36 104 13.8515 7.9063 9.9628 12.8569 16.8351 22.1937 37 105 15.1152 8.3217 10.6398 13.8983 18.4558 25.0224 38 106 14.9219 8.3597 10.6903 13.9624 18.3069 23.9848 39 107 15.2356 8.5077 10.832 14.1515 18.7268 24.8185 40 108 16.4957 9.034 11.5769 15.2209 20.3391 27.8359 41 109 17.1877 9.2028 11.9097 15.8378 21.5053 29.5336 42 110 17.8079 9.4559 12.2975 16.4381 22.2815 30.8589 43 111 17.0608 9.2828 11.9776 15.8358 21.2156 28.6204 44 112 17.7987 9.7114 12.5156 16.5898 22.3348 30.4912 45 113 17.3508 9.4748 12.2229 16.1105 21.4409 29.5455 46 114 18.1909 9.958 12.8837 17.0316 22.8715 30.9717 47 115 18.1465 9.7334 12.64 16.9008 22.958 31.3403 48 116 17.925 9.74 12.5646 16.6605 22.3463 30.8436 49 117 17.9615 9.8531 12.6848 16.8014 22.5428 30.2833 Page: 115 Page: 116 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 Journal of Forensic Vocationology Vol. 7(1) Monograph 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 17.5842 18.5207 19.5909 19.0001 18.9973 19.545 18.3497 20.3958 20.164 21.2247 21.3318 21.4662 21.7976 22.1807 23.2925 24.2717 25.8587 24.3427 23.619 22.0263 25.36 24.1246 26.74 26.7591 24.4583 22.27 22.766 24.8933 27.9075 32.6833 29.2133 39.766 47.5 46.26 39.1633 43.9033 49.05 47.8875 46.1517 9.7227 10.1664 10.4901 10.4703 10.4073 10.7323 10.4021 11.084 11.1314 11.1828 12.4024 11.2693 12.3994 13.05 13.6275 13.9114 15.2353 13.5762 13.0034 12.7374 15.482 13.9915 16.4962 16.0273 14.1867 12.41 13.016 13.2033 16.865 15.2467 17.8667 18.896 19.9367 20.646 18.0633 19.2717 19.05 19.715 18.6717 12.4955 13.1481 13.6225 13.5323 13.411 13.9023 13.2547 14.4751 14.2407 14.4375 15.6669 14.5533 15.7652 16.32 17.2334 17.9172 19.7916 17.5062 16.711 16.0421 19.411 17.7508 20.3125 20.0045 18.315 15.8933 16.74 16.81 21.265 26.8233 21.8467 33.694 41.7267 38.404 32.0733 37.2517 45.88 42.765 42.0217 16.4916 17.3923 18.3658 17.8094 17.7865 18.5622 17.3597 19.37 18.805 20.0333 20.4704 20.3433 20.7191 21.4624 22.8166 24.0548 26.2559 23.8762 23.0603 20.8689 25.131 23.2031 26.035 25.8445 23.84 20.9667 22.05 22.2767 27.7175 39.19 27.76 50.89 66.1267 60.86 49.2833 58.0917 72.71 67.7725 65.8083 21.9655 23.1641 25.1944 24.0781 23.9495 24.9141 22.9063 26.2007 25.4102 28.2503 27.1085 28.0948 28.1891 29.0184 30.4753 31.9603 35.1825 32.6654 32.0128 28.4632 33.199 31.5362 35.9763 35.73 32.52 29.0667 30.076 33.4 37.42 55.28 38.91 68.62 88.7867 80.184 66.48 78.5 99.54 91.475 90.1217 29.6067 31.5677 34.2459 32.26 32.1453 33.2764 30.2852 34.267 34.1633 38.2089 35.3922 38.086 37.0888 37.1569 37.7884 41.1634 43.9406 42.7335 41.8569 36.8853 41.415 40.9031 44.095 44.8982 40.4633 38.97 37.816 46.8433 45.5975 71.96 51.1433 86.142 111.8833 100.294 83.5433 99.345 126.37 115.505 114.7533 Table 2: Descriptive Statistics Results-All Variables: No Outliers Removed from vqhn88.sta Descriptive Statistics (vqhn88.sta) Standard Valid N Mean Minimum Maximum Std.Dev. Error Skewness VQ1 88 112.4886 68 156 25.56713 2.725465 -0.00272 HMEAN 88 19.14521 9.2136 49.05 10.04983 1.071316 1.509612 WPCT10 88 10.38945 5.89 20.646 4.198199 0.447529 0.863975 WPCT25 88 14.50219 6.8445 45.88 9.061727 0.965983 1.979139 HMEDIAN 88 19.88438 8.4009 72.71 14.69945 1.566966 2.243501 WPCT75 88 26.64598 10.4173 99.54 20.15005 2.148002 2.179085 WPCT90 88 34.4874 13.4773 126.37 25.3532 2.70266 2.129078 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 117 Table 3: Correlation Results for all Variables: No Outliers Removed from vqhn88.sta Correlations (vqhn88.sta) Red Marked correlations are significant at p < .05000 N=88 (Casewise deletion of missing data) VQ1 VQ1 HMEAN WPCT10 WPCT25 HMEDIAN WPCT75 WPCT90 1 0.881048 0.938424 0.821285 0.780183 0.792332 0.800457 HMEAN WPCT10 WPCT25 HMEDIAN WPCT75 WPCT90 0.881048 0.938424 0.821285 0.780183 0.792332 0.800457 1 0.96484 0.991111 0.97976 0.983001 0.984092 0.96484 1 0.930783 0.899275 0.905291 0.905269 0.991111 0.930783 1 0.996533 0.997419 0.99586 0.97976 0.899275 0.996533 1 0.99939 0.997568 0.983001 0.905291 0.997419 0.99939 1 0.999103 0.984092 0.905269 0.99586 0.997568 0.999103 1 Table 4: Regression Results for HMEAN: No Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: HMEAN (vqhn88.sta) R= .88104822 R²= .77624597 Adjusted R²= .77364418 F(1,86)=298.35 p<.00000 Std.Error of estimate: 4.7814 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -19.8118 2.312267 -8.56811 3.73E-13 VQ1 0.881048 0.051008 0.346319 0.02005 17.27283 1.06E-29 Table 5: Prediction Results for HMEAN: No Outliers Removed from vqhn88.sta Predicting Values for (vqhn88.sta) Predicting Values for (vqhn88.sta) variable: HMEAN variable: HMEAN B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.346319 0 0 VQ1 0.346319 0 0 Intercpt -19.8118 Intercpt -19.8118 Predictd -19.8118 Predictd -19.8118 -95.0%CL -24.4084 -95.0%PL -30.37 +95.0%CL -15.2151 +95.0%PL -9.25355 Table 6: Regression Results for WPCT10: No Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT10 (vqhn88.sta) R= .93842408 R²= .88063975 Adjusted R²= .87925184 F(1,86)=634.51 p<.00000 Std.Error of estimate: 1.4588 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -6.94415 0.705483 -9.84311 9.48E-16 VQ1 0.938424 0.037255 0.154092 0.006117 25.18944 1.84E-41 Table 7: Prediction Results for WPCT10: No Outliers Removed from vqhn88.sta Predicting Values for (vqhn88.sta) Predicting Values for (vqhn88.sta) variable: WPCT10 variable: WPCT10 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.154092 0 0 VQ1 0.154092 0 0 Intercpt -6.94415 Intercpt -6.94415 Predictd -6.94415 Predictd -6.94415 -95.0%CL -8.3466 -95.0%PL -10.1655 +95.0%CL -5.5417 +95.0%PL -3.72279 Page: 118 Journal of Forensic Vocationology Vol. 7(1) Monograph Table 8: Regression Results for WPCT25: No Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT25 (vqhn88.sta) R= .82128465 R²= .67450848 Adjusted R²= .67072369 F(1,86)=178.22 p<.00000 Std.Error of estimate: 5.1999 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -18.2418 2.514633 -7.25425 1.66E-10 VQ1 0.821285 0.061521 0.291087 0.021805 13.34975 1.14E-22 Table 9: Prediction Results for WPCT25: No Outliers Removed from vqhn88.sta Predicting Values for (vqhn88.sta) Predicting Values for (vqhn88.sta) variable: WPCT25 variable: WPCT25 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.291087 0 0 VQ1 0.291087 0 0 Intercpt -18.2418 Intercpt -18.2418 Predictd -18.2418 Predictd -18.2418 -95.0%CL -23.2407 -95.0%PL -29.724 +95.0%CL -13.2429 +95.0%PL -6.75953 Table 10: Regression Results for HMEDIAN: No Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: HMEDIAN R= .78018270 R²= .60868505 Adjusted R²= .60413488 F(1,86)=133.77 p<.00000 Std.Error of estimate: 9.2486 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -30.5729 4.472578 -6.83564 1.12E-09 VQ1 0.780183 0.067455 0.448555 0.038782 11.56598 3.29E-19 Table 11: Prediction Results for HMEDIAN: No Outliers Removed from vqhn88.sta Predicting Values for (vqhn88.sta) Predicting Values for (vqhn88.sta) variable: HMEDIAN variable: HMEDIAN B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.448555 0 0 VQ1 0.448555 0 0 Intercpt -30.5729 Intercpt -30.5729 Predictd -30.5729 Predictd -30.5729 -95.0%CL -39.4641 -95.0%PL -50.9955 +95.0%CL -21.6817 +95.0%PL -10.1503 Table 12: Regression Results for WPCT75: No Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT75 (vqhn88.sta) R= .79233195 R²= .62778992 Adjusted R²= .62346189 F(1,86)=145.05 p<.00000 Std.Error of estimate: 12.365 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -43.5981 5.979486 -7.29129 1.4E-10 VQ1 0.792332 0.065788 0.624455 0.051849 12.04377 3.76E-20 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 119 Table 13: Prediction Results for WPCT75: No Outliers Removed from vqhn88.sta Predicting Values for (vqhn88.sta) Predicting Values for (vqhn88.sta) variable: WPCT75 variable: WPCT75 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.624455 0 0 VQ1 0.624455 0 0 Intercpt -43.5981 Intercpt -43.5981 Predictd -43.5981 Predictd -43.5981 -95.0%CL -55.485 -95.0%PL -70.9015 +95.0%CL -31.7113 +95.0%PL -16.2948 Table 14: Regression Results for WPCT90: No Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT90 (vqhn88.sta) R= .80045652 R²= .64073064 Adjusted R²= .63655308 F(1,86)=153.37 p<.00000 Std.Error of estimate: 15.285 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -54.8014 7.391568 -7.41405 7.98E-11 VQ1 0.800457 0.064634 0.793759 0.064093 12.38445 8.14E-21 Table 15: Prediction Results for WPCT90: No Outliers Removed from vqhn88.sta Predicting Values for (vqhn88.sta) Predicting Values for (vqhn88.sta) variable: WPCT90 variable: WPCT90 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.793759 0 0 VQ1 0.793759 0 0 Intercpt -54.8014 Intercpt -54.8014 Predictd -54.8014 Predictd -54.8014 -95.0%CL -69.4954 -95.0%PL -88.5526 +95.0%CL -40.1075 +95.0%PL -21.0502 Page: 120 Journal of Forensic Vocationology Vol. 7(1) Monograph Final Results: Tables 16-33 (All Outliers Removed) Table 16: Descriptive Statistics Results: All HMEAN Outliers Removed from vqhn88.sta Descriptive Statistics (vqhn72.sta) Standard Valid N Mean Minimum Maximum Std.Dev. Error Skewness VQ1 72 106.7222 70 145 21.33517 2.514374 0.050029 HMEAN 72 15.77818 9.2136 25.36 5.106672 0.601827 0.331429 WPCT10 72 9.027733 5.89 15.482 2.687342 0.316706 0.592608 WPCT25 72 11.35689 6.8445 19.411 3.633217 0.428179 0.464957 HMEDIAN 72 14.81975 8.4009 25.131 5.061342 0.596485 0.405784 WPCT75 72 19.71538 10.4173 33.4 7.288025 0.858902 0.401742 WPCT90 72 25.91269 13.4773 46.8433 9.722123 1.145763 0.312846 Table 17: Regression Results for HMEAN: All HMEAN Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: HMEAN (vqhn72.sta) R= .97269928 R²= .94614389 Adjusted R²= .94537451 F(1,70)=1229.8 p<0.0000 Std.Error of estimate: 1.1935 St. Err. St. Err. BETA of BETA B of B t(70) p-level Intercpt -9.0689 0.722368 -12.5544 1.35E-19 VQ1 0.972699 0.027738 0.23282 0.006639 35.06793 0 Table 18: Prediction Results for HMEAN: All HMEAN Outliers Removed from vqhn88.sta Predicting Values for (vqhn72.sta) Predicting Values for (vqhn72.sta) variable: HMEAN Variable: HMEAN B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.23282 106.7222 24.84708 VQ1 0.23282 106.7222 24.84708 Intercpt -9.0689 Intercpt -9.0689 Predictd 15.77817 Predictd 15.77817 -95.0%CL 15.49764 -95.0%PL 13.38127 +95.0%CL 16.05871 +95.0%PL 18.17508 Table 19: Descriptive Statistics Results: All WPCT10 Outliers Removed from vqhn88.sta Descriptive Statistics (vq10n62.sta) Standard Valid N Mean Minimum Maximum Std.Dev. Error Skewness VQ1 62 102.2581 70 145 19.52211 2.47931 0.281659 HMEAN 62 14.53629 9.2136 24.8933 4.337411 0.550852 0.52454 WPCT10 62 8.296231 5.89 13.2033 2.089095 0.265315 0.671349 WPCT25 62 10.40483 6.8445 16.81 2.920144 0.370859 0.543168 HMEDIAN 62 13.52239 8.4009 22.2767 4.141906 0.526023 0.510285 WPCT75 62 17.91649 10.4173 33.4 6.123597 0.777698 0.612809 WPCT90 62 23.70568 13.4773 46.8433 8.570035 1.088396 0.600044 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 121 Table 20: Regression Results With All WPCT10 Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT10 R= .97369152 R²= .94807517 Adjusted R²= .94720976 F(1,60)=1095.5 p<.00000 Std.Error of estimate: .47999 St. Err. St. Err. BETA of BETA B of B t(60) p-level Intercpt -2.35869 0.327636 -7.19914 1.14E-09 VQ1 0.973692 0.029418 0.104196 0.003148 33.09859 3.04E-40 Table 21: Prediction Results With All WPCT10 Outliers Removed from vqhn88.sta Predicting Values for (vq10n62.sta) Predicting Values for (vq10n62.sta) variable: WPCT10 variable: WPCT10 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.104196 102.2581 10.65493 VQ1 0.104196 102.2581 10.65493 Intercpt -2.35869 Intercpt -2.35869 Predictd 8.296231 Predictd 8.296231 -95.0%CL 8.174294 -95.0%PL 7.32839 +95.0%CL 8.418167 +95.0%PL 9.264072 Table 22: Descriptive Statistics Results: All WPCT25 Outliers Removed from vqhn88.sta Descriptive Statistics (vq25n65.sta) Standard Valid N Mean Minimum Maximum Std.Dev. Error Skewness VQ1 65 103.6 70 145 20.03965 2.485612 0.194117 HMEAN 65 14.89228 9.2136 24.8933 4.542791 0.563464 0.440079 WPCT10 65 8.494946 5.89 13.2033 2.234358 0.277138 0.596825 WPCT25 65 10.66527 6.8445 16.81 3.092186 0.383538 0.474185 HMEDIAN 65 13.88674 8.4009 23.0603 4.381939 0.543513 0.45407 WPCT75 65 18.43281 10.4173 33.4 6.445447 0.799459 0.532285 WPCT90 65 24.37062 13.4773 46.8433 8.923797 1.106861 0.500962 Table 23: Regression Results With All WPCT25 Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT25 R= .97531640 R²= .95124208 Adjusted R²= .95046814 F(1,63)=1229.1 p<.00000 Std.Error of estimate: .68819 St. Err. St. Err. BETA of BETA B of B t(63) p-level Intercpt -4.92597 0.452839 -10.878 4.24E-16 VQ1 0.975316 0.02782 0.150495 0.004293 35.05849 4.83E-43 Table 24: Prediction Results With All WPCT25 Outliers Removed from vqhn88.sta Predicting Values for (vq25n65.sta) Predicting Values for (vq25n65.sta) variable: WPCT25 variable: WPCT25 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.150495 103.6 15.59124 VQ1 0.150495 103.6 15.59124 Intercpt -4.92597 Intercpt -4.92597 Predictd 10.66527 Predictd 10.66527 -95.0%CL 10.4947 -95.0%PL 9.279497 +95.0%CL 10.83585 +95.0%PL 12.05105 Page: 122 Journal of Forensic Vocationology Vol. 7(1) Monograph Table 25: Descriptive Statistics Results: All HMEDIAN Outliers Removed from vqhn88.sta Descriptive Statistics (vq50n68.sta) Standard Valid N Mean Minimum Maximum Std.Dev. Error Skewness VQ1 68 105.0882 70 145 20.81528 2.524223 0.151117 HMEAN 68 15.27591 9.2136 24.8933 4.795245 0.581509 0.394925 WPCT10 68 8.726466 5.89 14.1867 2.441013 0.296016 0.612996 WPCT25 68 10.96513 6.8445 18.315 3.337995 0.404791 0.48808 HMEDIAN 68 14.28152 8.4009 23.84 4.670555 0.566388 0.432296 WPCT75 68 18.98834 10.4173 33.4 6.824034 0.827536 0.4772 WPCT90 68 25.03844 13.4773 46.8433 9.273655 1.124596 0.410609 Table 26: Regression Results With All HMEDIAN Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: HMEDIAN R= .97352356 R²= .94774812 Adjusted R²= .94695643 F(1,66)=1197.1 p<.00000 Std.Error of estimate: 1.0757 St. Err. St. Err. BETA of BETA B of B t(66) p-level Intercpt -8.67399 0.676169 -12.8281 1.36E-19 VQ1 0.973524 0.028137 0.21844 0.006313 34.59931 5.04E-44 Table 27: Prediction Results With All HMEDIAN Outliers Removed from vqhn88.sta Predicting Values for (vq50n68.sta) Predicting Values for (vq50n68.sta) variable: HMEDIAN variable: HMEDIAN B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.21844 105.0882 22.95551 VQ1 0.21844 105.0882 22.95551 Intercpt -8.67399 Intercpt -8.67399 Predictd 14.28152 Predictd 14.28152 -95.0%CL 14.02108 -95.0%PL 12.11811 +95.0%CL 14.54196 +95.0%PL 16.44493 Table 28: Descriptive Statistics Results: All WPCT75 Outliers Removed from vqhn88.sta Descriptive Statistics (vq75n69.sta) Standard Valid N Mean Minimum Maximum Std.Dev. Error Skewness VQ1 69 105.4783 70 145 20.91412 2.517764 0.121374 HMEAN 69 15.39209 9.2136 24.8933 4.856707 0.584679 0.368552 WPCT10 69 8.797496 5.89 14.1867 2.4938 0.300218 0.593122 WPCT25 69 11.05597 6.8445 18.315 3.398205 0.409096 0.468029 HMEDIAN 69 14.40522 8.4009 23.84 4.748584 0.571662 0.41255 WPCT75 69 19.15482 10.4173 33.4 6.913389 0.832274 0.447047 WPCT90 69 25.22322 13.4773 46.8433 9.332305 1.123478 0.374256 Table 29: Regression Results With All WPCT75 Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT75 R= .97154723 R²= .94390402 Adjusted R²= .94306676 F(1,67)=1127.4 p<.00000 Std.Error of estimate: 1.6496 St. Err. St. Err. BETA of BETA B of B t(67) p-level Intercpt -14.7201 1.028247 -14.3157 4.63E-22 VQ1 0.971547 0.028935 0.321156 0.009565 33.5765 1.23E-43 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 123 Table 30: Prediction Results With All WPCT75 Outliers Removed from vqhn88.sta Predicting Values for (vq75n69.sta) Predicting Values for (vq75n69.sta) variable: WPCT75 variable: WPCT75 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.321156 105.4783 33.87493 VQ1 0.321156 105.4783 33.87493 Intercpt -14.7201 Intercpt -14.7201 Predictd 19.15482 Predictd 19.15482 -95.0%CL 18.75844 -95.0%PL 15.83847 +95.0%CL 19.5512 +95.0%PL 22.47117 Table 31: Descriptive Statistics Results: All WPCT90 Outliers Removed from vqhn88.sta Descriptive Statistics (vq90n77.sta) Standard Valid N Mean Minimum Maximum Std.Dev. Error Skewness VQ1 77 107.1429 68 146 22.62551 2.578416 0.021595 HMEAN 77 16.06936 9.2136 27.9075 5.502208 0.627035 0.410636 WPCT10 77 9.242504 5.89 16.865 3.017558 0.343883 0.757195 WPCT25 77 11.60929 6.8445 21.265 4.003461 0.456237 0.593977 HMEDIAN 77 15.13087 8.4009 27.7175 5.486332 0.625226 0.49413 WPCT75 77 20.15281 10.4173 37.42 7.883874 0.898451 0.479637 WPCT90 77 26.36378 13.4773 46.8433 10.27203 1.170607 0.333253 Table 32: Regression Results With All WPCT90 Outliers Removed from vqhn88.sta Regression Summary for Dependent Variable: WPCT90 R= .96636485 R²= .93386102 Adjusted R²= .93297917 F(1,75)=1059.0 p<0.0000 Std.Error of estimate: 2.6593 St. Err. St. Err. BETA of BETA B of B t(75) p-level Intercpt -20.6432 1.475953 -13.9864 1.36E-22 VQ1 0.966365 0.029696 0.438732 0.013482 32.54191 0 Table 33: Prediction Results With All WPCT90 Outliers Removed from vqhn88.sta Predicting Values for (vq90n77.sta) Predicting Values for (vq90n77.sta) variable: WPCT90 variable: WPCT90 B-Weight B-Weight B-Weight Value * Value B-Weight Value * Value VQ1 0.438732 107.1429 47.00699 VQ1 0.438732 107.1429 47.00699 Intercpt -20.6432 Intercpt -20.6432 Predictd 26.36378 Predictd 26.36378 -95.0%CL 25.76007 -95.0%PL 21.03197 +95.0%CL 26.96749 +95.0%PL 31.69559 Page: 124 Journal of Forensic Vocationology Vol. 7(1) Monograph Hourly Mean VQ-OES Wage Estimation The Hourly Mean distribution tends to be impacted more by extreme scores compared to the percentile distributions. The average income is not the same as the median income. Different values indicate the positive skew often found in wage data. The Hourly Mean distribution started with 88 whole number VQ points. After outliers were removed, the points were reduced to 72. Regressing the VQ points on the OES code group reported income was initially significant. In the original distribution, Multiple R was 0.88 and Multiple R-Squared was 0.78. The Standard Error of Estimate was $4.78. Probability was well below 0.05. Of course the results were statistically significant after outliers were removed. The 72 VQ points had a Multiple R of 0.97 and a Multiple R-Squared of 0.95. The Standard Error of Estimate dropped to $1.19. The mean VQ for this distribution was 106.72, and the mean wage was $15.78 per hour. Hourly Mean Wage Estimate = -9.068905 + (0.23282 * VQ) + error S c a tte r p lo t( v q h n 7 2 .s ta7 v * 7 2 c ) y = 9 .0 6 9 + 0 .2 3 3 * x + e p s 2 8 2 4 HMEAN 2 0 1 6 1 2 8 6 0 8 0 1 0 0 1 2 0 V Q 1 1 4 0 1 6 0 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 125 10th Percentile VQ-OES Wage Estimation The first percentile distribution studied (10th Percentile) appeared to primarily be the distribution of people entering an occupation grouping. When people start a job, they often are required to start at the lowest entry level, and this distribution seemed to represent that level of employment. The distribution started with 88 whole number VQ points. After outliers were removed, the points were reduced to 62. Regressing the VQ points on the OES code group reported income was initially significant. In the original distribution, Multiple R was 0.94 and Multiple R-Squared was 0.88. The Standard Error of Estimate was $1.46. Probability was well below 0.05. Of course the results were statistically significant after outliers were removed. The 62 VQ points had a Multiple R of 0.97 and a Multiple R-Squared of 0.95. The Standard Error of Estimate dropped to $0.48. This finding was consistent with previous research using Job Service Work Orders that had a Standard Error of Estimate of around $0.50. The mean VQ for this distribution was 102.26, and the mean wage was $8.30 per hour. 10th Percentile Wage Estimate = -2.35869 + (0.104196 * VQ) + error S c a tte r p lo t( v q 1 0 n 6 2 .s ta7 v * 6 2 c ) y = 2 .3 5 9 + 0 .1 0 4 * x + e p s 1 4 1 3 1 2 1 1 WPCT10 1 0 9 8 7 6 5 6 0 8 0 1 0 0 1 2 0 V Q 1 1 4 0 1 6 0 Page: 126 Journal of Forensic Vocationology Vol. 7(1) Monograph 25th Percentile VQ-OES Wage Estimation The second percentile distribution looked like people that have worked for a job for perhaps five years. They have some experience with the occupation, and may have transferred from a similar occupation to the present one. Again, the distribution started with 88 VQ data points, and the regression formula was statistically significant. After outliers were removed, the points were reduced to 65. Regressing the VQ points on the OES code group reported income produce an initial Multiple R of 0.82 and Multiple RSquared was 0.67. The Standard Error of Estimate was $5.20. After the outliers were removed, the Multiple R was 0.98 and Multiple R-Squared was 0.95. The final Standard Error of Estimate dropped to $0.69. The mean VQ for this distribution was 103.60, and the mean wage was $10.67 per hour. 25th Percentile Wage Estimate = -4.92597 + (0.150495 * VQ) + error S c a tte r p lo t( v q 2 5 n 6 5 .s ta7 v * 6 5 c ) y = 4 .9 2 6 + 0 .1 5 * x + e p s 1 8 1 6 1 4 WPCT25 1 2 1 0 8 6 6 0 8 0 1 0 0 1 2 0 V Q 1 1 4 0 1 6 0 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 127 50th Percentile (Median) VQ-OES Wage Estimation This mid point of the income distribution represented those people that had considerable work experience and had been moderately satisfactory in performing all job requirements. The distribution started with 88 VQ data points, and the regression formula was statistically significant. After outliers were removed, the points were reduced to 68. Regressing the VQ points on the OES code group reported income produced an initial Multiple R of 0.78 and a Multiple R-Squared of 0.61. The initial Standard Error of Estimate was $9.25. After the outliers were removed, the Multiple R was 0.97 and Multiple R-Squared was 0.95. The final Standard Error of Estimate dropped to $1.08. The mean VQ for this distribution was 105.09, and the mean wage was $14.28 per hour. 50th Percentile Wage Estimate = -8.67399 + (0.21844 * VQ) + error S c a tte r p lo t( v q 5 0 n 6 8 .s ta7 v * 6 8 c ) y = 8 .6 7 4 + 0 .2 1 8 * x + e p s 2 6 2 2 HMEDIAN 1 8 1 4 1 0 6 6 0 8 0 1 0 0 1 2 0 V Q 1 1 4 0 1 6 0 Page: 128 Journal of Forensic Vocationology Vol. 7(1) Monograph 75th Percentile VQ-OES Wage Estimation This distribution appeared to be composed of workers that had done well in there chosen occupations. They had marketed their talents well. Of course, the distribution started with 88 VQ data points, and the regression formula was statistically significant. After the outliers were removed, the points were reduced to 69. Regressing the VQ points on the OES code group reported income produced an initial Multiple R of 0.79 and a Multiple R-Squared of 0.63. The initial Standard Error of Estimate was $12.37. After outliers were removed, the Multiple R was 0.97 and Multiple R-Squared was 0.94. The final Standard Error of Estimate dropped to $1.65. The mean VQ for this distribution was 105.48, and the mean wage was $19.15 per hour. 75th Percentile Wage Estimate = -14.7201 + (0.321156 * VQ) + error S c a tte r p lo t( v q 7 5 n 6 9 .s ta7 v * 6 9 c ) y = 1 4 .7 2 + 0 .3 2 1 * x + e p s 3 6 3 2 2 8 WPCT75 2 4 2 0 1 6 1 2 8 6 0 8 0 1 0 0 1 2 0 V Q 1 1 4 0 1 6 0 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 129 90th Percentile VQ-OES Wage Estimation This distribution represented the Stars in their occupations. They were top wage earners. Of course, the variability within this distribution was also the highest. The distribution started with 88 VQ data points, and the regression formula was statistically significant. After outliers were removed, the points were reduced to 77. Most of the points were retained along with their variance. Regressing the VQ points on the OES code group reported income produced an initial Multiple R of 0.80 and a Multiple R-Squared of 0.64. The initial Standard Error of Estimate was $15.29. After outliers were removed, the Multiple R was 0.97 and Multiple R-Squared was 0.93. The final Standard Error of Estimate dropped to $2.66. The mean VQ for this distribution was 107.14, and the mean wage was $26.36 per hour. 90th Percentile Wage Estimate = -20.6432 + (0.438732 * VQ) + error S c a tte r p lo t( v q 9 0 n 7 7 .s ta7 v * 7 7 c ) y = 2 0 .6 4 3 + 0 .4 3 9 * x + e p s 5 0 4 5 4 0 3 5 WPCT90 3 0 2 5 2 0 1 5 1 0 6 0 8 0 1 0 0 1 2 0 1 4 0 1 6 0 V Q 1 Discussion, Conclusions and Recommendations Predictive Validity of VQ-OES Hourly Wage Estimation Formulas All regression formulas were statistically significant at very high levels of predictive validity with no outliers removed. The McCroskey Hahn Technique (McCroskey & Hahn, 1998) used in removing outliers significantly improved predictive validity and lowered standard error estimates for each of the six hourly wage estimates formulas. Six-digit ONET Occupational Unit Classification transferable skills groups did not represent jobs; they were collections of 9-digit DOT-Coded job titles that have similar transferable skills. Five-digit OES groups within ONET OUC groups do not represent jobs; they are collections of 9-digit DOT-Coded job titles that have similar transferable Page: 130 Journal of Forensic Vocationology Vol. 7(1) Monograph skills. Variability found in the wage distributions in this study increased as the research moved from entry-level worker 10th Percentile wage estimates to wage estimates for the Star occupational performers (worker wage estimates at higher Percentile levels). While the most accurate predictions were found for entry-level positions (10th Percentile Wage Estimates), this research significantly improved wage estimates prediction and lowered standard error estimates for workers with increasingly higher levels of transferable skills (Mean, 25th, 50th, 75th and 90th Percentile Wage Estimates). Generalizing Wage Estimates using Job Specific VQ1, Geographic Location Specific Earning Capacity Link Relatives, and Average Inflation since 1998 (AINF) to Increase Job-Specific Predictive Validity and Decrease the Overall SEE Associated with Aggregate OES Groups In order for these 1998 US National OES VQ1-Wage Estimation formulas to produce the most reasonable estimates when generalized to specific 9-digit McDOT Coded Jobs and present value dollars, in specific state and county level geographic labor markets of interest across time, several sources of error must be controlled. The first well-known and well-documented source of error is the job difficulty range within aggregate OES Code Transferable Skills Groups (i.e., jobs with higher VQ1 indices tend to pay more than those with lower VQ1 indices). This error can be controlled by replacing OES Mean VQ1s with McDOT 2000 (McCroskey, 2000), 9-digit DOTCoded Job Specific VQ1s, in each of the six prediction formulas across all 12,775 jobs in McDOT 2000. Two other well-known and well-documented sources of error are yearly wage inflation and overall average wage differences between specific geographic locations of interest. These two sources of error can be controlled by using Average Wage Inflation since 1998 (AINF; McCroskey, 1998, 2000) and Geographic-Location-Specific Earning Capacity Link Relatives (ECLRs, McCroskey, 1998, 2000) specifically designed to control these types of error (McCroskey, Dennis & Dennis, 1998; McCroskey & Hahn, 1997, 1998a, 1998b). These Link Relatives must be applied to the regression formulas identified in this study in order for wage estimates to accurately generalize to present value dollars for specific years of interest, in specific geographic locations of interest, for each of the 12,775 specific 9-digit DOT-Coded Occupations in McDOT 2000. Given the broader range of estimates (six points prediction, versus two points prediction) available from these highly reliable, highly valid wage estimation formulas and very reasonable known error rates, it is recommended that these be incorporated within the MVQS 2001 Windows 2000TM Program Series slated for release circa Mid-Fall, 2000. References and Bibliography Borland International, Inc. (1995). Borland Paradox® for Windows® and Windows NT®, Version 7.0. Scotts Valley, CA: Borland International, Inc. Bureau of Labor Market Performance and Information, Division of Jobs and Benefits, Florida Department of Labor and Employment Security. (1999). Florida Program Year (PY) 1998 (07/01/98-06/30/99) Job Education Partnership (JEP) 9-Digit DOT Coded Work Order Position Openings and Wage Data by County. Tallahassee, FL. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 131 Bureau of Labor Statistics (1999). The 1998 Occupational Employment Statistics (OES) Survey. Occupational Employment Statistics: OESINFO@BLS.GOV. Daubert v. Merrell Dow Pharmaceuticals, Inc. (1993). 113 S. Ct. 2786. Dennis, K. L. & Tichauer, G. (1998). Replicating Vocational Quotient (VQ) Wage Earning Capacity Predictions in Nebraska. Journal of Forensic Vocationology, 4(1), pp. 85-92. Dennis, K. L., Feldbaum, C. L. & Hahn, S. J. (2000). Louisiana State McDOT 8.0R VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. 37-47. Dennis, K. L., Feldbaum, C. L. & Hahn, S. J. (2000). Louisiana State McDOT 2000 VQ1-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. 49-59. Dennis, M. L. & Dennis, K. L. (1998). Replicating Vocational Quotient (VQ) Earning Capacity Predictions In Wisconsin. Journal of Forensic Vocationology, 4(1), pp. 61-68. E. I. du Pont de Nemours & Co. v. Robinson, (1995). 923 S. W. 2d. At 559 (Texas). Feldbaum, C. L. & McCroskey, B. J. (1995). Expert Testimony: Evolving Vocational and Rehabilitation Economic Technologies, Federal Rules of Evidence and the Daubert Decision. Journal of Vocationology, 1(1), pp. 1-5. Hahn, S. J. & Wells-Moran, J. (1998). Washington State VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 4(1), pp. 79-84. Hahn, S. J. (1997). An Independent Replication of the McCroskey Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Forensic Vocationology, 3(1), pp. 29-33. Hahn, S. J., Larkin, S. & Dennis, K. L. (2000). Florida State McDOT 2000 VQ1-Wage Earning Capacity Predictive Validity Generalization Follow-up Study. Journal of Forensic Vocationology, 6(1), pp. 29-36. Hahn, S. J., Larkin, S. & Williams, J. M. (2000). Florida State McDOT 1998 VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. 17-27. McCroskey, B. J. & Dennis, K. L. (2002). The MVQS Rehabilitation Economist. Journal of Forensic Vocationology, Vol 7(1), Fall Update, pp. 178-188. McCroskey, B. J. & Feldbaum, C. L. (1995). Statistical Basics Revisited for Vocational Evaluation and Earning Capacity Analysis under Daubert: A Need for Forensic Standards. Journal of Vocationology, 1(1), pp. 6-8. McCroskey, B. J. & Hahn, S. J. (1997). The Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Vocationology, 3(1), pp. 1-27. McCroskey, B. J. & Hahn, S. J. (1998). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Validity Follow-up Studies. Journal of Forensic Vocationology, 4(1) 11-52. McCroskey, B. J. & Hahn, S. J. (1998). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Follow-up Validity Studies. The Earnings Analyst, Journal of the American Rehabilitation Economics Association, 1(1), pp. 39-80. McCroskey, B. J. (1984-2003). The MVQS Rehabilitation Economist. (A Computerized Diminished Earning Capacity Calculations Program). Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998). The 1998 Encyclopedia of Job Requirements (EOJR-98). [Electronic Version within the 1998 McDOT 8.0R Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0R: Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0R. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2000). The 2000 Encyclopedia of Job Requirements (EOJR-2000). [Electronic Version within the McDOT 2000 Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2000). The McCroskey Dictionary of Occupational Titles Program (McDOT) Extended 5th Edition DOT Dataset, Version 2000. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. Hahn, S. J., Dennis, K. L. (2000). MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation. Journal of Forensic Vocationology, 6(1), pp. 107-134. McCroskey, B. J. Hahn, S. J., Dennis, K. L. (2002). MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation. Reprinted for continuity: Journal of Forensic Vocationology, 7(1), Fall Update, pp. 128-156. McCroskey, B. J. Hahn, S. J., Dennis, K. L. & Wattenbarger, W. E. (2002). MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation Follow-Up Study. Journal of Forensic Vocationology, 7(1), Fall Update, pp. 157-177. McCroskey, B. J., Dennis, M. L. & Dennis, K. L. (1998). Geographic Location and the Vocational Quotient (VQ) Prediction Of Earning Capacity. Journal of Forensic Vocationology, 4(1), pp. 69-78. StatSoft, Inc. (1998). STATISTICA, Kernel Release 5.1. Tulsa, OK: StatSoft, Inc. US Department of Labor, Bureau of Employment Security. (1991a). Dictionary Of Occupational Titles (Vols. I, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1991b). Dictionary Of Occupational Titles (Vols. II, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Employment & Training Administration (US DOLETA). (1998). The Occupational Information Network-98 (O*NET-98, CD-ROM Vers. 1.0). Washington, DC: US Govt. Printing Office. US Dept. of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1972). Standard Industrial Classification Codes. Washington, DC, US Govt. Printing Office. Revised, 1977. Revised, 1987. Page: 132 Journal of Forensic Vocationology Vol. 7(1) Monograph MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation Follow-Up Study By Billy J. McCroskey, Ph.D., CRE, CRC, CRV-Diplomate, ABVE-Diplomate Steven J. Hahn, MS, CRC, CVE, QRC, CRC-Diplomate Kenneth L. Dennis, Ph.D., LP, LMFT, CRC, CRV-Diplomate William E. Wattenbarger, CRC, CRV-Diplomate42 Abstract Original Study: Previous research has assessed the validity of the Vocational Quotient (VQ) as a predictor of income. This study evaluated the ability of the VQ1 to predict income reported by Occupational Employment Statistics (OES) groups. Linear regression was used to predict reported income at the Mean, 10th, 25th, 50th, 75th and 90th percentile of the 1998 OES-Wage distribution. VQ1 was used to predict to the middle of these six distributions, and was found to be a very accurate predictor of the OES-Wage distribution as reported by the US Department of Labor. Relative Predictive Validity (Rxy) Coefficients were determined to be 0.970, 0.973, 0.975, 0.974, 0.972 and 0.966, respectively. Relative Coefficients of Determination were 0.950, 0.948, 0.951, 0.948, 0.944 and 0.934, respectively. Relative Standard Errors of Estimate (SEE) were $1.19, $0.45, $0.69, $1.08, $1.65 and $2.66 per hour, respectively. It was recommended that specific McDOT-VQ143 Wage Prediction be used to increase overall reliability and reduce aggregate SEEs. Follow-up Study: This Follow-up Study extended the research in its predecessor study to allow better predictions in the 1st three VQ-Wage Bands and allows predictions to be extended into the 4th VQ-Wage Band, where most outliers were found and removed in the previous study. Literature Review From 1996 through 1999, there were a series of predictive validity studies that used the Vocational Quotient (VQ) to predict income. These were regression studies that used the VQ as the independent variable and Job Service work orders or actual income of Vocational Rehabilitation clients as the dependent variable. When the Vocational Quotient was used as a predictor to the middle of the income distribution, it was found to predict 80 to over 90 percent of the variance in actual income data. In 1999, the Vocational Quotient (VQ) was grouped by O*NET code groups. Again, the VQ was found to be an accurate predictor of Job Service work order income. This study expanded 42 Dr. Wattenbarger was added to the follow-up study authors as a result of his significant contributions in programming the curvilinear wage prediction algorithms (from the follow-up study prediction formulas) into the MVQS 2003 MTSP 6.0 Program. 43 McCroskey Dictionary of Occupational Titles (McDOT; McCroskey, 2003) 6th Edition DOT VQ replacement data. Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 133 earlier research by grouping linking the new McDOT VQ1 (McCroskey, 2000, 2003) mean for each Occupational Employment Statistics (OES) code groupings with the six mean OES Wage distribution data points. The McDOT VQ1 means were then used to predict Mean Hourly OES wages (1998 US DOL) at the Mean, 10th, 25th, 50th, 75th and 90th percentiles. Originally, only straight-line Linear Regression was used and outliers were removed. In this Follow-Up Study, a new regression technique using 4 VQ-Wage bands (with no outliers removed), each incorporating six-point Linear Regression formulas, was used to mimic the overall Curvilinear Regression Prediction Plot findings. Methodology As indicated above, in this study, a new curvilinear regression technique using 4 VQWage bands (with no outliers removed), each incorporating six-point Linear Regression formulas, was used to mimic the overall Curvilinear Regression Prediction Plot findings from the first Study. Since this Follow-Up study was based on the original study and on the same data, the references and bibliography remains the same. To keep it simple, tabled raw data inputs and selected output results will be presented with selected scatter plot graphs in the next section and commented on at the end of the follow-up study. Raw Data Inputs and Prediction Results MVQS MTSP 6th Edition Curvilinear Earning Capacity Prediction Inputs © 2003 by Billy J. McCroskey, Ph.D. The 1998 OES Raw Hourly Wage Means Data Across OES Group Integer VQs OBS 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 VQ1 68 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 HMEAN $ 9.73 $ 9.21 $ 10.18 $ 9.62 $ 9.73 $ 9.70 $ 9.73 $ 10.10 $ 9.87 $ 10.03 $ 10.12 $ 10.31 $ 10.41 $ 10.62 $ 10.63 $ 10.70 $ 10.65 $ 10.62 $ 10.73 $ 10.83 $ 10.71 $ 10.83 $ 10.89 $ 11.34 $ 11.09 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ WPCT10 6.10 5.89 6.19 6.01 5.97 6.02 6.02 6.18 6.13 6.16 6.23 6.31 6.34 6.44 6.44 6.44 6.43 6.43 6.47 6.55 6.53 6.55 6.57 6.72 6.67 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ WPCT25 7.23 6.84 7.41 7.05 6.98 7.07 7.10 7.37 7.24 7.33 7.43 7.55 7.62 7.78 7.78 7.80 7.79 7.79 7.83 7.92 7.90 7.95 7.97 8.27 8.11 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ HMEDIAN 9.10 8.40 9.36 8.77 8.79 8.84 8.87 9.25 9.06 9.20 9.32 9.49 9.59 9.78 9.78 9.86 9.82 9.81 9.87 9.99 9.92 10.03 10.06 10.48 10.24 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ WPCT75 11.25 10.42 11.89 11.02 11.24 11.20 11.21 11.75 11.48 11.70 11.81 12.06 12.22 12.49 12.52 12.64 12.54 12.51 12.65 12.75 12.60 12.78 12.88 13.50 13.16 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ WPCT90 14.25 13.48 15.46 14.36 14.99 14.68 14.64 15.26 14.83 15.16 15.14 15.58 15.78 16.05 16.15 16.29 16.12 16.02 16.31 16.37 16.13 16.34 16.49 17.27 16.83 Page: 134 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 Journal of Forensic Vocationology Vol. 7(1) Monograph 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 $ 10.91 $ 11.54 $ 11.84 $ 11.99 $ 11.83 $ 11.93 $ 12.13 $ 12.46 $ 12.80 $ 13.50 $ 13.85 $ 15.12 $ 14.92 $ 15.24 $ 16.50 $ 17.19 $ 17.81 $ 17.06 $ 17.80 $ 17.35 $ 18.19 $ 18.15 $ 17.93 $ 17.96 $ 17.58 $ 18.52 $ 19.59 $ 19.00 $ 19.00 $ 19.55 $ 18.35 $ 20.40 $ 20.16 $ 21.22 $ 21.33 $ 21.47 $ 21.80 $ 22.18 $ 23.29 $ 24.27 $ 25.86 $ 24.34 $ 23.62 $ 22.03 $ 25.36 $ 24.12 $ 26.74 $ 26.76 $ 24.46 $ 22.27 $ 22.77 $ 24.89 $ 27.91 $ 32.68 $ 29.21 $ 39.77 $ 47.50 $ 6.74 $ 6.95 $ 7.05 $ 7.11 $ 7.04 $ 7.05 $ 7.21 $ 7.33 $ 7.54 $ 7.88 $ 7.91 $ 8.32 $ 8.36 $ 8.51 $ 9.03 $ 9.20 $ 9.46 $ 9.28 $ 9.71 $ 9.47 $ 9.96 $ 9.73 $ 9.74 $ 9.85 $ 9.72 $ 10.17 $ 10.49 $ 10.47 $ 10.41 $ 10.73 $ 10.40 $ 11.08 $ 11.13 $ 11.18 $ 12.40 $ 11.27 $ 12.40 $ 13.05 $ 13.63 $ 13.91 $ 15.24 $ 13.58 $ 13.00 $ 12.74 $ 15.48 $ 13.99 $ 16.50 $ 16.03 $ 14.19 $ 12.41 $ 13.02 $ 13.20 $ 16.87 $ 15.25 $ 17.87 $ 18.90 $ 19.94 $ 8.10 $ 8.50 $ 8.74 $ 8.77 $ 8.66 $ 8.70 $ 8.91 $ 9.05 $ 9.36 $ 9.86 $ 9.96 $ 10.64 $ 10.69 $ 10.83 $ 11.58 $ 11.91 $ 12.30 $ 11.98 $ 12.52 $ 12.22 $ 12.88 $ 12.64 $ 12.56 $ 12.68 $ 12.50 $ 13.15 $ 13.62 $ 13.53 $ 13.41 $ 13.90 $ 13.25 $ 14.48 $ 14.24 $ 14.44 $ 15.67 $ 14.55 $ 15.77 $ 16.32 $ 17.23 $ 17.92 $ 19.79 $ 17.51 $ 16.71 $ 16.04 $ 19.41 $ 17.75 $ 20.31 $ 20.00 $ 18.32 $ 15.89 $ 16.74 $ 16.81 $ 21.27 $ 26.82 $ 21.85 $ 33.69 $ 41.73 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ 10.14 10.73 11.03 11.14 10.98 11.04 11.30 11.57 11.89 12.57 12.86 13.90 13.96 14.15 15.22 15.84 16.44 15.84 16.59 16.11 17.03 16.90 16.66 16.80 16.49 17.39 18.37 17.81 17.79 18.56 17.36 19.37 18.81 20.03 20.47 20.34 20.72 21.46 22.82 24.05 26.26 23.88 23.06 20.87 25.13 23.20 26.04 25.84 23.84 20.97 22.05 22.28 27.72 39.19 27.76 50.89 66.13 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ 12.90 13.72 14.14 14.33 14.06 14.26 14.45 15.00 15.33 16.22 16.84 18.46 18.31 18.73 20.34 21.51 22.28 21.22 22.33 21.44 22.87 22.96 22.35 22.54 21.97 23.16 25.19 24.08 23.95 24.91 22.91 26.20 25.41 28.25 27.11 28.09 28.19 29.02 30.48 31.96 35.18 32.67 32.01 28.46 33.20 31.54 35.98 35.73 32.52 29.07 30.08 33.40 37.42 55.28 38.91 68.62 88.79 $ 16.31 $ 17.32 $ 17.95 $ 18.23 $ 17.94 $ 18.21 $ 18.31 $ 19.41 $ 19.86 $ 20.96 $ 22.19 $ 25.02 $ 23.98 $ 24.82 $ 27.84 $ 29.53 $ 30.86 $ 28.62 $ 30.49 $ 29.55 $ 30.97 $ 31.34 $ 30.84 $ 30.28 $ 29.61 $ 31.57 $ 34.25 $ 32.26 $ 32.15 $ 33.28 $ 30.29 $ 34.27 $ 34.16 $ 38.21 $ 35.39 $ 38.09 $ 37.09 $ 37.16 $ 37.79 $ 41.16 $ 43.94 $ 42.73 $ 41.86 $ 36.89 $ 41.42 $ 40.90 $ 44.10 $ 44.90 $ 40.46 $ 38.97 $ 37.82 $ 46.84 $ 45.60 $ 71.96 $ 51.14 $ 86.14 $ 111.88 Journal of Forensic Vocationology Vol. 7(1) Monograph 83 84 85 86 87 88 151 152 153 154 155 156 VQ Band 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 2 2 2 2 2 2 2 2 2 3 3 3 3 3 3 VQ1 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 $ 46.26 $ 39.16 $ 43.90 $ 49.05 $ 47.89 $ 46.15 $ 20.65 $ 18.06 $ 19.27 $ 19.05 $ 19.72 $ 18.67 $ 38.40 $ 32.07 $ 37.25 $ 45.88 $ 42.77 $ 42.02 $ $ $ $ $ $ 60.86 49.28 58.09 72.71 67.77 65.81 Page: 135 $ $ $ $ $ $ 80.18 66.48 78.50 99.54 91.48 90.12 $ 100.29 $ 83.54 $ 99.35 $ 126.37 $ 115.51 $ 114.75 Predictions from 4 VQ-Wage Band Curvilinear Mean Hourly Wage Formulas HMEAN $ 9.37 $ 9.44 $ 9.52 $ 9.60 $ 9.67 $ 9.75 $ 9.83 $ 9.90 $ 9.98 $ 10.06 $ 10.14 $ 10.21 $ 10.29 $ 10.37 $ 10.44 $ 10.52 $ 10.60 $ 10.67 $ 10.75 $ 10.83 $ 10.90 $ 10.98 $ 11.06 $ 11.13 $ 11.21 $ 11.29 $ 11.37 $ 11.44 $ 11.52 $ 11.60 $ 11.67 $ 11.75 $ 11.95 $ 12.48 $ 13.00 $ 13.53 $ 14.06 $ 14.58 $ 15.11 $ 15.64 $ 16.17 $ 16.35 $ 16.62 $ 16.89 $ 17.16 $ 17.43 $ 17.70 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ WPCT10 5.86 5.90 5.93 5.97 6.01 6.04 6.08 6.12 6.15 6.19 6.22 6.26 6.30 6.33 6.37 6.41 6.44 6.48 6.52 6.55 6.59 6.63 6.66 6.70 6.74 6.77 6.81 6.85 6.88 6.92 6.95 6.99 7.15 7.37 7.58 7.80 8.01 8.23 8.44 8.66 8.87 8.60 8.79 8.97 9.16 9.35 9.53 WPCT25 $ 6.85 $ 6.91 $ 6.97 $ 7.02 $ 7.08 $ 7.14 $ 7.19 $ 7.25 $ 7.31 $ 7.37 $ 7.42 $ 7.48 $ 7.54 $ 7.59 $ 7.65 $ 7.71 $ 7.76 $ 7.82 $ 7.88 $ 7.93 $ 7.99 $ 8.05 $ 8.10 $ 8.16 $ 8.22 $ 8.27 $ 8.33 $ 8.39 $ 8.44 $ 8.50 $ 8.56 $ 8.61 $ 8.80 $ 9.13 $ 9.45 $ 9.78 $ 10.10 $ 10.42 $ 10.75 $ 11.07 $ 11.39 $ 11.21 $ 11.44 $ 11.67 $ 11.89 $ 12.12 $ 12.35 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ HMEDIAN 8.55 8.63 8.70 8.78 8.86 8.93 9.01 9.08 9.16 9.24 9.31 9.39 9.46 9.54 9.62 9.69 9.77 9.84 9.92 10.00 10.07 10.15 10.22 10.30 10.38 10.45 10.53 10.60 10.68 10.76 10.83 10.91 11.12 11.60 12.08 12.57 13.05 13.53 14.01 14.49 14.97 15.01 15.30 15.60 15.89 16.18 16.47 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ WPCT75 10.74 10.85 10.96 11.06 11.17 11.28 11.38 11.49 11.59 11.70 11.81 11.91 12.02 12.13 12.23 12.34 12.44 12.55 12.66 12.76 12.87 12.98 13.08 13.19 13.29 13.40 13.51 13.61 13.72 13.82 13.93 14.04 14.21 14.93 15.64 16.36 17.07 17.79 18.50 19.22 19.94 20.07 20.48 20.89 21.30 21.71 22.12 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ WPCT90 14.03 14.16 14.28 14.40 14.53 14.65 14.77 14.90 15.02 15.14 15.26 15.39 15.51 15.63 15.76 15.88 16.00 16.13 16.25 16.37 16.49 16.62 16.74 16.86 16.99 17.11 17.23 17.35 17.48 17.60 17.72 17.85 18.05 19.16 20.27 21.38 22.49 23.60 24.71 25.82 26.93 28.05 28.50 28.94 29.38 29.83 30.27 Page: 136 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 4 4 4 4 4 4 4 4 4 4 4 4 4 4 Journal of Forensic Vocationology Vol. 7(1) Monograph 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 $ 17.97 $ 18.24 $ 18.51 $ 18.78 $ 19.05 $ 19.32 $ 19.59 $ 19.86 $ 20.13 $ 20.39 $ 20.66 $ 20.93 $ 21.20 $ 21.47 $ 21.74 $ 22.01 $ 22.28 $ 22.55 $ 22.82 $ 23.09 $ 23.36 $ 23.63 $ 23.90 $ 24.17 $ 24.44 $ 24.71 $ 24.98 $ 25.25 $ 25.52 $ 25.06 $ 27.26 $ 29.45 $ 31.65 $ 33.85 $ 36.04 $ 38.24 $ 40.44 $ 42.64 $ 44.83 $ 47.03 $ 49.23 $ 51.43 $ 53.62 Filename: C:Documents\VQWageNew.xls $ 9.72 $ 9.91 $ 10.09 $ 10.28 $ 10.47 $ 10.65 $ 10.84 $ 11.03 $ 11.21 $ 11.40 $ 11.59 $ 11.77 $ 11.96 $ 12.14 $ 12.33 $ 12.52 $ 12.70 $ 12.89 $ 13.08 $ 13.26 $ 13.45 $ 13.64 $ 13.82 $ 14.01 $ 14.20 $ 14.38 $ 14.57 $ 14.76 $ 14.94 $ 14.78 $ 15.27 $ 15.76 $ 16.25 $ 16.74 $ 17.24 $ 17.73 $ 18.22 $ 18.71 $ 19.20 $ 19.69 $ 20.18 $ 20.68 $ 21.17 $ 12.57 $ 12.80 $ 13.03 $ 13.25 $ 13.48 $ 13.71 $ 13.94 $ 14.16 $ 14.39 $ 14.62 $ 14.84 $ 15.07 $ 15.30 $ 15.52 $ 15.75 $ 15.98 $ 16.20 $ 16.43 $ 16.66 $ 16.88 $ 17.11 $ 17.34 $ 17.56 $ 17.79 $ 18.02 $ 18.24 $ 18.47 $ 18.70 $ 18.92 $ 17.71 $ 20.11 $ 22.51 $ 24.91 $ 27.30 $ 29.70 $ 32.10 $ 34.50 $ 36.90 $ 39.29 $ 41.69 $ 44.09 $ 46.49 $ 48.88 $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ $ 16.76 17.06 17.35 17.64 17.93 18.22 18.52 18.81 19.10 19.39 19.68 19.98 20.27 20.56 20.85 21.14 21.44 21.73 22.02 22.31 22.60 22.89 23.19 23.48 23.77 24.06 24.35 24.65 24.94 22.80 27.08 31.37 35.65 39.93 44.22 48.50 52.79 57.07 61.36 65.64 69.92 74.21 78.49 $ 22.53 $ 22.95 $ 23.36 $ 23.77 $ 24.18 $ 24.59 $ 25.00 $ 25.41 $ 25.82 $ 26.23 $ 26.64 $ 27.05 $ 27.46 $ 27.87 $ 28.28 $ 28.69 $ 29.10 $ 29.51 $ 29.92 $ 30.33 $ 30.74 $ 31.15 $ 31.56 $ 31.97 $ 32.38 $ 32.80 $ 33.21 $ 33.62 $ 34.03 $ 31.92 $ 37.61 $ 43.30 $ 48.99 $ 54.68 $ 60.37 $ 66.06 $ 71.75 $ 77.44 $ 83.13 $ 88.82 $ 94.51 $ 100.20 $ 105.89 $ 30.71 $ 31.15 $ 31.60 $ 32.04 $ 32.48 $ 32.92 $ 33.37 $ 33.81 $ 34.25 $ 34.70 $ 35.14 $ 35.58 $ 36.02 $ 36.47 $ 36.91 $ 37.35 $ 37.80 $ 38.24 $ 38.68 $ 39.12 $ 39.57 $ 40.01 $ 40.45 $ 40.90 $ 41.34 $ 41.78 $ 42.22 $ 42.67 $ 43.11 $ 41.44 $ 48.52 $ 55.61 $ 62.69 $ 69.77 $ 76.86 $ 83.94 $ 91.02 $ 98.10 $ 105.19 $ 112.27 $ 119.35 $ 126.44 $ 133.52 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 137 Scatterplot 1: Mean Hourly VQ-Wage Bands Linear Regression Plot Scatterplot (vqhn88.sta 8v*88c) y=-19.812+0.346*x+eps 55 45 HMEAN 35 25 15 5 60 80 100 120 140 160 180 VQ1 Scatterplot 2: Mean Hourly VQ-Wage Bands Curvilinear Regression Plot Scatterpl ot (vqhn88.sta 7v*88c) y=-1247.383+65.486*x-1.339*x^2+0.013*x^3-6.59e-5*x^4+1.271e-7*x^5+eps 55 45 HMEAN 35 25 15 5 60 80 100 120 VQ1 140 160 180 Page: 138 Journal of Forensic Vocationology Vol. 7(1) Monograph Scatterplot 3: Six-Point Mean Hourly VQ-Wage Bands Curvilinear Prediction Plots Scatterplot 4: 10th %ile Mean Hourly VQ-Wage Band Curvilinear Prediction Plot Journal of Forensic Vocationology Vol. 7(1) Monograph Scatterplot 5: 25th %ile Mean Hourly VQ-Wage Band Curvilinear Plot Scatterplot 6: 50th %ile (Median) Mean Hourly VQ-Wage Band Curvilinear Plot Page: 139 Page: 140 Journal of Forensic Vocationology Vol. 7(1) Monograph Scatterplot 7: Hourly Mean VQ-Wage Band Hourly Means Curvilinear Plot Scatterplot 8: 75th %ile Mean Hourly VQ-Wage Band Curvilinear Plot Journal of Forensic Vocationology Vol. 7(1) Monograph Scatterplot 9: 90th %ile Mean Hourly VQ-Wage Band Curvilinear Plot NOTES * Wage Estimation Algorithms developed specifically for the McCroskey Transferable Skills Program 2003 (MTSP 2003; McCroskey, 2003). Predictive Validity Estimate=0.68; Std Error of Est. = $1.01/hr. (Dennis & McCroskey, 1999, p. 71; McCroskey & Dennis, 1999, p. 32). SINF = Simple Inflation Rates [McCroskey, 1998, p. 70; McCroskey & Hahn, 1998a, pp. 34-38; McCroskey & Hahn, 1998b, pp. 67-71]. ECLRs = Earning Capacity Link Relatives (McCroskey, 1998; McCroskey, Dennis & Dennis, 1998). REFERENCES & BIBLIOGRAPHY Dennis, K.L. & McCroskey, B.J. (1999). O*NET Validity Under Daubert. Journal of Forensic Vocationology (JOFV), 5(1), 49-74 McCroskey, B.J. (2000), Manual for the McCroskey Transferable Skills Program (MTSP) 2000. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B.J. & Dennis, K.L. (1999). O*NET Issues for Rehabilitation Economists. The Earnings Analyst Journal of the American Rehabilitation Economics Association, 2(1), 23-34. McCroskey, B.J. & Dennis, M.L. & Dennis, K.L. (1998). Geographic Location and VQ Prediction of Earning Capacity. JOFV, 4(1), pp. 69-78. McCroskey, B.J. (1998). The 1998-2000 ECLRBOOK. Brooklyn Park, MN: Vocationology Inc. McCroskey, B.J. & Hahn, S.J. (1998a). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Validity Follow-up Studies. Journal of Forensic Vocationology, 4(1), 11-52. McCroskey, B.J. & Hahn, S.J. (1998b). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Validity Follow-up Studies. The Earnings Analyst Journal of the American Rehabilitation Economics Association, 1(1), 39-80. US Dept. of Commerce, Economics & Statistics Admin., Bureau of the Census (1987, 1990, 1992, 1993, 1994, 1995, 1996, 1997, 1998). Selected Average Annual Pay Tables: 1987-2001 and Appendix III: Limitations of Data. In: Statistical Abstracts of the United States. Washington, DC: Government Printing Office. US Bureau of Labor, Occupational Employment Statistics (OES; 12/13/1999). 1998 National OES Employment and Wage Estimates. World Wide Web Internet Website: http://stats.bls.gov./oes/national/oes#####.htm. Filename: C:Documents\OESLPred.doc Page: 141 Page: 142 Journal of Forensic Vocationology Vol. 7(1) Monograph The Rxy Predictive Validity Coefficients and Standard Errors of Estimate (SEE) Across each of the VQ-Wage Bands and Across Each of the Six Predictions Points in each VQ Band: The Mean, 10th, 25th, Median (50th), 75th, and 90th Percentiles Six-Point Prediction Using the Overall VQ-Hourly Wage Distribution Regression Summary for Dependent Variable: HMEAN (vqhn88.sta) R= .88104822 R²= .77624597 Adjusted R²= .77364418 F(1,86)=298.35 p<.00000 Std.Error of estimate: 4.7814 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -19.8118 2.312267 -8.56811 3.73E-13 VQ1 0.881048 0.051008 0.346319 0.02005 17.27283 1.06E-29 Regression Summary for Dependent Variable: WPCT10 (vqhn88.sta) R= .93842408 R²= .88063975 Adjusted R²= .87925184 F(1,86)=634.51 p<.00000 Std.Error of estimate: 1.4588 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -6.94415 0.705483 -9.84311 9.48E-16 VQ1 0.938424 0.037255 0.154092 0.006117 25.18944 1.84E-41 Regression Summary for Dependent Variable: WPCT25 (vqhn88.sta) R= .82128465 R²= .67450848 Adjusted R²= .67072369 F(1,86)=178.22 p<.00000 Std.Error of estimate: 5.1999 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -18.2418 2.514633 -7.25425 1.66E-10 VQ1 0.821285 0.061521 0.291087 0.021805 13.34975 1.14E-22 Regression Summary for Dependent Variable: HMEDIAN R= .78018270 R²= .60868505 Adjusted R²= .60413488 F(1,86)=133.77 p<.00000 Std.Error of estimate: 9.2486 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -30.5729 4.472578 -6.83564 1.12E-09 VQ1 0.780183 0.067455 0.448555 0.038782 11.56598 3.29E-19 Journal of Forensic Vocationology Vol. 7(1) Monograph Regression Summary for Dependent Variable: WPCT75 (vqhn88.sta) R= .79233195 R²= .62778992 Adjusted R²= .62346189 F(1,86)=145.05 p<.00000 Std.Error of estimate: 12.365 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -43.5981 5.979486 -7.29129 VQ1 0.792332 0.065788 0.624455 0.051849 12.04377 Regression Summary for Dependent Variable: WPCT90 (vqhn88.sta) R= .80045652 R²= .64073064 Adjusted R²= .63655308 F(1,86)=153.37 p<.00000 Std.Error of estimate: 15.285 St. Err. St. Err. BETA of BETA B of B t(86) p-level Intercpt -54.8014 7.391568 -7.41405 VQ1 0.800457 0.064634 0.793759 0.064093 12.38445 Six-Point Prediction Using the VQ Band1-Mean Hourly Wage Distribution Regression Summary for Dependent Variable: HMEAN (vqhn881.sta) R= .95169735 R²= .90572784 Adjusted R²= .90247708 F(1,29)=278.62 p<.00000 Std.Error of estimate: .23075 St. Err. St. Err. BETA of BETA B of B t(29) p-level Intercpt 4.139882 0.388883 10.64556 VQ1 0.951697 0.057015 0.076866 0.004605 16.69191 Regression Summary for Dependent Variable: WPCT10 R= .95789162 R²= .91755636 Adjusted R²= .91471348 F(1,29)=322.76 p<.00000 Std.Error of estimate: .10180 St. Err. St. Err. BETA of BETA B of B t(29) p-level Intercpt 3.378015 0.171565 19.68936 VQ1 0.957892 0.053319 0.036498 0.002032 17.9654 Regression Summary for Dependent Variable: WPCT25 R= .95400454 R²= .91012466 Adjusted R²= .90702551 F(1,29)=293.67 p<.00000 Std.Error of estimate: .16607 St. Err. St. Err. BETA of BETA B of B t(29) p-level Intercpt 2.992104 0.27988 10.69069 VQ1 0.954005 0.05567 0.056795 0.003314 17.13678 Page: 143 Page: 144 Journal of Forensic Vocationology Vol. 7(1) Monograph Regression Summary for Dependent Variable: HMEDIAN R= .94777740 R²= .89828201 Adjusted R²= .89477449 F(1,29)=256.10 p<.00000 Std.Error of estimate: .23800 St. Err. St. Err. BETA of BETA B of B t(29) p-level Intercpt 3.383364 0.401098 8.435253 2.7E-09 VQ1 0.947777 0.059224 0.076009 0.00475 16.00319 6.25E-16 Regression Summary for Dependent Variable: WPCT75 R= .95170406 R²= .90574061 Adjusted R²= .90249029 F(1,29)=278.66 p<.00000 Std.Error of estimate: .31888 St. Err. St. Err. BETA of BETA B of B t(29) p-level Intercpt 3.520565 0.537409 6.551003 3.56E-07 VQ1 0.951704 0.057012 0.106231 0.006364 16.69316 2.06E-16 Regression Summary for Dependent Variable: WPCT90 R= .94083033 R²= .88516172 Adjusted R²= .88120178 F(1,29)=223.53 p<.00000 Std.Error of estimate: .41214 St. Err. St. Err. BETA of BETA B of B t(29) p-level Intercpt 5.673032 0.694567 8.167726 5.25E-09 VQ1 0.94083 0.062928 0.122967 0.008225 14.95089 3.66E-15 Six-Point Prediction Using the VQ Band2-Mean Hourly Wage Distribution Regression Summary for Dependent Variable: HMEAN (vqhn882.sta) R= .97948677 R²= .95939434 Adjusted R²= .95359353 F(1,7)=165.39 p<.00000 Std.Error of estimate: .31762 St. Err. St. Err. BETA of BETA B of B t(7) p-level Intercpt -40.7861 4.265817 -9.56115 2.87E-05 VQ1 0.979487 0.076163 0.527338 0.041005 12.86039 3.99E-06 Regression Summary for Dependent Variable: WPCT10 R= .98439509 R²= .96903370 Adjusted R²= .96460995 F(1,7)=219.05 p<.00000 Std.Error of estimate: .11250 St. Err. St. Err. BETA of BETA B of B t(7) p-level Intercpt -14.3451 1.510918 -9.49426 3.01E-05 VQ1 0.984395 0.066511 0.214955 0.014524 14.80041 1.54E-06 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 145 Regression Summary for Dependent Variable: WPCT25 R= .98502886 R²= .97028185 Adjusted R²= .96603640 F(1,7)=228.55 p<.00000 Std.Error of estimate: .16594 St. Err. St. Err. BETA of BETA B of B t(7) p-level Intercpt -23.5826 2.228627 -10.5817 1.47E-05 VQ1 0.985029 0.065157 0.32386 0.021423 15.11775 1.33E-06 Regression Summary for Dependent Variable: HMEDIAN R= .98507331 R²= .97036942 Adjusted R²= .96613648 F(1,7)=229.24 p<.00000 Std.Error of estimate: .24635 St. Err. St. Err. BETA of BETA B of B t(7) p-level Intercpt -37.0326 3.308625 -11.1927 1.01E-05 VQ1 0.985073 0.065061 0.481535 0.031804 15.14075 1.32E-06 Regression Summary for Dependent Variable: WPCT75 R= .98217707 R²= .96467179 Adjusted R²= .95962490 F(1,7)=191.14 p<.00000 Std.Error of estimate: .40071 St. Err. St. Err. BETA of BETA B of B t(7) p-level Intercpt -57.3069 5.38169 -10.6485 1.41E-05 VQ1 0.982177 0.071041 0.715203 0.051731 13.82541 2.45E-06 Regression Summary for Dependent Variable: WPCT90 R= .96822823 R²= .93746590 Adjusted R²= .92853245 F(1,7)=104.94 p<.00002 Std.Error of estimate: .83974 St. Err. St. Err. BETA of BETA B of B t(7) p-level Intercpt -93.0083 11.27809 -8.24681 7.5E-05 VQ1 0.968228 0.094517 1.110547 0.10841 10.24397 1.82E-05 Six-Point Prediction Using the VQ Band3-Mean Hourly Wage Distribution Regression Summary for Dependent Variable: HMEAN (vqhn883.sta) R= .92141818 R²= .84901147 Adjusted R²= .84443606 F(1,33)=185.56 p<.00000 Std.Error of estimate: 1.1831 St. Err. St. Err. BETA of BETA B of B t(33) p-level Intercpt -13.051 2.502885 -5.2144 9.8E-06 VQ1 0.921418 0.067642 0.269725 0.019801 13.62203 4.22E-15 Page: 146 Journal of Forensic Vocationology Vol. 7(1) Monograph Regression Summary for Dependent Variable: WPCT10 R= .90194312 R²= .81350139 Adjusted R²= .80784991 F(1,33)=143.95 p<.00000 Std.Error of estimate: .92944 St. Err. St. Err. BETA of BETA B of B t(33) p-level Intercpt -11.7441 1.966303 -5.97266 1.05E-06 VQ1 0.901943 0.075176 0.186633 0.015556 11.99771 1.4E-13 Regression Summary for Dependent Variable: WPCT25 R= .90417437 R²= .81753129 Adjusted R²= .81200194 F(1,33)=147.85 p<.00000 Std.Error of estimate: 1.1143 St. Err. St. Err. BETA of BETA B of B t(33) p-level Intercpt -13.5033 2.357321 -5.72824 2.15E-06 VQ1 0.904174 0.07436 0.226763 0.018649 12.15948 9.77E-14 Regression Summary for Dependent Variable: HMEDIAN R= .90607768 R²= .82097677 Adjusted R²= .81555182 F(1,33)=151.33 p<.00000 Std.Error of estimate: 1.4182 St. Err. St. Err. BETA of BETA B of B t(33) p-level Intercpt -16.8148 3.000214 -5.60453 3.1E-06 VQ1 0.906078 0.073654 0.291984 0.023735 12.30177 7.12E-14 Regression Summary for Dependent Variable: WPCT75 R= .91349165 R²= .83446699 Adjusted R²= .82945084 F(1,33)=166.36 p<.00000 Std.Error of estimate: 1.9013 St. Err. St. Err. BETA of BETA B of B t(33) p-level Intercpt -24.6636 4.022271 -6.13177 6.55E-07 VQ1 0.913492 0.070825 0.410421 0.031821 12.89791 1.94E-14 Regression Summary for Dependent Variable: WPCT90 R= .90960397 R²= .82737938 Adjusted R²= .82214845 F(1,33)=158.17 p<.00000 Std.Error of estimate: 2.1037 St. Err. St. Err. BETA of BETA B of B t(33) p-level Intercpt -20.2114 4.450472 -4.5414 7.08E-05 VQ1 0.909604 0.072325 0.4428 0.035208 12.57659 3.89E-14 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 147 Six-Point Prediction Using the VQ Band4-Mean Hourly Wage Distribution Regression Summary for Dependent Variable: HMEAN (vqhn884.sta) R= .89600170 R²= .80281904 Adjusted R²= .78489350 F(1,11)=44.786 p<.00003 Std.Error of estimate: 4.4295 St. Err. St. Err. BETA of BETA B of B t(11) p-level Intercpt -291.354 49.26559 -5.91394 0.000101 VQ1 0.896002 0.133886 2.197303 0.328335 6.692258 3.41E-05 Regression Summary for Dependent Variable: WPCT10 R= .77373982 R²= .59867331 Adjusted R²= .56218906 F(1,11)=16.409 p<.00191 Std.Error of estimate: 1.6368 St. Err. St. Err. BETA of BETA B of B t(11) p-level Intercpt -55.9965 18.20528 -3.07584 0.010549 VQ1 0.77374 0.191008 0.491488 0.121331 4.050814 0.001913 Regression Summary for Dependent Variable: WPCT25 R= .90281619 R²= .81507707 Adjusted R²= .79826589 F(1,11)=48.484 p<.00002 Std.Error of estimate: 4.6454 St. Err. St. Err. BETA of BETA B of B t(11) p-level Intercpt -327.548 51.66698 -6.33961 5.52E-05 VQ1 0.902816 0.129658 2.397657 0.344339 6.963063 2.38E-05 Regression Summary for Dependent Variable: HMEDIAN R= .89664712 R²= .80397607 Adjusted R²= .78615571 F(1,11)=45.116 p<.00003 Std.Error of estimate: 8.6048 St. Err. St. Err. BETA of BETA B of B t(11) p-level Intercpt -594.124 95.7041 -6.20793 6.64E-05 VQ1 0.896647 0.133493 4.284179 0.637829 6.716814 3.3E-05 Regression Summary for Dependent Variable: WPCT75 R= .90093160 R²= .81167774 Adjusted R²= .79455754 F(1,11)=47.411 p<.00003 Std.Error of estimate: 11.147 St. Err. St. Err. BETA of BETA B of B t(11) p-level Intercpt -787.367 123.9838 -6.35057 5.44E-05 VQ1 0.900932 0.130844 5.689523 0.826301 6.885529 2.64E-05 Page: 148 Journal of Forensic Vocationology Vol. 7(1) Monograph Regression Summary for Dependent Variable: WPCT90 R= .90173462 R²= .81312532 Adjusted R²= .79613671 F(1,11)=47.863 p<.00003 Std.Error of estimate: 13.812 St. Err. St. Err. BETA of BETA B of B t(11) p-level Intercpt -978.531 153.6213 -6.36976 5.3E-05 VQ1 0.901735 0.13034 7.083128 1.023824 6.918307 2.53E-05 Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 149 Table 4: Quick Reference Summary of MVQS 6.0 Predictive Validity (R xy) & Known Error Rates (SEE) Table 4: Quick Reference Summary of MVQS 6.0 Predictive Validity (Rxy) & Known Error Rates (SEE) Across All VQ Bands Mean Estimates: 10th %ile Estimates: 25th %ile Estimates: Median Estimates: 75th %ile Estimates: 90th %ile Estimates: VQ Band 1 Mean Estimates: 10th %ile Estimates: 25th %ile Estimates: Median Estimates: 75th %ile Estimates: 90th %ile Estimates: VQ Band 2 Mean Estimates: 10th %ile Estimates: 25th %ile Estimates: Median Estimates: 75th %ile Estimates: 90th %ile Estimates: VQ Band 3 Mean Estimates: 10th %ile Estimates: 25th %ile Estimates: Median Estimates: 75th %ile Estimates: 90th %ile Estimates: VQ Band 4 Mean Estimates: 10th %ile Estimates: 25th %ile Estimates: Median Estimates: 75th %ile Estimates: 90th %ile Estimates: VQ Range VQ Band 68 -158 68 -158 68 -158 68 -158 68 -158 68 -158 Across All 4 VQ Bands Across All 4 VQ Bands Across All 4 VQ Bands Across All 4 VQ Bands Across All 4 VQ Bands Across All 4 VQ Bands VQ Range VQ Band 68 -100 68 -100 68 -100 68 -100 68 -100 68 -100 Below Avg - Mid-Avg VQs Below Avg - Mid-Avg VQs Below Avg - Mid-Avg VQs Below Avg - Mid-Avg VQs Below Avg - Mid-Avg VQs Below Avg - Mid-Avg VQs VQ Range VQ Band 100 - 109 100 - 109 100 - 109 100 - 109 100 - 109 100 - 109 Mid-Avg - High-Avg VQs Mid-Avg - High-Avg VQs Mid-Avg - High-Avg VQs Mid-Avg - High-Avg VQs Mid-Avg - High-Avg VQs Mid-Avg - High-Avg VQs VQ Range VQ Band 109 - 144 109 - 144 109 - 144 109 - 144 109 - 144 109 - 144 High-Avg - Very-High VQs High-Avg - Very-High VQs High-Avg - Very-High VQs High-Avg - Very-High VQs High-Avg - Very-High VQs High-Avg - Very-High VQs VQ Range VQ Band 144 - 158 144 - 158 144 - 158 144 - 158 144 - 158 144 - 158 Extremely High VQs Extremely High VQs Extremely High VQs Extremely High VQs Extremely High VQs Extremely High VQs © 2002 by Billy J. McCroskey, Ph.D. %ile Band 1st - 100th 1st - 100th 1st - 100th 1st - 100th 1st - 100th 1st - 100th %ile Band 1st - 50th 1st - 50th 1st - 50th 1st - 50th 1st - 50th 1st - 50th %ile Band 50th - 67th 50th - 67th 50th - 67th 50th - 67th 50th - 67th 50th - 67th %ile Band 67th - 99th 67th - 99th 67th - 99th 67th - 99th 67th - 99th 67th - 99th %ile Band 99th - 100th 99th - 100th 99th - 100th 99th - 100th 99th - 100th 99th - 100th % Jobs in Range Rxy SEE 100 100 100 100 100 100 0.8810 0.9384 0.8213 0.7802 0.7923 0.8005 $ 4.78 $ 1.46 $ 5.20 $ 9.25 $ 12.37 $ 15.29 % Jobs in Range Rxy 50 50 50 50 50 50 0.9517 0.9579 0.9540 0.8948 0.9517 0.9408 % Jobs in Range Rxy 17 17 17 17 17 17 0.9795 0.9844 0.9850 0.9851 0.9823 0.9682 % Jobs in Range Rxy 32 32 32 32 32 32 0.9214 0.9019 0.9042 0.9061 0.9134 0.9096 SEE $ $ $ $ $ $ 0.23 0.10 0.17 0.24 0.32 0.41 SEE $ $ $ $ $ $ 0.32 0.11 0.17 0.25 0.40 0.84 SEE $ $ $ $ $ $ 1.18 0.93 1.11 1.42 1.90 2.10 % Jobs in Range Rxy SEE 1 1 1 1 1 1 0.8960 0.7737 0.9028 0.8966 0.9009 0.9017 $ 4.43 $ 1.64 $ 4.65 $ 8.60 $ 11.15 $ 13.81 Page: 150 Journal of Forensic Vocationology Vol. 7(1) Monograph Discussion, Conclusions and Recommendations Predictive Validity of VQ-OES Hourly Wage 4 VQ-Wage Band Six-Point Hourly Wage Estimation Formulas As in the original study, all regression formulas were statistically significant at very high levels of predictive validity, with no outliers removed. The McCroskey Hahn Technique (McCroskey & Hahn, 1998) was used in the original study for removing outliers significantly improved predictive validity and lowered standard error estimates for each of the six wage estimates formulas. In this follow-up study, outliers were retained for better, more complete, hourly wage estimate predictions based on the 4 VQ-Band Mean Hourly Wage six-point curvilinear hourly wage prediction estimate formulas. Six-digit Occupational Information Network (O*NET) Occupational Unit Classification (OUC) Occupational Employment Statistics (OES) transferable skills subgroups did not represent jobs; they were groupings of 9-digit DOT-Coded job titles that have similar transferable skills. They have now been replaced by even fewer 8-digit ONET OES Standard Occupational Code (SOC) subgroups, which continue to have the similar aggregate data problem. The variability found in the wage distributions, in both the original and follow-up studies, increased as the research moved from entry-level worker 10th Percentile wage estimates to wage estimates for the Star occupational performers (worker wage estimates at higher Percentile levels). The most accurate predictions were originally found for entry-level positions (10th Percentile Wage Estimates) in both studies. Results from the follow-up study research, using 4 VQ-Wage bands (with no outliers removed), each incorporating six-point Linear Regression formulas, to mimic the VQ-Hourly Wage Curvilinear Regression Prediction Plot findings, significantly improved wage estimate predictions relative to the original study, and lowered standard error estimates of VQ-Hourly Wage predictions for entry-level workers at the 10th Percentile, as well as, increasingly higher levels of transferable skills (Mean, 25th, 50th, 75th and 90th Percentile Wage Estimates). Generalizing Wage Estimates using Job Specific VQ1, Geographic Location Specific Earning Capacity Link Relatives, and Average Inflation since 1998 (AINF) to Increase Job-Specific Predictive Validity and Decrease the Overall SEE Associated with Aggregate OES Groups For the 1998 US National O*NET-98 OES VQ-Hourly Wage Estimation formulas to produce the most reasonable estimates when generalized to specific 9-digit McDOTCoded Jobs and present value dollars, in specific state and county level geographic labor markets of interest across time, several sources of known error must be controlled. The first known and well-documented source of error is the job difficulty range within aggregate O*NET-98 OES Code Transferable Skills Groups (i.e., jobs with higher VQ indices tend to pay more than those with lower VQ indices, and tend to have more known error). This error can best be controlled by replacing OES Mean VQs with 9-digit McDOT-Coded Job Specific VQs using the new 4 VQ Band, six-point curvilinear hourly Journal of Forensic Vocationology Vol. 7(1) Monograph Page: 151 wage prediction formulas across all 12,974 jobs in McCroskey Transferable Skills Program (MVQS MTSP 6.0; McCroskey, 2003). Two other well-known and well-documented sources of error are yearly wage inflation and average wage differences between specific geographic locations of interest. These two sources of error can be controlled by using Average Wage Inflation since 1998 (AINF; McCroskey, 1998, 2000, 2002) and Geographic-Location-Specific Earning Capacity Link Relatives (ECLRs, McCroskey, 1998, 2000, 2002) specifically designed to control these types of error (McCroskey, Dennis & Dennis, 1998; McCroskey & Hahn, 1997, 1998a, 1998b, and McCroskey, Hahn, Dennis & Wattenbarger, 2002). These Link Relatives must be applied to the 24 new curvilinear regression formulas (4 VQ Bands each with 6 formulas) identified in this follow-up study, in order for wage estimates to accurately generalize to present value dollars for specific years of interest, in specific geographic locations of interest, for each of the 12,974 specific 9-digit DOT-Coded Occupations in McDOT 2003. The 4 VQ-Wage Bands with six hourly wage prediction formulas model the curvilinear wage distribution of the entire VQ-Wage Range. Each of the 6 VQ-Wage prediction distributions was highly reliable. The development of these 24 new, reliable prediction distributions produce wage estimation formulas with very reasonable known error rates. This research documents that these formulas should be incorporated in the MVQS 2003, Windows 2000TM Program Series. These programs are slated for release circa Mid-Fall, 2002, after completion of the recommended Curvilinear Model Earning Capacity Prediction programming updates in the MVQS 2003 MTSP 6.0 Program. References and Bibliography Borland International, Inc. (1995). Borland Paradox® for Windows® and Windows NT®, Version 7.0. Scotts Valley, CA: Borland International, Inc. Bureau of Labor Market Performance and Information, Division of Jobs and Benefits, Florida Department of Labor and Employment Security. (1999). Florida Program Year (PY) 1998 (07/01/98-06/30/99) Job Education Partnership (JEP) 9-Digit DOT Coded Work Order Position Openings and Wage Data by County. Tallahassee, FL. Bureau of Labor Statistics (1999). The 1998 Occupational Employment Statistics (OES) Survey. Occupational Employment Statistics: OESINFO@BLS.GOV. Daubert v. Merrell Dow Pharmaceuticals, Inc. (1993). 113 S. Ct. 2786. Dennis, K. L. & Tichauer, G. (1998). Replicating Vocational Quotient (VQ) Wage Earning Capacity Predictions in Nebraska. Journal of Forensic Vocationology, 4(1), pp. 85-92. Dennis, K. L., Feldbaum, C. L. & Hahn, S. J. (2000). Louisiana State McDOT 8.0R VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. 37-47. Dennis, K. L., Feldbaum, C. L. & Hahn, S. J. (2000). Louisiana State McDOT 2000 VQ1-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. 49-59. Dennis, M. L. & Dennis, K. L. (1998). Replicating Vocational Quotient (VQ) Earning Capacity Predictions In Wisconsin. Journal of Forensic Vocationology, 4(1), pp. 61-68. E. I. du Pont de Nemours & Co. v. Robinson, (1995). 923 S. W. 2d. At 559 (Texas). Feldbaum, C. L. & McCroskey, B. J. (1995). Expert Testimony: Evolving Vocational and Rehabilitation Economic Technologies, Federal Rules of Evidence and the Daubert Decision. Journal of Vocationology, 1(1), pp. 1-5. Hahn, S. J. & Wells-Moran, J. (1998). Washington State VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 4(1), pp. 79-84. Hahn, S. J. (1997). An Independent Replication of the McCroskey Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Forensic Vocationology, 3(1), pp. 29-33. Hahn, S. J., Larkin, S. & Dennis, K. L. (2000). Florida State McDOT 2000 VQ1-Wage Earning Capacity Predictive Validity Generalization Follow-up Study. Journal of Forensic Vocationology, 6(1), pp. 29-36. Hahn, S. J., Larkin, S. & Williams, J. M. (2000). Florida State McDOT 1998 VQ-Wage Earning Capacity Predictive Validity Generalization. Journal of Forensic Vocationology, 6(1), pp. 17-27. McCroskey, B. J. & Dennis, K. L. (1998). O*Net Issues for Rehabilitation Economists. The Earnings Analyst (TEA), Journal of the American Rehabilitation Economics Association (AREA) Vol 2, pp. 23-34. Page: 152 Journal of Forensic Vocationology Vol. 7(1) Monograph McCroskey, B. J. & Dennis, K. L. (2002). The MVQS Rehabilitation Economist. Journal of Forensic Vocationology, Vol 7(1), Fall Update, pp. 178-188. McCroskey, B. J. & Feldbaum, C. L. (1995). Statistical Basics Revisited for Vocational Evaluation and Earning Capacity Analysis under Daubert: A Need for Forensic Standards. Journal of Vocationology, 1(1), pp. 6-8. McCroskey, B. J. & Hahn, S. J. (1997). The Vocational Quotient (VQ) as a Predictor of Earning Capacity. Journal of Vocationology, 3(1), pp. 1-27. McCroskey, B. J. & Hahn, S. J. (1998). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Validity Follow-up Studies. Journal of Forensic Vocationology, 4(1) 11-52. McCroskey, B. J. & Hahn, S. J. (1998). The Vocational Quotient (VQ) as a Predictor of Earning Capacity: 1996-97 Criterion-Referenced Follow-up Validity Studies. The Earnings Analyst, Journal of the American Rehabilitation Economics Association, 1(1), pp. 39-80. McCroskey, B. J. (1984-2003). The MVQS Rehabilitation Economist. (A Diminished Earning Capacity Calculations Program). Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998). The 1998 Encyclopedia of Job Requirements (EOJR-98). [Electronic Version within the 1998 McDOT 8.0R Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0R: Mini-Manual and Quick Start Guide. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (1998). The McCroskey Dictionary of Occupational Titles Program (McDOT). Version 8.0R. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2000). The 2000 Encyclopedia of Job Requirements (EOJR-2000). [Electronic Version within the McDOT 2000 Program]. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. (2000). The McCroskey Dictionary of Occupational Titles Program (McDOT) Extended 5th Edition DOT Dataset, Version 2000. Brooklyn Park, MN: Vocationology, Inc. McCroskey, B. J. Hahn, S. J., Dennis, K. L. (2000). MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation. Journal of Forensic Vocationology, 6(1), pp. 107-134. McCroskey, B. J. Hahn, S. J., Dennis, K. L. (2002). MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation. Reprinted for continuity: Journal of Forensic Vocationology, 7(1), Fall Update, pp. 128-156. McCroskey, B. J. Hahn, S. J., Dennis, K. L. & Wattenbarger, W. E. (2002). MTSP VQ1-OES Aggregate & VQ1-McDOT Specific Wage Estimation Follow-Up Study. Journal of Forensic Vocationology, 7(1), Fall Update, pp. 157-177. McCroskey, B. J., Dennis, M. L. & Dennis, K. L. (1998). Geographic Location and the Vocational Quotient (VQ) Prediction Of Earning Capacity. Journal of Forensic Vocationology, 4(1), pp. 69-78. StatSoft, Inc. (1998). STATISTICA, Kernel Release 5.1. Tulsa, OK: StatSoft, Inc. US Department of Labor, Bureau of Employment Security. (1991a). Dictionary Of Occupational Titles (Vols. I, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Bureau of Employment Security. (1991b). Dictionary Of Occupational Titles (Vols. II, 4th ed. Rev.). Washington, DC: US Government Printing Office. US Department of Labor, Employment & Training Administration (US DOLETA). (1998). The Occupational Information Network-98 (O*NET-98, CD-ROM Vers. 1.0). Washington, DC: US Govt. Printing Office. US Dept. of Commerce, Bureau of Economic Analysis and Bureau of the Census. (1972). Standard Industrial Classification Codes. Washington, DC, US Govt. Printing Office. Revised, 1977. Revised, 1987. Additional Resources 1) Journals of Forensic Vocationology, Vol 1(1), (1995) through Vol 7(1), (2002) for numerous Scientific Research Studies by various authors on Inter-Rater Reliability, Validity, Known Error Rates and Theoretical Foundations underpinning MVQS Program inputs and outputs. 2) McCroskey & Dennis (2000). Course Disks 1 - 4 for information on the development and underpinning of VDARE MVQS Programs Theory, the ONET, the Updating the 5th ed. DOT, MVQS Vocational Analysis, Vocational Evaluation, the impact of Daubert, Kumho & Kinneman on Expert Testimony, VDARE, MVQS, Inter-Reliability, Validity, & Known Error Rates. Published by Vocationology, Inc., 1809 Halifax Court North, Brooklyn Park, MN 55443, phone: 763-569-0680.