Job Analysis Report for the Position of Customer Assistance Representative For Southern Power Company May 21, 2011 Addresses the Job Analysis requirements of Sections 14C and 15C of the federal Uniform Guidelines on Employee Selection Procedures. Includes information necessary for the development and content-related validation of Written Tests, Structured Interviews, and other selection devices Report Prepared by 193 Blue Ravine Rd., Suite 270, Folsom, CA 95630 800-999-0438 www.biddle.com Specializing in Equal Employment Opportunity, Affirmative Action, and Personnel Selection Consulting and Software since 1974 Table of Contents ♦ Introduction and Purpose of the Study The Purpose ….............................………………………………. 1 Biddle Consulting Group, Inc. …………………………………. 1 Laws, Regulations, and Professional Standards ………………... 3 Job Analysis Facilitator ……………………………………..……4 ♦ Job Analysis Process Job Analysis: Content of the Job ………………………………. 5 ♦ Participants and Locations Participating Incumbent Employees.................................………. Experience of Subject-Matter Experts ..............................……... Gender of Subject-Matter Experts ...................................………. Ethnicity of Subject-Matter Experts ................................………. Age of Subject-Matter Experts ...................................………….. Location of Job Analysis Workshops ...............................……… 7 7 7 7 8 8 ♦ The Job Analysis Work Setting. …………………………………………………… 9 Job Analysis Workshop ………………………………………… 9 Investigation of Job Duties, KSAPCs and Physical Abilities ………………………………………………………….…… 9 Relationship of Duties to Knowledge, Skills, and Abilities (KSAPCs) ……………………… …………...........................……………. 12 ♦ Other Test Related Information Potential Limitations ...................................................…………... 14 Contact Person ..........................................................……………. 14 Accuracy and Completeness .........................................………… 14 ♦ References .........................................................................………………… 15 ♦ Attachments Table of Contents ..........................................……………….. 16 Copyright © 2011 Biddle Consulting Group, Inc. ii Introduction and Purpose of the Study The Purpose of the Job Analysis The purpose of this study was to conduct a job analysis for the position of Customer Assistance Representative (CAR) of Southern Power Company [Section 14C]1 Based upon information obtained during the current study; it was found that, generally, CAR employees work in an indoor office environment around and with others frequently. [Section 14C(4)] CAR employees generally: • Assist customers as they call in and provide customer service in an expedited manner. • Respond to customer correspondence by calling or writing. • Constantly multi-tasking and/or switching between multiple tasks. Biddle Consulting Group, Inc. and Firefighter Selection, Inc. Biddle Consulting Group, Inc. (BCG) is affiliated with Biddle & Associates, Inc. (B&A). Biddle & Associates started in 1974 and was incorporated in 1977, and BCG was incorporated in 2001. BCG’s consulting division specializes in Equal Employment Opportunity (EEO), litigation support, software development, and Affirmative Action Plan (AAP) technical support and has assisted over 1,000 employers in these areas. Our OPAC® (Office Proficiency Assessment and Certification) division has several thousand clients with automated test sales. Our CritiCall® Pre-Employment Testing Software is used by hundreds of public-safety agencies from around the United States and Canada for the selection of dispatchers and calltakers. And finally, we have a sister corporation called Fire and Police Selection, Inc. (FPSI), which specializes in tests for firefighter/police selection and promotion procedures. Since 1977, B&A/BCG has assisted attorneys in litigation support as consultants or experts in over one hundred EEO cases involving statistics and/or job-relatedness analyses. We have conducted sensitive statistical EEO audit analyses for employers prior to a suit to minimize the likelihood of suit. We have developed or validated selection devices in hundreds of situations, have licensed occupational census data from the 1970, 1980, 1990, and 2000 census to hundreds of clients, have licensed our test scoring and analysis, EEO/AAP analysis, and job 1 References in brackets throughout this report refer to sections of the federal Uniform Guidelines for Employee Selection Procedures (1978) being addressed. Copyright © 2011 Biddle Consulting Group, Inc. 1 analysis software to hundreds of clients, have trained clients on AAP development in hundreds of workshops, have developed AAPs for more than a hundred clients, have developed and licensed our tests to numerous cities and counties, and we have distributed self-administered and automatically scored word-processing and other administrative tests to more than a 3,000 employers and schools. While most of our litigation support has been for defense attorneys, we have worked on the plaintiff side in more than a dozen cases and served as the class expert monitor in a complex case involving statistical effects and validation of practices, procedures, and custom developed tests used for entry-level selection, promotion, and assignments and transfers to 75 jobs. Over the past few years, several courts have supported our statistical analyses or our job analysis and jobrelatedness work products: our reading ability test for firefighters was supported as job related in United States of America v. City of Torrance, [No. 93-4142-MRP, DC CA]; our statistical analyses and job-relatedness analyses for written tests, oral interviews, and assessments of promotability were supported for three classifications in Simmons v. The City of Kansas City, Kansas, [No. 88-2603-0, DC KA]; our job-relatedness work involving a test was supported in Sanchez v. City of Santa Ana, [No. CV-79-1818-KN, DC CA]; our statistical analyses were supported in Wunderly v. S.C. Johnson & Son, Inc., [828 F. Supp 801 (DC OR)], Shelton v. SCPIE, [No. BC 088821, 098887], and Kelley v. Metropolitan Transportation Authority, [No. BC 104734]. On the plaintiff side, our statistical work was supported in Paige v. California Highway Patrol, [No. CV-94-0083 CBM(Ctx), DC CA] and Bouman v. Baca, 940 F2d 1211 (9th Cir. 1991), cert. denied 12-9-91. During the past several years, we have had professional articles published in the Personnel Journal, The Human Resources Professional, Public Personnel Journal, Public Personnel Management, California Labor & Employment Law Quarterly, and Labor Law Journal. These articles deal with statistics, disparate impact, and job-relatedness. Some of the sensitive statistical analyses we have conducted for employers have included the effects by sex, race, ethnic origin, and age groups of possible layoff actions, performance evaluations, forced distribution ratings, pay, overtime, bonuses, raises, promotions, hiring, transfers, plant closures, mergers, false arrests claims, vice arrests, cigarette smoking and asbestos exposure, PCBs, and contracts let to minority and female owned businesses. Copyright © 2011 Biddle Consulting Group, Inc. 2 A substantial part of our practice is the determination of job relatedness (i.e., validation of selection devices) such as written tests, skills tests, oral interviews, and performance appraisals. Establishing job-related cutoffs for tests and combining several test results into an overall list are other important components of our validation work. We also evaluate skill, effort, responsibility, and working conditions in exemption cases. BCG also offers a variety of AAP development options ranging from AutoAAP® affirmative-action planning software to affirmative action plan outsourcing with a team of tenured consultants that can develop an organization's entire set of affirmative action plans and more. Laws, Regulations, and Professional Standards Biddle & Associates/Biddle Consulting Group has performed job analyses and developed numerous pre-employment selection tests during the past 30 years, and is aware that these need to address federal laws and regulations including, but not limited to, the • Civil Rights Act of 1964 (CRA 1964; Title VII) • Civil Rights Act of 1991 (CRA 1991) • Americans with Disabilities Act (ADA) • Age Discrimination in Employment Act (ADEA) • Federal Uniform Guidelines for Employee Selection Procedure • OFCCP Federal Contractor Requirements and Regulations We are also aware that job analyses and selection tests should also address the professional standards, including, but not limited to, the • Principles for Validation and Use of Personnel Selection Procedures of the Society for Industrial and Organizational Psychology (2003) • American Educational Research Association /American Psychological Association’s Standards for Educational and Psychological Testing (1999) The job analysis was designed to address the relevant laws, regulations, guidelines, and professional standards. Copyright © 2011 Biddle Consulting Group, Inc. 3 Job Analysis Facilitator BCG Principal Consultant, Jim Kuthy, Ph.D., was the primary Job Analysis facilitator. His resume is included as Attachment A. Copyright © 2011 Biddle Consulting Group, Inc. 4 Job Analysis Process Job Analysis: Content of the Job [Section 14C(2) and 15C(3)] The job analysis was conducted using BCG’s proprietary GOJA® (Guidelines Oriented Job Analysis®) System. The GOJA System is a comprehensive job analysis and selection planning system that has been used by hundreds of employers since its original development in the mid 1970s. Based on the requirements of the federal Guidelines (1978), the Principles for the Validation and Use of Personnel Selection Procedures (2003), and the 1991 Americans with Disabilities Act, the GOJA System is designed to help build customized job analysis and selection components that are fair, valid, effective, and defensible. The GOJA System is more than a job analysis method. It is a methodology for developing content valid employment selection tools including job analyses, selection plans, jobspecific supplemental application forms, assessments of promotability, structured interviews, and job-related performance appraisals to address the requirements of the Guidelines and other relevant standards. Many of the technical requirements of the Guidelines are addressed just by using the GOJA System. GOJA provides the format to be used for the linking process called for by the Guidelines with content validity, and, through its design is tailored to address the technical requirements of Sections 14C(1)-(4), (6)-(9) of the Guidelines. Work products developed with the GOJA System have been challenged in court and the employer has won in each of the following cases: • Calderon v. Imperial County (a consent decree that specifically exempts the County from initiating a stringent selective certification procedure for all classifications that have been validated under the “GOJA” System). • Forsberg v. Pacific Northwest Bell Telephone [840 F2d 1409, CA-9 1988] for maintenance administrators and test desk technicians. • Gilbert v. East Bay Municipal Utility District [DC CA, 19 EPD 9061, 1979] for customer accounting service supervisor. • Martinez v. City of Salinas [DC CA, No. C-78-2608 SW (S.J.)] for firefighter. Copyright © 2011 Biddle Consulting Group, Inc. 5 • Parks v. City of Long Beach [DC CA, No. 84-1611 DWW (Px)] for fire engineer and captain. • Sanchez v. City of Santa Ana [DC CA, No. CV-79-1818 KN] for sergeant. • Simmons v. City of Kansas City [DC KS, No. 88-2603-0] for detective, sergeant, and lieutenant. • United States v. City of Torrance [DC CA, No. 93-4142-MRP (RMCx)] for firefighter. GOJA has been discussed in several articles and textbooks used in universities throughout the United States: • Buford, J. A. (1991) Personnel Management and Human Resources in Local Government. Center for Governmental Services, Auburn University. • Gatewood, R. S. & Field, H. S. (1986). Human Resource Selection. Drydan Press. • Buford, J. A. (1985). Recruiting and Selection: Concepts and Techniques for Local Government. Alabama Cooperative Extension Service, Auburn University. • Schuler, R. S. Personnel and Human Resource Management. West Publishing Company. • Bemis, S. E., Belenky, A. H., & Soder, D. A. Job Analysis: An Effective Management Tool. Bureau of National Affairs: Washington D.C. • Campbell, T. (July, 1982). Entry-Level Exam Examined in Court. The Western Fire Journal. • Sturn, R. D. (September, 1979). Mass Validation: The Key to Effectively Analyzing an Employer's Job Classifications. Public Personnel Management. Copyright © 2011 Biddle Consulting Group, Inc. 6 Job Analysis Participants and Location Participating Incumbent Employees [Section 14C(4)] Data and information from 18 incumbent CAR employees who have performed the functions of a CAR employee are included in these analyses. The following will demonstrate that the Subject-Matter Experts (SMEs) who participated in this study are diverse in age and ethnicity. How many Job Experts are necessary to include in the job analysis process to produce reliable results? Some courts have relied on as few as seven to ten Job Experts for providing judgments and ratings about job and selection procedure characteristics (e.g., Contreras v. City of Los Angeles, 656 F.2d 1267. 9th Cir. 1981; US v. South Carolina, 434 US 1026, 1978). The number of Job Experts that initially participated in the current study exceeds the seven to ten experts allowed under those decisions. Experience of Subject-Matter Experts 1-4 years 5-9 years 10-19 years 20 or more years 5 8 5 0 Gender of Subject-Matter Experts The vast majority of those who hold CAR positions are women. The number of each gender of the SMEs that participated in the current study was: Male Female 6 12 It is noted that the CAR position is staffed by more than twice as many women as men. Ethnicity of Subject-Matter Experts The number of each ethnic background of the SMEs that participated in the current study was: Copyright © 2011 Biddle Consulting Group, Inc. 7 White Black/African American Hispanic/Latino Asian / Pacific Islander Native American / Alaska Native 7 4 7 0 0 Age of Subject-Matter Experts The ages of the SMEs that participated in the current study was: Less than 20 years of age 20 – 29 years of age 30 – 39 years of age 40 – 49 years of age 50 or more years of age 0 3 5 9 1 Location of Job Analysis Workshop/Data-Collection Site [Section 15C(1)] The Job Analysis workshop was held at Southern Power Company Office, 1234 Pine Mountain Road, Los Angeles, CA. Copyright © 2011 Biddle Consulting Group, Inc. 8 The Job Analysis Process Work Setting [Section 14C(4) and Section 15C(3)] During the Job Analysis workshop the SMEs discussed and arrived at a consensus to describe a typical CAR’s work situation, including the setting in which work behaviors are performed. ♦ The work situation, including the setting in which work behaviors are performed, can be found in Attachment B. Job Analysis Workshop During the job analysis workshop, the SMEs individually documented the duties performed by incumbents on the job. They also individually documented the KSAPCs needed to perform the CAR position at Public Utility. After writing down this information, the SMEs collectively reviewed the duties and the KSAPCs, and the following modifications were made based on a consensus: 1. The descriptions of the duties and the KSAPCs were modified to most accurately represent the duties and KSAPCs used by incumbents at all locations. 2. The wording of several duties/KSAPCs was modified to make the duties/KSAPCs more understandable (e.g., removed vernacular that might be unfamiliar to others). 3. Skills and abilities were operationally defined in terms of observable aspects of work behavior of the job. Investigation of Job Duties, KSAPCs and Physical Abilities The resulting lists of duties (including work behaviors, associated tasks, and if the behavior results in a work product, a description of the work products), knowledge, skills, abilities, and personal characteristics from the workshop were formed into a Job Analysis Survey (JAS). All 18 of the SMEs were asked to individually rate the duties, KSAPCs (including physical abilities) that they identified during the job analysis. For each duty, SMEs rated: Copyright © 2011 Biddle Consulting Group, Inc. 9 • The FREQUENCY with which the duty was performed (listed as daily to weekly, monthly to quarterly, quarterly to yearly, less than yearly, and not performed). SMEs identified one of the above selections. • The IMPORTANCE level of the duty. A scale of 1 - 5 (1 = not required / 5 = extremely critical) was used. [Section 14C(4) & 15C(3)] In addition to rating the two criteria listed above, five senior-level SMEs also rated those portions of the survey that are typically reserved for supervisors2: • Whether the above-minimum performance of this duty denotes the BEST WORKER or is PERFORMANCE DIFFERENTIATING of employees’ job performance. A scale of 1 – 5 (1 = no difference / 5 – a very significant difference) was used. [Section 14C(9)] • Whether the duty is FUNDAMENTAL. A dichotomous scale (N = NO - this duty should not be considered “fundamental” / Y = YES – this duty should be considered “fundamental”) was used. [Americans with Disabilities Act, 1990] • If the duty could be readily ASSIGNABLE to other employees in order to accommodate persons with disabilities who cannot perform them. A dichotomous scale (N = NO – it is NOT reasonable to assign this duty to another employee / Y = YES – it is reasonable to assign this duty to another employee) was used. [Americans with Disabilities Act, 1990] For those duties that are not observable, those aspects of the behaviors (i.e., KSAPCs required to perform the job duty) that can be observed and the observed work products were identified and analyzed. [Section 14C(2)] All 18 of the SMEs also rated: • The FREQUENCY with which the KSAPC was applied (listed as daily to weekly, monthly to quarterly, quarterly to yearly, less than yearly, and not performed). SMEs identified one of the above selections. 2 There were no supervisors “per se” that participated in the workshop. For that reason, the rating tasks that are normally assigned to supervisory personnel during the GOJA process were made by very experienced, senior-level job incumbents. Copyright © 2011 Biddle Consulting Group, Inc. 10 • The IMPORTANCE level of the KSAPC. A scale of 1 - 5 (1 = not required / 5 = extremely critical) was used. [Section 14C(4)] In addition to rating the three criteria listed above, five senior-level CAR job incumbents also rated: • If possessing above-minimum levels of the KSAPC denotes the BEST WORKER or is PERFORMANCE DIFFERENTIATING of employees’ job performance. A scale of 1 – 5 (1 = no difference / 5 – a very significant difference) was used. [Section 14C(9)] • Whether the KSAPC is a HELPFUL OR MINIMUM QUALIFICATION. Minimum Qualifications are those KSAPCs that an applicant or candidate must have prior to entry to the position. A dichotomous scale (HQ / MQ) was used. • What level of the KSAPC is needed upon entry to the job. (LEVEL NEEDED UPON ENTRY). A scale of 1 – 4 (1 = none or very little / 4 = all or almost all) was used. [Section 14C(1) and 14C(6)] • Also, the LEVEL NEEDED FOR SUCCESS (this rating was given for knowledge items only) was identified. A scale of 1 (Low) to 4 (Mastery) was used. All 18 of the SMEs rated each Physical Ability for: • The FREQUENCY with which the Physical Ability is performed (listed as daily to weekly, monthly to quarterly, quarterly to yearly, less than yearly, and not performed). SMEs identified one of the above selections. • The IMPORTANCE level of the Physical Ability. A scale of 1 - 5 (1 = not required / 5 = extremely critical) was used. [Section 14C(4)] In addition to rating the three criteria listed above, five senior-level CAR job incumbents also rated: • Whether the Physical Ability is a HELPFUL OR MINIMUM QUALIFICATION. Minimum Qualifications are those Physical Abilities that an applicant or candidate must perform to gain entry to the position. A dichotomous scale (HQ / MQ) was used. Copyright © 2011 Biddle Consulting Group, Inc. 11 • If possessing above-minimum levels of this Physical Ability denotes the BEST WORKER or is PERFORMANCE DIFFERENTIATING of employees’ job performance. A scale of 1 – 5 (1 = no difference / 5 – a very significant difference) was used. [Section 14C(9)] • Possessing this Physical Ability is needed upon entry to the job. (LEVEL NEEDED UPON ENTRY). A scale of 1 – 4 (1 = none or very little / 4 = all or almost all) was used. [Section 14C(1) and 14C(6)] Relationship of Duties to KSAPCs [Section 15C(3)] The federal Guidelines require in Section 14C(4) that “for any selection procedure measuring a knowledge, skill, or ability the user should show that… (b) [the] knowledge, skill, or ability is used in and is a necessary prerequisite to performance of critical or important work behavior(s).” One way this can be accomplished is by showing that the KSAPCs are related to the duties performed on the job. During the end of the first day of the workshop, SMEs linked each of the KSAPCs to one or more job duties. Two or more SMEs had to agree on a proposed linkage for that linkage to be identified as being appropriate for selection purposes. In addition, KSAPCs deemed appropriate for assessment must have received an average importance rating of important or higher (i.e., a rating of 3, 4, or 5) and also must have received an average level needed upon entry rating that indicated that most or all of a KSAPC/Physical Ability would be needed at the time of entry to the job (i.e., a rating of 3 or 4). ♦ The KSAPC to duty linkage results can be found in Attachment C. The following attachments are documents that were used in, or are derivative products of, the Customer Account Representative Job Analysis process: ♦ A full explanation of the rating scales used during the Job Analysis process can be found in the Instructions in Attachment D. Copyright © 2011 Biddle Consulting Group, Inc. 12 ♦ The averages/summaries of the SMEs’ duty ratings can be found in Attachment E. The numbers shown in this attachment were calculated after the ratings of any SMEs who provided an extreme rating for a particular duty were eliminated (outliers).3 ♦ The averages/summaries of the SMEs’ ratings of the KSAPCs can be found in Attachment F. Once again, the numbers shown in this attachment were calculated after the ratings of any SMEs who provided an extreme rating for a particular KSAPC were eliminated (outliers). KSAPCs that did not achieve an importance rating of important higher, or which did not receive a level needed upon entry rating that most or all of a KSAPC would be needed at the time of entry to the job, are shaded grey in Attachment I to identify that they did not meet the court-supported criteria used by Biddle Consulting Group, Inc. for inclusion in a pre-employment selection process. ♦ The averages/summaries of the SME ratings of the Physical Abilities can be found in Attachment G. Once again, the numbers shown in this attachment were calculated after the ratings of any SMEs who provided an extreme rating for a particular Physical Ability were eliminated (outliers). 3 An outlier was defined as a rating greater than or less than 1.645 standard deviations above/below the mean. Copyright © 2011 Biddle Consulting Group, Inc. 13 Other Related Information Potential Limitations The Job Analysis, to the best of its ability, identified the job duties and KSAPCs that are common for the majority of CAR positions across multiple locations. However, even with the great care taken to achieve this goal, it is possible that some of the KSAPCs identified during this study are not required of all CAR employees in every location. It is therefore recommended that the results of this Job Analysis be applied with discretion. A periodic review of this position is also encouraged to identify whether the duties performed by CAR employees or the KSAPCs required to perform those tasks change over time. Contact Person [Section 15C(8)] To receive further information about this validity study, contact: Biddle Consulting Group, Inc. Attention: James E. Kuthy, Ph.D. 193 Blue Ravine Road, Suite 270 Folsom, CA. 95630 Voice (916) 294-4250· Fax (916) 294-4255 Accuracy and Completeness [Section 15C(9)] Trained BCG human resource consultants conducted the job analysis workshop and collected the data. The data collected was entered by administrative staff employees and then independently checked for accuracy by BCG employees. Analyses were also independently double-checked and verified. Finally, a Principal Consultant reviewed the final Content Validity Report. We invite any comments you might have about this report. Copyright © 2011 Biddle Consulting Group, Inc. 14 References American Educational Research Association, the American Psychological Association, & the National Council on Measurement in Education. (1999). Standards for educational and psychological testing. American Educational Research Association: Washington, DC. Society for Industrial and Organization Psychology (SIOP) (2003). Principles for the validation and use of personnel selection procedures. (Fourth edition) College Park, MD: Author. Uniform Guidelines on Employee Selection Procedures. (1978). Federal Register, 43, 3829038315. Copyright © 2011 Biddle Consulting Group, Inc. 15 ATTACHMENTS TABLE OF CONTENTS Job Analysis Facilitator’s Resume……………………………………… Attachment A Work Situation……………………………………………………………Attachment B Knowledge, Skill, & Ability Ratings to Duty Linkages………………...Attachment C Explanation of GOJA Job Analysis Rating Scales……………………...Attachment D Average Job Duty Ratings……………………………………………….Attachment E Average Knowledge, Skill, & Ability Ratings…………………………..Attachment F Average Physical Ability Ratings………………………………………..Attachment G Copyright © 2011 Biddle Consulting Group, Inc. 16 ATTACHMENT A Job Analysis Facilitator’s Resume Copyright © 2011 Biddle Consulting Group, Inc. 17 Biddle Consulting Group, Inc. 193 Blue Ravine Road, Suite 270, Folsom, CA 95630 (916) 294-4250 Fax: (916) 294-4255 __________________________________________________________________________________________________________________ James E. Kuthy, Ph.D. Senior Consultant and Director of Product Development Experienced consultant in Equal Employment Opportunity (EEO) field, specializing in the areas of: ♦ Selection/Promotion Plan Development ♦ Test Development and Validation (including overseeing computerized test development) ♦ Question Item Writing and Item Analysis ♦ Job Analysis ♦ Public Safety Practices and Procedures ♦ Litigation Support ♦ Performance Evaluation ♦ Industrial and Organizational Development and Research Selection Plan Development Experience with multiple aspects of selection plan development, including the professional and legal aspects of designing, implementing, and reviewing selection plan components. Conceived of, designed the test development process for, conducted the job analysis of, and validated the nation’s first computerized professional selection testing battery for public safety dispatchers and calltakers (9-1-1 Operators). Promotion Plan Development Experience with multiple aspects of promotion plan development, including the professional and legal aspects of designing, implementing, and reviewing promotion plan components, including plans for law enforcement agencies and a large labor union. Test Development/Validation Experience in developing tests and conducting job analyses, with an emphasis in the public safety area, including written and physical ability testing. Written Tests Wrote, reviewed, and/or revised thousands of test items for multiple-choice ability tests. Wrote, reviewed, and revised materials and test items for numerous in-basket exercises. Areas of written test development include police, fire, and industrial classifications. Performed readability studies on job materials and test items, item response analyses, and other statistical and research evaluations of written tests. Tests developed for use by some of the largest United States’ cities Copyright © 2011 Biddle Consulting Group, Inc. 18 including a major metropolitan public-transit police agency with jurisdiction in two states and one district. Physical Ability Tests Assisted in the development of physical ability testing used for screening candidates for entrylevel public safety positions and municipal electrical workers. This work includes developing cutoff times, administration methodology, and modifications. Lead Administrator of peace officer physical ability testing for a major mid-western city. Other Selection Devices or Test Development Assistance Development of various entry-level selection tests, revision of structured oral interviews, and rated hundreds of oral briefing exercises. Conceived of and authored an automated professional testing battery for public safety dispatchers. Trained a county police department in job analysis and multiple-choice item writing to develop their own content-related job knowledge tests for four different positions. Instructed test item writing at a three-day training session sponsored by an international nonprofit public safety organization. Created an item-writing guide for an international nonprofit public safety organization that is now an official publication distributed by that organization. Validation/Reliability Application of content and criterion oriented approaches for validating numerous tests including knowledge tests, physical ability tests, personality assessment, in-basket and oral briefing measures. Authored the reliability and validation report for a computerized public-safety dispatcher selection test. Conduct reliability studies (test/retest, internal consistency) of selection tests, including work sample and personality tests. Job Analysis Conducted job analyses for a diverse variety of classifications including public-safety and public transportation positions, customer service representatives, and Longshore Foremen. Conducted job analysis workshops, including the collection of data from over forty-five different organizations during a single project in order to create a unified content-validation report. Responsible for working with subject matter experts and management in identifying duties, importance ratings, duty statements, degrees of importance, consequence of errors, knowledge, skills, abilities, physical and other characteristics, and link-up studies between job analyses and tests. Conducted individual and group critical incident interviews to determine job tasks and the knowledge, skills, abilities, and other characteristics needed to perform those tasks. Conducted on-site job observations of job-related activities. Copyright © 2011 Biddle Consulting Group, Inc. 19 Litigation Support Statistical and methodological research in response to federal court cases involving entry-level and promotional examinations and transfer practices. Was the lead entry-level selection monitor for a large law enforcement agency under a federal court mandate. Educational Background Ph.D. Industrial and Organizational Psychology: The University of Akron, OH M.A. Industrial and Organizational Psychology: The University of Akron, OH B.A. Robert F. Kennedy Program for Public Security and Administration: King’s College, PA. Membership American Psychological Association (APA) Society of Industrial and Organizational Psychology (SIOP) Recent Work History Biddle Consulting Group, Inc. Biddle & Associates, Inc. Senior Consultant/Director of Test Development 1999-present Organizational consulting, selection planning, test development, job analysis, item writing, human-resource related training, and test/item reviewer. Lead entry-level selection monitor for a large county sheriff’s office under a federal Court’s mandate. Performed statistical and database manipulation and/or analyses of data and information. Instructed selection and validation seminars. Conceived of, designed, and validated the nation’s first and only computerized 9-1-1 communications operator test. Act as the national spokesperson for Biddle Consulting Group in the public safety communications area. Create, and direct the programming and implementation of, new and updated tests for both OPAC® (Office Skills Proficiency and Certification) software and CritiCall® Personnel Selection software. Manage the company’s customer service division. Independent Consultant International Association of Chiefs of Police, Inc., Alexandria, VA (Exclusive Client) 1997-1999 Law Enforcement promotion test development. Contributing author of certification test items for the organization’s certification/training modules. Instructed test item-writing at the 1999 IACP Conference on Assessment Centers and Selection Issues. Assisted in a unique pilot project where I instructed police supervisors on how to develop their own content-valid written tests. Barrett and Associates, Inc., Akron, OH Associate 1993-1996 Test planning, development, job analysis, rating, and item-writing for a wide variety of classifications with an emphasis on public safety. Lead administrator for public safety testing. Copyright © 2011 Biddle Consulting Group, Inc. 20 Primary developer for all phases of test development, including job analysis and item writing, for several job classifications of a regional rapid transit agency. Rated hundreds of oral-briefing exercises for a major police department’s sergeant and lieutenant promotion testing. The University of Akron, Akron, OH University Faculty and Graduate Teaching Assistant 1994-1998 Instructed “Human Behavior at Work” as a part-time faculty member. Instructed “Introduction to Psychology” classes and directed the laboratory portion of “Experimental Psychology” classes as a graduate teaching assistant. Caesar’s Tahoe, Lake Tahoe, NV Lead Stage Technician/Stage Technician 1984-1993 Acted as a Reserve Deputy Constable (Peace Officer) for the Lake Tahoe, Nevada, Justice Court concurrent with this position. Douglas County Sheriff’s Office, Minden and Lake Tahoe, NV Criminal Investigator/Detective, Crime Lab Supervision, Crime Scene Analyst, Traffic Accident Investigation, Certified Latent Fingerprint Examiner, Traffic Enforcement Specialist, Patrol Officer. Concurrently coordinated the county’s search and rescue functions for two years. 19781984 El Dorado County Sheriff’s Office, South Lake Tahoe, CA Reserve and full-time seasonal Deputy Sheriff assigned to the patrol division. Full-time Summer 1977, Part-time Reserve 1976-1978 Recent Publications and Presentations Kuthy, J. E. (1998). Senior Police Officer and Senior Detective test development and training. Two-day session presented for the International Association of Chiefs of Police to the Chesterfield County, VA Police Department. Kuthy, J. E. (1999). Item writing for job knowledge testing. Presented at the International Association of Chiefs of Police Annual Assessment Center and Selection Issues conference, San Diego, CA. Kuthy, J. E. (2000, May/June). Establishing Dispatcher Selection Testing. 9-1-1 Magazine, pages 19 - 20. Kuthy, J. E. (2000, October). Selecting the Best Applicant for Today’s Computerized Communications Workplace. Presented at the APCO Canada (Association of Public-Safety Communication Officials, Inc.) conference, Ottawa, Canada. Kuthy, J. E. (2000, March). Computerized Testing for Pre-Employment Dispatcher/CallTaker Selection. Presented at the APCO (Association of Public-Safety Communication Officials, Inc.) Western Regional conference, Portland, OR. Copyright © 2011 Biddle Consulting Group, Inc. 21 Kuthy, J. E. (2000, April). Selecting the Best Applicant Using Pre-Employment Testing. Presented at the APCO (Association of Public-Safety Communication Officials, Inc.) North Central Regional conference, Columbus, OH. Kuthy, J. E. (2000). National Dispatcher/Call-taker Job Analysis and CritiCall Content Validity Study. Sacramento, CA: Biddle Consulting Group. Kuthy, J. E. (2001). Reducing Employee Turnover. Presented at the Montana State APCO Conference. Kuthy, J. E. (2001). Update to the CritiCall Job Analysis Report: Test-Retest Reliability Study. Sacramento, CA: Biddle Consulting Group. Kuthy, J. E. (2001). Reduce Employee Turnover. Presented at the NENA National Conference, Orlando, FL. Kuthy, J. E. (2001). Computerized selection testing. Presented at the Southern California Personnel Management Association, San Diego, CA. Kuthy, J. E. (2002). Selecting the Best Employee for the Computerized Communications Workplace. Presented at the Western Regional APCO-NENA Conference, Phoenix, AZ. Kuthy, J. E. (2002; April). Should we be pre-employment testing for computer-related skills? A report on the national dispatcher/call-taker job analysis study. Presented at the Navigator Conference (National Academy of Emergency Dispatch), St. Petersburg, FL. Kuthy, J. E. (2002; April). Written Test Item Analysis Study for a California County Sheriff’s Office. Sacramento, CA: Biddle Consulting Group. [Proprietary document, not for publication] Kuthy, J. E. (2002; June). Update to the CritiCall Content Validity and Reliability Report. Sacramento, CA: Biddle Consulting Group. Kuthy, J. E. (2002). Conducting interviews that work. Presented at the Annual Conference of the National Number Association, Indianapolis, IN. Makiney, J., Fulp, J., & Kuthy, J. (2002; June/July). Using computerized testing to streamline hiring and certification processes. Presented at the International Personnel Management Assessment Council’s Annual Conference, New Orleans, LA. Kuthy, J. E. (2002; August). Advances in Calltaker and Dispatcher Screening. Presented at the APCO National Conference, Nashville, TN. Kuthy, J. E. (2002; October). Personnel Selection Management using CritiCall. Presented at the Atlantic Chapter APCO Conference, Manchester, NH. Copyright © 2011 Biddle Consulting Group, Inc. 22 Kuthy, J. E., (2003; February). Bilingual (English/Spanish) telecommunicator certification job analysis and test development. Presented at the Western Regional APCO Conference, Las Vegas, NV. Kuthy, J. E., & Mateo, D. (April; 2003). What have we here? Assessing dispatcher competency, skills, and language abilities. Presented at the Navigator (National Academy of Emergency Dispatching) Conference, Anaheim, CA. Kuthy, J. E. (2003; May). Test your job applicants using a telephone. Public Safety Communications, pages 44-46. Kuthy, J. E. (2003; May). Bilingual (English/Spanish) telecommunicator certification job analysis and test development. Presented at the East Coast Regional Association of Public-Safety Communications Officials (APCO) conference, Cape Cod, MA. Kuthy, J. E. (2003; June). Bilingual (English/Spanish) telecommunicator testing and certification. 9-1-1 Magazine, pages 28-29. Kuthy, J. E. (2003, June). Bilingual 9-1-1 operator certification. Presented at the International Personnel Management Association’s Assessment Council Annual Conference, Baltimore, MD. Biddle, D. A., Kuthy, J. E., & Nooren, P. (2003). Protecting your agency against EEO litigation related to selection and promotion practices. Law Enforcement Executive Forum, 5(3), pages 5 - 14. Kuthy, J. E. (2004). Multitasking: The reason why computer skill testing of telecommunicator job applicants is necessary. National Journal of Emergency Dispatch, 6(1). Kuthy, J. E. (2004, March). It’s not fair! How employees’ perceptions of unfairness fuel the staffing crisis. Presented at the Western Regional Association of Public-Safety Communications Officials (APCO) conference, Spokane, WA. Kuthy, J. E. (2004, June). It’s not fair! How employees’ perceptions of unfairness fuel the staffing crisis. Presented at the NENA National Annual Conference, Tampa, FL. Kuthy, J. E. (2005, April). Selecting employees who can efficiently do two or more things at once. Presented at the North-Central APCO Annual Conference, Kansas City, MO. Kuthy, J. E. (2005, June). Invited speaker. Presented an all-day session on human resource-related issues at the Royal Canadian Mounted Police National Divisional Representative Conference, Ottawa, ON. Kuthy, J. E. (2005, August). Increasing the effectiveness of your training and assessment. Presented at the APCO International Conference, Denver, CO. Copyright © 2011 Biddle Consulting Group, Inc. 23 Kuthy, J. E. (2005, October). Selecting employees who can do two (or more) things at once: It’s harder than it looks. Presented at the APCO Canada Conference, Vancouver, BC. Kuthy, J. E. (2006, March). Hiring great employees who can also multitask: It’s harder than it looks. Presented at the Western Regional APCO Conference, Portland, OR. Kuthy, J. E. (2006, March). Developing and conducting effective, fair, and valid employment interviews. Presented at the Personnel Testing Council of Northern California’s 20th Annual Conference, Berkeley, CA. Kuthy, J. E. (2006, in press). Introduction. In D. Biddle (Ed.), A practitioner’s guide to valid and defensible employment testing. Burlington, VT: Gower Publishing Company. Meloun, J. M., & Kuthy, J. E. (submitted for publication). Helping trainees to succeed by having them “think aloud.” Selected Technical Reports and Case Consultation International Longshore Workers Union, Local 94/Pacific Maritime Association Foreman/Walking Boss Position • Conducted job analysis. • Authored job analysis report. • Supervised development and implementation of a selection plan for this position. • Written job knowledge test and structured interview developed and validated. • Supervised implementation and rating of over 200 panel interviews Seattle City Lights • As part of a team, created a selection plan for three industrial-job classifications. • Conducted and interpreted reliability and validity statistical analyses. • Created electrical and mechanical written test items. • Developed physical ability and work-skills tests. • Developed selection interview guide and behavioral characteristic measures. Burns v. County of San Mateo, U.S. District Court o Submitted declaration as expert concerning public-safety calltaker task training and employee discipline/discharge procedures Humetrics, Inc. • Statistical evaluation of personality characteristic measures for customer service position. • Conducted and interpreted criterion-related validity analyses. • Conducted and interpreted test reliability analyses. • Authored confirmatory/cross-validation criterion-related validity study. Copyright © 2011 Biddle Consulting Group, Inc. 24 Ultramar Diamond Shamrock • Conducted job analysis of customer service position for this national company. • Authored job analysis report. • Conducted a concurrent criterion validity study of non-cognitive pre-employment selection test. CritiCall Personnel Selection Software • Conducted nationwide job analysis study of public-safety telecommunication positions (including more than 45 public-safety agencies). • Authored and developed test content, including 22 different test modules. • Conducted content-related validity study of the CritiCall selection test. • Conducted follow-up validation studies of test. • Authored validation report and its four updates. • Collected and statistically analyzed test score data from over 5,000 test takers and recommended cutoff score data from over 300 job experts. • Determined appropriate time limits for testing for five of the CritiCall test modules. Major mid-western Regional Rapid Transit Authority (agency name withheld at request of client) • As part of a team, developed job analyses and selection plans for motor-coach diesel mechanic and electrician positions. • The sole author of written test items for job knowledge testing for both positions. • Made recommendations for additional types of testing. Bouman v. Pritchess, Ninth Circuit Court of Appeals • Provided services pertaining to validation, statistics, and EEO/AA laws and regulations including preparation of exhibits and declarations to the court. • Statistical analyses of adverse impact for entry level and promotional selection. • Qualitative analyses of potential “alternate employment practices” which may have lower adverse impact. • Review of test validation procedures for numerous positions within the organization. Public Utility, Las Vegas, NV o Conducted job analysis study of a Customer Assistance Representative position. o Developed a list of tasks performed, and the knowledge, skills, abilities, and personal characteristics needed to perform those tasks. o Created a report of job analysis findings. Paige v. California Highway Patrol, Federal District Court • Validity/fairness review of entry level written tests. • Disparate impact theory application and analysis. • Drafted documents submitted to the court. Copyright © 2011 Biddle Consulting Group, Inc. 25 Stallworth/Kemp v. County of Alameda Sheriff’s Department • Conducted a content-validation study of a written promotional examination. • Authored validation report and made recommendations to client. Copyright © 2011 Biddle Consulting Group, Inc. 26 ATTACHMENT B Work Situation Copyright © 2011 Biddle Consulting Group, Inc. 27 WORK SITUATION The work situation for the Customer Assistance Representative position, including the setting in which work behaviors are performed, was examined during the workshop. The following is a synopsis of the findings from that examination. • Employees are typically assigned to work five days a week. • Employees are typically assigned to work only Monday through Friday. • The typical work shift is eight-hours per day. • Employees are sometimes asked to work extended work hours. • Employees work indoors in an office-style environment. • Employees typically do not work irregular hours or days outside of their normally assigned shifts. • Employees are not typically “on-call.” • Employees typically do not work at more than one site or location. • Employees do not typically travel on the job. However, some travel may be required for job-related functions, such as participating in the Job Analysis workshop. • All employees must comply with a “business casual” company grooming/attire standard. • Employees work under consistent, but moderate, time pressure. • Employees must be able to focus for long periods of time on many different tasks at once, with frequent interruptions. Copyright © 2011 Biddle Consulting Group, Inc. 28 ATTACHMENT C Knowledge, Skill and Ability to Job Duty Linkages Notes Those KSAPCs that are shaded in the following table did not meet the court-supported criteria used by Biddle Consulting Group, Inc. for inclusion in a pre-employment selection process. Job Duty numbers can be found in Attachment E. Copyright © 2011 Biddle Consulting Group, Inc. 29 LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) KSAPCs 1 The ability to read and comprehend information and ideas written in English. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11,12, 13, 14, 15, 16, 17, 18, 19, 20, 21 2 The ability to take notes and compose effective written communication in English using a keyboard and/or by hand. 1, 2, 3, 4, 5, 6, 7, 8, 10, 12, 13, 14, 16, 17, 18, 19, 21 3 The ability to perform basic math such as addition, subtraction, multiplication, and division using a calculator. 1, 2, 3, 5, 6, 8, 9, 10, 14, 16, 19, 20, 21 4 The skill to choose the right mathematical methods or formulas to solve a problem. 1, 2, 3, 6, 8, 13, 14, 16, 18, 19, 20, 21 5 The ability to work closely with others and to be an effective member of a team in order to achieve goals; including an ability and willingness to help others, as needed. 1, 2, 3, 4, 5, 12, 13, 14, 15, 17, 18, 19, 21 6 The ability to speak clearly and effectively when communicating with others so that others will understand, both in person and by telephone. Effectively communicate at the appropriate level (e.g., elderly, confused, intoxicated, lacking education) 1, 2, 3, 4, 5, 6, 7, 8, 9, 11,12, 13, 14, 15, 16, 17, 18, 19, 21 7 The ability to listen and understand the spoken word by being attentive and properly interpreting and/or responding to verbal communication, understanding the points being made, asking questions as appropriate, and not interrupting at inappropriate times. Stay focused and not be distracted. Ability to maintain control of the call. 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 14, 15, 16, 17, 18, 19, 21 Copyright © 2011 Biddle Consulting Group, Inc. 30 KSAPCs LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) 8 The ability to quickly and accurately solve problems and/or make decisions. Includes, but is not limited to, the ability to apply general rules to specific problems to produce answers that make sense. 1, 2, 3, 4, 5, 6, 7, 8, 12, 14, 16, 17, 18, 19, 21 9 The ability to tell when something is wrong or is likely to go wrong, knowing what the appropriate next step is, and following through to resolution. 1, 2, 3, 4, 5, 6, 7, 8, 12, 14, 16, 17, 18, 19, 21 10 The ability to use logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions or approaches to problems. 1, 2, 3, 4, 5, 6, 7, 8, 9, 12, 13, 14, 15, 16, 17, 18, 19, 21 11 The ability to learn and retain information to be used at a later time. Includes both long-term learning and the ability to recall bits of information, such as telephone numbers, names, addresses from memory for short periods of time. 1, 2, 3, 5, 6, 7, 8, 9, 10, 11, 12, 13, 16, 17, 18, 19, 21 12 The ability and willingness to learn and use new techniques or procedures in a timely fashion. Includes, but is not limited to, the ability to adapt to change without incurring overwhelming stress. 1, 2, 3, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 13 The ability to convey the value of options or programs. May require the ability to convince others to take or not take action. 1, 2, 3, 6, 8, 9, 12, 13, 14, 16, 17, 18, 21 14 The ability to identify and prioritize things or actions in a certain order or pattern according to a specific rule, set of rules (e.g., patterns of numbers, letters, words, pictures, mathematical operations), or routine (moving from one computer screen to another). 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 16, 17, 18, 19, 20, 21 Copyright © 2011 Biddle Consulting Group, Inc. 31 LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) KSAPCs 15 The ability to file and/or retrieve information stored using alphabetical and/or numerical filing systems. 1, 2, 3, 10 16 The ability to combine pieces of information to form conclusions (includes finding a relationship among seemingly unrelated events). Follow up or pursue additional information when information provided is not sufficient or does not make sense. 1, 2, 3, 5, 6, 7, 8, 9, 10, 12, 13, 16, 17, 18 ,19 ,21 17 The ability to handle stressful situations while maintaining a high level of performance and professionalism (such as maintaining appropriate use of words). Includes, but is not limited to, the ability to appropriately use emotions; being stable and level-headed under stressful situations (not overreacting), help others regain their composure or defuse situation. 1, 2, 3, 5, 6, 7, 8, 9, 11, 12, 14, 16, 17, 18, 19 , 21 18 The ability to make fast, simple, repeated movements of the fingers, hands, and wrists. 2, 3, 4, 6, 7, 10, 19 19 The ability to use a mouse and keyboard associated with a personal computer without having to concentrate or focus on those behaviors. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13, 17, 18, 19, 20, 21 20 The ability to simultaneously perform two or more job-related tasks (e.g., speak with client on telephone while entering information using a keyboard; work reports while speaking on the phone). 1, 2, 3, 5, 6, 7, 8, 9, 10, 12, 14, 15, 16, 17, 18, 19, 20, 21 21 The ability to filter out or minimize distractions that might potentially interfere with job performance. Includes the ability to focus on a single source of sound in the presence of other distracting sounds. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 Copyright © 2011 Biddle Consulting Group, Inc. 32 LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) KSAPCs 22 The ability to be honest in work and in relationship to others, including being truthful, straightforward, and consistent. Includes, but is not limited to, the ability to appropriately maintain the security and/or privacy of information. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 23 The ability to monitor/assess your own performance and manage one’s own time, to make improvements or take corrective action. Includes the ability to have self discipline to adjust work pace and/or take initiative when appropriate. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 24 The ability to understand the implications of new information for both current and future problem-solving and decision-making. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17, 18, 19, 21 25 Skill at accurately recording information, such as entering data into a computer and/or by hand. Includes, but is not limited to, the ability to focus on essential portions of conversation or communication and enter that information into a computer while engaged in that communication. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17, 18, 19, 20, 21 26 Knowledge of principles and processes for providing customer services. This includes customer needs assessment, meeting quality standards for services, perform services in a tactful manner. 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 14, 16, 17, 18, 19, 21 27 Knowledge of the structure and content of the English language including the meaning and spelling of words, rules of composition, and grammar. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14 ,15, 16, 17, 18, 19, 20, 21 28 Knowledge of administrative and clerical procedures and systems such as word processing, managing files and records, and other office procedures and terminology. 1, 2, 3, 4, 5, 6, 7, 8, 10, 12, 13, 14, 16, 17, 18, 19, 20, 21 Copyright © 2011 Biddle Consulting Group, Inc. 33 LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) KSAPCs 1, 2, 3, 4, 5, 6, 8, 13, 14, 16, 18, 19, 20 29 Knowledge of arithmetic and its applications. 30 Knowledge of principles and methods for promoting services. This includes a well-rounded knowledge of company programs, products (e.g., natural gas), web site (resources tools on web site). 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17, 18, 19, 21 31 The ability and willingness to take appropriate precautions in various settings to address safety standards. Includes the ability and willingness to help others to do the same. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12 , 13, 14, 16, 17, 18, 19, 20, 21 32 The ability to take responsibility for one’s own actions, as well as the consequences of inaction. Includes the ability to take appropriate action when necessary without external prompting and standing by decisions appropriately. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 33 The ability to behave in a way that is consistent with societal and legal guidelines in work-related situations and also avoids conflicts of interest. Being tactful with customers. 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 34 The ability and willingness to appear to work on time and ready to work. Includes, but is not limited to, the ability to work diligently throughout entire day. The ability to use company time wisely. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 35 The ability to encourage and/or direct others toward the achievement of goals. 1, 2, 3, 5, 6, 7, 8, 9, 11,12, 13, 14, 15, 16, 17, 18, 19, 21 Copyright © 2011 Biddle Consulting Group, Inc. 34 LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) KSAPCs 36 The ability to treat people fairly and with dignity and respect, including, but not limited to, those who may be different. Includes the ability to interact harmoniously with others, including those who may be different. 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 14, 15, 16, 17, 18, 19, 21 37 Ability to take and learn from constructive feedback in a positive way. 1, 2, 3, 4, 5, 6, 7, 8, 9, 12, 13, 14, 16, 17, 18, 19, 21 38 The ability to paraphrase information. 1, 2, 3, 5, 6, 8, 9, 12, 13, 14, 16, 17, 18, 19, 21 39 Ability to be respectful of the property of the company and of others. 2, 3, 7, 10, 11, 12, 14, 19, 21 40 Ability to organize information and resources in a systematic way to maximize its use. Includes keeping a work area organized and easily accessible. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 14, 16, 17, 18, 19, 21 41 Ability to know where to get information. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17, 18, 19, 20, 21 42 Ability to be aware of issues or actions that may affect others in a negative way. Includes being aware of your surroundings and acting appropriately. 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 13, 12, 14, 16, 17, 18, 19, 21 Copyright © 2011 Biddle Consulting Group, Inc. 35 KSAPCs LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) 43 Ability to project a positive image of the company and its employees at all times. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 44 Ability to show initiative. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 45 Ability to motivate others. 1, 2, 3, 4, 5, 6, 7, 8, 9, 12, 13, 14, 15, 16, 17, 18, 19, 21 46 Ability to share knowledge with others. 1, 2, 3, 4, 5, 6, 7, 8, 9, 12, 13, 14, 15, 16, 17, 18, 19, 21 47 Knowledge of computer programs: CSS, WMIS, TTS, Vista Plus, One Step, OLTE, CAS, Walker, Mobile Services, Oracle. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 48 Knowledge of tariffs (i.e. codified rules and regulations of public utilities commission) (Note: different tariffs for different states) and statements of rates. 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 14, 16, 17, 18, 19, 21 49 Ability to dress and groom, including personal hygiene, according to company policies. 1, 14, 19 Copyright © 2011 Biddle Consulting Group, Inc. 36 KSAPCs LINK TO DUTIES (Numbers indicate duties associated with this KSAPC) 50 Ability to use Internet, Infonet (internal internet), and Groupwise software. 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17, 18, 19, 20, 21 51 Knowledge of Company Jargon (vernacular). 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21 Copyright © 2011 Biddle Consulting Group, Inc. 37 ATTACHMENT D Explanation of GOJA Job Analysis Rating Scales Copyright © 2011 Biddle Consulting Group, Inc. 38 The following instructions were provided to the SMEs during the Job Analysis workshop. Rating scales for job duties to be completed by all SMEs Frequency Give each duty a Frequency Rating to show how often, in general, you perform it. Choose one of the following options: 1 2 3 4 5 6 7 8 9 – – – – – – – – – Annually or less often Semi-Annually (approx. 2 times/year) Quarterly (approx. 4 times/year) Monthly (approx. 1 time/month) Bi-Weekly (approx. every 2 weeks) Weekly (approx. 1 time/week) Semi-Weekly (approx. 2 to 6 times/week) Daily/Infrequently (approx. 1 to 6 times/day) Daily/Frequently (approx. 7 or more times/day) Importance Give each duty an Importance Rating to show how important the duty is to successful job performance–to achieving the purpose of the job. Consider how often the duty is performed, the amount of time spent on the duty, and how serious the consequences are if the duty is not performed or not performed properly. Choose one of the following options: 1 – Not Important: Minor significance to the performance of the job. 2 – Of Some Importance: Somewhat useful and/or meaningful to the performance of the job. • Improper performance may result in slight negative consequences 3 – Important: Useful and/or meaningful to the performance of the job. • Improper performance may result in moderate negative consequences 4 – Critical: Necessary for the performance of the job. • Improper performance may result in serious negative consequences 5 – Very Critical: Necessary for the performance of the job, and with more extreme consequences. • Improper performance may result in very serious negative consequences Additional rating scales for job duties to be completed by Supervisor SMEs Best Worker This question is asked because it helps in rank ordering applicants on the basis of job-related qualifications and in evaluating current job-holder’s job performance. Complete the following statement using the rating scale provided. Above-minimum performance of this duty makes (Select one option from below) difference in overall performance of the job. 1 – no 2 – little 3 – some Copyright © 2011 Biddle Consulting Group, Inc. 39 4 – significant 5 – very significant Fundamental (Fundamental Duty): We need to be able to distinguish fundamental job duties from those that are not fundamental to the purpose of the job. Answer “Yes” if the duty is a fundamental duty; answer “No” if it is not. All the duties of some jobs may be fundamental duties; for other jobs some, but not all, of the duties may be fundamental. A duty is considered fundamental to the job in any of the following ways: • The duty is frequently performed (check the Frequency rating) and/or the proportion of work time spent on it is significant (check the Percentage of Time), or • The consequence to the purpose of the job is severe if the duty is not performed or if it is performed poorly (check the Importance rating), or • Removing the duty would fundamentally change the job. In other words, the duty is fundamental because the reason the job exists is to perform the duty, or • There are a limited number of employees available among whom the performance of this duty can be distributed, or • The duty is so highly specialized that the current job-holder was placed in the job because of his/her expertise or ability to perform this particular duty. Assignable (Assignable to Others): This section is necessary to identify those duties that can be readily assumed by other employees in order to accommodate persons with disabilities who cannot perform them. Duties that are frequently performed and/or take up a large proportion of work time and are important or critical probably are not easily assigned to others. A “No” answer might be appropriate in this case. Duties that occur infrequently and/or that require a small percentage of work time can sometimes be assumed by others, regardless of how important or unimportant they are. A “Yes” answer might be appropriate in this case. Rating scales for KSAPCs to be completed by all SMEs Frequency Give each KSAPC a Frequency Rating to show how often, in general, you use it. Before deciding on a frequency rating, review the duties which you have listed as requiring the KSA. The frequency rating of the KSAPC can be less often, more often, or the same as the frequency rating of any duty to which it is linked. For example, a KSAPC can be linked to five duties, each of which is performed weekly (one on each day of the week), so the frequency of the KSAPC could be daily even though each duty it is linked to is performed weekly. Or if the duties are performed daily, but the KSAPC is needed only every two weeks to do a part of the duties, then its frequency is bi-weekly. Choose one of the following options: 1 – Annually or less often 2 – Semi-Annually (approx. 2 times/year) 3 – Quarterly (approx. 4 times/year) 4 – Monthly (approx. 1 time/month) 5 – Bi-Weekly (approx. every 2 weeks) 6 – Weekly (approx. 1 time/week) 7 – Semi-Weekly (approx. 2 to 6 times/week) Copyright © 2011 Biddle Consulting Group, Inc. 40 8 – Daily/Infrequently (approx. 1 to 6 times/day) 9 – Daily/Frequently (approx. 7 or more times/day) Importance Give each KSAPC an Importance Rating. How important is the KSAPC to successful job performance or to achieving the purpose of the job? Consider the importance rating of the duties for which the KSAPC is needed. Typically, a KSAPC’s importance rating will be the same as the most important duty for which it is needed – but not always. Therefore, don’t just automatically select the importance of the most important duty; evaluate what the importance rating of each KSAPC should be. Choose one of the following options: 1 – Not Important: Minor significance to the performance of the job. 2 – Of Some Importance: Somewhat useful and/or meaningful to the performance of the job. • Improper performance may result in slight negative consequences 3 – Important: Useful and/or meaningful to the performance of the job. • Improper performance may result in moderate negative consequences 4 – Critical: Necessary for the performance of the job. • Improper performance may result in serious negative consequences 5 – Very Critical: Necessary for the performance of the job, and with more extreme consequences. • Improper performance may result in very serious negative consequences Rating scales for KSAPCs to be completed by Supervisor SMEs Level Needed Upon Entry Having Supervisors identify the minimum amount of a KSAPC or Physical Abilities that are necessary upon entry to the job provides direction on which KSAPCs and Physical Abilities to screen in a selection process. Supervisors are asked to complete the following statement to gather this data: Possessing (Select one option from below) of this KSAPC/Physical Abilities is needed upon entry to the job. 1 – None or very little 2 – Some (less than half) 3 – Most (more than half) 4 – All or almost all The Guidelines state, “Content validity is also not an appropriate strategy when the selection procedure involves knowledge, skills, or abilities which an employee will be expected to learn on the job” (Section 14C[1]). To address this requirement, we suggest using an average rating of 3.0 as a minimum threshold for determining which KSAPCs or Physical Abilities to include in a selection process. Copyright © 2011 Biddle Consulting Group, Inc. 41 Best Worker This question is asked because it helps in rank ordering applicants on the basis of job-related qualifications and in evaluating current job-holder’s job performance. Complete the following statement using the rating scale provided. Above-minimum performance of this duty makes (Select one option from below) difference in overall performance of the job. 1 – no 2 – little 3 – some 4 – a significant 5 – a very significant Minimum v. Helpful Qualifications Supervisors provide this rating to determine which KSAPCs and Physical Abilities to include in a selection process. Supervisors provide a rating of “MQ” to indicate that the KSAPC or Physical Abilities is a minimum qualification (i.e., requirement), and “HQ” to indicate that it is only helpful: MQ – Minimum Qualification HQ – Helpful Qualification Minimum qualifications are those that the applicant or candidate must have prior to entry into the position; helpful qualifications can still be included in the selection process, but are not absolute necessities prior to entry. Level Needed for Success Supervisors provide these ratings to indicate the minimum amount of a job knowledge that is necessary for successful performance. The following scale is used to gather these ratings: This level of job knowledge held must be at a (Select one option from below) level for successful job performance. 1 – Low: none or only a few general concepts or specifics available in memory in none or only a few circumstances without referencing materials or asking questions. 2 – Familiarity: have some general concepts and some specifics available in memory in some circumstances without referencing materials or asking questions. 3 – Working knowledge: have most general concepts and most specifics available in memory in most circumstances without referencing materials or asking questions. 4 – Mastery: have almost all general concepts and almost all specifics available in memory in almost all circumstances without referencing materials or asking questions. The data from these ratings are useful for choosing the job knowledge that should be included in a written job knowledge test. We suggest only including job knowledge that have average ratings of 3.0 or higher on written job knowledge tests. See Section 14C(4) of the Guidelines for specific requirements about measuring job knowledge in a testing process. Copyright © 2011 Biddle Consulting Group, Inc. 42 Rating scales for Physical Abilities to be completed by all SMEs Frequency Rating Give a Frequency Rating to show how often, in general, you use each Physical Abilities. Before deciding on a frequency rating, review the duties which you have listed for the Physical Abilities. The frequency rating of the Physical Abilities can be less often, more often, or the same as the frequency rating of any duty it is linked to. For example, a Physical Abilities can be linked to five duties, each of which is performed weekly (one on each day of the week), so the frequency of the Physical Abilities could be daily even though each duty to which it is linked is performed weekly. Or if the duties are performed daily, but the Physical Abilities is needed only every two weeks to do a part of the duties, then its frequency is bi-weekly even though the duties are performed daily. Choose one of the following options: 1 – Annually or less often 2 – Semi-Annually (approx. 2 times/year) 3 – Quarterly (approx. 4 times/year) 4 – Monthly (approx. 1 time/month) 5 – Bi-Weekly (approx. every 2 weeks) 6 – Weekly (approx. 1 time/week) 7 – Semi-Weekly (approx. 2 to 6 times/week) 8 – Daily/Infrequently (approx. 1 to 6 times/day) 9 – Daily/Frequently (approx. 7 or more times/day) Importance Rating How important is the Physical Abilities to successful job performance or to achieving the purpose of the job? A Physical Abilities’ importance rating may or may not be the same as the most important duty for which it is needed. Therefore, don’t just automatically select the importance of the most important duty. Decide what the importance rating of each Physical Abilities should be. Choose one of the following options: 1 – Not Important: Minor significance to the performance of the job. 2 – Of Some Importance: Somewhat useful and/or meaningful to the performance of the job. • Improper performance may result in slight negative consequences 3 – Important: Useful and/or meaningful to the performance of the job. • Improper performance may result in moderate negative consequences 4 – Critical: Necessary for the performance of the job. • Improper performance may result in serious negative consequences 5 – Very Critical: Necessary for the performance of the job, and with more extreme consequences. • Improper performance may result in very serious negative consequences Copyright © 2011 Biddle Consulting Group, Inc. 43 Rating scales for Physical Abilities to be completed by supervisor SMEs Minimum v. Helpful Qualifications: Identify whether the Physical Abilities is a minimum or helpful qualification. Minimum qualifications are those that the applicant or candidate must have prior to entry into the position. Best Worker: This question is asked because it helps in rank ordering applicants on the basis of job-related qualifications and in evaluating current job-holder job performance. Complete the following statement using the rating scale provided. Possessing above-minimum levels of this Physical Abilities makes (Select one option from below) difference in overall performance of the job. 1 – no 2 – little 3 – some 4 – a significant 5 – a very significant Level Needed Upon Entry: When Physical Abilities are required on the job is used to address Section 5F and 14C(1) of the Guidelines (not measuring KSAPCs that are learned in a brief orientation or trained on the job). It should be a supervisor rating. Complete the following statement using the rating scale provided. Possessing (Select one option from below) of this Physical Abilities is needed upon entry to the job. 1 - None or very little 2 – Some (less than half) 3 – Most (more than half) 4 – All or almost all Copyright © 2011 Biddle Consulting Group, Inc. 44 ATTACHMENT E Average/Summaries for SME Duty Ratings Copyright © 2011 Biddle Consulting Group, Inc. 45 FREQUENCY IMPORTANCE BEST WORKER FUNDAMENTAL ASSIGNABLE 9.00 4.72 4.60 Y N 9.00 4.73 4.60 Y N 3. Resolve customers' service or billing complaints by performing activities such as refunding money and adjusting bills (e.g., late payment charges or bill collection fees). Includes calculating appropriate numbers and amounts. 8.11 3.89 4.60 Y N 4. Check to ensure that appropriate changes are made to resolve customers' problems. 7.94 3.88 4.20 Y Y 5. Based upon a call, research unresolved customer grievances or queries with designated departments and follow-up. May transfer call to appropriate department for resolution. 7.44 3.33 5.00 Y Y 6. Determine charges for services requested, collect deposits or payments, and/or arrange for billing or payment arrangements. Make decisions based on customer’s needs and status (e.g., new or disconnected customer). 9.00 4.31 4.40 Y N JOB DUTY: If applicable, include domain (area within the job to which the duty is related; for example, client contact, personnel, etc.) 1. 2. Effectively converse with a wide variety of people, including internal/external customers, by telephone or in person. This may be done to quickly communicate information about products and services, to take orders or cancel accounts, or to obtain details of complaints and compliments; or for other reasons, with a high volume of diverse calls. Use a computer and/or handwriting to make records of customer interactions and transactions, recording details of inquiries, complaints, and comments, as well as actions taken. Navigating on a computer to frequently access, view, enter information or take handwritten notes while performing other activities, such as conversing on the telephone. Copyright © 2011 Biddle Consulting Group, Inc. 46 FREQUENCY IMPORTANCE BEST WORKER FUNDAMENTAL ASSIGNABLE 7. Complete forms, prepare change of address records, and issue service discontinuance orders, emergency orders, using computers and/or by hand when computer systems are down. 8.82 5.00 5.00 Y N 8. Obtain and examine all relevant information in order to assess validity of complaints and/or determine possible causes, such as extreme weather conditions or contextual factors that could increase utility bills. 8.00 4.00 4.40 Y N 9. Educate and/or persuade others to take action, such as utilizing gas efficiently, upgrading to more efficient products, increase insulation or do an energy audit. Educate customer about other resources, including internal/community resources that may be available. 8.25 3.00 3.40 Y N 10. File and/or retrieve information stored using alphabetical and/or numerical listing using either an electronic or paper filing systems. 6.88 3.13 3.40 Y Y 11. Maintain the security and privacy of company and customer information. 9.00 5.00 4.75 Y N 12. Help customers to maintain a safe environment, such as recognizing when unsafe conditions are likely to exist or whether safety-related issues might arise if appropriate action is not taken. Instruct customers about emergency procedures. 8.11 5.00 4.60 Y N 13. Learn work-related basics and then actively continue to expand knowledge of work-related activities, including learning and using new methods or techniques. 7.33 3.67 4.00 Y N JOB DUTY: If applicable, include domain (area within the job to which the duty is related; for example, client contact, personnel, etc.) Copyright © 2011 Biddle Consulting Group, Inc. 47 FREQUENCY IMPORTANCE BEST WORKER FUNDAMENTAL ASSIGNABLE 14. Work as part of a team, proactively assisting others as needed. Also work as an individual and use your level of empowerment (selecting from a number of appropriate solutions). 8.81 3.73 3.80 Y N 15. Answering call for volunteers and/or are assigned to help educate peers. 4.44 2.50 3.40 Y N 16. Quickly and accurately make decisions or solve problems, as needed with minimal supervision within company guidelines. 8.75 4.35 4.60 Y N 17. Effectively communicate with others, both in writing and verbally, as needed. Includes, but is not limited to, the use of proper grammar, spelling, punctuation, and phrasing. 8.87 4.50 4.60 Y N 18. Deal with more than one situation at a time, while being focused and aware of geographical areas (e.g., setting up accounts, dealing with more than one phone conversation at a time, going from one program to another). 8.76 4.06 4.60 Y N 19. Perform all the duties of a customer assistant representative in addition to the duties performed by cashiers such as; compile bank deposits, collect payments, make change, balance the drawer and perform face to face duties of a cashier, while using a computer. 6.61 4.59 4.40 Y Y 20. Maintains statistical information such as call volume and attendance. 7.00 3.88 4.40 Y N JOB DUTY: If applicable, include domain (area within the job to which the duty is related; for example, client contact, personnel, etc.) Copyright © 2011 Biddle Consulting Group, Inc. 48 IMPORTANCE BEST WORKER FUNDAMENTAL ASSIGNABLE 21. Contact internal/external customers about a wide variety of issues, such as responding to inquiries or to notifying them of account investigation results and any planned adjustments. FREQUENCY JOB DUTY: If applicable, include domain (area within the job to which the duty is related; for example, client contact, personnel, etc.) 6.91 3.60 4.00 Y N Copyright © 2011 Biddle Consulting Group, Inc. 49 ATTACHMENT F Average/Summaries for KSAPC Ratings Copyright © 2011 Biddle Consulting Group, Inc. 50 NOTE: Those KSAPCs that are shaded did not meet the court-supported criteria used by Biddle Consulting Group, Inc. for inclusion in a pre-employment selection process. MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER The ability to read and comprehend information and ideas written in English. 9.00 5.00 MQ 5.00 4.00 2. The ability to take notes and compose effective written communication in English using a keyboard and/or by hand. 9.00 5.00 MQ 5.00 4.00 3. The ability to perform basic math such as addition, subtraction, multiplication, and division using a calculator. 8.69 4.53 MQ 5.00 4.00 4. The skill to choose the right mathematical methods or formulas to solve a problem. 8.38 4.24 MQ 4.60 3.60 5. The ability to work closely with others and to be an effective member of a team in order to achieve goals; including an ability and willingness to help others, as needed. 8.69 4.00 MQ 4.40 3.60 6. The ability to speak clearly and effectively when communicating with others so that others will understand, both in person and by telephone. Effectively communicate at the appropriate level (e.g., elderly, confused, intoxicated, lacking education) 9.00 4.59 MQ 5.00 4.00 Copyright © 2011 Biddle Consulting Group, Inc. 51 LEVEL NEEDED UPON ENTRY IMPORTANCE LEVEL NEEDED FOR SUCCESS (knowledge only) FREQUENCY 1. KSAPC’s MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER 9.00 4.53 MQ 5.00 4.00 8. The ability to quickly and accurately solve problems and/or make decisions. Includes, but is not limited to, the ability to apply general rules to specific problems to produce answers that make sense. 9.00 4.56 MQ 4.40 3.60 9. The ability to tell when something is wrong or is likely to go wrong, knowing what the appropriate next step is, and following through to resolution. 8.40 4.57 MQ 4.60 3.40 10. The ability to use logic and reasoning to identify the strengths and weaknesses of alternative solutions, conclusions or approaches to problems. 8.44 4.06 MQ 4.40 3.60 11. The ability to learn and retain information to be used at a later time. Includes both long-term learning and the ability to recall bits of information, such as telephone numbers, names, addresses from memory for short periods of time. 8.71 3.94 MQ 4.20 3.40 12. The ability and willingness to learn and use new techniques or procedures in a timely fashion. Includes, but is not limited to, the ability to adapt to change without incurring overwhelming stress. 7.56 4.13 MQ 5.00 3.60 Copyright © 2011 Biddle Consulting Group, Inc. 52 LEVEL NEEDED UPON ENTRY IMPORTANCE LEVEL NEEDED FOR SUCCESS (knowledge only) FREQUENCY 7. The ability to listen and understand the spoken word by being attentive and properly interpreting and/or responding to verbal communication, understanding the points being made, asking questions as appropriate, and not interrupting at inappropriate times. Stay focused and not be distracted. Ability to maintain control of the call. KSAPC’s MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER The ability to convey the value of options or programs. May require the ability to convince others to take or not take action. 7.94 3.88 HQ 3.40 3.00 14. The ability to identify and prioritize things or actions in a certain order or pattern according to a specific rule, set of rules (e.g., patterns of numbers, letters, words, pictures, mathematical operations), or routine (moving from one computer screen to another). 8.79 4.38 MQ 4.00 3.40 15. The ability to file and/or retrieve information stored using alphabetical and/or numerical filing systems. 7.80 3.07 HQ 4.00 3.60 16. The ability to combine pieces of information to form conclusions (includes finding a relationship among seemingly unrelated events). Follow up or pursue additional information when information provided is not sufficient or does not make sense. 8.12 3.94 MQ 4.40 3.60 17. The ability to handle stressful situations while maintaining a high level of performance and professionalism (such as maintaining appropriate use of words). Includes, but is not limited to, the ability to appropriately use emotions; being stable and level-headed under stressful situations (not overreacting), help others regain their composure or defuse situation. 8.65 4.81 MQ 5.00 4.00 18. The ability to make fast, simple, repeated movements of the fingers, hands, and wrists. 8.81 4.00 HQ 4.00 3.40 Copyright © 2011 Biddle Consulting Group, Inc. 53 LEVEL NEEDED UPON ENTRY IMPORTANCE LEVEL NEEDED FOR SUCCESS (knowledge only) FREQUENCY 13. KSAPC’s IMPORTANCE MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER 19. The ability to use a mouse and keyboard associated with a personal computer without having to concentrate or focus on those behaviors. 9.00 4.38 MQ 4.60 3.60 20. The ability to simultaneously perform two or more job-related tasks (e.g., speak with client on telephone while entering information using a keyboard; work reports while speaking on the phone). 8.71 4.00 MQ 4.40 3.60 21. The ability to filter out or minimize distractions that might potentially interfere with job performance. Includes the ability to focus on a single source of sound in the presence of other distracting sounds. 9.00 3.94 MQ 4.40 3.40 22. The ability to be honest in work and in relationship to others, including being truthful, straightforward, and consistent. Includes, but is not limited to, the ability to appropriately maintain the security and/or privacy of information. 9.00 4.80 MQ 5.00 4.00 23. The ability to monitor/assess your own performance and manage one’s own time, to make improvements or take corrective action. Includes the ability to have self discipline to adjust work pace and/or take initiative when appropriate. 9.00 4.31 MQ 4.40 4.00 24. The ability to understand the implications of new information for both current and future problemsolving and decision-making. 8.25 4.31 MQ 4.40 3.40 25. Skill at accurately recording information, such as entering data into a computer and/or by hand. Includes, but is not limited to, the ability to focus on essential portions of conversation or communication and enter that information into a computer while engaged in that communication. 9.00 4.88 MQ 4.60 4.00 Copyright © 2011 Biddle Consulting Group, Inc. 54 LEVEL NEEDED UPON ENTRY FREQUENCY LEVEL NEEDED FOR SUCCESS (knowledge only) KSAPC’s KSAPC’s FREQUENCY IMPORTANCE MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER LEVEL NEEDED FOR SUCCESS (knowledge only) LEVEL NEEDED UPON ENTRY 26. Knowledge of principles and processes for providing customer services. This includes customer needs assessment, meeting quality standards for services, perform services in a tactful manner. 8.94 4.69 MQ 4.60 3.40 3.00 27. Knowledge of the structure and content of the English language including the meaning and spelling of words, rules of composition, and grammar. 9.00 4.64 MQ 5.00 4.00 4.00 28. Knowledge of administrative and clerical procedures and systems such as word processing, managing files and records, and other office procedures and terminology. 8.60 3.82 MQ 4.20 3.40 3.00 29. Knowledge of arithmetic and its applications. 8.53 3.94 MQ 5.00 4.00 4.00 30. Knowledge of principles and methods for promoting services. This includes a well-rounded knowledge of company programs, products (e.g., natural gas), web site (resources tools on web site). 9.00 4.00 MQ 4.40 3.60 2.80 31. The ability and willingness to take appropriate precautions in various settings to address safety standards. Includes the ability and willingness to help others to do the same. 8.35 4.80 MQ 5.00 4.00 32. The ability to take responsibility for one’s own actions, as well as the consequences of inaction. Includes the ability to take appropriate action when necessary without external prompting and standing by decisions appropriately. 8.81 4.12 MQ 4.60 4.00 Copyright © 2011 Biddle Consulting Group, Inc. 55 MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER 9.00 5.00 MQ 4.60 4.00 34. The ability and willingness to appear to work on time and ready to work. Includes, but is not limited to, the ability to work diligently throughout entire day. The ability to use company time wisely. 9.00 5.00 MQ 5.00 4.00 35. The ability to encourage and/or direct others toward the achievement of goals. 7.47 3.60 MQ 4.00 2.80 36. The ability to treat people fairly and with dignity and respect, including, but not limited to, those who may be different. Includes the ability to interact harmoniously with others, including those who may be different. 9.00 4.69 MQ 5.00 4.00 37. Ability to take and learn from constructive feedback in a positive way. 6.94 3.94 MQ 4.40 3.40 38. The ability to paraphrase information. 8.75 4.13 HQ 4.00 2.80 39. Ability to be respectful of the property of the company and of others. 8.75 4.29 MQ 5.00 4.00 Copyright © 2011 Biddle Consulting Group, Inc. 56 LEVEL NEEDED UPON ENTRY IMPORTANCE LEVEL NEEDED FOR SUCCESS (knowledge only) FREQUENCY 33. The ability to behave in a way that is consistent with societal and legal guidelines in work-related situations and also avoids conflicts of interest. Being tactful with customers. KSAPC’s MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER 8.60 3.94 MQ 4.40 3.20 41 Ability to know where to get information. 8.88 4.24 MQ 4.40 3.20 42. Ability to be aware of issues or actions that may affect others in a negative way. Includes being aware of your surroundings and acting appropriately. 8.63 4.13 MQ 5.00 4.00 43. Ability to project a positive image of the company and its employees at all times. 9.00 4.57 MQ 5.00 4.00 44. Ability to show initiative. 8.73 3.94 MQ 4.60 3.20 45. Ability to motivate others. 8.23 3.92 MQ 4.20 3.40 46. Ability to share knowledge with others. 8.62 3.79 MQ 4.20 3.20 Copyright © 2011 Biddle Consulting Group, Inc. 57 LEVEL NEEDED UPON ENTRY IMPORTANCE LEVEL NEEDED FOR SUCCESS (knowledge only) FREQUENCY 40. Ability to organize information and resources in a systematic way to maximize its use. Includes keeping a work area organized and easily accessible. KSAPC’s FREQUENCY IMPORTANCE MINIMUM vs. HELPFUL QUALIFICATION BEST WORKER LEVEL NEEDED FOR SUCCESS (knowledge only) LEVEL NEEDED UPON ENTRY 47. Knowledge of computer programs: CSS, WMIS, TTS, Vista Plus, One Step, OLTE, CAS, Walker, Mobile Services, Oracle. 9.00 4.88 HQ 4.40 3.60 2.40 48. Knowledge of tariffs (i.e. codified rules and regulations of public utilities commission) (Note: different tariffs for different states) and statements of rates. 8.24 4.69 HQ 4.20 3.60 2.20 49. Ability to dress and groom, including personal hygiene, according to company policies. 9.00 3.69 MQ 4.00 4.00 50. Ability to use Internet, Infonet (internal internet), and Groupwise. 9.00 4.53 MQ 4.20 2.60 51. Knowledge of Company Jargon (vernacular). 9.00 4.13 HQ 4.20 KSAPC’s Copyright © 2011 Biddle Consulting Group, Inc. 58 3.40 2.20 ATTACHMENT G Average/Summaries for Physical Abilities Ratings Copyright © 2011 Biddle Consulting Group, Inc. 59 FOR SUPERVISORS ONLY FOR ALL JOB EXPERTS DESCRIBE FREQUENCY IMPORTANCE MINIMUM v. HELPFUL QUALIFICATION BEST WORKER LEVEL NEEDED UPON ENTRY PHYSICAL ABILITIES 9.00 4.72 MQ 4.20 4.00 1a. SEE/TYPICAL (e.g., see standard printed material and basic colors) Looking at a computer screen, memos, emergency instructions, and reader boards (10-50 feet away), documents that customers bring into the office (leases or drivers licenses). 1b. SEE/MAXIMUM (e.g., see small objects in far distance, fine print, distinguish shades of color) Looking at smaller print on training PowerPoint presentations. 6.47 3.29 MQ 4.00 3.40 2a. HEAR/TYPICAL (e.g., hear ordinary in-person and telephone conversation) Telephone conversations with a headset. Compensate for bad phone connections. Filter out background noises. Understanding different dialects. 8.94 4.65 MQ 4.20 4.00 2b. HEAR/MAXIMUM (e.g., hear conversation above other noises, hear devices like alarms) Hearing the internal paging system and fire alarms. 5.44 3.83 MQ 4.00 3.60 3a. SPEAK/TYPICAL (e.g., ordinary in-person and telephone conversation) Clearly, concisely, slowly with minimal company jargon. Must use proper English no slang. 9.00 4.39 MQ 4.20 4.00 Copyright © 2011 Biddle Consulting Group, Inc. 60 FOR SUPERVISORS ONLY FOR ALL JOB EXPERTS FREQUENCY IMPORTANCE MINIMUM v. HELPFUL QUALIFICATION BEST WORKER LEVEL NEEDED UPON ENTRY 3b. SPEAK/MAXIMUM (e.g., converse above other noises; shout instructions) Evaluated volume of voice for hearing impaired customers. 8.12 4.11 HQ 4.20 4.00 4a. SIT/TYPICAL HOW LONG? 7 1/2 – 8 hours a day. 9.00 4.59 MQ 4.60 4.00 SIT/MAXIMUM HOW LONG? Overtime as long as 10 hours a day. 6.82 3.65 MQ 4.20 3.20 STAND/TYPICAL HOW LONG? If performing the cashier job 3-4 hours a day. 5.00 2.33 HQ 3.20 2.60 STAND/MAXIMUM HOW LONG As a cashier could be as long as 8 hours. 3.40 2.94 HQ 3.40 2.80 PHYSICAL ABILITIES 4b. 5a. 5b. DESCRIBE Copyright © 2011 Biddle Consulting Group, Inc. 61 FOR SUPERVISORS ONLY FOR ALL JOB EXPERTS BEST WORKER LEVEL NEEDED UPON ENTRY WALK/TYPICAL MINIMUM v. HELPFUL QUALIFICATION HOW FAR? Minimal walking required (To the fax machine/copy machine) HOW FAST? IMPORTANCE 6. DESCRIBE FREQUENCY PHYSICAL ABILITIES 7.12 2.33 HQ 2.40 1.80 3.13 1.53 HQ 2.50 2.00 3.11 1.71 HQ 2.40 1.25 2.23 1.23 HQ 2.33 1.33 WHAT SURFACE? Carpet PUSH WHAT? Boxes of files or correspondences. Office supplies. Chairs. 7. PUSH (WITH HELP): TYPICAL WEIGHT? HOW FAR? WHAT HELP? 8. PUSH (WITHOUT HELP): TYPICAL PUSH WHAT? Boxes of files or correspondences. Office supplies. Chairs WEIGHT? 10-15 lbs HOW FAR? 10-20 ft. LIFT WHAT? Storage boxes 9. LIFT AND CARRY (WITHOUT HELP): MAXIMUM WEIGHT? 5-20 lbs HOW FAR? 25-50 ft. Copyright © 2011 Biddle Consulting Group, Inc. 62 FOR SUPERVISORS ONLY FOR ALL JOB EXPERTS BEST WORKER LEVEL NEEDED UPON ENTRY 2.31 1.14 HQ 1.60 1.60 8.44 3.00 HQ 3.20 2.60 5.18 2.94 HQ 2.60 2.00 4.40 2.80 3.00 2.50 WHAT – Climb stairs in parking garage. HOW FAR? 2 flights of stairs REACH WHAT? Arms length – for office supplies or desk items. REACH: TYPICAL MINIMUM v. HELPFUL QUALIFICATION 11. CLIMB: TYPICAL (e.g., stairs, ladders, scaffolding, hills) IMPORTANCE 10. DESCRIBE FREQUENCY PHYSICAL ABILITIES HOW FAR/ HIGH/LOW? WORK IN AWKWARD POSITIONS: TYPICAL 12a. (e.g., stoop, bend, twist, crawl, kneel, squat) When performing the cashier position, twist to get from cash drawer to customer. WORK IN AWKWARD POSITIONS: MAXIMUM 12b. (e.g., bend, twist, crawl, kneel, squat, stoop) Copyright © 2011 Biddle Consulting Group, Inc. 63 FOR SUPERVISORS ONLY FOR ALL JOB EXPERTS LEVEL NEEDED UPON ENTRY 64 BEST WORKER Copyright © 2011 Biddle Consulting Group, Inc. MINIMUM v. HELPFUL QUALIFICATION USE HANDS AND FINGERS: TYPICAL Use of typing on keyboard, dialing phone numbers, using calculators, writing (obtaining customer information, correspondence) and filing, coping and faxing. IMPORTANCE 13. DESCRIBE FREQUENCY PHYSICAL ABILITIES 9.00 5.00 MQ 4.60 4.00