About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results KnowlEDGE for Leaders Interpreting Your Assessment Results About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results About this Assessment KnowlEDGE for Leaders will help you identify your strengths as well as any needs you might have for further leadership development. It measures what you know about effective leadership in several important areas using multiple-choice questions. You’ll be able to see, in black and white, whether you know the most effective leadership behaviors in these critical skill areas. This assessment is very important in helping you build on your identified strengths and allowing you to focus your development efforts on those areas where you have the greatest need. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Tasks The term “leadership” covers quite a number of tasks, skills, and behaviors that are important in dealing with the people you supervise in a workplace. In developing KnowlEDGE for Leaders, we identified the most critically important skill areas, and grouped these skills into the tasks we measure with this assessment test. • • • • • • • • Coaching & Counseling Communicating Effectively Influence & Negotiation Managing Change Performance Management Setting Goals and Standards Managing Conflict Problem Solving & Decision Making About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Tasks Coaching & Counseling Providing an employee with feedback on his or her present job performance; counseling an employee who has unsatisfactory job behaviors; taking disciplinary action or invoking a consequence for an employee’s behavior; one-on-one training with an employee to teach a new task; giving positive feedback to employees Communicating Effectively Effective oral communications; conducting meetings; giving presentations Influence & Negotiation Persuading and influencing employees; negotiating with an employee in order to reach agreement About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Tasks Managing Change Helping employees deal effectively with change Managing Conflict Dealing with employee complaints, grievances, and conflicts on the job Performance Management Giving work assignments; delegating; managing time; conducting performance appraisals About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Tasks Problem Solving & Decision Making Working with employees to identify problem causes and apply solutions; analyzing information to make effective decisions Setting Goals and Standards Establishing measurable objectives when planning; creating job performance standards for employees About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Perception vs. Knowledge There are two major types of assessment tests: perception-based and knowledge-based. A perception test measures how you see yourself and/or how others see you. A knowledge test tells you what you know or don’t know. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Perception Test The EDGE360 for Leaders is an example of a perception-based assessment. Using the EDGE360, raters (including yourself, your direct supervisor, your direct reports, your peers, and customers) read a behavior statement and then assess how frequently you exhibit that behavior on the job. For example The person being assessed . . . Asks open-ended questions to gather more information. Almost Always Usually Often Sometimes Not Usually Almost Never About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Knowledge Test A knowledge test such as KnowlEDGE for Leaders uses multiplechoice questions or similar techniques to measure what you actually know and don’t know about the tasks being assessed. For example You’ve just gone over some new procedures with one of your employees and want to find out what the employee thinks about the changes. Which of the following questions is likely to gain the most information? A. “Does this sound okay to you?” B. “What problems do you see with these procedures?” C. “Am I overlooking any problems with these new procedures?” D. “Do you see any problems with these procedural changes?” About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Knowledge Test A knowledge test such as KnowlEDGE for Leaders uses multiplechoice questions or similar techniques to measure what you actually know and don’t know about the tasks being assessed. For example You’ve just gone over some new procedures with one of your employees and want to find out what the employee thinks about the changes. Which of the following questions is likely to gain the most information? A. “Does this sound okay to you?” B. “What problems do you see with these procedures?” C. “Am I overlooking any problems with these new procedures?” D. “Do you see any problems with these procedural changes?” About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Uses Leadership training programs and career development systems should provide clear training solutions for clear training needs. The more accurately we pinpoint an individual's developmental needs - areas in which additional knowledge and training is needed - the more effective we can be in meeting those needs. A knowledge-based assessment test like KnowlEDGE for Leaders can be used for a variety of purposes, including: • Needs Assessment • Career Development • Training Evaluation • Selection / Succession Planning About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Uses Needs Assessment Your organization receives feedback on its leadership training needs by administering this instrument to all (or a random sample) of your leadership employees. The group reports you receive with the KnowlEDGE for Leaders assessment results can help you pinpoint group training needs and plan for better utilization of your training resources. In addition, you can use the data from this assessment to measure specific needs and strengths across the organization, between departments, or at differing levels of leadership responsibility. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Uses Career Development Each participant receives detailed individual assessment results. This feedback identifies areas of strength as well as areas in need of further development. This information is helpful in personal career development planning, and allows each participant the opportunity to tailor an individual development plan to meet his or her own needs. Individuals can build on their strengths and further develop their needs, based on their own personal results. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Uses Training Evaluation KnowlEDGE for Leaders is very useful as a pre- and post-assessment test when used in conjunction with group or individual training. The test can be given prior to a group’s participation in a training curriculum to establish group and individual baselines. At some point following training, a post-test can be administered to measure the effectiveness of the training that was given. Measuring the effectiveness of training in an objective way is often a challenge for most organizations. This assessment test can help provide that objective training evaluation data. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Uses Selection / Succession Planning KnowlEDGE for Leaders gives supporting data that, when used properly, can be useful in making promotional or selection decisions. No test should be the sole or determining factor in a selection decision, but the additional information provided by this instrument will help provide a more complete view of your candidates. As you identify future leaders and develop leadership succession plans, this instrument can help you identify strong candidates, and build appropriate development plans for their preparation prior to assuming leadership positions. About This Assessment Validity & Reliability Clients 3M AT&T Alcoa-Fujikara Affinity Insurance Group Allied-Signal Amana American Electric Power AMP, Inc. Atmos Energy Bob Evans Farms Canon Caterpillar, Inc. Champion International Checkpoint Systems Collier County Sheriff's Dept Comcast Cable Understanding Your Report Taking Action On Your Results Edge Training Systems, Inc. has worked with a wide variety of clients on their leadership and employee assessment needs. The following is a sample of Edge’s assessment client list: County of San Diego DuPont East Jefferson Hospital Federal Reserve Bank Gateway 2000 Growmark Hannaford Brothers Ingram Industries John Deere Kraft Foods Mayo Clinic MCI McKesson-General Medical Media One Michelin Tires Miller Brewing NSK Corporation Pacific Gas & Electric Parson's Technologies Paychex PrimeStar Public Service of New Mexico Qwest Ralston Purina Scripps Howard Seagate Technologies Southwest Missouri State University Universal Instruments Venator Group - Kinney Shoes V A Medical Centers Walgreens Wyeth-Ayerst Laboratories About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results About Edge Edge Training Systems, Inc. is a leading producer of innovative assessment and training products for leadership and employee development. Located in Richmond, Virginia, Edge offers products and services to clients across the United States and internationally. In addition to knowledge-based assessments for leaders and team members, Edge offers 360-degree or multi-rater assessment instruments such as the EDGE360 for Leaders, and personality and general abilities instruments such as the Prevue. Edge’s training films include the best-selling “With All Due Respect: Promoting A Respectful Workplace” and “Conflict Resolution: The Skill That Makes The Difference.” About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Validity & Reliability How do we know if a test gives an accurate measurement? Test developers determine the validity and reliability of tests to make sure that the measurements they give are correct. • A test is said to be “reliable” if it gives a consistent result each time it is given. • A test is said to be “valid” if the measurement it gives is accurate. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Validity & Reliability For example If we were to test the validity and reliability of a State Trooper’s radar gun, we might have a car pass through the radar several times at exactly the same speed each time and see what measurement the radar gun gives. If, each time the car passes by, the radar consistently clocks it at 60mph, we could say the radar was reliable. If, however, the car was actually travelling only 45mph each time, then the radar would be reliable but would not be valid. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Validity & Reliability KnowlEDGE for Leaders has been built on a solid base of research regarding effective leadership behaviors. The question pool from which this instrument is built has been tested and found to be both valid and reliable. This test consistently and accurately measures your knowledge of the most effective leadership behaviors. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development The KnowlEDGE for Leaders instrument of today has a research and development history dating back more than a decade. Originally developed and released in 1987 as the Leatherman Leadership Questionnaire, this instrument came about as a result of much research, with the active participation of many leaders in the training and human resources field. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development Existing Assessment Tests Evaluated Over 400 existing supervisory assessment tests were evaluated, and none could be found that: • • • • Tested more than ten tasks Used a multiple-choice format to reduce guessing errors Was shown to be valid and reliable Exhibited a clear linkage between the leadership tasks and the test questions Clearly, a new and better test was needed for leadership assessment. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development Development Process Defined This new assessment test was developed over a five-year period using a five-step process: • • • • • A panel of industry experts was selected to oversee the process Key leadership tasks were identified Key behaviors for each task were researched Questions were written for each behavior Reliability and validity studies were completed About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development Industry Panel Selected The industry panel selected included many of the top experts in the field of training and development: • • • • • • • • Dr. Ron Zemke, Senior Editor of Training Magazine Dr. David Jamieson, Past National President of the ASTD Dr. Chip Bell, nationally-known author and consultant Dr. Michael Wriston, consultant James Kelley, Senior VP of Human Resources for a financial organization Dennis LaMountain, consultant Ashton Trice, Manager of HRD for a large electric utility Robert Kelley, VP of HRD for a food service organization About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development Key Leadership Tasks Identified Key leadership tasks were identified using a variety of sources, including: • • • • Industry studies Training product suppliers Articles and published studies Needs assessment research From these sources, an initial list of 36 leadership tasks was identified. With input from the industry panel, this list was reduced to 27 tasks by deleting and combining some tasks. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development The 27 leadership tasks originally identified included: • • • • • • • • • • • • • • Assigning Work Career Counseling Coaching Employees Oral Communication Managing Change Handling Employee Complaints Dealing with Employee Conflicts Counseling on Performance Helping an Employee Make Decisions Delegation Taking Disciplinary Action Handling Emotional Situations Setting Goals, Objectives, and Planning Handling Employee Grievances • • • • • • • • • • • • • Conducting Employee Meetings Giving Positive Feedback Negotiating Conducting Performance Appraisals Establishing Performance Standards Persuading/Influencing Employees Making Presentations to Employees Problem Solving with Employees Conducting Selection Interviews Team Building Conducting Termination Interviews Helping an Employee Manage Time One-On-One Training About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development Leadership Behaviors Researched The specific leadership behaviors that are critical to each leadership task were researched. Over 300 individual behaviors were identified. Each behavior was reviewed by the industry panel and evaluated for its importance to the task. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development Questions Written A questionnaire was created to test a participant’s knowledge of these identified leadership behaviors. Each question was content-specific, with one or more questions relating to each of the 300+ behaviors. The multiple-choice format was used to reduce guessing errors. Each question was written with one most correct answer, and three plausible but less correct responses. A total of 339 questions were selected for use in the test. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development Validity and Reliability Studies Conducted Over 300 people at nine different organizations completed the test and the results used to determine the reliability of the test. The test was determined to be very reliable, at .9657 on a scale of .0001 to .9999. Fourteen studies were then conducted with 443 people at 11 different organizations to test for validity, using various other measurements as criterion. The test consistently produced validity results in the .7000 to .9000 range, showing high validity. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Research & Development KnowlEDGE for Leaders Published in 1998 The original 339-question assessment test was used with thousands of participants for more than ten years. In 1998, an inter-item correlation study was conducted to identify those questions which had the highest correlation to total score, and to eliminate as many questions as possible without adversely affecting the validity and reliability of the test. In addition, new studies of the relative importance of the leadership tasks were conducted, leading to the elimination of several tasks rated less than “very important” and the combining of other tasks. The resulting 120-question assessment test was published in 1998. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Understanding Your Report The Scoring Report for your KnowlEDGE for Leaders assessment results has been designed to provide you with a lot of information about your assessment in an easy-to-understand format. But what might be “easy-to-understand” for one person might look complicated and confusing to another! We all have different ways of processing information. So, perhaps some explanation of the report and its format may help ensure that all participants can make the best use of the data provided. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Report Your Assessment Results Name: DOE JOHN Q Task Percentage Correct Coaching & Counseling Incorrect answers given to questions: 12, 22 Organization: The XYZ Corporation Number of Questions = 17 Questions Attempted = 17 Questions Correct = 15 Percentage Correct = 0% 25% 50% Your Percentage Correct Score Your Group’s Range of Scores and Group Ave 88.2% Your Percentage Correct Score Number of Questions = 15 Questions Attempted = 15 shows the task being The first column of the Scoring Report Communicating Effectively Questions Correct = 15 Range of Scores and Group Ave assessed and the questions for that task that Your youGroup’s answered Percentage Correct = Incorrect answers given to questions: incorrectly. The second column shows how many questions on 100.0% the test were counted as part of that task. It also show how many of those questions you attempted to answer, and how many you answered correctly. Your Percentage Correct score equals the Questions Correct divided by the Number of Questions. About This Assessment Validity & Reliability Taking Action On Your Results Understanding Your Report Report Organization: The XYZ Corporation Percentage Correct Number of Questions = 17 Questions Attempted = 17 Questions Correct = 15 Percentage Correct = 0% 25% 50% 75% Your Percentage Correct Score Your Group’s Range of Scores and Group Average Score 88.2% Number of Questions = 15 Questions Attempted = 15 Questions Correct = 15 Percentage Correct = Your Percentage Correct Score Your Group’s Range of Scores and Group Ave 100.0% Your Percentage Correct score is also represented by the bar graph in the third column. This graph lets you quickly see how your scores for the various tasks compare to each other. If you did much better on some tasks than others, the bar graph will give you an easily visible way to see this. 100% About This Assessment Validity & Reliability Taking Action On Your Results Understanding Your Report Report Organization: The XYZ Corporation Percentage Correct Number of Questions = 17 Questions Attempted = 17 Questions Correct = 15 Percentage Correct = 88.2% If you took this assessment with Number of Questions = 15 others in your organization and your Questions Attempted = 15 report was run as part of the larger Correct = group, the thirdQuestions column of your 15 Percentage Correct = report will also have a bar graph showing how your group did. 100.0% The bar graph shows the range of percentage correct scores received by your group. The Group Average Score is shown by the darker line. 0% 25% 50% 75% Your Percentage Correct Score Your Group’s Range of Scores and Group Average Score Your Percentage Correct Score Your Group’s Range of Scores and Group Ave 100% About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Report 50% 75% 100% Percentile Rank You scored as well as or better than nd Group Average Score 89.8 percent of all others taking this assessment. You scored as well as or better than nd Group Average Score 99.9 percent of all others taking this assessment. Strengths and Needs Your Percentile Rank for each task is shown in the fourth column of the report. AStrength percentile rank is a way of comparing your performance to the performance of others. On the first task of this sample report, the Percentile Rank shows Strength that this person scored as well as or better than 89.8% of all others taking this assessment. About This Assessment Validity & Reliability Understanding Your Report Report 50% 75% 100% Percentile Rank Strengths and Needs You scored as well as or better than nd Group Average Score 89.8 Strength percent of all others taking this assessment. You scored as well as or better than The fifth column of your report is titled “Strengths and Needs.” 99.9 nd Group Average Score In this column you will see the percent word of all others taking this assessment. Strength, Need, or Okay. This rating provides a quick way to compare your tasks and identify strengths you can build on and areas of need in which you can seek further improvement. Strength Taking Action On Your Results About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action Develop Your Personal Action Plan Once you’ve received this report of your assessment results, it’s time to put this information to immediate use. The first step is to develop a personalized action plan for your continued development as a leader. This action plan should include steps to build on the strengths you have identified, and to further develop areas of need. You might want to turn to your supervisors, peers, or others to help develop your action plan. Discuss this plan with others, get additional ideas and feedback, involve others in helping you to achieve your objectives. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action Task: Actions: Resources / People: Objective: The back page of your report is a form to use in creating your action plan. Use this form to write down your personal action plan for putting your results to immediate use. Milestones / Target Dates: About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action Task: Actions: Resources / People: Milestones / Target Dates: Managing Conflict Objective: Learn how to respond to employee complaints without defensiveness. The first step is to write down the task on which you want to take action. Then specify your objective for that task. What is it you want to do in regard to this task? Is this a strength on which you can build, or an area of need for further development? About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action Actions: 1. Attend class on “Handling Employee Complaints” this quarter at the training center. Next, you should plan appropriate actions, learning experiences, and exercises to further develop this area. 2. Role play with my colleague Bill, who is very good at handling complaints, to get practice in this area. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action Resources / People: 1. Training Manager 2. Learning Resource Center 3. Bill Identify other resources and people that you can turn to for assistance in developing this area. About This Assessment Validity & Reliability Understanding Your Report Taking Action Finally, set specific milestones or target dates for completion of these development activities. Milestones / Target Dates: 1. Finish training class on 24th of next month. 2. Have practice session with Bill by 27th of next month. Taking Action On Your Results About This Assessment Validity & Reliability Taking Action On Your Results Understanding Your Report Taking Action Task: Managing Conflict Objective: Learn how to respond to employee complaints without defensiveness. Actions: Resources / People: 1. Attend class on “Handling Employee Complaints” this quarter at the training center. 1. Training Manager 2. Role play with my colleague Bill, who is very good at handling complaints, to get practice in this area. 2. Learning Resource Center 3. Bill Milestones / Target Dates: 1. Finish training class on 24th of next month. 2. Have practice session with Bill by 27th of next month. Make your action plans specific, measurable, and achievable. Then begin, step by step, to accomplish your objectives. Take time to review and update your action plans on a regular basis. About This Assessment Validity & Reliability Understanding Your Report Taking Action What are some of the resources you can turn to for help in your leadership development . . . •in your organization? •in your community? •elsewhere? Taking Action On Your Results About This Assessment Validity & Reliability Understanding Your Report Taking Action Within your organization you might find: •training classes •learning resource centers •mentors •tuition reimbursement plans Taking Action On Your Results About This Assessment Validity & Reliability Understanding Your Report Taking Action Within your community you might find: •college courses •public seminars •libraries •civic organizations Taking Action On Your Results About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action Other resources available elsewhere include: •books & magazines •audio tapes •videos •internet-based resources About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action One internet resource available to you is the Online Leadership Development Center located on the web at: http://www.edgetraining.com/assessment Your assessment report will contain your username and password to access this resource center. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results Taking Action Your leadership development should continue to be an ongoing process. Assessing your current level of knowledge about leadership is just a starting point. You should work to improve your areas of need, build on your areas of strength, and always seek continuous improvement in your role as an effective leader. About This Assessment Validity & Reliability Understanding Your Report Taking Action On Your Results