Item 2.D-April 12, 2013 ADMINISTRATIVE FACULTY POSITION DESCRIPTION QUESTIONNAIRE To expedite and facilitate the PDQ review process, please send the PDQ and Org Chart electronically to marshag@unr.edu for discussion and for initial review before routing PDQ for approval signatures. Questions - call UNR Faculty HR at 682-6114 INSTRUCTIONS: See http://www.unr.edu/hr/compensation-and-evaluation for complete instructions. Incumbent(s) Name (if applicable): Position #(s): Current Title: Current Range: (JCC: ) Department: Office of Medical Education College/Division: Vice President, Health Sciences / Dean, UNSOM Account #(s): 1108-119-2501 Action Proposed: (check all that apply) 2 (X) New position: Proposed Range: Proposed Title: Coordinator, On-line Assessments ( ) Title Change, Proposed Title: ( ) Proposed Reassignment from Range to Range ( ) Revised PDQ only (no change in range or title) ( ) Line of Progression (show titles below) Range: JCC (Current or new HR assigned): I certify that the statements in this description are accurate and complete to the best of my knowledge. ____________________________________________________________ Employee’s Signature __________________ Date I/we have reviewed the statements in this form and they accurately reflect the job assignments. _______________________________/_____________________________ __________________ Gwen Shonkwiler, Dir, Eval and Assess / Timothy Baker, Assoc Dean, Med Educ Date Immediate Supervisor’s Signature ______________________________/______________________________ __________________ Melissa Piasecki, Sr Assoc Dean, Acad Affrs / Thomas Schwenk, VP, HS/Dean, UNSOM Date Director/Chair/Dean Approved for Salary Placement Committee review. ____________________________________________________________ __________________ Pres / Vice Pres / Vice Prov Signature Jannet Vreeland Date Vice Provost and Secretary of University Action Approved by the Provost/President (Completed by Faculty HR): 67372 Range: 2 Pos #(s): JCC: EEO: 3A Eff: 4/1/2013 Coordinator, On-line Assessments Approved Title: Employee signs on “final” stamped approved PDQ and sends to HR for personnel file. Employee Signature:_______________________________________________ __________________ Date Printed Name: ____________________________________________________ Rev: 10/1/2012 Position Description – Coordinator, On-Line Assessments (OME) Page 2 1. Summary Statement: State the major function(s) of the position and its role in the university. Attach an organizational chart with positions, ranges, and names for the division which reflects the position in it as well as those supervised in the department. (This section is used for advertisement of the position.) The Coordinator, On-line Assessments, provides design and measurement expertise to ensure the quality of program-level assessment of student learning. The individual works closely with faculty to develop effective assessment initiatives that will yield results applicable to the improvement of student learning. The Coordinator is expected to develop on-going relationships with faculty that support a culture of faculty-driven assessment. The position reports to the Director, Evaluation and Assessment in the Office of Medical Education. 2. List the major responsibilities, including percentage of time devoted to each. Provide enough detail to enable a person outside the department to understand the job (percentage first with heading and then bulleted information). 60% - Exam Administration Work with faculty to ensure the integrity and accuracy of on-line assessment creation and data analysis using standard/commonly accepted reliability and validity assurance practices appropriate for either quantitative or qualitative data Plan and implement faculty development opportunities regarding use of the ExamSoft program as the on-line resource for exam item banking and exam creation, exam measurement issues and the creation of assessment reports Assist with the implementation of technological solutions for automating faculty efforts to collect and analyze assessment data 20% - Data Analysis Assist the Director with analysis of student and program related data for the purpose of providing information related to student and program achievement to evaluate program effectiveness and to provide data needed for institutional reporting Collaborate with faculty on the development of quantitative assessments such as consulting in the development of test blueprints; administering the process of on-line exam creation and implementation; and, assisting with interpretation of exam item analysis Participate in meetings, workshops and/or trainings for the purpose of conveying and/or gathering information Perform other related duties for the purpose of ensuring the efficient and effective functioning of UNSOM continuing and undergraduate medical education programs 20% - Oversight of NBME Web-Based Exam Proctoring Procedures and Implementation In collaboration with the UNSOM National Board of Medical Examiners (NBME) Chief Proctor, train and schedule exam proctors for all high stakes on-line exams and NBME web-based exams Coordinate administration of NBME web-based subject exams for medical students and serve as the Technical Support Coordinator on the Reno campus Work collaboratively to help train and support the Las Vegas Technical Support Coordinator for NBME web-based subject exams for third year students Position Description – Coordinator, On-Line Assessments (OME) Page 3 3. Describe the level of freedom to take action and make decisions with or without supervision and how the results of the work performed impact the department, division and/or the university as a whole. Level of Freedom: The incumbent must take initiative and complete measurement/assessment projects independently, creatively, and efficiently with little direct supervision. The position must collaborate with the Director and academic faculty on exam creation and implementation and must ensure security, accuracy and consistency in testing and scoring of on-line documents. The Coordinator consults with the supervisor on overall program needs and long-term goals for the department. Impact: Implementing effective measurement techniques/outcomes assessment to evaluate medical student learning plays a significant role in achieving the mission of UNSOM. Validity, reliability, relevance, and credibility of assessment methods are essential elements of fulfilling the UNSOM goals and objectives. The assessment process must also be carefully administered to ensure the steady improvement of student learning experiences. Failure to perform the functions of the position will negatively affect UNSOM’s mission, effectiveness, accountability, and accreditation. 4. Describe the knowledge, skills (to include cognitive requirement and verbal and written communication), and abilities (to include task complexity, problem solving, creativity and innovation) essential to successful performance of this job (in bullet format). Knowledge of: Assessment processes, student learning outcomes, and accountability issues Quantitative and qualitative assessment research design and measurement techniques, including sampling procedures and issues of reliability and validity NBMC testing and LCME medical school accreditation information and processes Federal law as related to position, i.e., Family Educational Rights and Privacy Act (FERPA) Medical terminology Skills: Data management (data gathering or storage) or assessment software Analytical, decision-making, and problem-solving skills Excellent verbal and written communication Excellent interpersonal and human relations skills Proficiency in use of a personal computer and current software applications including but not limited to Microsoft Office Suite (Word, Access, Excel, PowerPoint, and email) Ability to: Interact effectively and professionally with faculty, staff and medical students Assist faculty in meaningful related assessment of curricular and pedagogical needs Exercise good judgment in safeguarding confidential or sensitive information Be sensitive to gender, disabilities, and cultural and ethnic diversity issues Maintain professional business and work ethics and standards Stay current in discipline by seeking out and learning new information pertinent to performance of duties Position Description – Coordinator, On-Line Assessments (OME) Page 4 5. Describe the type of personal contacts encountered in performing the duties of the job. Explain the nature and purpose of these contacts: i.e., to provide services, to resolve problems, to negotiate. Internal Years 1 and 2 Block Directors Year 3 Clerkship Administrators Office of Medical Education classified staff Director, Evaluation and Assessment UNSOM IT Administrators External ExamSoft account representative and technical support personnel NBME web-based technical support personnel Reason for Contact To create and implement exams To schedule administration and implementation of web-based NBME subject exams To train and supervise as exam proctors for all block level exams To assist with analysis of student learning outcomes based on academic performance To collaborate on any administration issues related to Information Technology (IT) Reason for Contact To communicate with ExamSoft vendor on issues related to administration of on-line exams To communicate and discuss issues related to administration of web-based subject exams 6. Indicate the minimum qualifications which are necessary in filling this position should it become vacant. Please keep in mind the duties/responsibilities of the position rather than the qualifications of the incumbent. a. Minimum educational level, including appropriate field, if any. Bachelor’s Degree from a regionally accredited institution b. Minimum type and amount of work experience, in addition to the above required education necessary for a person entering this position. Bachelor’s Degree and two years, or a Master’s Degree and one year, of experience in education assessment and designing, administering, and analyzing on-line assessment instruments (e.g., rubrics, test blueprints, and surveys) Preferred Licenses or Certifications: None c. Indicate any license or certificate required for this position. None