Coordinator, On-Line Assessment

advertisement
Item 2.D-April 12, 2013
ADMINISTRATIVE FACULTY POSITION DESCRIPTION QUESTIONNAIRE
To expedite and facilitate the PDQ review process, please send the PDQ and Org Chart electronically to
marshag@unr.edu for discussion and for initial review before routing PDQ for approval signatures.
Questions - call UNR Faculty HR at 682-6114
INSTRUCTIONS: See http://www.unr.edu/hr/compensation-and-evaluation for complete instructions.
Incumbent(s) Name (if applicable):
Position #(s):
Current Title:
Current Range:
(JCC: )
Department: Office of Medical Education
College/Division: Vice President, Health
Sciences / Dean, UNSOM
Account #(s): 1108-119-2501
Action Proposed: (check all that apply)
2
(X) New position: Proposed Range:
Proposed Title: Coordinator, On-line Assessments
( ) Title Change, Proposed Title:
( ) Proposed Reassignment from Range
to Range
( ) Revised PDQ only (no change in range or title)
( ) Line of Progression (show titles below)
Range:
JCC (Current
or new HR
assigned):
I certify that the statements in this description are accurate and complete to the best of my knowledge.
____________________________________________________________
Employee’s Signature
__________________
Date
I/we have reviewed the statements in this form and they accurately reflect the job assignments.
_______________________________/_____________________________
__________________
Gwen Shonkwiler, Dir, Eval and Assess / Timothy Baker, Assoc Dean, Med Educ
Date
Immediate Supervisor’s Signature
______________________________/______________________________
__________________
Melissa Piasecki, Sr Assoc Dean, Acad Affrs / Thomas Schwenk, VP, HS/Dean, UNSOM Date
Director/Chair/Dean
Approved for Salary Placement Committee review.
____________________________________________________________
__________________
Pres / Vice Pres / Vice Prov Signature Jannet Vreeland
Date
Vice Provost and Secretary of University
Action Approved by the Provost/President (Completed by Faculty HR):
67372 Range:
2
Pos #(s):
JCC:
EEO: 3A
Eff: 4/1/2013
Coordinator,
On-line
Assessments
Approved Title:
Employee signs on “final” stamped approved PDQ and sends to HR for personnel file.
Employee Signature:_______________________________________________ __________________
Date
Printed Name: ____________________________________________________
Rev: 10/1/2012
Position Description – Coordinator, On-Line Assessments (OME)
Page 2
1. Summary Statement: State the major function(s) of the position and its role in the
university. Attach an organizational chart with positions, ranges, and names for the division
which reflects the position in it as well as those supervised in the department. (This section is
used for advertisement of the position.)
The Coordinator, On-line Assessments, provides design and measurement expertise to ensure the
quality of program-level assessment of student learning. The individual works closely with faculty to
develop effective assessment initiatives that will yield results applicable to the improvement of student
learning. The Coordinator is expected to develop on-going relationships with faculty that support a
culture of faculty-driven assessment. The position reports to the Director, Evaluation and Assessment
in the Office of Medical Education.
2. List the major responsibilities, including percentage of time devoted to each. Provide
enough detail to enable a person outside the department to understand the job (percentage
first with heading and then bulleted information).
60% - Exam Administration
 Work with faculty to ensure the integrity and accuracy of on-line assessment creation and data
analysis using standard/commonly accepted reliability and validity assurance practices
appropriate for either quantitative or qualitative data
 Plan and implement faculty development opportunities regarding use of the ExamSoft program
as the on-line resource for exam item banking and exam creation, exam measurement issues
and the creation of assessment reports
 Assist with the implementation of technological solutions for automating faculty efforts to
collect and analyze assessment data
20% - Data Analysis
 Assist the Director with analysis of student and program related data for the purpose of
providing information related to student and program achievement to evaluate program
effectiveness and to provide data needed for institutional reporting
 Collaborate with faculty on the development of quantitative assessments such as consulting in
the development of test blueprints; administering the process of on-line exam creation and
implementation; and, assisting with interpretation of exam item analysis
 Participate in meetings, workshops and/or trainings for the purpose of conveying and/or
gathering information
 Perform other related duties for the purpose of ensuring the efficient and effective functioning
of UNSOM continuing and undergraduate medical education programs
20% - Oversight of NBME Web-Based Exam Proctoring Procedures and Implementation
 In collaboration with the UNSOM National Board of Medical Examiners (NBME) Chief Proctor,
train and schedule exam proctors for all high stakes on-line exams and NBME web-based
exams
 Coordinate administration of NBME web-based subject exams for medical students and serve
as the Technical Support Coordinator on the Reno campus
 Work collaboratively to help train and support the Las Vegas Technical Support Coordinator
for NBME web-based subject exams for third year students
Position Description – Coordinator, On-Line Assessments (OME)
Page 3
3. Describe the level of freedom to take action and make decisions with or without
supervision and how the results of the work performed impact the department, division and/or
the university as a whole.
Level of Freedom:
The incumbent must take initiative and complete measurement/assessment projects independently,
creatively, and efficiently with little direct supervision. The position must collaborate with the Director
and academic faculty on exam creation and implementation and must ensure security, accuracy and
consistency in testing and scoring of on-line documents. The Coordinator consults with the supervisor
on overall program needs and long-term goals for the department.
Impact:
Implementing effective measurement techniques/outcomes assessment to evaluate medical student
learning plays a significant role in achieving the mission of UNSOM. Validity, reliability, relevance, and
credibility of assessment methods are essential elements of fulfilling the UNSOM goals and
objectives. The assessment process must also be carefully administered to ensure the steady
improvement of student learning experiences. Failure to perform the functions of the position will
negatively affect UNSOM’s mission, effectiveness, accountability, and accreditation.
4. Describe the knowledge, skills (to include cognitive requirement and verbal and written
communication), and abilities (to include task complexity, problem solving, creativity and
innovation) essential to successful performance of this job (in bullet format).
Knowledge of:
 Assessment processes, student learning outcomes, and accountability issues
 Quantitative and qualitative assessment research design and measurement techniques,
including sampling procedures and issues of reliability and validity
 NBMC testing and LCME medical school accreditation information and processes
 Federal law as related to position, i.e., Family Educational Rights and Privacy Act (FERPA)
 Medical terminology
Skills:





Data management (data gathering or storage) or assessment software
Analytical, decision-making, and problem-solving skills
Excellent verbal and written communication
Excellent interpersonal and human relations skills
Proficiency in use of a personal computer and current software applications including but not
limited to Microsoft Office Suite (Word, Access, Excel, PowerPoint, and email)
Ability to:
 Interact effectively and professionally with faculty, staff and medical students
 Assist faculty in meaningful related assessment of curricular and pedagogical needs
 Exercise good judgment in safeguarding confidential or sensitive information
 Be sensitive to gender, disabilities, and cultural and ethnic diversity issues
 Maintain professional business and work ethics and standards
 Stay current in discipline by seeking out and learning new information pertinent to performance
of duties
Position Description – Coordinator, On-Line Assessments (OME)
Page 4
5. Describe the type of personal contacts encountered in performing the duties of the job.
Explain the nature and purpose of these contacts: i.e., to provide services, to resolve
problems, to negotiate.
Internal
Years 1 and 2 Block Directors
Year 3 Clerkship Administrators
Office of Medical Education
classified staff
Director, Evaluation and
Assessment
UNSOM IT Administrators
External
ExamSoft account
representative and technical
support personnel
NBME web-based technical
support personnel
Reason for Contact
To create and implement exams
To schedule administration and implementation of web-based
NBME subject exams
To train and supervise as exam proctors for all block level exams
To assist with analysis of student learning outcomes based on
academic performance
To collaborate on any administration issues related to Information
Technology (IT)
Reason for Contact
To communicate with ExamSoft vendor on issues related to
administration of on-line exams
To communicate and discuss issues related to administration of
web-based subject exams
6. Indicate the minimum qualifications which are necessary in filling this position should it
become vacant. Please keep in mind the duties/responsibilities of the position rather than the
qualifications of the incumbent.
a.
Minimum educational level, including appropriate field, if any.
Bachelor’s Degree from a regionally accredited institution
b.
Minimum type and amount of work experience, in addition to the above required
education necessary for a person entering this position.
Bachelor’s Degree and two years, or a Master’s Degree and one year, of experience in
education assessment and designing, administering, and analyzing on-line assessment
instruments (e.g., rubrics, test blueprints, and surveys)
Preferred Licenses or Certifications: None
c.
Indicate any license or certificate required for this position.
None
Download