1 Appendix B: Departmental Application of Criteria (DAC) Lumpkin College of Business and Applied Sciences College of Business (SBUS) – 2007 Number of online students: 26 1) Mention that student evaluations of "off-campus" classes be administered in the same spirit as for the on-campus classes 2) Mention that peer evaluations of distance learning /online courses be done in the same spirit as the on-campus courses. 3) Curriculum development and instructional software development is mentioned as positive. 4) Creating technologies for teaching/learning is considered positive, but not high priority professional activity. Teaching a TD course is mentioned and may be considered positive, but not in a notably significant manner. Family and Consumer Sciences (FCS) – 2008 Number of online students: 630 Teaching: Satisfactory: Development and/or update of a web-assisted course that includes the basic course “brochureware” made available to students, such as the course outline/schedule, syllabus, and assignment page. Teaching: Highly Effective: Provide evidence of incorporating, and/or use of, a student management tool in the face-to-face classroom, such as the student grade book, discussion boards, chat, white boards, and video conferencing. Teaching: Superior: Development of and/or teaching an online course or adding an audio component to online course notes. Innovative use of assessment techniques using technology, such as the development of an online test/quiz, survey instruments, class projects/presentations, and surveys. Development of an extensive online resource tool such as simulations, webcams, and animations. Teaching a TD course is specifically mentioned as being favorable in faculty evaluation. School of Technology (STEC) – 2008 Number of online students: 2171 Teaching/Performance of Primary Duties: A general statement about how evaluations will take into account several factors (such as class size, etc.) and it includes taking into account mode of delivery. Under Level II and Level III (which are presumably higher priority than Level I), labeled #4 in both levels “Delivers a technology-delivered course.” Teaching a TD course is specifically mentioned as being favorable in faculty evaluation. College of Arts and Humanities English (ENG) – 2008 Number of online students: 156 Under Teaching/Primary Duties and Student Evaluations: In the case of technology-delivered classes, an evaluation form will be provided to students during the final weeks of the semester, to be returned to the department secretary, who will transmit the results to testing services. Under Chair and Peer Evaluations: In the case of technology-delivered classes, tenured/tenure-track faculty will invite the chair and a tenured/tenure-track member of the department chosen by the instructor to examine the course materials, resources, and student work available online at a time of the instructor's choice. Listed as F. under Teaching: Curriculum Development (includes enhancing or developing programs, planning and proposing new courses). Good assessment of TD courses but no specific mention of incentives for TD course development. Art (ART) – 2008 Number of online students: 23 Under Teaching/Primary Duties and Peer Evaluations, there is the statement typical to many DACs: “Reference to both the technological and pedagogical aspects of distance learning shall be made for 2 distance learning assignments when observed as a required peer evaluation.” Under Student Evaluations, “Items which refer to both the technological and pedagogical aspects of distance learning shall be included on student evaluations for distance learning courses.” No evidence any incentives for TD course development. Theater Arts (THA) – 2008 Number of online students: 3 This department DAC has a whole section (equivalent to whole sections on Teaching, Research, and Service), labeled Distance Learning: Documentation of Materials and Evaluation Criteria. This section is quite thorough and appears well thought through. Although the evaluation of TD courses is given impressive thought, there does not appear to be any real incentives to teach TD courses. History (HIS) – 2008 Number of online students: 199 Under Teaching/Primary Duties: Observations of distance education (online delivery) will reference both technological and pedagogical aspects. Under Student Evaluations: Evaluations of distance education must include both technological and pedagogical aspects as an area of evaluation and be consistent with University (include Approved University Core items) and DAC specifications. Instructors of technology delivered courses may wish to use the secure confidential online student course evaluation option available from the Office of Assessment and Testing that is equivalent to the traditional paper bubble forms. Some effort to address evaluation of TD courses, but no mention of specific incentives. Journalism (JOU) – 2008 Number of online students: 398 Under Teaching/Primary Duties, “Incorporation and use of new and evolving technologies” listed 6th out of 8 items for materials and activities for evaluation of teaching. Could not find any evidence of TD course evaluations or encouragement of TD course development. No hits on word searches on “technology”, “distance”, “web”, “online. Music (MUS) – 2008 Number of online students: 244 Under Teaching/Primary Duties, under items considered for “superior” ranking, item k is “Participating in curriculum revision and development including activities such as proposing a course that is approved by the Music Department and College of Arts and Humanities curriculum committees.” Under Student Evaluations: “Participating in curriculum revision and development including activities such as proposing a course that is approved by the Music Department and College of Arts and Humanities curriculum committees.” Under Peer Evaluations: “Peer evaluations for distance learning courses will address technological and pedagogical aspects of the course.” No evidence of any incentives given for developing TD courses. Communication Studies (CMN) – 2008 Number of online students: 255 Under Categories of Material and Methods of Evaluation, it basically lays out that an online course should be evaluated as equivalent to a face-to-face course with regards to what materials and methods will be used to evaluate the faculty member. There is some mention of development of curriculum as being part of the material considered for teaching evaluation. However, no evidence of web-based learning being encouraged or rewarded in any special way. Philosophy (PHI) – 2008 Number of online students: 311 3 Under Teaching/Performance of Primary Duties, item A (Peer Evaluations): “Reference to both the technical and pedagogical aspects of distance learning shall be made for distance learning assignments reviewed by peers.” Under item B (Student Evaluations): “Course evaluations equivalent to the traditional paper form will be used in technology-delivered courses.” and “Items which refer to both the technological and pedagogical aspects of distance learning shall be included on student evaluations for distance learning courses.” There is a general statement under item E about “Program Development”: “The candidate may submit to the DPC any material relevant to program development involving the philosophy department. This may include course proposals, CAHCC or CAA minutes or other relevant materials.” Some mention of dealing with evaluation of online courses, but no particular incentives evident. College of Sciences Psychology (PSY) – 2008 Number of online students: 895 "In each of the areas of review (teaching/primary duties; research; service) the activities specifically listed shall be regarded as of primary importance…" Under teaching/primary duties, there is a statement about student evaluations that faculty use must, for distance learning courses, include items that refer to both the technological and pedagogical aspects of distance learning. Under peer review of teaching: "Reference to both the technological and pedagogical aspects of distance learning shall be made for distance learning assignments reviewed by peers". Faculty may "documentation of innovative teaching methods and materials..." Under Part C, which is described as being of the lowest priority, "Attendance at workshops and conferences pertaining to professional development in teaching." and "Application of technology in the teaching and learning process". No particular incentives here for development of TD courses. Political Science (PLS) – 2008 Number of online students: 656 Could not find any reference to the words “technology”, “distance”, or “online” or “online”. Casual review of the DAC did not find any references to TD courses. Sociology (SOC) – 2008 Number of online students: 710 “In assessing teaching effectiveness… Reference to both the technical and pedagogical aspects of distance learning shall be made for distance learning assignments reviewed by the chair and a tenured faculty member of the department.” Under Teaching/Performance of Primary Duties: Category of Materials: Items listed in order of importance. “Development of technology-delivered instruction (web courses).” is listed as item f. (6th) out of 9 items. Under Evaluation section: “Any faculty member who develops and teaches a web-based course is expected to provide summary documentation of work to develop those courses. Electronic delivery of student evaluation instrument is accommodated by Testing and Assessment, and all faculty teaching online courses will avail themselves of this opportunity. Web Course instructors will provide a tenured faculty member of the department and chair with their course syllabus and examples of their tests as well as electronic access to the course so that at least one class/lesson may be visited electronically to evaluate the class.” Development of web-based courses mentioned for evaluation purposes, but not given any unusual priority or incentives. Evaluation of web course quality is addressed. Geology-Geography (GEL/GEG) – 2008 Number of online students: 357 (all under GEL) Under Supporting Materials for Teaching/Primary Duties: a list (which DAC states is in decreasing order of importance) consisting of items a through n lists “c. development and implementation of unique programs d. new course development e. curriculum development material.” Under Peer Evaluations of teaching: “In the case of online technology delivered courses, faculty must provide the DPC and 4 department chair access to web-sites and course materials.” For collecting evaluations from students: “Technology delivered (i.e. online) courses will be evaluated using the Purdue evaluation form or an equivalent university instrument. The forms, along with a self-addressed postage paid envelope will be mailed to students by the department secretary. This process will remain in effect until online course evaluation procedures are developed and implemented. Faculty teaching technology delivered courses shall include instructor selected items relevant to both the technological and pedagogical aspects of their courses.” No particular incentives mentioned for development of online courses (except the fairly high priority given to a generic mention of new course or curriculum development). Physics (PHY) – 2008 Number of online students: 363 Under Methods of Collecting Documentation: A. Student Evaluations: “Student evaluations in technology-delivered courses shall be considered relative to the level of technological support/ reliability and performance quality of the hardware and software used, and in the context of general student response to distance education versus face-to-face classroom instruction.” B. Physics Department Faculty and Chair Teaching Evaluation Report: “Evaluators shall refer to both the technological and pedagogical aspects of distance learning for distance learning assignments.” “In the case of technology-delivered courses, that is, a course in which face-to-face interaction is not the predominant mode of instruction, the classroom visit may be replaced by observation of course activities using the course web site (or whatever mode of delivery is used), such as discussion groups, chat rooms, and posted materials.” Under Categories of Teaching Documentation, developing a new course is listed as item b. in Type I activities and enhancing technology use is listed as item f. in Type 2 activities. Development of new courses given a fairly high priority, but no emphasis on web-based courses. Fairly careful consideration of evaluation of technology-delivered courses. Nursing (NUR) – 2008 Number of online students: 226 Under Teaching I Performance of Primary Duties and I. Categories of Materials and Activities for Evaluation of Teaching / Performance of Primary Duties: Development of new courses is listed as #3 out of 15 items in category B, the lower priority category. Under Methods of Evaluation of Teaching…, subsection 4. there is mention of submitting materials for distance/online/electronic materials for evaluation and “Narrative description of methodologies utilized (active learning, technology)”. Development of website materials is listed as item #10 in section A. under evaluation of Research/Creative Activity. No evidence of any particular incentives for online course development. Biological Sciences (BIO) – 2008 Number of online students: 576 Under Teaching/Performance of Primary Duties, Categories of Materials and Activities: Item c is “Course/curriculum development, e.g., new study abroad or on-campus courses developed & implemented, development of new technology for use in instruction” and item g is “Course/curriculum improvement, (e.g, new laboratory exercises developed, incorporation of new technology into instruction)”. There is also the (common) inclusion of a statement about considerations for student evaluations of distance-education courses. The student evaluation form does include a question asking students if the instructor is available “electronically” for distance-education classes and the department does require an extra question on the student evaluation form for distance-education classes: “11. Please evaluate the technology (server access, interacting with other students, etc.) used to deliver your technology-delivered course section.” 5 There appears to be a slightly better emphasis on curriculum development than in other DACs, but still no particular incentives here for development of TD courses. There also appears to be at least a marginally more deliberate attempt to evaluate the quality of any TD courses. Communication Disorders and Sciences (CDS) – 2008 Number of online students: 16 Under Teaching/Performance of Primary Duties, Level 2 (for highly effective rating), item c is “Highly effective use of technology and innovative teaching techniqes which enhance the learning process.” item f is “Curriculum revision, curriculum development, or development of teaching assignments.” Level 3 (superior) has a similar item c “Superior use of technology and innovative teaching techniques which enhance the learning process.” but no analog to item f from Level 2. Under Student Evaluation Procedures, there is a typical statement about distance learning evaluations: “In evaluating distance learning courses, both technological and pedagogical aspects shall be included in student evaluations.” This same statement is used in the Chair and tenured faculty evaluation of tenure-track faculty and Unit B faculty. Another statement regarding evaluations: “It should be recognized that teaching evaluations might be affected by the rigor of a course or technological issues in distance learning courses. In applying these guidelines, evaluators should, therefore, recognize that new course preparation, teaching methods/traits and technological difficulties may affect evaluations.” There is some encouragement for curriculum development and use of technology in the teaching section. No direct references to incentives for online course development. Careful placement of statements about considering distance learning challenges in evaluating faculty. Economics (ECN) – 2008 Number of online students: 71 Under Teaching/Performance of Primary Duties, Categories of Materials and Activities, Student Evaluations, is a typical statement about taking into account special circumstances for student evaluations of distance learning: “Items which refer to both the technological and pedagogical aspects of distance learning shall be included in student course evaluations for distance learning courses.” In the same area of the DAC, under Other Documentation, there is “The faculty member may submit other materials in support of teaching effectiveness such as samples of course syllabi, examinations and class materials, teaching awards or recognition and contributions to the development or revision of curriculum. Such material is particularly encouraged in so far as it pertains to i)Application of technology in the teaching and learning process; ii)Participation on an interdisciplinary, interdepartmental and/or intercollegiate basis; iii)Participation in instructional and/or outreach activities including student engagement and mentoring, recruitment, or off-campus instruction.” In the same area of the DAC (teaching) and Methods of Evaluation is “In assessing teaching effectiveness, evaluators shall consider such factors as 1) the size of the class; 2) the level of the class (lower division, upper division, graduate); 3) required or elective status; 4) whether the students are primarily majors in economics, business, or some other discipline; 5) innovative technique and course development; and 6) application of technology in the teaching and learning process. Reference to both the technological and pedagogical aspects of distance learning shall be made for distance learning assignments reviewed by peers and the chair.” There is some effort to encourage innovative use of technology and engagement of off-campus students. No extraordinary emphasis on TD course development, but a slightly more noticeable effort than in “typical” DACs. College of Education and Professional Studies Educational Administration (EDA) or Educational Leadership – 2008 Number of online students: 35 Under “Classroom Visitations” under peer evaluation of teaching: “The technological and pedagogical aspects of distance learning shall be considered for distance learning assignments.” Under “student 6 evaluations”: “Items which refer to both technological and pedagogical aspects of distance learning shall be included on student evaluations for distance learning courses.” Under “course materials”: “For distance education, assignments and assessments are to be specified in course syllabi.” and “Distance education materials (such as assignments, assessments, and web sites) will be available to the DPC for review.” Some care taken in evaluating faculty that are teaching distance education courses, but no particular incentives here for development of TD courses. Health Studies (HST) – 2008 Number of online students: 199 Under Teaching/Primary Duties and Categories of Materials and Activities – Group B (Highly Effective, h): Application of technology in the teaching and learning process. Group C – Superior: k) New course development, modifying existing courses or developing technology delivered courses ) Innovative use of assessment techniques using technology, such as the development of an online test/quiz, survey instruments, class projects/presentations, and surveys. Under Methods of Evaluation: 3. Student evaluations for Technology-Delivered Courses must be submitted using the University approved online Technology-Delivered Course Evaluation. Specific mention of development of TD courses under the “Superior” category, although not given a higher priority than other listed items. Secondary Education (SED) – 2008 Number of online students: 653 Under Teaching/Primary Duties and Categories of Materials and Activities Materials Part D: Services Provided to Support Teaching “integration of technology in the Classroom (including distance learning)”. Under Methods of Assessment: “Peers will evaluate distance learning courses based on both technological and pedagogical criteria.” Under Student Evaluations: “For distance learning courses, additional items must refer to both pedagogical and technological aspects of distance learning.” Under “Other Professional Service” : “participation in service or technology projects.” Some care taken in evaluating faculty that are teaching distance education courses, but no particular incentives here for development of TD courses. Kinesiology and Sports Studies (KSS) – 2008 Number of online students: 142 (KSS) + 109 (PED) = 251 Under Teaching/Performance of Primary Duties – Peer Evaluation: “In the case of technology delivered courses, that is, a course in which face-to-face interaction is not the predominant mode of instruction, the classroom visit may be replaced by observation of course activities using the course web site (or whatever mode of delivery is used), such as discussion groups, chat rooms and posted materials.” Under Teaching/Performance of Primary Duties – Additional Documentation: “Use of technology and innovative teaching techniques which enhance the learning process.” and “Course and curriculum development or revision.” Appears to be at least moderately more encouraging of technology-based course development than most other DACs Counseling and Student Development (CSD) – 2008 Number of online students: 114 Under Teaching/Performance of Primary Duties, Documentation, Supporting Evidence of Teaching Effectiveness…: Item 5 (out of 11 items) is “Exceptional use of technology integrated into teaching/primary duties (e.g., web enhanced course design, resources for learning, etc.).” Item 8 is “New course development and implementation.” No evidence of any incentives for TD course development.