AMERICAN UNIVERSITY OF BEIRUT CENTER FOR TEACHING & LEARNING NEEDS ASSESSMENT SURVEY RESULTS, 2013-2014 A needs assessment survey was administered electronically to all AUB full time faculty members during the spring semester 2013-2014; this is the second round of collecting data in a needs assessment survey from AUB full time faculty members. The survey consisted of four sections. The first section requested the name (optional), position, faculty, and department of the respondents. The second section targeted general professional needs and the possible methods of delivery. For example respondents were asked to rank professional development topics such as classroom management, assessment, planning for teaching, teaching methods, and technology. The second section targeted ranking specific professional needs within the general needs themes. For example, respondents were asked to rank the following possible needs within “assessment”: 1) Developing traditional assessments (multiple choice items, matching items, essay items, …), 2) Developing alternative assessments (authentic, performance, portfolio, rubrics), 3) Interpreting assessment data, 4) Improving test taking performance, 5) Identifying educational difficulties, 6) other activities. The third section of the survey requested information about preferred modes of presentation such as face-to-face single workshops, face-to-face workshop series, speaker series, peer mentoring, action research, and faculty learning communities, brown bag sessions, and individual consultation. In addition, this section requested information about the preferred duration of professional development activities and the preferred time during the week when these activities should be presented. Appendix A presents a copy of the survey. Ninety one faculty members responded to the survey; however, 65 of the respondents answered all the survey questions. Respondents came from all faculties and schools with the largest number from the Faculty of Arts and Sciences and from the rank of assistant professor. Figure 1 presents the percentage of professors from different ranks and different faculties who responded to the survey: 1 Figure 1. Percentage of professors from different ranks and different faculties who responded to the survey. Rank Faculty Results Results of the survey are presented below. These results are presented in the same order that the questions appeared in the survey. Faculty members were requested to respond to the items of the survey using a 5-point scale with 1 being the least important and 5 being the most important. General Professional Needs The section of the survey on general professional needs included two items. The first items asked faculty members to rank professional development activities while the second asked them to identify the preferred mode of presentation. Most Important Professional Development Topics Results showed that 75.4% of faculty members ranked teaching methods as important or most important followed by 73.5% who ranked active learning as important or most important and 69.6% who ranked technology as important or most important. The topic that ranked last was academic advising which was ranked important or most important by 36.2% of the respondents (Figure 2). 2 Figure 2. Percentage ranking of professional development topics. 1 2 3 4 Least Important 5 Most Important Classroom Management 7.2 7.2 23.2 27.5 34.8 Assessment 29.0 7.2 21.7 13.0 29.0 Planning for Teaching 15.9 13.0 24.6 14.5 31.9 Teaching Methods 7.2 5.8 11.6 31.9 43.5 Technology 7.2 4.3 18.8 37.7 31.9 Active Learning 10.1 2.9 13.0 17.0 56.5 Liberal Arts Education 20.3 20.3 15.9 17.4 26.1 Academic Advising 31.9 11.6 20.3 17.4 18.8 Specific Professional Needs The section on specific professional needs asked faculty members to identify specific professional development activities under the larger topics of assessment, classroom management, instructional planning, and instructional methods. Assessment Figure 3 shows that 78.2% of respondents thought that identifying educational difficulties was important or most important. This was followed by developing traditional assessments (69.6%). However, 53.6% of the respondents thought that interpreting assessment data was important or most important, followed by those who selected improving students' test taking performance (47.8%), and 37.7% who selected developing alternative assessments. Figure 3. Percentage ranking of assessment activities. 1 Least Important 36.2 8.7 17.4 20.3 5 Most Important 17.4 Developing traditional assessments (multiple choice items, True-False, essay) 10.1 4.3 15.9 34.8 34.8 Interpreting assessment data 10.1 11.6 24.6 27.5 26.1 Improving students’ test-taking performance 20.3 18.8 13.0 24.6 23.2 Identifying educational difficulties 8.7 4.3 39.1 Developing alternative assessments (checklists, portfolios, rubrics, short write-ups) 3 2 3 8.7 4 39.1 Classroom Management Figure 4 shows that 82.6% of respondents thought that techniques to enhance student motivation were important or most important while 69.9% thought that creating an effective learning environment was important or most important followed by 68.1% who identified succeeding with difficult and challenging students as important or most important. Finally, defining rules and teaching appropriate behavior was identified by 42% as important or most important. Figure 4. Percentage ranking of classroom management activities. 1 2 3 4 5 Least Most Important Important 24.6 10.1 18.8 24.6 17.4 Defining rules and teaching appropriate behavior Creating effective learning environments 4.3 8.7 14.5 15.9 52.2 Techniques to enhance student motivation 1.4 2.9 8.7 30.4 52.2 Succeeding with difficult and challenging students 7.2 10.1 10.1 24.6 43.5 Instructional Planning Figure 5 shows that 65.2% and 60.9% of the respondents respectively ranked writing program learning outcomes and selecting instructional activities as important or most important. Furthermore, 44.9% thought that writing course learning outcomes was important or most important, while 42.0% thought that preparing course syllabi and identifying assessment methods were important or most important. Figure 5. Percentage ranking of instructional planning activities. 1 2 Least Important 21.7 13.0 Preparing course syllabi 3 4 18.8 5 Most Important 17.4 24.6 Writing course learning outcomes 17.4 11.6 21.7 27.5 17.4 Writing program learning outcomes 8.7 5.8 15.9 33.3 31.9 Selecting instructional activities 2.9 5.8 26.1 31.9 29.0 Identifying assessment methods 15.9 8.7 29.0 26.1 15.9 4 Instructional Methods Figure 6 shows that teaching critical thinking and higher order thinking was ranked as important or most important by more than 85.5% or the respondents. Alternatively, between 62.0% and 66.3% only 66.6% of the respondents thought that research-based instructional methods, student-centered classes in higher education, inquiry based learning, interdisciplinary curriculum, and project-based learning were important or most important. Furthermore, between 50.7% and 59.4% of the respondents thought that team-based learning, community-based learning, technology-based learning, flipped classes, interdisciplinary curriculum, project-based learning, and case-based learning, were important or most important, while between 43.4% and 49.3% thought that Teacher centered approaches (interactive lectures), cooperative learning, and flipped classes were important or most important. Figure 6. Percentage ranking of instructional methods 1 Least Important 8.7 3 4 8.7 5 Most Important 13.0 36.2 29.0 Teaching critical thinking and higher order thinking skills 5.8 1.4 2.9 26.1 59.4 Student-centered classes in Higher Education 7.2 5.8 20.3 36.2 26.1 Teacher centered approaches (interactive lectures) 8.7 8.7 29.0 33.3 15.9 Cooperative learning 10.1 11.6 24.6 26.1 23.2 Inquiry-based learning 7.2 7.2 18.8 33.3 29.0 Team-based learning 8.7 8.7 18.8 33.3 26.1 Community-based learning 13.0 13.0 18.8 27.5 23.2 Technology-based learning 8.7 4.3 30.4 29.0 23.2 Flipped classes 14.5 7.2 30.4 24.6 18.8 Interdisciplinary curriculum 5.8 2.9 23.2 37.7 26.1 Project-based learning 4.3 7.2 17.4 39.1 27.5 Case-based learning 5.8 5.8 26.1 33.3 24.6 Research-based instructional methods 5 2 Logistics Mode of Presentation of Professional Development Activities Faculty members were asked to rank a list of items under mode of presentation of professional development activities. Results presented in Figure 7 show that 52.2% thought that individual consultations were important or most important. This was followed by speaker series (49.3%), self-directed learning (42.0%), and faculty learning communities (42%). Finally, between 29.0% and 39.1% thought that face-to-face single workshops, face-to-face workshop series, peer mentoring , conference presentations, forums, study groups, action research, examining student work, , peer observation, , online workshops, and brown bag sessions were important or most important. Figure 7. Percentage ranking of mode of presentation of Professional Development Activities 1 2 3 4 5 Least Most Important Important Speaker series 13.0 13.0 17.4 26.1 23.2 Face-to-Face Single workshops 13 15.9 26.1 18.8 18.8 Face-to-Face workshop series 8.7 18.8 29.0 21.7 14.5 Peer mentoring 17.4 18.8 21.7 15.9 18.8 Conference presentations 14.5 20.3 21.7 23.2 13.0 Forums 15.9 13.0 26.1 23.2 14.5 Study groups 26.1 23.2 14.5 20.3 8.7 Action research 21.7 24.6 13.0 21.7 11.6 Examining student work 11.6 26.1 27.5 20.3 7.2 Self-directed learning 13.0 15.9 21.7 31.9 10.1 Peer observation 11.6 15.9 26.1 26.1 13.0 Faculty learning communities 7.2 13.0 30.4 18.8 23.2 Online workshops 23.2 15.9 15.9 23.2 14.5 Brown Bag sessions 15.9 17.4 29.0 21.7 8.7 Individual consultations 11.6 11.6 17.4 34.8 17.4 Preference of Duration of Professional Development Activities Results showed that the majority of respondents prefer 1 or 2-hour workshops and one hour activities scheduled after work hours or in the afternoon. 6 Comments Provided by Respondents Survey respondents were provided with the opportunity to provide comments and suggest additional topics for professional development activities. Below is a list of the comments and suggestions provided the respondents. 1. Effective and ethical use of social media in the classroom -scholarly blogging (instructors) and for classroom 2. Share practical teaching via video from other universities 3. Developing peer observation is important in one of our programs but could be a project to develop in collaboration or consultation with CTL 4. Enhancing students' motivation, examining learning outcomes to suit students' needs 5. I would love to attend a workshop on transformative learning that I have picked up, read about and tried somewhat in my classes. 6. I suggest that CTL coordinate with the writing center in developing templates as well as handouts that outline formats as well as criteria for graduate academic writing that professors of graduate courses can use as part of their guidelines for their seminar and courses assignments 7. Independent Learning/ Self-Access and / Self-Learning, using Technology in research, how to "beat" plagiarism 8. Provide more grant opportunities 9. More work on enhancing the use of technology in teaching should be done. Students at FM favor this option whereas not all professors know about it or even how to do it. An incentive was provided to promote blended learning; the same should be done for the use of clickers.... 10. One issue I struggle with is how to maximize teaching effectiveness while spending less time on teaching, since research is a priority in terms of promotion criteria. While I highly value the ways in which teaching can be improved, a recurrent concern of mine is that improving my teaching methods and assessment methods requires spending more time on teaching, so I'd appreciate techniques to help make us more efficient teachers. 11. Opportunities to hear what people have found to work and not work is more important than formal presentations. If formal presentations, at least half the time should be audience engagement. 12. Program reinvention, seeing what is being done in top ranking universities, seeing alternative teaching strategies, a focus on teaching writing. 13. Set up a forum once a year whereby faculty members are invited to give one most effective and innovative idea to improve pedagogy in less than 15 minutes. The forum will be one day long whereby at the end an award is given to the most effective idea. Summary In Summary, faculty members ranked teaching methods as important or most important followed by active learning and technology. Also respondents thought that identifying educational difficulties, developing traditional assessments as important or most important. In terms of 7 classroom management, respondents thought that techniques to enhance student motivation were important or most important. Moreover, they ranked writing program learning outcomes selecting instructional activities aligned with these outcomes and teaching critical thinking and higher order thinking as important or very important,. Regarding mode of presentation of professional development activities, faculty members rank individual consultations as the most important among these modes. As to comments provided, they show that faculty members are interested in effective teaching methodology and alternative practices, further collaboration with the writing center and other universities. Other themes were reported such as learning outcomes, grant opportunities, peer observation and forums on best practices. 8 Appendix A Needs Assessment Survey 2014 The purpose of this survey is to obtain your input on the types of professional development activities that you think the Center for Teaching and Learning (CTL) should offer in the future. Your responses will help us make the CTL more responsive to your needs. Dear Colleagues There are 13 questions in this survey Personal Information 1. Name: (Optional) Please write your answer here: 2. Rank: Please choose only one of the following: Professor Associate Professor Assistant Professor Lecturer Instructor 3. Faculty and School. Please choose only one of the following: FAFS FAS FEA FHS FM OSB SON 4. Department: Please write your answer here: General Professional Needs 5. Overall, which topics in professional development are the most important to you? Rank each of the following items in the set, 1 being the least important and 5 being the most important 1 2 Classroom Management Assessment Planning for Teaching Teaching Methods Technology Active Learning 9 3 4 5 Liberal Arts Education Academic Advising 6. Rank each of the items in the following set, 1 being the least important and 5 being the most important. I am interested in: A. Assessment: 1 2 3 4 5 Developing alternative assessments (checklists, portfolios, rubrics, short write-ups) Developing traditional assessments (multiple choice items, TrueFalse, essay) Interpreting assessment data Improving students' test taking performance Identifying educational difficulties Specific Professional Needs 7. Rank each of the items in the following set, 1 being the least important and 5 being the most important. B. Classroom Management: Please choose the appropriate response for each item: 1 2 3 4 5 Defining rules and teaching appropriate behavior Creating effective learning environments Techniques to enhance student motivation Succeeding with difficult and challenging students 8. Rank each of the items in the following set, 1 being the least important and 5 being the most important. C. Instructional Planning: 1 Preparing course syllabi Writing course learning outcomes Writing program learning outcomes Selecting instructional activities Identifying assessment methods 10 2 3 4 5 9. Rank each of the items in the following set, 1 being the least important and 5 being the most important. D. Instructional Methods: 1 2 3 4 5 Research-based instructional methods Teaching critical thinking and higher order thinking skills Student-centered classes in Higher Education Teacher centered approaches (interactive lectures) Cooperative learning Inquiry-based learning Team-based learning Community-based learning Technology-based learning Flipped classes Interdisciplinary curriculum Project-based learning Case-based learning Logistics 10. In what ways would you like to see CTL professional development activities presented? Rank each of the items in the set, 1 being the least favorable, and 5 being the most favorable.* 1 Speaker series Face-to-Face Single workshops Face-to-Face workshop series Peer mentoring Conference presentations Forums Study groups Action research Examining student work Self-directed learning Peer observation Faculty learning communities Online workshops Brown Bag sessions Individual consultations 11 2 3 4 5 11. I prefer to participate in CTL professional development sessions that last: Please choose only one of the following: One hour Two Hours Half-day Full day Two days More than two days 12. I prefer to participate in professional development activities that are: Please choose only one of the following: Scheduled on Saturday Scheduled after work hours and/or in the afternoon Scheduled during times when university is not in session 13. In the space provided, please suggest additional topics for professional development activities. Please rank the topics from most to least important. Please write your answer here: Thank you very much in advance for your support 12