Academic Departments Assessment Survey Survey was answered by 18 units including 3 faculties ( FHS, OSB, FAFS), HSON, 5 departments from FM, 5 FAS departments, 3 centers/offices, and 2 OSB departments. 52% response rate, some had 1 assessment tool, others 3 or 4. Question Department Name Name of person in charge of assessment Responses Hariri School of Nursing pharmacology and toxicology Dermatology Mathematics English Issam Farres Institute for Public Policy and International Affairs Business Information and Decision Systems Track Psychiatry economics OSB computer science Center for Arab and Middle Eastern Studies Management, Marketing, and Entrepreneurship FAFS, Dean's Office Experimental Pathology, Immunology & Microbiology Facutly of Health Sciences Radiation Oncology OIRA Christine Abbyad, BSN Convener Ramzi Sabra Abdul-Ghani Kibbi, MD, FACP Nabil Nassif David Wrisley Rami Khoury, Director myself Nisreen Salti Elias Khater chairman - Wassim El-Hajj none Yusuf Sidani Maya Nabhani Zeidan Dr. Ramzi Sabra, assistant dean for medical education Roua Dalli Dr. Toufic Eid Monia Hamzeh Mona Haddad 1 Assessment Tool/ Used (1) Purpose (1) Frequency (1) Conducted by (1) PLO, departmental, Alumni surveys, exit surveys, OIRA surveys My evaluations software Employee Evaluations OSB appraisal system PLO Rubric ANNUAL EVALUATION Undergraduate Advising Questionnaire [LIMESURVEY] End of year evaluation report Monitor outcomes, assess need for changes, ascertain fit of requirement of employers, ascertain whether or not accreditation standards being met. faculty assessment Assess employee performance and output evaluation of all faculty members assessment of PLOs To assess Business Professional Competence assess CMPS 299 Assess faculty contributions to teaching, service, and research PLO Assessment Questionnaire about advisor for undergraduates Assess eligibility for promotion to next PGY Annually ( 6 times mentioned) every 6 months Once/semester (3 times) started Spring 2012-13 BSN Convener, OIRA, Office of student affairs Residents in training Rami Khoury, Director dept. chair and then dean committee OSB Wassim El-Hajj & Haidar Safa Chairperson Departments Students Services Office Program Director 2 Reported to (1) Use made of results (1) Assessment Tool/ Used (2) BSN Convener, Director of School, Curriculum Committee, at faculty meetings Chair and Program Director HR, Performance Appraisal sent by email to HR dean and then provost CTL OSB Dean/Associate Deans/Conveners and Directors self Dean Dean's Office, Biannual report chair and department members/UGCA-SA/ Dean Graduate Medical Education Committee Institution of simulation lab for practice and a summer practicum as students felt they needed more practice. Added content to courses such as geriatrics as required by accrediting body. Promotion of teaching effectiveness seminars and use of team based learning, blended learning and case based learning for better student engagement. Notes sent to faculty Promotions and Pay Raises based on outcomes salary increase, contract renewal none Changed course syllabus; Introduced new learning approaches such as simulation; fix the syllabus of the course Bonus/promotion Revision of course content corrective actions in the advising process Decide if the resident is eligible for promotion PPR through faculty retreats My evaluations software Programs Assessments PLO exams - assignment - projects ICE Self Evaluation/Perception Ask dr. Sabra Employment Profile for Graduate Public Health Program Alumni (one year after graduation) [LIMESURVEY] End of rotation exams 3 Purpose (2) Frequency (2) Conducted by (2) Reported to (2) Use made of results (2) Assess need for curriculum changes and maintaining accreditation standards. Residents Assessment Assess whether programs are meeting goals which are set annually To assess Analytical Decision Making assess major CMPS courses Assess faculty contributions to teaching PLO Assessment Survey to report on the employment status of graduates Assess Medical knowledge acquired after the rotation bi-annually every 6 months (2 times) Once/semester (4 times) yearly every 3 months BSN convener Faculty Rami Khoury, Director OSB course instructors OIRA Departments Students Services Office/Graduate Public Health Program (GPHP) Administrative Coordinator Faculty members Faculty at large Chair and Program Director Rami Khoury, Director OSB Dean/Associate Deans/Conveners and Directors chairman (George Turkiyyah at that time) Chairpersons, deans Dean's Office, Biannual repor GPHP administrative Team/GPHP-Curriculum Task Force Graduate Medical Education Committee Curriculum changes such as requesting that science faculty add biology prior to human morphology and then combining human morphology with physiology to create a 5 credit course over 2 semesters. Offering courses in block form, reducing credits from 6/clinical course to 5 to better align ourselves with US schools of nursing, 4 Assessment Tool/ Used (3) Purpose (3) Frequency (3) Conducted by (3) Reported to (3) Notes sent to residents Assess quantity and quality of output of each program Change Changed course syllabus; adjusted times for delivery of certain course topics few action items have been made. a better action plan should be put in place Assessment of teaching Sent to the Council on Education for Public Health (CEPH the GPHP accrediting agency) in the annual report Assess medical knowledge in the subjects of the rotation Surveys of US schools Specific Performance indicators Strategic Review for Institute PLO Assurance of Learning Forms in core courses Oral exams Assessment of MPH core and concentration courses learning objectives [LIMESURVEY/CLICKERS] 6 competencies evaluation Benchmarking for example to see how courses and components of courses are taught. Clinical services Assess whether Institute is meeting its goals according to its mission statement and strategic plan To assess Qualitative Decision Making Assurance of learning PLO Assessment Graduate students ratings on achievement of the courses learning objectives (indirect assessment of program competencies) Assess the 6 competencies Occasionally as needed Twice a year Yearly Once per semester Curriculum committee Quality officers assigned by department Rami Khoury, Director OSB Individual faculty members Departments Students Services Office/GPHP admin team Program director Curriculum and faculty committee Chair and quality and risk management in the hospital Provost, a written report is sent to the provost after the 5 Use made of results (3) Assessment tool/used (4) Purpose (4) frequency (4) Conducted by (4) Reported to (4) Use made of results (4) assessment is conducted OSB Dean/Associate Deans/Conveners and directors OSB accreditation officer Dean’s office, biannual report Associate Dean and GPHP coordinator Graduate Medical Education Committee For example deciding where course content belongs such as mental health promotion content, collaboration with medicine and faculty of health Sciences on interprofessional education Amend certain clinical pathways Organizational adjustments are made based on outcomes of assessment Changed course syllabus; assigned more weights to different topics of course AACSB accreditation Sent to course instructors and chairs of departments for corrective actions at course level Attached with the end of year evaluation My evaluation software PLO Student exit survey Assessment of graduate and undergraduate program competencies (Excel sheet/ word document) Describe progress on competencies Residency training To assess ethics PLO assessment Grades on course assignments that measure students’ achievement of specific competencies – direct assessment of program competencies Twice per year Yearly Once per semester Faculty members Residents in training OSB Departments Accreditation officer Chair and program director OSB dean/ Associate deans/ Conveners and directors Dean’s office, Biannual report Associate dean, GPHP coordinator and undergraduate program coordinators Graduate medical education committee Improve curriculum Changed course syllabus; changed assessment approaches 6 Assessment tool/ used (5) Purpose (5) Frequency (5) Conducted by (5) Reported to (5) Use made of results (5) Assessment tool/ used (6) Purpose (6) Frequency (6) Conducted by (6) Reported to (6) such as administering the final exam as a take home exam Revision of curricula Sent to provost office for the institutional accreditation requirements and corrective actions are made at the programmatic level Monitor the residents’ progress PLO 1-year Alumni survey Undergraduate and graduate exit survey (Limesurvey) Assess professionalism To assess leadership PLO assessment Graduating students fill and exit survey where they have the opportunity to voice their opinions about the program in both close-ended and open-ended formats By the end of treatment each patient is given a form to fill Once per semester Yearly By the end of treatment each patient is given a form to fill OSB Departments Students service office Patients OSB dean/associate deans/ conveners and directors Dean’s office, biannual report Undergraduate chairs and departments/UGCA-SA/ dean / GPHP-CTF and Graduate studies committee (GSC) Graduate Medical education committee Changed course syllabus; introduce simulation to course corrective actions at the programmatic level Attached with the end of year evaluation PLO Employer satisfaction surveys GA Evaluation by the student [LIMESURVEY] To assess teamwork PLO Assessment A form filled in by students at the end of each semester that allows them to evaluation their GA experience Once per semester Yearly OSB Departments Students service office/GPHP administrative coordinator OSB dean/associate deans/ conveners and directors Dean’s office, biannual report GA coordinator/Graduate studies committee(GSC) 7 Use made of results (6) Assessment tool/ used (7) Purpose (7) Frequency (7) Conducted by (7) Reported to (7) Use made of results (7) Assessment tool/ used (8) Purpose (8) Frequency (8) Conducted by (8) Reported to (8) Use made of results (8) Assessment tool/ used (9) Purpose (9) Changed course syllabus; use a peer evaluation approach Used in decisions to allocate GAs to faculty members in next semester PLO Embedded Questions GA Evaluation by the supervisor [LIMESURVEY] To assess written communication PLO Assessment A form filled by the faculty supervisor at the end of each semester evaluating Once per semester OSB Departments Students service office/GPHP administrative coordinator OSB dean/associate deans/ conveners and directors Dean’s office, biannual report Graduate studies committee(GSC) Changed course syllabus Used in making decisions to grant GAs to students in subsequent PLO Projects Graduate and Undergraduate orientation session [LIMESURVEY] To assess oral communication PLO Assessment Evaluation of the orientation session Once per semester yearly OSB Departments Students service office/GPHP administrative coordinator OSB dean/associate deans/ conveners and directors Dean’s office, biannual report GPHP administrative Team/UGCA-SA/communications unit Changed course syllabus Used in improving the orientation sessions in subsequent years PLO Case Studies FHS Annual Performance Review [INTRANET APPLICATION] To assess globalization PLO Assessment This is an extensive system that collects data related to each 8 faculty members contributions to teaching, research and service - it is automated and filled out by faculty members Frequency (9) Conducted by (9) Reported to (9) Use made of results (9) Assessment tool/ used (10) Purpose (10) Frequency (10) Conducted by (10) Reported to (10) Use made of results (10) Assessment tool/ used (11) Purpose (11) Frequency (11) Once per semester yearly OSB Departments Dean's Office OSB Dean/Associate Deans/Conveners and Directors Dean's Office, Biannual report Associate Dean Changed course syllabus The dean reviews all performance review forms and discusses them with the chairs and occasionally with the particular faculty members - used for contract renewal, promotion and merit increases Oral Presentations Graduate Public Health Program Indicators Monitoring Report [EXCEL SHEET DATABASE/WORD DOCUMENT REPORT] PLO Assessment For evaluating and monitoring the program's efforts in serving its various constituencies including (instruction, research, service, faculty and staff, students and instruction) Once per semester yearly Departments Dean's Office Dean's Office, Biannual report Dean, Associate Dean, GPHP-CTF,GPHP admin team, Research Committee, Outreach and Practice Unit/Administrative Committee The review teams assess the relevant indicators against the targets and propose corrective actions as needed. These corrective actions are then sent to the appropriate committee or faculty at large for implementation Student Performance Test Results Graduate and Undergraduate TOWN MEETINGS [WORD DOCUEMNT REPORT] PLO Assessment The purpose of the town meeting is to voice graduate students opinions re the program’s strengths and weaknesses, and about overall levels of satisfaction Once per semester 9 Conducted by (11) Reported to (11) Use made of results (11) Assessment tool/ used (12) Purpose (12) Frequency (12) Conducted by (12) Reported to (12) Use made of results (12) Assessment tool/ used (13) Purpose (13) Frequency (13) Conducted by (13) Reported to (13) Use made of results (13) yearly Departments Dean and Associate Dean Dean's Office, Biannual report Program Coordinators/chairs of departments Corrective actions are suggested based on issues raised by students Course grades How were you informed about the FHS undergraduate and graduate program [LIMESURVEY] PLO Assessment To assess the means through enrolled students were informed about the FHS programs Once per semester yearly Departments Students Services office Dean's Office, Biannual report GPHP Admin Team/GPHP-CTF/GSC To improve Faculty communication tools Student Surveys/Questionnaires Description of work experience [LIMESURVEY] PLO Assessment To assess the profile of enrolled students Once per semester yearly Departments Students Services Office Dean's Office, Biannual report Chairs of Departments revision of curricula to assess the diversity of students' background and experience and consequently ensuring diversity FHS Alumni contact info update [LIMESURVEY] Assessment tool/ used (14) Purpose (14) Frequency (14) Conducted by (14) Reported to (14) To regularly update the contact info of alumni Yearly FHS communications unit (as of AY 2013-14) Dean and available to all FHS faculty members and AUB alumni office upon request 10 Use made of results (14) To keep in touch with alumni GA Application for Faculty [LIMESURVEY] Assessment tool/ used (15) Frequency (15) A form completed by faculty to request percent GA for the coming semester and justify use of GA time by semester Conducted by (15) Students Service Office/GPHP Administrative Coordinator Purpose (15) Reported to (15) Use made of results (15) Graduate Studies Committee (GSC) To assess GA needs of faculty and allocate GA lines GA Application for Students [LIMESURVEY] Assessment tool/ used (16) Purpose (16) Frequency (16) Conducted by (16) Reported to (16) Use made of results (16) A form filled in by students requesting GA by semester Students Service Office/GPHP Administrative Coordinator Graduate Studies Committee (GSC) To select the students who are eligible for getting GA Why did not you join FHS GPHP [LIMESURVEY] Assessment tool/ used (17) Purpose (17) Frequency (17) Conducted by (17) Reported to (17) Use made of results (17) To assess reasons for not joining the graduate public health program Yearly Students Services Office GPHP administrative team/GPHP-CTF For corrective actions at the programmatic level Survey on socio-economical status [LIMESURVEY] Assessment tool/ used (18) 11 Purpose (18) Frequency (18) Conducted by (18) Reported to (18) To assess the profile of enrolled students Yearly Students Services Office GPHP administrative team Use made of results (18) To ensure having a student body with diverse backgrounds Assessment tool/ used (19) Masters of Public Health Practicum students and advisors evaluation forms [WORD DOCUMENTS] Purpose (19) Frequency (19) Conducted by (19) Reported to (19) Use made of results (19) The practicum evaluation aims to evaluate student performance and satisfaction with the practicum experience as well as the advisor’s evaluation of the practicum experience by semester Practicum Coordinator GPHP Admin Team/GPHP-CTF As a mean to improve practicum practices and to gain insight into the student level of satisfaction. Training Activity Forms [WORD DOCUMENTS] Assessment tool/ used (20) Purpose (20) Frequency (20) Conducted by (20) Reported to (20) Use made of results (20) Process measures: Participants are asked to evaluate relevance of the sessions to their current work or function; extent to which they have acquired information that is new to them; usefulness of the information that they have acquired; focus of the sessions on what they specifically needed to learn; and overall quality of the sessions. Output measures include pre and post test to indicate changes in knowledge of participants. by training activity Training Activity Organizer GPHP Admin Team/GPHP-CTF/Outreach and Practice Unit as a tool to monitor and evaluate continuing education and 12 workforce development Assessments conducted on an ad hoc basis (new program study, etc.) Assessment tool/ used (1) Purpose (1) Frequency (1) Conducted by (1) Reported to (1) Use made of results (1) Assessment tool/ used (2) Purpose (2) surveys of students preferences for elective courses Surveys Employer Surveys Masters of Public Health Program Rubrics [LIMESURVEY] Survey deciding which electives to offer Assess demand for a new program New Program market study As a subjective measure of achievement of competencies Assess satisfaction with ICE yearly Ad hoc basis 2-3 years various faculty members Ad hoc committee Departments in collaboration with Dean's Office Students Service Office/Accreditation officer OIRA chair Committee in form of a report Analysis is performed by Dean's Office personnel and reported to Departmental Chair GPHP administrative Team, chairs and course instructors OIRA deciding on courses to offer Start a new program or not Included in the market study of new program proposals Corrective actions at the programmatic level Improvement, revise forms & process Alumni Surveys FHS Alumni feedback [LIMESURVEY] Questionnaire New Program market study As part of the accreditation/program reviews we administer surveys to alumni and employers to get feedback on the graduate and undergraduate programs at the FHS. (Mainly to 13 Frequency (2) Conducted by (2) Reported to (2) Use made of results (2) Assessment tool/ used (3) Purpose (3) Frequency (3) Conducted by (3) Reported to (3) Use made of results (3) Assessment tool/ used (4) Purpose (4) Frequency (4) Conducted by (4) Reported to (4) Use made of results (4) identify perceived strengths and weaknesses) of the programs and usually done every five years) Satisfaction OIRA services once a year Every 3-5 years Once every 5 years Departments in collaboration with Dean's Office Dean's Office OIRA Analysis is performed by Dean's Office personnel and reported to Departmental Chair Dean, Associate Dean, Program coordinators and departments' members OIRA Included in the market study of new program proposals In compliance with CEPH accrediting body criteria and for continuous improvement of the program Introduce new activities, improve services FHS Employers feedback [SEMI-STRUCTURED INTERVIEWS] As part of the accreditation/program reviews we administer surveys to alumni and employers to get feedback on the graduate and undergraduate programs at the FHS. (Mainly to identify perceived strengths and weaknesses) of the programs and usually done every five years) Every 3-5 years Dean's Office Dean, Associate Dean, Program coordinators and departments' members In compliance with CEPH accrediting body criteria and for continuous improvement of the program Undergraduate self-study reports [WORD DOCUMENT REPORT with data reported from various DATABASES] For continuous improvement of the programs at FHS Every 5-7 years Dean's Office AUB provost office For corrective actions at the departmental/programmatic 14 Assessment tool/ used (5) Purpose (5) Frequency (5) Conducted by (5) Reported to (5) Use made of results (5) levels GPHP self study report [WORD DOCUMENT REPORT with data reported from various DATABASES] For continuous improvement of the programs at FHS Every 5-7 years Dean's Office CEPH accrediting body For corrective actions at the departmental/programmatic levels 15