SJSU Annual Program Assessment Form Academic Year 2013-2014

advertisement
SJSU Annual Program Assessment Form
Academic Year 2013-2014
Electronic copy of report is due June 1, 2014. Send to Undergraduate Studies
(academicassessment@sjsu.edu), with cc: to your college’s Associate Dean and college
Assessment Facilitator. List of AFs is found at
http://www.sjsu.edu/ugs/faculty/programs/committee/index.html>
Department: Communication Studies
Program: MA Program Communication Studies
College: Social Sciences
Website: http://www.sjsu.edu/comm/ma_students/
_ Check here if your website addresses the University Learning Goals. <If so, please provide
the link.>
Program Accreditation (if any): N/A
Contact Person and Email: Matthew Spangler / matthew.spangler@sjsu.edu
Date of Report: May 30, 2014
Part A
1. List of Program Learning Outcomes (PLOs)
Faculty decided on these six PLOs in the 2008/2009 academic year.
Conceptual Foundations
Students will be able to identify, explain, and critique the major paradigms, theories, and
conceptual frameworks for understanding communication, and demonstrate an
appreciation of the significance of ethics and social responsibility as they engage in
communication.
Conceptual Foundations learning objectives:
 1) Paradigms and Theories of Communication: Students will be able to identify,
explain and critique the major paradigms and theories that have shaped the field of
communication, including their historical development and current trends.
 2) Ethics: Students will be able to articulate the ethical and social responsibilities in
communicating with others in different social contexts (i.e. interpersonal,
organizational, intercultural, mediated, and public).
Inquiry and Research
Students will be able to analyze and evaluate published research, and design and conduct
communication research studies using quantitative social science, interpretive, critical,
rhetorical, and/or performative methods.
Inquiry and Research learning objectives:
 3) Research Methods: Students will be able to interpret and critique research
methods used in published communication research studies.
 4) Research Design: Students will be able to design and conduct scholarly research
using one or more method of inquiry.
1
Professional Practice
Students will be able to demonstrate advanced competency in scholarly writing, oral
communication, and the application of conceptual foundations and research methods in
professional contexts by designing and conducting applied communication activities.
Professional Practice learning objectives:
 5) Advanced Communication Competence: Students will be able to articulate indepth understanding of conceptual foundations and research methods through
advanced scholarly writing and oral communication.
 6) Theory and Research Applications: Students will be able to design, facilitate,
and evaluate applied communication activities (i.e. presentations, workshops,
forums, trainings, group discussions, etc.) in professional contexts utilizing
conceptual foundations and research methods.
2. Map of PLOs to University Learning Goals (ULGs)
This map was created by the Curriculum Committee in the College of Social Sciences. It
was later discussed and approved by the graduate committee and faculty in the
Communication Studies Department.
PLO 1 (Paradigms and Theories of Communication) maps onto ULG 1 (Specialized
Knowledge)
PLO 2 (Ethics) maps onto ULG 5 (Social and Global Responsibilities)
PLO 3 (Research Methods) maps onto ULG 3 (Intellectual Skills)
PLO 4 (Research Design) maps onto ULG 2 (Broad Integrative Knowledge)
PLO 5 (Advanced Communication Competence) maps onto ULG 2 (Broad Integrative
Knowledge)
PLO 6 (Theory and Research Applications) maps onto ULG 4 (Applied Knowledge)
3. Alignment – Matrix of PLOs to Courses
All of the graduate level courses in the department address each of the six PLOs: (1)
theories of communication, (2) ethics, (3) research methods, (4) research design, (5)
communication competence, and (6) research applications. All six PLOs are assessed in
the culminating course – Comm 297 Writing Seminar & Exams – that all students must
take in their last semester in the program.
4. Planning – Assessment Schedule
Starting in the fall of 2014, each of the six PLOs will be assessed two times a year in
Comm 297. The course will be offered in the fall and again in the spring. In the spring
of 2015, as a graduate faculty, we will look at the assessment data from the fall 2014
semester and begin a conversation about which PLOs we might more successfully teach
in the department and what strategies we will use.
2
5. Student Experience
The PLOs are communicated to students on the department’s website and on individual
class syllabi. The ULGs are not currently communicated to students. But, starting in the
fall of 2014, we plan to list the ULGs on the department website and on individual class
syllabi.
Part B
6. Graduation Rates for Total, Non URM and URM students (per program and
degree)
7. Headcounts of program majors and new students (per program and degree)
8. SFR and average section size (per program)
9. Percentage of tenured/tenure-track instructional faculty (per department)
3
Part C
10. Closing the Loop/Recommended Actions
We have a program review starting this coming fall (2014). We anticipate the program
review will provide us with some specific recommended actions with regard to the MA
program.
11. Assessment Data
Starting in fall 2010, we created and tested a rubric for our graduate program
culminating experience that assesses students’ mastery of our SLOs at the end of their
graduate experience. Members of a student’s thesis, exam, or project committee
complete the rubric after the student’s oral defense evaluating the student in theory,
method, and written and oral communication skills. The following rubric item
corresponds to SLO4: Rate the student’s understanding and execution of stated method or
mode of analysis: 1) exceptional, 2) good, 3) adequate, 4) ineffective or lacking.
As of the fall of 2014, we had collected evaluations for 17 exams (51 evaluations), 12
theses (35 evaluations), and 6 projects (17 evaluations) with 76 responses total to the
above rubric item. Students who completed exams (rather than doing a thesis or
project) had the weakest showing of the three on this item with 7 rated as “ineffective
or lacking.” 43% rated projects “adequate” in the area of method while 27% rated
exams and theses “adequate” in the area of method.
12. Analysis
Our assessment data suggests that (1) students who complete a thesis or project tend to
have a better grasp of method than do exam takers, OR (2) that our exams do not
adequately assess students’ understanding of method OR (3) that our stronger students
self-select into a thesis or project, whereas our weaker students self-select into the
exam. In any event, we may need to revise our exam design and boost student
preparation in the area of method. When the department moved to 4 unit seminars, the
graduate program adopted the model of our undergraduate program with each seminar
featuring a 4th “unit of engagement” that students satisfied with a specific assignment.
After a review of our courses, the graduate faculty determined that a 4th unit focused
on the practice of specific research methods would better serve graduate students.
Seminars integrated with a 4th unit focused on methods begin in fall 2013. We also
made our comprehensive exam mandatory for all students beginning fall 2013 and
introduced a required research presentation as part of the exam process. These
changes are designed to provide students with continuous instruction and practice in
research methods, as well as the department’s other 5 PLOs.
13. Proposed changes and goals (if any)
4
Starting in the fall of 2014, the comprehensive exams will be the primary site for
assessing the six PLOs. We plan to assess all six PLOs each semester (so 12 PLOs per
year). All MA students will take the exams in their final semester in the program.
5
Download