SJSU Annual Program Assessment Form Academic Year 2014-2015 Department: HUMANITIES

advertisement
SJSU Annual Program Assessment Form
Academic Year 2014-2015
Department: HUMANITIES
Program: LIBERAL STUDIES TEACHER PREPARATION
College: H&A
Website: <SJSU.EDU/HUM>
Program Accreditation (if any):
NONE
Contact Person and Email: Susan Verducci (susan.verducci@sjsu.edu)
Date of Report: June 8, 2015
Part A
List of Program Learning Outcomes (PLOs)
1. Demonstrate the ability to frame questions and pursue answers to aesthetic, social, cultural and
global problems using interdisciplinary methods.
2. Demonstrate the ability to describe and compare the roles, impacts and ethical implications of
ideas, texts, social movements, contemporary situations, and creations of the human
imagination.
3. Demonstrate skill in written and verbal communication, including argumentation.
4. Demonstrate the ability to identify, select, use, and cite information sources appropriately.
5. Demonstrate foundational knowledge in subjects taught in K-8 schools.
6. Demonstrate understanding of how to engage and support all K-8 students in learning.
7. Demonstrate understanding of how to create and maintain effective learning environments for
K-8 students.
8. Demonstrate understanding of how to plan instruction and assess student learning.
Faculty decided on PLO content and criteria for assessing levels of mastery during the 2011-12
Program Planning process. In the case of courses offered within the department, ongoing
assessment of levels of mastery is monitored by the Liberal Studies Program Coordinator, Susan
Verducci (who teaches several such courses). However, there are many courses that Liberal
Studies majors take in other departments. Therefore, at the beginning of the current program
planning cycle, the Program Coordinator initiated a project of recording grades of Liberal
Studies majors in subjects ranging from the arts to the physical and life sciences to the social
sciences. In other words, since it is not possible to require participation in Liberal Studies BA
assessment of instructors in art history, biology, chemistry, geography, and so forth, we felt we
should at least get a sense of the overall performance (measured by grades) of Liberal Studies
majors in their classes. The coordinator also developed and implemented an exit survey given
to graduating seniors that includes two questions asking students to self-report on the
programs overall effectiveness in meeting the PLOs. The following questions are scaled with:
Strongly agree, Agree, Somewhat Agree, Disagree, Strongly Disagree.
1) Based on my academic experience at San Jose State University, I believe that:

I can frame questions and pursue answers to aesthetic, social, cultural and global
issues in education using interdisciplinary methods
1



I can describe and compare the roles, impacts and ethical implications of ideas,
texts, social movements, contemporary situations, and creations of the human
imagination
I can identify, select, use and cite information sources appropriately
I can communicate effectively verbally and through writing
2) Based on my experience in the Liberal Studies program, I believe that:





I have strong content and pedagogical knowledge in subjects taught in K-8 schools
I understand how to create and maintain effective learning environments for K-8
students
I understand how to engage and support all K-8 students in learning
I understand how to plan instruction and assess student learning
I recognize the need to stay current professionally through lifelong learning
Applied Knowledge
x
x
x
x
x
x
x
x
x
x
x
x
x
Social and Global Responsibilities
Intellectual Skills
Broad Integrative knowledge
PLO/ULG
1. Frame questions/pursue answers
2. Describe and compare
3. Skill in written and verbal
communication
4.
Identify . . . and cite information
5. Knowledge of K-8 school subjects
current
. . . w hist. knowledge
6. Engage/support
K-8 students
7. Create/maintain K-8 learning
environments
8.
Plan instruction and assess learning
Specialized knowledge
2. Map of PLOs to University Learning Goals (ULGs)
x
x
x
x
x
x
3. Alignment – Matrix of PLOs to Courses (Highlighted courses provide data for assessment)
PLO
1
ENG 1A
ENG 1B
ENG 112A
ENG 103/LING 107
PLO 2 PLO 3
X
X
X
X
PLO 4 PLO 5
X
X
X
X
PLO
6
PLO 7
PLO
8
X
2
LLD 108/CHAD 150
EDEL 108E/CHAD 151
HIST 15AB
GEOG 137
GEOG 138
GEOG 139
MATH 12
MATH 105
MATH 106
BIO 21
CHEM 30A
GEOL 103
SCI 110/ENVS 158
CA 177
ART 39/139
ART 138
DANC 148
MUS 10B
MUS 185
TA 131
TA 167
KIN/CHAD 149 KIN177
EDTE 190
CHAD 60
CHAD 67
HUM 85
HUM 160
HUM 185
HUM 190
HUM 119A
HUM 119B
HUM 120A
HUM 120B
HUM 128
AMS 169
AMS 179
RELS 162
RELS 191
HUM 114
RELS 131
RELS 145
AMS 159
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
X
3
3. Planning – Assessment Schedule
Academic
Year/Courses
Program Learning Objective
1
Demonstrate the ability to frame questions and pursue
answers to aesthetic, social, cultural and global issues using
interdisciplinary methods.
(Collect data,
Analyze, Discuss,
Formulate plan)
AY 2015-16
Humanities 190
Humanities 85
(Begin implementing
plan for PLOs 6-8)
2
3
Demonstrate the ability to describe and compare the roles,
impacts and ethical implications of ideas, texts, social
movements, contemporary situations, and creations of the
human imagination.
Demonstrate skill in written and verbal communication,
including argumentation.
AY 2016-17
Humanities 190
Humanities 85
(Begin implementing
plan for PLO 1)
AY 2017-18
Humanities 190
Humanities 85
(Begin implementing
plan for PLO 2)
4
5
Identify, select, use and cite information sources
appropriately.
Demonstrate foundational knowledge in subjects taught in
K-8 schools.
AY 2017-18
Humanities 190
Humanities 85
AY 2018-19
Grades in Teacher
Prep Core Courses
Across Campus*
(Begin implementing
plan for PLOs 3-4)
4
6
Demonstrate understanding of how to engage and support
all K-8 students in learning.
7
Demonstrate understanding of how to create and maintain
effective learning environments for K-8 students.
8
Demonstrate understanding of how to plan instruction and
assess student learning.
AY 2019-20
Humanities 185
(Begin implementing
plan for PLO 5)
AY 2019-20
Humanities 185
AY 2019-20
Creative Arts 177
*Grades will be taken from the following courses:
History/Social Science: GE Area D2; GEOG 137; GEOG 138 and HIST 139
Art: All required Art courses taken (Art 39/138/139; Dance 148; Music 10B/185A; TA
131/167; CA 177)
Math: MATH 12; MATH 105; and MATH 106.
English Language Arts: ENG 103 or LLD 107; ENG 112A; CHAD 150 & 151 or LLD 108 &
EDEL 108E
Sciences: CHEM 30A, BIO 21, GEOL 103 and ENVS 158/SCI 110
5. Student Experience
Relevant Program Learning Objectives are listed on the syllabi of many Humanities courses in the
major and communicated verbally to students on the first day of each class. All PLOs map onto
courses across requirements, and a number of Humanities courses align PLOs with individual
assignments in their syllabi. PLOs are also listed on the website. What instructors do in their
courses, however, can be most critical to communication of the program’s learning objectives.
Instructors of the three core courses in the major (Hum 85 – introductory course, Hum 185, and
190 – capstone course) are strongly encouraged to review PLOs and ULGs with their students.
Liberal Studies requirements taken outside the department lie beyond our direct scope of influence.
Although we have made progress with communicating PLOs and collecting data through student
self-reports on the effectiveness of the program in meeting these objectives, we are at early stages
in changing the frequency and way ULGs and PLOs are communicated to students as well as
integrating student feedback into the creation of PLOs.
Part B
6. Graduation Rates for Total Non URM and URM students (entire department)
First-Time Freshmen
Undergraduate
Transfer
First-Time Graduate
5
Fall 2008 Cohort: 6-Year
Graduation Rate
Fall 2011 Cohort: 3-Year
Graduation Rate
Fall 2011 Cohort: 3-Year
Graduation Rate
Program
Cohort Size
Program
Cohort Size
Program
Cohort Size
Program
Grad Rate
Program
Grad Rate
Program
Grad Rate
Total
43
44.2%
30
56.7%
0
/0
URM
13
69.2%
3
100.0%
0
/0
Non-URM
23
30.4%
20
50.0%
0
/0
All others
7
42.9%
7
57.1%
0
/0
7. Headcounts of program majors and new students (per program and degree)
Fall 2014
New Students
Continuing
Students
FT
Admit
Continuing
New
Transf
Total
Total
20
43
157
220
BA
20
43
157
220
8. SFR and average section size (per department)
Fall 2014
Subject
SFR
Subject Headcount
per Section
Course Prefix
Course Level
HUMHumanities
Lower Division
27.0
29.8
Upper Division
19.3
22.6
Graduate Division
9. Percentage of tenure/tenure-track instructional faculty (per department)
6
Fall 2014
Department
FTEF #
Department
FTEF %
7.5
38%
Not tenure-track
12.2
62%
Total
19.8
100%
Tenured/Tenure-track
The following area of this assessment will cover two academic years, as the Program Coordinator and
sole dedicated program faculty member was on sabbatical in 2013-14.
Part C
10. Closing the Loop/Recommended Actions
a) Feedback on our last Program Assessment, recommended that a revised schedule for the next
five years be included. See Section 3 of this report.
b) In our last Program Review, one action item encouraged us to explore better outreach and
liaison deeper relationships with community colleges to increase transfers into all our department
majors. We have brought in a new tenure track hire to begin next semester (Fall 2015) that, while
teaching in the American Studies concentration of Humanities, with a doctorate and a specialty in
the history of education will be able to collaborate on this goal through service specific to the
Liberal Studies Teaching Prep major, growing an annual cohort of future teachers majoring in our
department. In the past year, outreach was made to a teaching academy at a local high school
(Independence High) during college application time. A panel of Liberal Studies Students and the
program coordinator discussed their experience at SJSU and answered questions about the
program to prospective college applicants.
c) Actions that the department has taken include the hiring of two new tenure track faculty
members with education as areas of expertise.
d) A special topics course on Education is being offered every Spring.
e) In 2013-14, policy documents were developed for Humanities 101 and 190.
11. Assessment Data
PLO #3 (Demonstrate skill in written and verbal communication, including argumentation) 1)
Data to analyze this was collected from two sections of HUM 100W, Writing in the Humanities.
Sample essays were submitted from the two different instructors teaching HUM 100W, three from
one section and five from the other. The samples were assessed by Prof. Jochim for their basic skill
levels in written communication and persuasive argumentation. All were judged to be at the level
7
assigned by the seminar instructors, which selected the students to illustrate the range of rankings
in their courses. Prof. X ranked one student at strong thesis (Exemplary), one at sound thesis
(Accomplished), two at clear thesis (Developing) and one at vague thesis (Beginning). Prof. Y
ranked the three essays numerically, one at 169 (Accomplished), one at 146 (Developing) and one
at 137 (Beginning).
2) An online exit survey was administered to 87 Spring 2013 recently graduated senior Liberal
Studies students. Data was collected from 28 respondents. 75% (21) of these 28 students reported
that they strongly agreed that their experience at SJSU had provided them with written and verbal
skills; 21.4% (6) agreed; and 3.6 12) somewhat agreed.
PLO #6 (Engage and support all students in learning) AND PLO #7 (Create and maintain effective
learning environments):
1) Data was collected and analyzed from course materials of 29 students from the Spring 2015
Humanities 185 class. These course materials include electronic journal entries covering: ability
grouping; homework; play; contexts for learning; ideal classrooms; the physical environment;
“seeing” two students; and classroom procedures. A total of 209 documents were examined for
student understanding of how to engage/support students with differing needs and abilities and
how to create/maintain effective learning environments. An additional 29 lesson plans were
examined for students’ ability to apply their theoretical understanding to practice.
2a) PLO#6 - An online exit survey was administered to 87 Spring 2013 recently graduated seniors.
Data was collected from 28 respondents. 29% (11) students reported that they strongly agreed
that their experience at SJSU met this objective; 36%% (10) agreed; 18% (5) somewhat agreed;
3.6% disagreed; and 3.6% strongly disagreed.
2b) PLO #7 - An online exit survey was administered to 87 Spring 2013 recently graduated seniors.
Data was collected from 28 respondents. 42.9% (12) strongly agreed that their experience at SJSU
met this objective; 32.1% (9) agreed; 17.9% (5)) somewhat agreed; 3.6% (1) somewhat disagreed;
and 3.6% strongly disagreed.
PLO #8 (Plan instruction and assess student learning):
1) 33 lesson plans from 11 Liberal Studies students were collected and analyzed from Creative Arts
177. These students earned an average of 18.01 points out of 20 for these lesson plans. Their
scores were compared to the scores of 54 lesson plans from 18 non-Liberal Studies students in the
same course, who earned an average of 18.6.
2) An online exit survey was administered to 87 Spring 2013 recently graduated seniors. Data was
collected from 28 respondents. 46.4% (13) students reported that they strongly agreed that their
experience at SJSU taught them to plan instruction and assess learning; 25% (7) agreed; 21.4%
somewhat agreed; 3.6% somewhat disagreed; and 3.6% strongly disagreed.
12. Analysis
8
PLO #3 - The assigned work in 100W seems to be covering the required areas to meet this PLO, and
the teachers’ feedback to the students indicates attention to helping them move forward toward
even better responses in written communication and persuasive argumentation.
PLOs 5-8 – The online student survey indicates that students’ perceive one weakness of the
program to be a relative lack of focus on knowledge and skills related to pedagogy in K-8 schooling.
Nearly every comment critical of the program noted the lack of attention to pedagogy embedded in
the curriculum.
PLO #6 – Average scores on journal entries that prompted students to write about supporting and
engaging all students in learning (ability grouping-2.1/3, homework and play-4.6/5; and “seeing”
two students-1.6/2) showed that students are between the emerging and developed phase of
understanding. The 29 lesson plans evaluated required that students show their ability to translate
this theoretical understanding to practice by developing differentiated and multi-layered
instructional plans for English Language Learners and differently-abled students. The average
student score on these lesson plans 14/15 was much higher than the journal entries. This might
suggest a number of things, including that students have a stronger mechanical understanding of
lesson planning than they do of the principles underlying the choices they are making in their
planning.
PLO #7 – Average scores on journal entries that prompted students to write about creating an
environment for learning showed students to be in the developed phase (context-4.5/5; ideal
classroom-9.5/10; procedures-4.8/5; physical environment-4.7/5). Students noted in their
suggestions on how to strengthen the program that they would welcome direct discussion about
classroom management.
PLO #8 – Scores from Liberal Studies students in the Creative Arts 177 class are in the developed
phase of this PLO. Although they seem marginally below the average of the teacher preparation
students from other programs, when a single outlying score is removed from the analysis the
difference disappears.
13. Proposed changes and goals (if any)
No changes in the PLOs themselves.
PLO #3 - In the past, an argumentation exercise was added to HUM 190 senior seminar capstone
classes to ensure that the argumentation skill covered in HUM 100W was reinforced in that
capstone experience, and a closing the loop assessment activity on that modification demonstrated
that graduating seniors demonstrated a higher proficiency in this particular skill as a result. As
perhaps five years have gone by since that check, it might be useful the next time around in
assessing this PLO that we look not only at the level of what is produced in HUM 100W students but
also, for that particular skill of argumentation, at a class of students in HUM 190 as well.
PLOs 5-8 – In the Humanities department, there is currently only one permanent faculty member
9
with an area of expertise in K-8 education and thus most upper division courses available to teacher
preparation students’ are not infused with ideas pertaining to K-8 education. This relates to one of
the perennial difficulties of undergraduate teacher preparation in California: meeting student
expectations for courses to provide pedagogical knowledge and skills with the demands of The
Ryan Act, which requires that all undergraduates interested in education receive a liberal arts
education. The professional education many students in our program expect occurs at the graduate
level in California because of this law. We anticipate the department’s recent hiring of two tenure
track professors with expertise in education will infuse educational history and theory into Liberal
Studies students’ upper division courses across the major. This should allow the program to better
meet students’ expectations while complying with the requirements of The Ryan Act.
PLOs 5-8 – One goal for 2015-16 is to collaborate closely with newly hired faculty to examine the
possibility of transforming our required introductory course, Humanities 85: Introduction to
Liberal Education, from a one unit course to a three unit course. This course has the potential for
Liberal Studies students to directly study the UGLs and our department’s PLOs in the light of the
broader aims and purposes of liberal education in a pluralistic democracy.
PLO#6 – Analysis of this PLO points to paying increased attention to providing opportunities for
students to develop and articulate the social, political and educational principles and rationales for
attending to needs of diverse students in departmental courses.
PLO #7 – Analysis of this PLO suggests a need to increase attention to discussing “classroom
management” aspects of creating a learning environment in Humanities 185.
PLO #8 – Continue to provide opportunities for students to practice and hone their lesson planning
skills in Creative Arts 177 and Humanities 185.
Next year, assessment will focus on PLO #1.
10
Download