Chapter 14 Assessment of Student Learning Expectations of Student

advertisement
Chapter 14
Assessment of Student Learning
Assessment of student learning demonstrates that the institution’s students have knowledge, skills, and
competencies consistent with institutional goals and that students at graduation have achieved appropriate
higher education goals. MSCHE
__________________________________________________________________________________________
Expectations of Student Learning
Prince George’s Community College has experienced a cultural transformation in the
decade since its last comprehensive self-study. In addition to becoming a predominantly
minority institution of higher education, the college has created a more vibrant learningcentered culture. Expectations of student learning are inherent in the learning-centered
culture and are articulated throughout the college.
Expectations of student learning are articulated on three different levels-collegewide, degrees and programs level, and courses:
Collegewide
Student Success and Quality are two of the initiatives in the Prince George’s
Community College FY 2001 to FY 2005 Strategic Plan that define the college’s expectations
for student learning. The Student Success initiative emphasizes improving the success rate of
students in university transfer, developmental education, career and workforce training,
continuing education, and personal enrichment. The Quality initiative emphasizes improving
the integration of students’ intellectual and social development into the learning process. The
college’s effectiveness in achieving these two initiatives is assessed by the Progress
Barometer (Exhibit 12).
Additionally, the college’s expectation for student learning is inherent in the core
educational outcomes that each student who graduates should have attained. These outcomes
are shared with students in the 2004-2005 College Catalog, page 29.
PGCC Self-Study
Chapter 14
165
Degrees and programs
Expectations for student learning are defined by accreditation requirements and
articulated through programmatic handbooks, handouts, the college catalog, and Web sites.
Nursing, for example, specifies learning expectations in its handbook and the 2004-2005
College Catalog, p.13. Engineering Technology uses its Web site, and Teacher Education
requirements for student learning can be seen in the 2004-2005 College Catalog, pp.66-68, in
handouts and on the Web.
Courses
The syllabus for each course specifies the expected learning outcomes in assessable
terms that have been reviewed and approved by the college’s Academic Outcomes
Assessment Committee (AOAC).
Assessment Plan to Validate Student Learning
Prince George’s Community College, as a learning-centered college, is committed to
assessment of student learning. Expectations of student learning are validated through the
assessment practices that the college has implemented at strategic points in a student’s
educational development:
Upon entry to the institution
The college’s admissions process requires that new students be assessed in basic
academic skills (reading, writing, and mathematics) using placement standards that are
consistent with statewide expectations.
Within Departments
Departmental self-studies began in 2003. The department invests a year in selfexamination to determine how it can improve the delivery of instruction to promote student
PGCC Self-Study
Chapter 14
166
learning. To date, Learning Resources (the library), the Business Management, English,
Nursing, Language Studies, Psychology, Criminal Justice, Paralegal and Forensic Science
departments, and the calculus area of Mathematics have completed their self-studies. One
year after the completion of the self-study, each department reports to a large group of chairs,
deans, the vice president and president the results of changes it made to improve delivery of
instruction.
At the course level
Course assessment is a continuous cyclical process, not a one-time event. Using the
cyclical process of assessment, the college can determine whether students are learning what
faculty intend them to learn and whether faculty members’ teaching exemplifies the learningcentered philosophy. The process requires
•
identifying desired goals and outcomes
•
developing methods that are expected to result in the desired outcomes
•
defining outcome measures of success
•
implementing the developed methods and analyzing the results
•
evaluating and reassessing.
The strength of the process is the department’s analysis of the assessment results, followed
by evaluation, course adjustment and reassessment. After analysis of the results, the
department submits the course assessment report that includes an action plan for course
improvement to the AOAC which provides feedback and recommendations to the
department.
Upon completion of certain programs
PGCC Self-Study
Chapter 14
167
Programs that are accredited by outside agencies such as engineering technology,
nursing, radiography, health information technology, emergency medical technicianparamedic are required to prepare comprehensive self-studies which include review of
curricula, student success, faculty effectiveness, and other facets of the program. These
accreditation processes require an ongoing self-examination leading to continuous
improvement of student learning as demonstrated, in some programs, by student pass rates on
national exams.
At graduation
The Academic Profile assessment is administered as part of the graduation process to
assess the degree to which general education outcomes have been acquired by graduating
students.
The assessment conducted at each point in a student’s educational development draws
its authority from the college’s mission to ensure “high quality programs for university
transfer, general education, workforce development….” and supports the strategic initiatives
of Quality and Student Success.
Assessment Used to Improve Teaching and Learning
Assessment results have been primary motivators in making changes that improve
teaching and learning. Changes have taken place throughout the institution. Some examples
include admissions testing, developmental education, courses, and faculty professional
development.
Admissions Testing
To ensure that students are placed in courses that are appropriate to their entering
level of ability, the relationship between placement test scores and student success are
PGCC Self-Study
Chapter 14
168
monitored. In 2000, the reading cutoff score for eligibility to enroll in courses with a reading
prerequisite was raised.
In fall 2004, the college piloted the Accuplacer Levels of English Proficiency
(LOEP) test for international students as a possible replacement for the Michigan test that has
been used for many years. Indications are that the Accuplacer LOEP provides more useful
information for the Language Studies Department to use for placing international students.
Developmental Education
Both the developmental reading and the developmental mathematics departments
have instituted changes designed to improve student learning. The developmental
mathematics department offers a two-week review of mathematics designed to advance
students whose entering placement test scores indicate that with some review and practice
they could be successfully placed in a higher level course. The Developmental Reading
Department offers an accelerated reading course that accomplishes the same purpose.
In addition, the developmental mathematics department examined reasons that some
students perform poorly in mathematics and determined that fear of math is a major inhibitor.
Beginning in 2003, the Developmental Mathematics Department required all students who
take developmental math courses also to take a one-credit course, CAP 103-Math Confidence
Building. The research study to verify the effectiveness of this change is not complete.
However, according to the mathematics department, students who have taken CAP 103 and
advanced from developmental math courses to a credit math course (MAT 104) are more
successful than students who did not need developmental math or CAP 103 prior to enrolling
in MAT 104. The difference is attributed to the CAP 103 course. Effective fall 2004, all
students in MAT 104 are required to take CAP 103.
PGCC Self-Study
Chapter 14
169
Programs
Programs such as health information technology, nuclear medicine technology,
nursing, radiography, respiratory therapy, and electronic engineering technology rely heavily
on external assessment measures generated through licensing and certification testing results.
In fall 2003, the Technology Accreditation Commission of the Board for Engineering
and Technology (TAC/ABET) evaluation of the electronic engineering technology program
resulted in a thorough updating of the department’s programs. The department also began
tracking its graduates. Information received from the graduates will assist the department in
determining curriculum changes. Other effective uses of external assessment information are
detailed in Chapter 2.
Courses
Grades are included as an assessment method especially for individual faculty
members within their own classes. However, to achieve overall improvement in student
learning requires assessing the course as a whole. Evidence of the effectiveness of the course
assessment program was summarized in the 2003 year-end report that documented actions
taken by various instructional departments as a result of course assessments. According to the
report, “The highlight of the 2002-03 year was the high number of departments whose
faculty reported that their first course assessment actually resulted in improvement in the
course.” The report cited specific improvements: “The group identified three areas for
improvement: outcomes, the design and implementation of assessment and outcomes that
students had not mastered…Areas of student weakness were identified and additional time
will be devoted to those topics” (Accounting 201); “the assessment helped give a more
uniform approach to the course content” (Art 271); and “our discussion focused…on how to
PGCC Self-Study
Chapter 14
170
change the way we teach certain concepts, including giving more examples and take-home
exercises” (Economics 103).
Faculty Professional Development
The results of the Academic Profile assessment of graduating students indicated the
need to strengthen students’ critical thinking ability. The college began equipping faculty
with more “tools” to address this need. It started by declaring FY 2005 as the Year of Critical
Thinking. Pedagogical techniques to develop critical thinking ability are provided through
workshops, formal critical thinking courses, and the Critical Thinking Institute. Additionally,
the English Department has conducted two “Summits.” The first emphasized the
incorporation of more writing in course requirements. The second addressed preparing test
questions whose answers require higher order thinking skills.
Documented Use of Assessment Information as Part of Institutional Assessment
The college’s strategic plan, defined by eight strategic initiatives, drives the
institution’s assessment process. The assessment of student learning is an obvious component
and is required in two of the strategic initiatives, Student Success and Quality. In the Student
Success initiative, student learning is assessed indirectly in terms of retention, graduation,
and transfer. In the Quality initiative, direct assessment of student learning is required to
“improve on high quality programs and services to promote student learning.” (See Table
I.1.)
Conclusive evidence of the extent to which student learning assessment is integrated
into the college’s overall institutional assessment plan is found in the overview of the
institutional assessment plan written by the Dean of Planning and Institutional Research.
PGCC Self-Study
Chapter 14
171
“Institutional assessment at Prince George’s Community College has three tiers. The first tier
has to do with how we understand the learning outcomes of our students.” (Exhibit).
Recommendations
1. Include oral and written communication, abstract reasoning, and critical thinking as
outcomes for all courses.
2. Develop a process for integrative and coherent assessment of student learning.
3. Develop a schedule for the reassessment of courses.
4. Survey students who complete programs for the purpose of assessing their perception
of the quality of education that they received.
PGCC Self-Study
Chapter 14
172
Download