Student Learning Objectives Assessment Report
Criminal Justice Program
June 1, 2015
Objectives & Curriculum Objective Mapping
See attached revised Criminal Justice Assessment Mapping Tool (revised Spring 2014)
Objective Assessed
AA - Criminal Justice
No assessment was scheduled for AA-CJ. The information captured in Spring 2014 was related to Objective 1 – Knowledge of Criminal Justice and the results were presented in the 2014 report.
The data were collected from CRIM295 (Ethics in Criminal Justice). This course serves as the highest required course for the AA-CJ and a midpoint course for BA-CJ students.
BA - Criminal Justice
Objective 4: Effective Communication Skills (CRIM 500 – Spring 2014) o 4a. Effective Verbal Communication Skills o 4b. Effective Written Communication Skills
Direct Assessment
BA – Criminal Justice
To assess Objective 4, department faculty outside of the course instructor was selected to either observe final research presentations via face-to-face and online formats or read final research papers for both sections (F2F & online). o The scoring rubrics used were the “Oral Communication Value Rubric” and “Written
Communication Value Rubric” constructed and validated by the Association of American
Colleges & Universities (AACU).
Two sections of Seminar in Criminal Justice (CRIM 500) were taught both face-to-face and online in Spring 2014. Results are provided in aggregate for all sections, and then by section, and a comparison of results by course method (traditional face-to-face and online).
Indirect Assessment
BA – Criminal Justice
Course Grade (n = 30)
BA – Criminal Justice - Analysis of Results
Direct Assessments
Overall Score – Verbal Communication
Class average for two sections:
Online:
2.37 (n=30)
2.16 (n=18)
Face-to-Face: 2.59 (n=12)
Average Scores by Categories
Category
Organization
Language
Delivery
Supporting Material
Central Message
Total Average Score
Total n=30
2.49
2.46
2.37
2.25
2.17
2.38
Overall Score – Written Communication
Class average for two sections: 1.67 (n=30)
Online: 1.67 (n=18)
Face-to-Face: 1.67 (n=12)
Average Scores by Categories
Category
Context & Purpose
Content Development
Genre & Disciplinary
Conventions
Sources &Evidence
Control of Syntax &
Mechanics
Total Average Score
Total n=30
1.89
1.66
1.36
1.60
1.86
1.67
2
Online n=18
2.31
2.27
2.16
2.02
2.04
2.16
Online n=18
1.86
1.56
1.47
1.56
1.92
1.67
Face-to-Face n=12
2.66
2.64
2.57
2.47
2.59
2.59
Face-to-Face n=12
1.92
1.75
1.25
1.63
1.79
1.67
Indirect Assessment
Of 30 students who were enrolled in the two sections of CRIM 500, 2 students attained an A, 21 students achieved a B, 6 received a C, 0 received a D, and 1 received an F in the CRIM 500 course. One student received an F but was not attending class to be evaluated for the verbal or written assessment.
Online Sections
Online
Face-to-Face
Total
A
2
2
B
10
11
21
C
5
1
6
D F
1
1
W
1 (F)
1
The vast majority of criminal justice students received above average grades (n=23). In ascertaining course grades, students were scored on debates, discussion board posts, class presentations and the final paper.
Overall Evaluation
The overall quantitative results demonstrate the criminal justice program is not meeting Objective 4:
Effective Communication Skills in either realm of verbal or written skills. The scores are barely meeting benchmark. The baseline scores are only to be improved upon after assessment of assignments, expectations and standards are discussed during the CJ program’s summer retreat. There seems to be a disconnect between the assessment of faculty given rubric scores and grades achieved, although a partial explanation is reviewers only assessed a portion of the overall class (final papers and presentations).
Potentials Explanations
It is possible research, writing and presentation assignments and skills are lacking within lower-level courses; however, this may be instructor dependent. It is duly noted that instructor diligence and guidance is needed for assignment comprehension and completion in all courses, regardless of level. A review of the research and writing process for papers and presentations may be in order, as well as the types of writing assignments and/or research components in each class.
Areas of Improvement
In Summer 2015, CJ faculty will be provided a form to assess the types and purposes of written assignments and verbal presentations in every courses taught (see Appendix C). Data will be collected and discussions held to determine writing, research, citation, and presentation expectations for upper-, lower- and introductory courses in criminal justice. It is hoped to link these objectives to the Department objectives.
3
A module with resources on research skills and APA citation will be compiled and provided to faculty for consistency of information in all courses. The module would be via the D2L online management system.
Faculty input will be sought for additional information.
A revision of the content for the First Year Experience class may be needed. The revision would include incorporation of research, citation, and writing components. In addition, students would start college resumes as the expectation is a one-page resume by their second year.
Based on the above data, what changes do you propose?
No drastic measures should take place at this time. The CJ program implemented prerequisite courses for all required classes in its major as of Fall 2013. This substantive change may need this upcoming year to determine its effectiveness and impact.
At this time, CJ faculty should determine the level of competency preferred by the final stages of a student’s tenure in the program. Additionally, writing and presentation skills should be introduced sooner into the curriculum. Prior to changes, an assessment of current practices will take place. It is clear the need to write is an important element in the criminal justice field. Even more so, the need to be concise and comprehensive is most important, as well as documentation.
Action Items Proposed (2014-2015 Academic Year)
Review and revision of CRIM 395 internship evaluation forms (Spring 2015)
Analysis of Objective 4a & 4b data from CRIM 500 (completed)
1.
Faculty discussion on results and need for consistency, lower-level course related requirements, etc.
2.
Note: prerequisites for required courses were put in place Fall 2013; improvement should be seen in future cohorts
Data collection for Objective 2a,b,c: CRIM 295 & CRIM 475 (Fall 2014 and Spring 2015)
1.
Rubrics for critical thinking, ethical reasoning and research skills
http://www.aacu.org/value/rubrics/pdf/CriticalThinking.pdf
http://www.aacu.org/value/rubrics/pdf/ethicalreasoning.pdf
All VALUES rubrics: http://www.aacu.org/value/rubrics/pdf/All_Rubrics.pdf
Implement online research skills & citation module for incorporation into ALL relevant CRIMdesignated courses. (TBD – see below)
Action Items Implemented (2014-2015 Academic Year)
Review and revision of CRIM 395 internship evaluation forms (completed)
Analysis of Objective 4a & 4b data from CRIM 500 (completed)
Data collection for Objective 2a,b,c: CRIM 295 & CRIM 475 (completed)
4
2015-2016 Academic Term Plans
Proposal revision of CRIM 395 internship to be sent to UWCC for approval (Fall 2015)
1.
Prerequisite: CRIM 295
2.
Consideration of the application of knowledge of criminal justice system components, criminology, and related courses via questions that require mini-papers in lieu of a major paper (15-20 pages)
Analysis of Objective 2a, b, c: CRIM 295 & CRIM 475 to be completed
Determine standard citation style for papers and presentations (APA)
Implement online research skills & citation module for incorporation into ALL relevant CRIMdesignated courses
Assess the types of writing and research assignments in various CJ classes and any required presentations.
Consider revamping FYE to include writing and citation, resumes, and research skills.
5
Appendix A
Department of Political Science and Criminal Justice
6
Appendix B
Department of Political Science and Criminal Justice
7
Appendix C
Course Number CRIM _______________
Course Title _________________________________________________________________
Writing Assignments (Please provide the # of assignments per category & then check the purpose of the assignment using Bloom’s taxonomy)
_______ Discussion Board Posts _______ Research Paper o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Interview o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Current Event o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Documentary/Movie Paper o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Annotated Bibliography _______ Legal Brief o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Essay/Minute Paper
8 o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Research Presentation o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Other: _______________________________________ o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Other: _______________________________________ o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
_______ Other: _______________________________________ o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge
For this class:
APA format discussed/demonstrated? ____ yes
APA citation required? ____ yes
APA resources provided online? ____ yes
9
_____ no
_____ no
_____ no
10