Student Learning Objectives Assessment Report Criminal Justice Program June 1, 2015

advertisement

Student Learning Objectives Assessment Report

Criminal Justice Program

June 1, 2015

Objectives & Curriculum Objective Mapping

See attached revised Criminal Justice Assessment Mapping Tool (revised Spring 2014)

Objective Assessed

AA - Criminal Justice

No assessment was scheduled for AA-CJ. The information captured in Spring 2014 was related to Objective 1 – Knowledge of Criminal Justice and the results were presented in the 2014 report.

The data were collected from CRIM295 (Ethics in Criminal Justice). This course serves as the highest required course for the AA-CJ and a midpoint course for BA-CJ students.

BA - Criminal Justice

Objective 4: Effective Communication Skills (CRIM 500 – Spring 2014) o 4a. Effective Verbal Communication Skills o 4b. Effective Written Communication Skills

Direct Assessment

BA – Criminal Justice

To assess Objective 4, department faculty outside of the course instructor was selected to either observe final research presentations via face-to-face and online formats or read final research papers for both sections (F2F & online). o The scoring rubrics used were the “Oral Communication Value Rubric” and “Written

Communication Value Rubric” constructed and validated by the Association of American

Colleges & Universities (AACU).

Two sections of Seminar in Criminal Justice (CRIM 500) were taught both face-to-face and online in Spring 2014. Results are provided in aggregate for all sections, and then by section, and a comparison of results by course method (traditional face-to-face and online).

Indirect Assessment

BA – Criminal Justice

Course Grade (n = 30)

BA – Criminal Justice - Analysis of Results

Direct Assessments

Overall Score – Verbal Communication

Class average for two sections:

Online:

2.37 (n=30)

2.16 (n=18)

Face-to-Face: 2.59 (n=12)

Average Scores by Categories

Category

Organization

Language

Delivery

Supporting Material

Central Message

Total Average Score

Total n=30

2.49

2.46

2.37

2.25

2.17

2.38

Overall Score – Written Communication

Class average for two sections: 1.67 (n=30)

Online: 1.67 (n=18)

Face-to-Face: 1.67 (n=12)

Average Scores by Categories

Category

Context & Purpose

Content Development

Genre & Disciplinary

Conventions

Sources &Evidence

Control of Syntax &

Mechanics

Total Average Score

Total n=30

1.89

1.66

1.36

1.60

1.86

1.67

2

Online n=18

2.31

2.27

2.16

2.02

2.04

2.16

Online n=18

1.86

1.56

1.47

1.56

1.92

1.67

Face-to-Face n=12

2.66

2.64

2.57

2.47

2.59

2.59

Face-to-Face n=12

1.92

1.75

1.25

1.63

1.79

1.67

Indirect Assessment

Of 30 students who were enrolled in the two sections of CRIM 500, 2 students attained an A, 21 students achieved a B, 6 received a C, 0 received a D, and 1 received an F in the CRIM 500 course. One student received an F but was not attending class to be evaluated for the verbal or written assessment.

Online Sections

Online

Face-to-Face

Total

A

2

2

B

10

11

21

C

5

1

6

D F

1

1

W

1 (F)

1

The vast majority of criminal justice students received above average grades (n=23). In ascertaining course grades, students were scored on debates, discussion board posts, class presentations and the final paper.

Overall Evaluation

The overall quantitative results demonstrate the criminal justice program is not meeting Objective 4:

Effective Communication Skills in either realm of verbal or written skills. The scores are barely meeting benchmark. The baseline scores are only to be improved upon after assessment of assignments, expectations and standards are discussed during the CJ program’s summer retreat. There seems to be a disconnect between the assessment of faculty given rubric scores and grades achieved, although a partial explanation is reviewers only assessed a portion of the overall class (final papers and presentations).

Potentials Explanations

It is possible research, writing and presentation assignments and skills are lacking within lower-level courses; however, this may be instructor dependent. It is duly noted that instructor diligence and guidance is needed for assignment comprehension and completion in all courses, regardless of level. A review of the research and writing process for papers and presentations may be in order, as well as the types of writing assignments and/or research components in each class.

Areas of Improvement

In Summer 2015, CJ faculty will be provided a form to assess the types and purposes of written assignments and verbal presentations in every courses taught (see Appendix C). Data will be collected and discussions held to determine writing, research, citation, and presentation expectations for upper-, lower- and introductory courses in criminal justice. It is hoped to link these objectives to the Department objectives.

3

A module with resources on research skills and APA citation will be compiled and provided to faculty for consistency of information in all courses. The module would be via the D2L online management system.

Faculty input will be sought for additional information.

A revision of the content for the First Year Experience class may be needed. The revision would include incorporation of research, citation, and writing components. In addition, students would start college resumes as the expectation is a one-page resume by their second year.

Based on the above data, what changes do you propose?

No drastic measures should take place at this time. The CJ program implemented prerequisite courses for all required classes in its major as of Fall 2013. This substantive change may need this upcoming year to determine its effectiveness and impact.

At this time, CJ faculty should determine the level of competency preferred by the final stages of a student’s tenure in the program. Additionally, writing and presentation skills should be introduced sooner into the curriculum. Prior to changes, an assessment of current practices will take place. It is clear the need to write is an important element in the criminal justice field. Even more so, the need to be concise and comprehensive is most important, as well as documentation.

Action Items Proposed (2014-2015 Academic Year)

Review and revision of CRIM 395 internship evaluation forms (Spring 2015)

Analysis of Objective 4a & 4b data from CRIM 500 (completed)

1.

Faculty discussion on results and need for consistency, lower-level course related requirements, etc.

2.

Note: prerequisites for required courses were put in place Fall 2013; improvement should be seen in future cohorts

Data collection for Objective 2a,b,c: CRIM 295 & CRIM 475 (Fall 2014 and Spring 2015)

1.

Rubrics for critical thinking, ethical reasoning and research skills

 http://www.aacu.org/value/rubrics/pdf/CriticalThinking.pdf

 http://www.aacu.org/value/rubrics/pdf/ethicalreasoning.pdf

 All VALUES rubrics: http://www.aacu.org/value/rubrics/pdf/All_Rubrics.pdf

Implement online research skills & citation module for incorporation into ALL relevant CRIMdesignated courses. (TBD – see below)

Action Items Implemented (2014-2015 Academic Year)

Review and revision of CRIM 395 internship evaluation forms (completed)

Analysis of Objective 4a & 4b data from CRIM 500 (completed)

Data collection for Objective 2a,b,c: CRIM 295 & CRIM 475 (completed)

4

2015-2016 Academic Term Plans

Proposal revision of CRIM 395 internship to be sent to UWCC for approval (Fall 2015)

1.

Prerequisite: CRIM 295

2.

Consideration of the application of knowledge of criminal justice system components, criminology, and related courses via questions that require mini-papers in lieu of a major paper (15-20 pages)

Analysis of Objective 2a, b, c: CRIM 295 & CRIM 475 to be completed

Determine standard citation style for papers and presentations (APA)

Implement online research skills & citation module for incorporation into ALL relevant CRIMdesignated courses

Assess the types of writing and research assignments in various CJ classes and any required presentations.

Consider revamping FYE to include writing and citation, resumes, and research skills.

5

Appendix A

Department of Political Science and Criminal Justice

6

Appendix B

Department of Political Science and Criminal Justice

7

Appendix C

Course Writing Assignments & Presentations

Course Number CRIM _______________

Course Title _________________________________________________________________

Writing Assignments (Please provide the # of assignments per category & then check the purpose of the assignment using Bloom’s taxonomy)

_______ Discussion Board Posts _______ Research Paper o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Interview o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Current Event o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Documentary/Movie Paper o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Annotated Bibliography _______ Legal Brief o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Essay/Minute Paper

8 o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Research Presentation o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Other: _______________________________________ o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Other: _______________________________________ o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

_______ Other: _______________________________________ o Evaluation o Synthesis o Analysis o Application o Comprehension o Knowledge

For this class:

APA format discussed/demonstrated? ____ yes

APA citation required? ____ yes

APA resources provided online? ____ yes

9

_____ no

_____ no

_____ no

10

Download