Assessment Day ‘15
Social Science
Today’s Plan
• 1 – Overview/Background/Questions
• 2 – Ethical Responsibility
– Overview of results/plan for future
• 3 – Critical Thinking
– Discussion of items/ Norming items in groups
• 4 – Odds and Ends from Laura’s office
• 5 – Info Lit./Written Comm. Discussion for those
of us w/ Gordon Rule classes (History, Poli Sci)
1 – Overview/Background/Questions
1 – Overview/Background/Questions
2 – Ethical Responsibility - Overview
• 5 shared questions amongst all Social Science
• 5 discipline specific questions
– This was developed Assessment Day ’14
• We rolled out a small pilot in the Fall ’14
– Only to full time faculty
• We rolled out a 30% sample to all section
Spring’15 – just after spring break
– N= 3455
2 – Ethical Responsibility - Overview
• We rolled out a 30% sample to all section
Spring’15 – just after spring break
• There were some… issues… w/ this roll out.
• The Learning Outcomes Leaders (LOLs) have
proposed a number of changes based on these
issues and our overall experiences.
– I will address these changes after presenting the data
2 – Ethical Responsibility - Results
146/3455= 4.23%
Add in the pilot data from the fall and we had 181
responses
2 – Ethical Responsibility – Shared Results
Q1- Academic Dishonesty – Students are assigned at the start of the term a
midterm exam. This midterm will take place the week after spring break.
While on spring break, one student email the professor and explains that
their uncle has died and they will miss the exam. In the email, they ask if they
could take the midterm exam late. The professor agrees but asks for
verification of the story upon the students’ return. The student returns but
fails to provide any evidence of the story.
60
1
14
2
28
3
49
4
52
5
37
50
40
30
N=181
20
10
1 – Totally ethical with no code violation
0
2 – Mostly ethical with minor code violation
1
2
3 – Kind of ethical and generally accepted for this type of situation
4 – Mostly unethical with minor code violation
5 – Totally unethical and a total code violation
3
4
5
2 – Ethical Responsibility – Shared Results
• Q2 - Cheating– Subhas and Sally are taking a multiple choice test.
After 45 minutes of the test, Sally sneezes accidently and her
scantron sheet flies off the desk. Subhas as a nice gesture picks up
the scantron for Sally, however, prior to giving it back, looks at the
scantron very briefly. After returning to his own test, Subhas then
proceeds to changes several of his answers to what he saw on
Sally’s sheet.
150
1
7
2
5
3
10
4
38
5
120
100
50
N=181
1 – Totally ethical with no code violation
0
2 – Mostly ethical with minor code violation
1
2
3 – Kind of ethical and generally accepted for this type of situation
4 – Mostly unethical with minor code violation
5 – Totally unethical and a total code violation
3
4
5
2 – Ethical Responsibility – Shared Results
• Q3 - Plagiarism– A student is feeling pressured to do a writing
assignment but does not fully understand what is required. As
this student never asked the teacher for clarification nor help, it
has been left until the night before it is due. At this point, the
student asks a friend who previously took the course for help. The
friend loans their old paper to the student who then proceeds to
copy 35% of the paper and fills in their own info the test. The
student then submits the paper to the teacher as their own.
150
1
6
N=181
2
4
3
15
4
40
5
114
100
50
0
1 – Totally ethical with no code violation
1
2
2 – Mostly ethical with minor code violation
3 – Kind of ethical and generally accepted for this type of situation
4 – Mostly unethical with minor code violation
5 – Totally unethical and a total code violation
3
4
5
2 – Ethical Responsibility – Shared Results
• Q4 – Sexual Harassment – A female professor is walking through
campus passes by a former female student and says “Hello.” The
female student responds, “Hi , beautiful, nice to see you again.”
Both keep walking and the conversation ends. The next day, they
see each other again and the student comes over and says, “Hi,
gorgeous, how has your day been?” The professor, feeling
uncomfortable, walks away quickly.
80
1
14
2 3
15 23
N=181
4
57
5
71
60
40
20
1 – Totally ethical with no code violation
0
2 – Mostly ethical with minor code violation
1
2
3 – Kind of ethical and generally accepted for this type of situation
4 – Mostly unethical with minor code violation
5 – Totally unethical and a total code violation
3
4
5
2 – Ethical Responsibility – Shared Results
• Q5 – Class Disruption – During class time, a student has
repeatedly been able to text without a professor noticing.
However, another student in the near proximity has noticed the
texting and has become annoyed by the distraction.
80
1
11
2 3
15 49
N=181
4
69
5
36
60
40
20
0
1
2
3
1 – Totally ethical with no code violation
2 – Mostly ethical with minor code violation
3 – Kind of ethical and generally accepted for this type of situation
4 – Mostly unethical with minor code violation
5 – Totally unethical and a total code violation
4
5
2 – Ethical Responsibility – Discipline
Specific - Psychology N=105
• 1 – My Psychology course challenged me to
think more broadly about poverty, health,
rights of children, and/or issues of prejudice
and discrimination.
SA
A
N
D
SD
43
32
19
5
4
Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD
2 – Ethical Responsibility – Discipline
Specific - Psychology N=105
• 2 – My Psychology course enhanced my ability
to see the world from someone else’s
perspective.
SA
A
N
D
SD
42
42
11
6
2
Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD
2 – Ethical Responsibility – Discipline
Specific - Psychology N=105
• 3 – My Psychology course promoted the
tolerance of others with different beliefs.
SA
A
N
D
SD
45
29
25
2
2
Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD
2 – Ethical Responsibility – Discipline
Specific - Psychology N=105
• 4 – My Psychology course influenced my
openness to having my views challenged.
SA
A
N
D
SD
47
33
18
4
1
Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD
2 – Ethical Responsibility – Discipline
Specific - Psychology N=105
• 5 – My Psychology course promoted the
understanding of differences in culture,
gender, and/or sexual orientation.
SA
A
N
D
SD
45
30
24
2
1
Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD
2 – Ethical Responsibility – Discipline
Specific - Sociology N = 26
Scenario #1 - While you are walking down a busy street you see a
foreman yelling at a construction worker. At first it appears that they
are arguing about the worker’s performance on the job but then you
realize the foreman is criticizing the worker’s resistance to working
overtime during the weekend.
1
1
2
1
3
8
1 – Totally ethical
2 – Mostly ethical
3 – Kind of ethical and generally acceptable
4 – Mostly unethical
5 – Totally unethical
4
8
5
8
2 – Ethical Responsibility – Discipline
Specific - Sociology N = 26
Scenario #2 - A man steals bread from a grocery store in order to
feed his starving wife and children. He is caught, put in jail for a
number of years and his children are removed from their home.
Using the above scale, rate the man’s theft.
1
1
2
3
3
9
1 – Totally ethical
2 – Mostly ethical
3 – Kind of ethical and generally acceptable
4 – Mostly unethical
5 – Totally unethical
4
8
5
5
2 – Ethical Responsibility – Discipline
Specific - Sociology N = 26
Scenario #3 - You are standing in line to vote and you see an elderly
lady struggling with filling out her ballot. She turns to you and asks
for help. You find a volunteer to help her but while you wait she
shows you her ballot and asks what you think. You say “This looks
good.” Rate this reaction using the above scale.
1
2
2
3
3
14
1 – Totally ethical
2 – Mostly ethical
3 – Kind of ethical and generally acceptable
4 – Mostly unethical
5 – Totally unethical
4
3
5
4
2 – Ethical Responsibility – Discipline
Specific - Sociology N = 26
Scenario #4 - On the first day of high school at a new school two
siblings are revealed to have “two mommies.” This is mentioned by
the homeroom teacher and without the siblings consent. The
siblings are not embarrassed but also do not elaborate on the
teacher’s admission. Rate the teacher using the above scale.
1
0
2
2
3
4
1 – Totally ethical
2 – Mostly ethical
3 – Kind of ethical and generally acceptable
4 – Mostly unethical
5 – Totally unethical
4
8
5
12
2 – Ethical Responsibility – Discipline
Specific - Sociology N = 26
Scenario #5 - A young man, about 15 years old, listens to a lot of hip
hop and rap music. His mother hears the music coming from his
bedroom and asks him about the names of some of his favorite
songs. After Googling the songs, and finding the lyrics
objectionable, she demands that he delete the music from his
devises and has a talk with him about why the songs were
objectionable. Rate the mother using the above scale.
1
9
2
5
3
5
1 – Totally ethical
2 – Mostly ethical
3 – Kind of ethical and generally acceptable
4 – Mostly unethical
5 – Totally unethical
4
5
5
2
2 – Ethical Responsibility – Proposed Changes
• Survey either Eth. Resp. or Crit. Thinking every
year – not both.
– 2016 Critical Thinking and 2017 Ethical Resp.
• Survey all Gen. Ed classes in all disciplines
– Not 30% sample
– This allows us to offer pts for completion, etc.
• Increase involvement by part time faculty
2 – Ethical Responsibility – Discussion
• Questions from Laura
1 - What do the results of your assessment suggest about
student preparation in your program?
2 - What are the strengths of your students as shown
through your program assessment? Which areas need to
be strengthened?
3 - What next steps are suggested regarding your program
from the assessment process and outcomes?
4 - Which of these steps can be taken over the next year?
5 - Which of these steps need to be taken over the long
term?
3 – Critical Thinking - Overview
• How was this list of questions developed?
East Questions tend to be a bit different from West
We now have a list of 59 questions.
• The accepted questions will go into a pool.
• When we assess for Critical Thinking – it will
be a 10 item test, drawn from this pool.
3 – Critical Thinking – Group Norming
• We will break into 5 groups lead by LOLs
– Carl, Gina, Adrienne, Derek and Jovan
• You will assess 12 questions as Acceptable, Revise, or
Reject
• The accepted questions will go into a pool.
• When we assess for Critical Thinking – it will be a 10 item
test, drawn from this pool.
Keep in Mind
Questions must be general (not requiring disc. specific knowledge)
Students will be answering 10 of them
Other departments have been shooting for 70% accuracy
3 – Critical Thinking - Discussion
• Thoughts and Concerns about:
– Items/Questions?
– Pool?
– Overall Assessment?
4 – Odds and Ends from Laura’s office
6 - What kinds of faculty development activities are needed?
7 - Is this outcome being assessed in other areas of the
program?
8 - Should the process of communicating the assessment
process and results change next year? If so, how?
9 - How should the process of assessing and reviewing the
results change next year, if at all?
10 - What are the other learning outcomes for the program
and how are they being assessed?
11- Who is responsible for the next steps in the development
of the improvement plan and when should these steps be
taken?
5 – Info Lit./Written Comm.
• Discussion for those of us w/ Gordon Rule
classes (History, Poli Sci)