Data in Context
Week 03: Ethics & Accountability
What did we cover LAST week?
• The relationship between technology & society
• Technological determinism
• The social construction of technology
• Social shaping of technology/Affordances
• What data can do
• Tracking
• Homogenizing
• Triaging
• Nudging
• Valuating
Our large, overarching questions from
last week
Our big questions were: What is the range of possible
effects a technology can have? How can we think about
whether those effects are morally good, morally bad, or
morally neutral?
So, this leads us to this week’s focus – the ethics of
algorithms.
PART 1
Roadmap for
today
• Lecture: Ethical frameworks for algorithms
• TED talk & discussion:What moral decisions should
driverless cars make?
• In-class exercise 1:The Moral Machine Experiment
PART 2
• Lecture: Algorithmic accountability
• In-class exercise 2: Medical imaging programs
• Case Study 1 Review
Algorithms & ethics
Can machines learn human
morality? If so, how?
Algorithms & ethics
Delphi (2021; these days they’re offering a “Digital Clone”)
• A neural network that
”learned” ethics by analyzing
1.7 million ethical decisions
made by real humans
• Made in the hope to build
an ethical framework for
machines
• “It’s a first step toward
making A.I. systems
more ethically
informed, socially aware
and culturally inclusive.”
–Yejin Choi, the leader
of the project
Algorithms &
ethics
•
https://delphi.allen.ai/
A recent article on Delphi
experiment:
https://www.nature.com/
articles/s42256-02400969-6
Algorithms &
ethics
Delphi reflects the choices made by its creators, including the
ethical scenarios they chose to feed into the system and the online
workers they chose to judge those scenarios
Ethical frameworks
What ethical frameworks exist that would help us
determine the morality of machines/algorithms?
Utilitarianism
Kantian deontology
Ethical frameworks
1. Utilitarianism (Jeremy Bentham
and John Stuart Mill)
:The moral permissibility of a
given action depends on the
consequences the action
produces, not the intentions of
the actor
Utilitarianism
Ethical frameworks
1. Utilitarianism (Jeremy Bentham and John
Stuart Mill)
The moral permissibility of a given action
depends on the consequences the action
produces, not the intentions of the actor
Actions are immoral if they cause pain,
suffering, or unhappiness; actions are moral if
they cause happiness or pleasure
An action is moral if it produces more
pleasure than it does pain
Ethical frameworks
1.Utilitarianism (Jeremy Bentham and John Stuart Mill)
: The moral permissibility of a given action depends on the
consequences the action produces, not the intentions of the
actor
: Actions are immoral if they cause pain, suffering, or
unhappiness; actions are moral if they cause happiness or
pleasure
An action is moral if it produces more pleasure than
it does pain
: Per Bentham, people should adhere to the “greatest
happiness principle,” striving to take actions that will yield
“the greatest happiness for the greatest number”
Ex. A doctor killing one to save five; a person’s life
with a family is worth more than a person without
one
Ethical frameworks
1.Utilitarianism (Jeremy Bentham and John Stuart Mill)
: The moral permissibility of a given action depends on the
consequences the action produces, not the intentions of the
actor
: Actions are immoral if they cause pain, suffering, or
unhappiness; actions are moral if they cause happiness or
pleasure
An action is moral if it produces more pleasure than
it does pain
: Per Bentham, people should adhere to the “greatest
happiness principle,” striving to take actions that will yield
“the greatest happiness for the greatest number”
Ex. A doctor killing one to save five; a person’s life
with a family is worth more than a person without one
Pros? Cons?
Ethical frameworks
Deontology (aka Kantian deontology)
•The morality of an action should be
based on whether that action is right
or wrong, regardless of the
consequences
•White lie?
Deontology (aka Kantian deontology)
Ethical frameworks
We must act according to the Categorical Imperative
• Categorical imperative: Absolute,
unconditional requirement that must be
obeyed in all circumstances
• Against hypothetical moral systems,
which rely on subjective considerations
• Our actions must follow universal maxims
(e.g., killing is morally impermissible) that
are determined to be moral through the
exercise of “pure reason”
Kantian deontology
Ethical frameworks
2.Deontology (aka Kantian deontology)
-How can we determine what actions
are moral?
-Universalizability: Moral
maxims are universal (i.e., one
should not do something unless
it would be morally permissible
for all people do that thing)
-Humans must be treated as ends
in themselves, and must not be
used as mere means in ways that
diminish their autonomy
Ethical frameworks
2.Deontology (aka Kantian deontology)
-How can we determine what actions
are moral?
-Universalizability: Moral
maxims are universal (i.e., one
should not do something unless
it would be morally permissible
for all people do that thing)
-Humans must be treated as ends
in themselves, and must not be
used as mere means in ways that
diminish their autonomy
Pros? Cons?
The Trolley Problem
•
•
•
•
•
What would be the utilitarian choice?
What about the Kantian choice?
What would be your choice?Why?
What if automated or semi-automated systems would have to make these
choices?
PART 1
Roadmap for
today
• Lecture: Ethical frameworks for algorithms
• TED talk & discussion:What moral decisions should
driverless cars make?
• In-class exercise 1:The Moral Machine Experiment
PART 2
• Lecture: Algorithmic accountability
• In-class exercise 2: Medical imaging programs
• Case Study 1 Review
Case study: Moral decisions & driverless cars
•
https://www.youtube.com/watch?v=tb-WdVA4_bo
“In-class" Exercise
• Go to moralmachine.net and complete the exercise (“start judging”). Make sure
you read the descriptions!
Write your responses to the following questions and post them on the Canvas
discussion board
• What’s your most saved character? Your most killed character?
• What surprised you? Did you find anything disturbing or problematic?
“In-Class" Exercise
• Bigger question:
• What ethical
judgments should
algorithmic selfdriving cars rely on?