Learn to let go. That is the key to happiness.
~Jack Kornfield
1
Probability
Section
4.1-4.5
Basic terms and rules
Conditional probability and
independence
Bayes’ rule
2
This lady has lost 10
games in a row on
this slot machine.
Would you play this
slot machine or
another one?
3
Random Circumstance
A random circumstance is one in which the
outcome is unpredictable. The outcome is
unknown until we observe it.
Eg. Toss a die

4
Interpretations of Probability

Given a random circumstance, the probability of a
specific outcome can be interpreted as
1.
(classical interpretation) a % arising from the nature
of the circumstance.
(relative frequency interpretation) the proportion of
times this outcome will occur over a large number
of the same circumstances.
(personal interpretation) what a person believes.
2.
3.
5
Two Ways to Determine Probability
6

Making an assumption about the physical
world and use it to find the probabilities.

Repeating the same circumstances many
times and calculating the relative
frequencies.

Based on the person’s experiences.
Example 1: Coin Flipping
7

What is the probability that a flipped coin
shows heads up?

Simulation in Minitab (random digit table and
binomial way)
Example 2: Traffic Jam on the I-880

< = 30 mph  traffic jam
How often will a driver encounter traffic jam
on the I-880 during 7-9 am in weekdays?
Ans: __ out of 100 times.

8
Terms

Sample space SS: the collection of all
possible outcomes of a random circumstance

An event is a collection of one or more
outcomes in the sample space.

A simple event is an event of one outcome.
** what are the random circumstances of the examples?
** what are the outcomes/sample space/event of the examples?
9
Probability Models
A probability model assigns a value to each
outcome which satisfies the following properties:
 The probability of an outcome must be
between 0 and 1

10
The sum of the probabilities over all possible
outcomes must be 1 (i.e. P(SS) =1)
Probability of an Event

The sum of the probabilities of outcomes in
the event
** Revisit the examples: 1) build up probability
models and 2) find probabilities of events
11
Probability Models
12

A probability model with a finite sample space is
called discrete

A continuous probability model assigns probabilities
as areas under a density curve. The area under the
curve and above any range of values is the
probability of an outcome in that range
Example: randomly pick a number between 0 and 1
Equally Likely Probability Model

If the sample space S is finite in number and
the outcomes have the same likelihood of
occurrence, then each outcome has
probability equal to 1 divided by the number
of possible outcomes and so
# in A
P( A) 
.
# in S
13
Random Variables

A random variable is a function assigning a real value
to an outcome of a RC
The distribution of a random variable X tells us what
values X can take and how to assign probabilities to
those values
Example:
1. # of dots (RC: rolling a die)
2. height of a student (RC: randomly pick from the class)

14
Basic Event Relations
15

Mutually exclusive events
Two events A and B are called mutually
exclusive if the occurrence of one excludes
the occurrence of the other.

Complement events
The complement of an event A is the event
that A does not occur, denoted as A.
Basic Probability Laws



The union of 2 events A and B, A  B , is
the event when either A or B or both
occur.
The intersection of A and B, A  B, is the
event when A and B both occur.
Venn diagram shows us that
P( A  B)  P( A)  P( B)  P( A  B)
16
Operation Laws
17
Conditional Probability
Base on a survey of 1000 government employees:
18
Conditional Probability
19
1.
If an employee is selected randomly (out of
the 1000 surveyed), what is the probability
that the selected one is a male employee?
2.
If a male employee is selected, what is the
probability that he is also married? (called the
conditional probability of selecting a married
employee given that the selected one is male.)
Conditional Probability
P(married| male)=
# of married male employees
# of male employees
i.e. proportion of married male employees
proportion of male employees
20
Conditional Probability

In general, the conditional probability of
event B given event A is
P( A  B)
P( A | B) 
P( B)
21
Independent Events
Event A is called independent of event B if
the knowledge that B has occurred
DOES NOT
change the probability of the occurrence of A,
i.e. P(A|B) = P(A).


22
Does P(B|A) = P(B)?
Independent Events


Events A and B are independent events if and
only if, P(A|B) = P(A) or P(B|A) = P(B).
Otherwise, A and B are dependent.
A and B are independent if and only if,
P( A  B)  P( A) P( B).

A1, A2, …, Ak are independent if and only if,
P( A1  A2  ...Ak)  P( A1) P( A2)...P( Ak).
23
Independent Events


24
An event cannot be both mutually exclusive
and independent (unless it is trivial i.e.
probability 0):
If events are independent, then they cannot
be mutually exclusive.
If events are mutually exclusive, they cannot
be independent.
Independent Events
Example 1:
A red die and a white die are rolled. Define the
events:
A= 4 on red die; B= sum of two dice is odd.
Show that A and B are independent.
Example 2:
Given that P(grade A in 6204)= .60; P(grade A in
6304)= .60; P(grade A in both) =.36. Are A, B
independent?
25
Diagnostic Tests




26
A diagnostic testing or screening is the
application of a test to individuals who have not
yet exhibited any clinical symptoms in order to
classify them with respect to their probability of
having a particular disease.
“sensitivity” is the true + rate
“specificity” is the true - rate
“prevalence” is the proportion of subjects with
the disease in a population
Diagnostic Tests
Consider a common pregnancy test
27
Truth\Test result Positive
Negative
Pregnancy
Correct
False Negative
No pregnancy
False Positive
Correct
Diagnostic Tests
Eg. Pregnancy tests
Sensitivity
False positive rate
Specificity
False negative rate
=
=
=
=
P( + | pregnancy)
P( + | non-preg)
P( - | non-preg)
P( - | pregnancy)
Q: What is the probability that a woman with a positive
result is actually NOT pregnant?
28
Bayes’ Rule
P( A | B) 
29
P( A  B)
P( B)
P( A  B)
C
C
P ( B | A) P( A)  P ( B | A ) P ( A )
Example: Pap Smear
1,000,000
women
Cervical
cancer
83
Test +
70
30
No cervical
cancer
999,917
Test –
13
Test +
186,385
Test –
813,532
Bayes’ Theorem
P( Ai  B)
P( Ai | B) 
P( B | A1) P( A1)  ...  P( B | Ak) P( Ak)
Think of the events A1, A2,…, Ak as representing all possible
conditions that can produce the observable “effect” B. In this
context, the probabilities P(Ai)’s are called prior probabilities. Now
suppose that the effect B is observed to occur. Bayes’ theorem
gives a way to calculate the probability that B was produced or
caused by the particular condition Ai than by any of the other
conditions. The conditional probability P(Ai|B) is called the posterior
probability of Ai .
31
Steps for Finding Probabilities
1.
2.
3.
4.
5.
32
Identify random circumstance
Identify the sample space
Assign whatever probabilities you know
(building a probability model if possible)
Specify the event for which the probability is
wanted
Use the probabilities from step 3 and the
probability rules to find the probability of
interest
Example 4.3:

33
A book club classifies members as heavy,
medium, or light purchasers, and separate
mailings are prepared for each of these
groups. Overall, 20% of the members are
heavy purchasers, 30% medium, and 50%
light.
Example 4.3:

The following % are obtained from existing
records of individuals classified as heavy,
medium, or light purchasers:
1st 3 months’
purchases
34
Group (%)
Heavy
Medium
Light
0
5
15
60
1
10
30
20
2
30
40
15
3+
55
15
5
Example 4.3:



35
If a member is a heavy purchaser, what is
the probability he/she will buy 2 books in the
first 3 months?
What percent of members will buy 2 books in
the first 3 months?
If a member purchases 2 books in the first 3
months, what is the probability that he/she is
a light purchaser?
Tools for Finding Probabilities
36

When conditional or joint probabilities are
known for two events  Two-way tables

For a sequence of events, when conditional
probabilities for events based on previous
events are known  Tree diagrams
Example:

37
People are classified into 8 types. For
instance, Type 1 is “Rationalist” and applies
to 15% of men and 8% of women. Type 2 is
“Teacher” and applies to 12% of men and
14% of women. Each person fits one and
only one type.
Suppose college roommates have a particularly hard time getting
along with each other if they are both “Rationalists.”
A college randomly assigns roommates of the same sex.
What proportion of male roommate pairs will have this problem?
What proportion of female roommate pairs will have this problem?
Assuming that half of college roommate pairs are male and half are female.
What proportion of all roommate pairs will have this problem?
38
A psychologist has noticed that “Teachers” and “Rationalists” get along
particularly well with each other, and she thinks they tend to marry each other.
One of her colleagues disagrees and thinks that the “types” of spouses are
independent of each other.
•
If the “types” are independent, what is the probability that a randomly
selected married couple would consist of one “Rationalist” and one
“Teacher”?
•
In surveys of thousands of randomly selected married couples, she has
found that about 5% of them have one “Rationalist” and one “Teacher.”
Does this contradict her colleague’s theory that the types of spouses are
independent of each other?