Chapter 2: PMF, PDF, CDF, and Summary Statistics
1. Probability Mass Function (PMF)
Definition: The PMF gives the probability that a discrete random variable is exactly equal to some
value.
Formula: P(X = x) = f(x), where 0 ≤ f(x) ≤ 1 and Σ f(x) = 1
Example (General Life): Rolling a fair die, P(X=3) = 1/6.
Example (Reliability): Number of machine breakdowns in a day.
2. Probability Density Function (PDF)
Definition: The PDF describes the relative likelihood for a continuous random variable to take on a
given value.
Formula: f(x) ≥ 0, and ∫ f(x) dx = 1
Example (General Life): Distribution of people's heights.
Example (Reliability): Time until a light bulb fails often follows an exponential PDF.
3. Cumulative Distribution Function (CDF)
Definition: The CDF gives the probability that a random variable is less than or equal to a certain
value.
Formula: F(x) = P(X ≤ x)
Example (General Life): Probability a student scores ≤ 70 marks.
Example (Reliability): Probability that a machine fails within 100 hours of operation.
4. Cumulative Mass Function (CMF)
Definition: For discrete random variables, CMF is the cumulative version of the PMF.
Formula: F(x) = Σ P(X = k) for k ≤ x
Example (General Life): Probability of rolling ≤ 3 on a die.
Example (Reliability): Probability that ≤ 2 components fail in a system.
5. Expected Value (Mean)
Definition: The expected value is the long-run average value of repetitions of the experiment.
Formulas:
• Discrete: E[X] = Σ x·P(X=x)
• Continuous: E[X] = ∫ x·f(x) dx
Example (General Life): Average of a fair die roll = 3.5.
Example (Reliability): Average lifetime of a component.
6. Variance
Definition: Variance measures the spread of a random variable around its mean.
Formula: Var(X) = E[X²] – (E[X])²
Example (General Life): Variability in exam scores.
Example (Reliability): Variability in machine lifetimes.
7. Standard Deviation
Definition: Standard deviation is the square root of variance. It represents the average deviation
from the mean.
Formula: SD(X) = √Var(X)
Example (General Life): Consistency of student marks.
Example (Reliability): Consistency of product lifetimes.