Chapter 2: PMF, PDF, CMF, and CDF
This chapter introduces four fundamental probability functions used in probability theory and
statistics: PMF (Probability Mass Function), PDF (Probability Density Function), CMF (Cumulative
Mass Function), and CDF (Cumulative Distribution Function). These are crucial tools to describe
random variables, both discrete and continuous.
Probability Mass Function (PMF)
- Used for discrete random variables.
- Defines the probability that a discrete random variable takes a specific value.
Formula: P(X = x) = f(x), where sum f(x) = 1.
Probability Density Function (PDF)
- Used for continuous random variables.
- Represents the density of probability at each point.
Formula: f(x) ≥ 0, ∫ f(x) dx = 1.
Probability in range: P(a ≤ X ≤ b) = ∫ f(x) dx from a to b.
Cumulative Mass Function (CMF)
- Used for discrete random variables.
- Represents the probability that X ≤ x for a discrete distribution.
Formula: F(x) = Σ P(X = k), where k ≤ x.
Cumulative Distribution Function (CDF)
- Used for both discrete and continuous random variables.
- Represents the probability that X ≤ x.
Formula: F(x) = P(X ≤ x).
For continuous variables: F(x) = ∫ f(t) dt from -∞ to x.
Expectation, Variance, and Standard Deviation
- Expected Value (Mean):
For discrete: E[X] = Σ x * P(X=x)
For continuous: E[X] = ∫ x f(x) dx
- Variance: Var(X) = E[X²] - (E[X])²
- Standard Deviation: SD(X) = √Var(X)