IE 434/ IE 534 – Stochastic Models in Operations Research
HW#.1
Due to: (17:00), Tuesday, September, 29, 2009 at EA 323.
All the problems are taken from the course textbook by Ross (Introduction to Probability Models,
9th Edition, 2007, Chapter 4)
Note: To solve the following problem, please check the gambler’s ruin problem in your text,
Chapter 4.
(a)
(b)
Define an appropriate Markov chain to analyze this model.
Find the long-run probabilities.
1