SOLUTIONS MANUAL for Stochastic Modeling: Analysis and ...
SOLUTIONS MANUAL for Stochastic Modeling: Analysis and ...
SOLUTIONS MANUAL for Stochastic Modeling: Analysis and ...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
52 CHAPTER 6. DISCRETE-TIME PROCESSES<br />
6. (a) irreducible, all states recurrent<br />
(b) irreducible subset {2, 5} are recurrent<br />
{1, 3, 4} are transient<br />
(c) irreducible, all states recurrent<br />
7. (a)<br />
6(a)<br />
n =2<br />
n =5<br />
n =20<br />
⎛<br />
⎜<br />
⎝<br />
⎛<br />
⎜<br />
⎝<br />
0.54 0.08 0.09 0.08 0.21<br />
0.27 0.19 0.24 0.02 0.28<br />
0.08 0.26 0.32 0.18 0.16<br />
0.05 0.10 0.01 0.81 0.03<br />
0.31 0.15 0.18 0.02 0.34<br />
⎞<br />
⎟<br />
⎠<br />
0.27496 0.16438 0.19033 0.14404 0.22629<br />
0.34353 0.14109 0.16246 0.12082 0.23210<br />
0.33252 0.11926 0.11720 0.23690 0.19412<br />
0.12455 0.11640 0.06041 0.60709 0.09155<br />
0.33137 0.14745 0.17200 0.11146 0.23772<br />
⎞<br />
⎟<br />
⎠<br />
⎛<br />
⎜<br />
⎝<br />
6(b)<br />
n =2<br />
0.2664964441 0.1393997993 0.1400484926 0.2628192095 0.1912360548<br />
0.2675253416 0.1395887257 0.1406686163 0.2602309763 0.1919863403<br />
0.2632018511 0.1388746569 0.1382171161 0.2707695205 0.1889368557<br />
0.2490755395 0.1364940963 0.1301154884 0.3054031203 0.1789117568<br />
0.2678558364 0.1396398961 0.1408494124 0.2594398254 0.1922150308<br />
⎞<br />
⎟<br />
⎠<br />
⎛<br />
⎜<br />
⎝<br />
0.01 0.55 0.14 0.01 0.29<br />
0 0.74 0 0 0.26<br />
0 0.35 0.09 0 0.56<br />
0 0 0.3 0 0.7<br />
0 0.65 0 0 0.35<br />
⎞<br />
⎟<br />
⎠