28.11.2014 Views

SOLUTIONS MANUAL for Stochastic Modeling: Analysis and ...

SOLUTIONS MANUAL for Stochastic Modeling: Analysis and ...

SOLUTIONS MANUAL for Stochastic Modeling: Analysis and ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

52 CHAPTER 6. DISCRETE-TIME PROCESSES<br />

6. (a) irreducible, all states recurrent<br />

(b) irreducible subset {2, 5} are recurrent<br />

{1, 3, 4} are transient<br />

(c) irreducible, all states recurrent<br />

7. (a)<br />

6(a)<br />

n =2<br />

n =5<br />

n =20<br />

⎛<br />

⎜<br />

⎝<br />

⎛<br />

⎜<br />

⎝<br />

0.54 0.08 0.09 0.08 0.21<br />

0.27 0.19 0.24 0.02 0.28<br />

0.08 0.26 0.32 0.18 0.16<br />

0.05 0.10 0.01 0.81 0.03<br />

0.31 0.15 0.18 0.02 0.34<br />

⎞<br />

⎟<br />

⎠<br />

0.27496 0.16438 0.19033 0.14404 0.22629<br />

0.34353 0.14109 0.16246 0.12082 0.23210<br />

0.33252 0.11926 0.11720 0.23690 0.19412<br />

0.12455 0.11640 0.06041 0.60709 0.09155<br />

0.33137 0.14745 0.17200 0.11146 0.23772<br />

⎞<br />

⎟<br />

⎠<br />

⎛<br />

⎜<br />

⎝<br />

6(b)<br />

n =2<br />

0.2664964441 0.1393997993 0.1400484926 0.2628192095 0.1912360548<br />

0.2675253416 0.1395887257 0.1406686163 0.2602309763 0.1919863403<br />

0.2632018511 0.1388746569 0.1382171161 0.2707695205 0.1889368557<br />

0.2490755395 0.1364940963 0.1301154884 0.3054031203 0.1789117568<br />

0.2678558364 0.1396398961 0.1408494124 0.2594398254 0.1922150308<br />

⎞<br />

⎟<br />

⎠<br />

⎛<br />

⎜<br />

⎝<br />

0.01 0.55 0.14 0.01 0.29<br />

0 0.74 0 0 0.26<br />

0 0.35 0.09 0 0.56<br />

0 0 0.3 0 0.7<br />

0 0.65 0 0 0.35<br />

⎞<br />

⎟<br />

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!