Markov Chain
2015-10-28 18:52:58 4 举报AI智能生成
为你推荐
查看更多
离散马尔科夫链学习大纲
作者其他创作
大纲/内容
Markov Chain
Continuoes-time Markov chain
Discrete-time Markov chain
Markov Condition
Strong Markov property
Pij=P(?)
Transaction Matrix
One-step transaction probability
(m-step) transaction probability
Chapman-Kolmogorov equation
Collaps transaction matrix
(Discrete) State Space
States
Communicate
Class property
Regular
Closed
Recurrent
Irreducible
Ergodic
Recurrence Time
Tao_i
Number of times return to state i
Ri
Positive
Null
Transient
Periodic
Aperiodic
Pij
Pij(m)
fii
P(ever return to i when start from i)
fij
\\Pi_i
\\Mu_i
Mean recurrence time
Nj
Mean time spent in transient states
Mtt=(I-Ptt)^(-1)
Proof
Shiryaev
(Xn) has an unique stationary distribution
Existence of limiting distribution of (Xn)
Exactly one positive recurrent class
Time reversible Markov chain
Definition
Property
Pi_iPij=Pi_jPji
(Time-homogeneous)
0 条评论
回复 删除
下一页
