# Simulating a Continuous time markov chain

159 views (last 30 days)

Show older comments

##### 0 Comments

### Accepted Answer

Dana
on 27 Aug 2020

See here:

##### 20 Comments

Basma Bargal
on 11 Sep 2021

Hi Susman,

Wondering whether you found any code or references on how to go about non-homogenous MArkov Chains in Matlab?

Thanks

### More Answers (1)

Dana
on 3 Feb 2021

Edited: Dana
on 3 Feb 2021

I don't know offhand of any non-homogeneous CTMC references, sorry.

Regarding your case, this part of the help section regarding ths inputs of simCTMC.m is relevant:

% nsim: number of simulations to run (only used if instt is not passed in)

% instt: optional vector of initial states; if passed in, nsim = size of

% instt; otherwise, nsim draws are made from the stationary

% distribution of the Markov chain (if there are multiple stationary

% distributions, an error is returned).

So if you don't pass in a vector of initial states in the variable instt, the program randomly draws nsim initial states from the stationary distribution of the MC. But when you have an absorbing state, the stationary distribution of the MC has probability 1 associated with the absorbing state, and 0 for every other state. If you draw the initial state randomly from this stationary distribution, you're always going to start with the absorbing state, and then of course you'll stay in that state forever, which obviously isn't very interesting.

Long story short, for cases like these you probably want to pick your own initial vector instt. How to pick it is up to you.

### See Also

### Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!