Note: This page has been translated by MathWorks. Click here to see

To view all translated materials including this page, select Country from the country navigator on the bottom of this page.

To view all translated materials including this page, select Country from the country navigator on the bottom of this page.

Create discrete-time Markov chain

`dtmc`

creates a discrete-time, finite-state,
time-homogeneous Markov chain from a specified state transition matrix.

After creating a `dtmc`

object, you can analyze the structure and
evolution of the Markov chain, and visualize the Markov chain in various ways, by using
the object
functions.

`mc = dtmc(P)`

`mc = dtmc(P,'StateNames',stateNames)`

creates the discrete-time Markov chain object `mc`

= dtmc(`P`

)`mc`

specified
by the state transition matrix `P`

.

optionally associates the names `mc`

= dtmc(`P`

,`'StateNames'`

,stateNames)`stateNames`

to the
states.

You also can create a Markov chain object using `mcmix`

.

[1]
Gallager, R.G. *Stochastic Processes: Theory for Applications.* Cambridge, UK: Cambridge University Press, 2013.

[2]
Haggstrom, O. *Finite Markov Chains and Algorithmic Applications.* Cambridge, UK: Cambridge University Press, 2002.

[3]
Hamilton, J. D. *Time Series Analysis*. Princeton, NJ: Princeton University Press, 1994.

[4]
Norris, J. R. *Markov Chains.* Cambridge, UK: Cambridge University Press, 1997.