I'm trying to understand markov chains and transition probability matrices. I have a recording of time, velocity and acceleration data for a car in three columns. Could someone explain to me how you would generate a two dimensional transition probability matrix of velocity and acceleration. A description of how you would do it would be great.
Would I use this?
Thank you for your help