File Exchange

image thumbnail

Markov Decision Process - Pendulum Control

version 1.4.0.0 (20.5 KB) by Matthew Kelly
Creates a Markov Decision Process model of a pendulum, then finds optimal swing-up policy.

3 Downloads

Updated 21 Feb 2016

GitHub view license on GitHub

Takes a single pendulum (with a torque actuator) and models it as a Markov Decision Process (MDP), using linear barycentric interpolation over a uniform grid. Then, value iteration is used to compute the optimal policy, which is then displayed as a plot. Finally, a simulation is run to demonstrate how to evaluate the optimal policy.

Comments and Ratings (1)

Updates

1.4.0.0

Changed name

1.3.0.0

updated photo

1.2.0.0

added a photo.

1.1.0.0

Improved error handling regarding the MEX functions.

MATLAB Release Compatibility
Created with R2014a
Compatible with any release
Platform Compatibility
Windows macOS Linux