Sutton's Mountain Car Problem with Value Iteration

Implementation of Sutton's mountain car problem using value iteration.

https://github.com/auralius/sutton-mountain-car

You are now following this Submission

View Sutton's Mountain Car Problem with Value Iteration on File Exchange

Sutton Mountain Car Problem with Value Iteration

Please chek this pdf file for the details on the problem.

Please also check this submission, where a more general dynamic programming algorithm is used to sove this problem. You can also find a general implementation of value iteration implemented there.

This is an example for a 400 x 400 grids:

The car is replaced with Universitas Pertamina's logo ;-)

Cite As

Auralius Manurung (2026). Sutton's Mountain Car Problem with Value Iteration (https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.2), GitHub. Retrieved .

General Information

MATLAB Release Compatibility

  • Compatible with any release

Platform Compatibility

  • Windows
  • macOS
  • Linux
Version Published Release Notes Action
2.0.2

See release notes for this release on GitHub: https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.2

2.0.1

See release notes for this release on GitHub: https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.1

2.0.0

See release notes for this release on GitHub: https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.0

1.0.0.0

To view or report issues in this GitHub add-on, visit the GitHub Repository.
To view or report issues in this GitHub add-on, visit the GitHub Repository.