Implementation of Sutton's mountain car problem using value iteration.
You are now following this Submission
- You will see updates in your followed content feed
- You may receive emails, depending on your communication preferences
Sutton Mountain Car Problem with Value Iteration
Please chek this pdf file for the details on the problem.
Please also check this submission, where a more general dynamic programming algorithm is used to sove this problem. You can also find a general implementation of value iteration implemented there.
This is an example for a 400 x 400 grids:
The car is replaced with Universitas Pertamina's logo ;-)
Cite As
Auralius Manurung (2026). Sutton's Mountain Car Problem with Value Iteration (https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.2), GitHub. Retrieved .
General Information
- Version 2.0.2 (380 KB)
-
View License on GitHub
MATLAB Release Compatibility
- Compatible with any release
Platform Compatibility
- Windows
- macOS
- Linux
| Version | Published | Release Notes | Action |
|---|---|---|---|
| 2.0.2 | See release notes for this release on GitHub: https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.2 |
||
| 2.0.1 | See release notes for this release on GitHub: https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.1 |
||
| 2.0.0 | See release notes for this release on GitHub: https://github.com/auralius/sutton-mountain-car/releases/tag/2.0.0 |
||
| 1.0.0.0 |




