Matlab2TorchRL

Version 1.0.0 (609 KB) by Spinkoo
This project is a pipeline that connects a Matlab simulation (Simulink) to an OpenAI Gym wrapper for PyTorch Reinforcement Learning
5 Downloads
Updated 12 Jun 2024

Matlab2PyTorchRL

This project is a pipeline that connects a Matlab simulation (Simulink) to an OpenAI Gym wrapper for PyTorch Reinforcement Learning using DQN algorithm (and various ML/DL algorithms eventually).

General pipeline

Matlab implementation

Matlab simulations offer an excellent way to model real-world scenarios. This project aims to establish a connection between Matlab simulations and third-party libraries and open-source AI solutions. As such, we have chosen to develop an interface that bridges a Matlab simulation with Python AI libraries

The simulation that we used to test the interface is based on a Robot (Thymio) navigating through a maze, the robot has multiple sensors to measure the distance to nearby walls with the goal of learning how to efficiently navigate throught the maze and exit it safely.

Prerequisites

What things you need to install the software and how to install them:

  • Matlab
  • Simulink
  • OpenAI Gym
  • PyTorch

Installing

  1. Clone the repo : git clone --recursive https://github.com/Spinkoo/Matlab2TorchRL (to get the Matlab2Py submodule)
  2. Navigate to the project directory
  3. Install requirements.txt pip install -r requirements.txt
  4. Install Matlab engine for Python

Running the tests

The trainig process of thymio

Reward graph while training the model

Built With

Authors

Initial work - Spinkoo

License

see the LICENSE.md file for details

Acknowledgments

  • This work was supported by the French National Research Agency under the France 2030 program project IRT Nanoelec (ANR-10-AIRT-05).

Cite As

Spinkoo (2024). Matlab2TorchRL (https://github.com/Spinkoo/Matlab2TorchRL), GitHub. Retrieved .

MATLAB Release Compatibility
Created with R2023a
Compatible with R2018a to R2023b
Platform Compatibility
Windows macOS Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Versions that use the GitHub default branch cannot be downloaded

Version Published Release Notes
1.0.0

To view or report issues in this GitHub add-on, visit the GitHub Repository.
To view or report issues in this GitHub add-on, visit the GitHub Repository.