Simulink Blockset for MuJoCo Simulator

Blocks for accessing MuJoCo physics engine within Simulink
232 Downloads
Updated 19 Nov 2023
Simulink Blockset for MuJoCo Simulator
This repository provides a Simulink® C-MEX S-Function block interface to the MuJoCo™ physics engine.
Useful for,
Robot simulation (mobile, biomimetics, grippers, robotic arm)
Development of autonomous algorithms
Camera (RGB, Depth) rendering
Installation Instructions
MathWorks® Products (https://www.mathworks.com)
MATLAB® (required)
Simulink® (required)
Computer Vision Toolbox™ (optional)
Robotics System Toolbox™ (optional)
Control System Toolbox™ (optional)
Simulink® Coder™ (optional)
MATLAB R2022b or newer is recommended. Install MATLAB with the above products and then proceed to set up MuJoCo blocks.
Note - You may need to rebuild the S-Function if you are using an older release of MATLAB.
Simulink Blockset for MuJoCo
(Linux users) Install GLFW library from Ubuntu terminal
sudo apt update && sudo apt install libglfw3 libglfw3-dev
Download the latest release of this repository (MATLAB Toolbox - MLTBX file)
Open MATLAB R2022b or higher and install the downloaded MATLAB Toolbox file
Run the setup function packaged in the toolbox. MuJoCo (and GLFW for Windows users) library is downloaded and added to MATLAB path.
>>mujoco_interface_setup
(Linux users) The default pathdef.m is likely not saveable in Linux. Save pathdef.m to new location as given in this MATLAB answer.
savepath ~/Documents/MATLAB/pathdef.m
Usage
>>mj_gettingStarted
Open the example model and run it in normal simulation mode.
If the installation is successful, you should see a pendulum model running in a separate window and camera streams displayed by Video Viewer blocks (Computer Vision Toolbox).
A dedicated graphics card is recommended for the best performance. Disable Video Viewer blocks if the model runs slow
(Linux users) - In case MATLAB crashes, it may be due to a glibc bug. Please follow this bug report for a workaround!
Blocks
MuJoCo Plant block steps MuJoCo engine, renders visualization window & camera, sets actuator data, and outputs sensor readings
It takes an XML (MJCF) as the main block parameter. It auto-detects the inputs, sensors, and cameras from XML to configure the block ports and sample time.
Inputs can either be a Simulink Bus or a vector.
Sensors are output as a Simulink Bus.
RGB and Depth buffers from cameras are output as vectors. These can be decoded to Simulink image/matrix using the RGB and Depth Parser blocks.
*Getting started videos can be found from Github.
Build Instructions (optional)
Steps for building/rebuilding the C-MEX S-Function code. These instructions are only required if you are cloning the repository instead of downloading the release.
Windows:
Install one of the following C++ Compiler
Microsoft® Visual Studio® 2022 or higher (recommended)
(or) MinGW (GCC 12.2.0 or higher)
Clone this repository
$ git clone git@github.com:mathworks-robotics/mujoco-simulink-blockset.git
Launch MATLAB and open the repository folder
>> install
Open tools/
Open setupBuild.m. In case you are using MinGW compiler, edit the file and set selectedCompilerWin to "MINGW".
>> setupBuild
>> mex -setup c++
>> build
Ubuntu
Install the tools required for compiling the S-Function
$ sudo apt update && sudo apt install build-essential git libglfw3 libglfw3-dev
Clone this repository
$ git clone git@github.com:mathworks-robotics/mujoco-simulink-blockset.git
Launch MATLAB and open the repository folder. Run the install.m script.
>> install
Open tools/ and run the following commands in MATLAB command Windows
>> setupBuild
>> mex -setup c++
>> build
Tips and Tricks
Code generation - The MuJoCo Plant block supports code generation (Simulink Coder) and monitor and tune for host target. Refer to mj_monitorTune.slx for more info.
Performance improvement - In case you want to reduce the mask initialization overhead, you can directly use the underlying S-Function. Select the MuJoCo Plant block and Ctrl+U to look under the subsystem mask. Make sure to call the initialization functions (whenever the MJCF XML model changes).
Bugs/Workarounds
GLFW
In case MATLAB crashes while running getting started model and you see the following lines in stack trace,
#10 0x00007fdaf8619f40 in glfwCreateWindow () at /lib/x86_64-linux-gnu/libglfw.so.3
#11 0x00007fdaf8675c4d in MujocoGUI::initInThread(offscreenSize*, bool),
Updating glfw could fix the issue.
Building glfw from source (glfw main - commit id) and installing fixed this issue for me,
sudo apt remove libglfw3 libglfw3-dev # Remove existing glfw
mkdir ~/glfwupdated
cd ~/gflwupdated
git clone git@github.com:glfw/glfw.git
sudo apt install cmake-qt-gui
cmake-gui
Set the source directory to the root of cloned repo
mkdir build in the cloned repo
Set the build directory
In Cmake Gui settings - Select "BUILD_SHARED_LIBS" as well
Configure and then generate
Open a terminal in the build directory and run $make in terminal
Once build goes through without any error, run $sudo make install in terminal
sudo ldconfig (to refresh linker cache)
Follow the build instructions for mujoco-simulink-blockset
License
The license is available in the license.txt file within this repository.
Acknowledgments
Cite this work as,
Manoj Velmurugan. Simulink Blockset for MuJoCo Simulator (https://github.com/mathworks-robotics/mujoco-simulink-blockset), GitHub. Retrieved date.
Refer to the MuJoCo repository for guidelines on citing the MuJoCo physics engine.
The sample codes and API documentation provided for MuJoCo and GLFW were used as reference material during development.
MuJoCo and GLFW libraries are dynamically linked against the S-Function and are required for running this blockset.
UR5e MJCF XML from MuJoCo Menagerie was used for creating demo videos.
Community Support
You can post your queries in the discussions section.
Copyright 2023 The MathWorks, Inc.
MATLAB Release Compatibility
Created with R2022b
Compatible with R2022b and later releases
Platform Compatibility
Windows macOS Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Release_glnxa64_2022b_2.3.5

Release_glnxa64_2022b_2.3.5/blocks

Release_glnxa64_2022b_2.3.5/tools

Release_win64_2022b_2.3.5

Release_win64_2022b_2.3.5/blocks

Release_win64_2022b_2.3.5/tools

Release_glnxa64_2022b_2.3.5/blocks

Release_glnxa64_2022b_2.3.5/examples

Release_win64_2022b_2.3.5/blocks

Release_win64_2022b_2.3.5/examples

Version Published Release Notes
3.0.0.0

See release notes for this release on GitHub: https://github.com/mathworks-robotics/mujoco-simulink-blockset/releases/tag/3.0

2.0

See release notes for this release on GitHub: https://github.com/mathworks-robotics/mujoco-simulink-blockset/releases/tag/2.0

1.0.0

To view or report issues in this GitHub add-on, visit the GitHub Repository.
To view or report issues in this GitHub add-on, visit the GitHub Repository.