MathWorks Announces MATLAB Integration with NVIDIA TensorRT to Accelerate Artificial Intelligence Applications

Speeds deep learning inference by 5x compared to TensorFlow on NVIDIA GPUs

Natick, MA, United States - (27 Mar 2018)

MathWorks today announced that MATLAB now offers NVIDIA TensorRT integration through GPU Coder. This helps engineers and scientists develop new AI and deep learning models in MATLAB with the performance and efficiency needed to meet the growing demands of data centers, embedded, and automotive applications.

MATLAB provides a complete workflow to rapidly train, validate, and deploy deep learning models. Engineers can use GPU resources without additional programming so they can focus on their applications rather than performance tuning. The new integration of NVIDIA TensorRT with GPU Coder enables deep learning models developed in MATLAB to run on NVIDIA GPUs with high-throughput and low-latency. Internal benchmarks show that MATLAB-generated CUDA code combined with TensorRT can deploy Alexnet with 5x better performance than TensorFlow and can deploy VGG-16 with 1.25x better performance than TensorFlow for deep learning inference.*

“Rapidly evolving image, speech, sensor, and IoT technologies are driving teams to explore AI solutions with better performance and efficiency. In addition, deep learning models are becoming more complex. All of this puts immense pressure on engineers,” said David Rich, director, MathWorks. “Now, teams training deep learning models using MATLAB and NVIDIA GPUs can deploy real-time inference in any environment from the cloud to the data center to embedded edge devices.”

* All benchmarks were run on MATLAB R2018a with GPU Coder, TensorRT 3.0.1, TensorFlow 1.6.0, CUDA 9.0 and cuDNN 7 on an NVIDIA TITAN Xp GPU in a Linux 12 core Intel ® Xeon® E5-1650 v3 PC with 64GB RAM

 

About MathWorks

MathWorks is the leading developer of mathematical computing software. MATLAB, the language of technical computing, is a programming environment for algorithm development, data analysis, visualization, and numeric computation. Simulink is a graphical environment for simulation and Model-Based Design for multidomain dynamic and embedded systems. Engineers and scientists worldwide rely on these product families to accelerate the pace of discovery, innovation, and development in automotive, aerospace, electronics, financial services, biotech-pharmaceutical, and other industries. MATLAB and Simulink are also fundamental teaching and research tools in the world's universities and learning institutions. Founded in 1984, MathWorks employs more than 4000 people in 16 countries, with headquarters in Natick, Massachusetts, USA. For additional information, visit mathworks.com.

MATLAB and Simulink are registered trademarks of The MathWorks, Inc. See mathworks.com/trademarks for a list of additional trademarks. Other product or brand names may be trademarks or registered trademarks of their respective holders.