Text Analytics Toolbox Model for BERT-Mini Network

Pretrained BERT-Mini Network for MATLAB
Updated 20 Mar 2024
BERT-Mini is a pretrained language model based on Deep Learning Transformer architecture that can be used for a wide variety of Natural Language Processing (NLP) tasks. This model has 4 self-attention layers and a hidden size of 256.
To load a BERT-Mini model, you can run the following code:
[net, tokenizer] = bert(Model="mini");
MATLAB Release Compatibility
Created with R2023b
Compatible with R2023b to R2024a
Platform Compatibility
Windows macOS (Apple silicon) macOS (Intel) Linux

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!