Image and Video Labeling

Image and video labeling using the single user options

Use the Image Labeler and Video Labeler apps to create individual labeling projects for yourself. You can load a set of images or a video, create label definitions and automate the labeling process. To get started labeling a collection of images, see Get Started with the Image Labeler. To get started labeling a video or sequence of images, see Get Started with the Video Labeler.

Apps

Image Labeler	Label images for computer vision applications
Video Labeler	Label video for computer vision applications

Functions

expand all

Create Labels and Label Definitions

Load Data

`cuboid2img`	Project cuboids from 3-D world coordinates to 2-D image coordinates (Since R2022b)
`groundTruthDataSource`	Object for storing ground truth data sources
`pixelLabelDatastore`	Datastore for pixel label data
`boxLabelDatastore`	Datastore for bounding box label data (Since R2019b)
`groundTruth`	Ground truth label data

Create Label Definitions

`labelDefinitionCreator`	Object for storing, modifying and creating label definitions table
`create`	Create label definitions table from the label definition creator object
`info`	Display information about a label, sublabel, or attribute stored in label definition creator object

Add

`addLabel`	Add label to label definition creator object
`addSublabel`	Add sublabel to label in label definition creator object
`addAttribute`	Add attributes to label or sublabel in label definition creator object

Edit

`editLabelGroup`	Modify a label group name (Since R2019a)
`editGroupName`	Change group name (Since R2019a)
`editLabelDescription`	Modify description of label or sublabel in label definition creator object
`editAttributeDescription`	Modify description of attribute in label definition creator object

Remove

`removeLabel`	Remove label from label definition creator object
`removeSublabel`	Remove sublabel from label in label definition creator object
`removeAttribute`	Remove attribute from label or sublabel in label definition creator object

Automate Labeling

Action Flags

`initialize`	Initialize state for algorithm execution (optional)
`run`	Run label automation on every frame in interval
`terminate`	Terminate automated algorithm (optional)

Validation

`checkSetup`	Set up validation (optional)
`checkLabelDefinition`	Validate label definition

Algorithm

`vision.labeler.AutomationAlgorithm`	Interface for algorithm automation in ground truth labeling
`settingsDialog`	Display algorithm settings (optional)
`vision.labeler.mixin.Temporal`	Mixin interface for adding temporal context to automation algorithms
`vision.labeler.mixin.BlockedImageAutomation`	Mixin interface for performing blocked image automation (Since R2021a)
`blockedImageAutomationAlgorithm`	Implements the blocked image automation algorithm (Since R2021a)
`supportsReverseAutomation`	Set reverse algorithm automation flag

Export and Post-process Labels

Store Data

`groundTruth`	Ground truth label data
`merge`	Merge two or more ground truth objects (Since R2023b)
`pixelLabelDatastore`	Datastore for pixel label data
`boxLabelDatastore`	Datastore for bounding box label data (Since R2019b)
`changeFilePaths`	Change file paths in ground truth data
`writeVideoScenes`	Write video sequence to video file (Since R2021b)
`sceneTimeRanges`	Time ranges of scene labels from ground truth data (Since R2021b)
`gatherLabelData`	Gather label data from ground truth (Since R2021a)

Select Labels

`selectLabelsByGroup`	Select ground truth labels by label group (Since R2019a)
`selectLabelsByType`	Select ground truth labels by label type (Since R2019a)
`selectLabelsByName`	Select ground truth labels by label name (Since R2019a)

Enumerate Attribute and Label Types

`attributeType`	Attribute type enumerations for labeling
`labelType`	Label type enumerations for labeling

Create Training Data for Object Detectors

`objectDetectorTrainingData`	Create training data for an object detector
`pixelLabelTrainingData`	Create training data for semantic segmentation from ground truth
`polyToBlockedImage`	Create labeled `blockedImage` object from set of ROIs (Since R2021b)
`merge`	Merge two or more ground truth objects (Since R2023b)

Topics

Get Started

Choose an App to Label Ground Truth Data
Decide which app to use to label ground truth data: Image Labeler, Video Labeler, Ground Truth Labeler, Lidar Labeler, Signal Labeler, or Medical Image Labeler.
Get Started with the Image Labeler
Interactively label rectangular ROIs for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification.
Get Started with the Video Labeler
Interactively label rectangular ROIs for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification in a video or image sequence.
Keyboard Shortcuts and Mouse Actions for Image Labeler
Use keyboard shortcuts and mouse actions to increase productivity while using the Image Labeler app.
Keyboard Shortcuts and Mouse Actions for Video Labeler
Use keyboard shortcuts and mouse actions to increase productivity while using the Video Labeler app.

Load Ground Truth Data Sources

Use Custom Image Source Reader for Labeling
Create a reader function to load a custom image data source into the Ground Truth Labeler or Video Labeler.

Label Ground Truth

Label Pixels for Semantic Segmentation
Label pixels for training a semantic segmentation network by using a labeling app.
Label Objects Using Polygons
Label objects using polygons.
View Summary of Ground Truth Labels
View a summary of ROI and scene labels in a labeling app session.
Use Sublabels and Attributes to Label Ground Truth Data
Learn how ROI sublabels and attributes work in labeling apps.
Label Large Images in the Image Labeler
This section describes the differences with using the Image Labeler app with blocked images.

Automate Labeling

Create Automation Algorithm for Labeling
Create a custom automation algorithm to use in a labeling app.
Create Automation Algorithm Function for Labeling
Create a custom automation algorithm function to use in a labeling app.
Temporal Automation Algorithms
Create a time-based custom tracking algorithm to import into a labeling app.
Blocked Image Automation Algorithms
Create a blocked image custom automation algorithm to import into a labeling app.

Use Ground Truth Labels

Elements of Ground Truth Objects
Understand how to save and pass data using a ground truth data object.
Share and Store Labeled Ground Truth Data
Share and store labeled ground truth data exported from labeling apps.
How Labeler Apps Store Exported Pixel Labels
Learn how the labeling apps store pixel label data.
Training Data for Object Detection and Semantic Segmentation
Create training data for object detection or semantic segmentation using the Image Labeler or Video Labeler.