Label ground truth data for automated driving applications
The Ground Truth Labeler app enables you to label ground truth data in a video, in an image sequence, or from a custom data source reader. Using the app, you can:
Define rectangular regions of interest (ROI) labels, polyline ROI labels, pixel ROI labels, and scene labels, and use these labels to interactively label your ground truth data.
Use built-in detection or tracking algorithms to label your ground truth data.
Write, import, and use your own custom automation algorithm to automatically label ground truth. See Create Automation Algorithm for Labeling (Computer Vision System Toolbox).
Evaluate the performance of your label automation algorithms using a visual summary. See View Summary of Ground Truth Labels (Computer Vision System Toolbox).
Export the labeled ground truth as a groundTruth
object. You can use
this object for system verification or for training an object detector or
semantic segmentation network. See Train Object Detector or Semantic Segmentation Network from Ground Truth Data (Computer Vision System Toolbox).
Display time-synchronized signals, such as lidar or CAN bus data, using the
driving.connector.Connector
API.
To learn more about the app, see Ground Truth Labeler App.
MATLAB® Toolstrip: On the Apps tab, under Automotive, click the app icon.
MATLAB command prompt: Enter groundTruthLabeler
.
The built-in automation algorithms support the automation of rectangular ROI labels only. When you select a built-in algorithm and click Automate, scene labels, pixel labels, polyline labels, sublabels, and attributes are not imported into the automation session. To automate the labeling of these features, create a custom automation algorithm. See Create Automation Algorithm for Labeling (Computer Vision System Toolbox).
Pixel ROI labels do not support sublabels or attributes.
The Label Summary window does not support sublabels or attributes
To avoid having to relabel ground truth with new labels, organize the labeling scheme you want to use before marking your ground truth.
The Ground Truth Labeler app provides built-in algorithms that you can use to automate labeling. From the app toolstrip, click Select Algorithm, and then select an automation algorithm.
Built-In Automation Algorithm | Description |
---|---|
ACF People Detector | Detect and label people using a pretrained detector based on aggregate channel features (ACF). With this algorithm, you do not need to draw any ROI labels. |
Point Tracker | Track and label one or more rectangular ROI labels over short intervals using the Kanade-Lucas-Tomasi (KLT) algorithm. |
Temporal Interpolator | Estimate ROIs in intermediate frames using the interpolation of rectangular ROIs in key frames. Draw ROIs on a minimum of two frames (at the beginning and at the end of the interval). The interpolation algorithm estimates the ROIs between the frames. |
ACF Vehicle Detector | Detect and label vehicles using a pretrained detector based on ACF. With this algorithm, you do not need to draw any ROI labels. |