Image Segmentation Bounding Box

24 views (last 30 days)
Henk-Jan Ramaker
Henk-Jan Ramaker on 31 May 2023
Commented: Image Analyst on 1 Jun 2023
I have a image that contains the topview of an animal. The objective is to isolate the animal from the image. The original image can be seen in the left upper picture form the following figure:
I do some preprocessing steps that lead to the image (inverseBW_filtered) shown in the right lower corner. Using this image, I run the following line of code:
stats = regionprops(inverseBW_filtered, 'BoundingBox', 'Centroid');
Sadly, just one bounding box is found (plotted as the red box). I would have expected to get a few boxes at least with one of them surrounding the animal. Can I get some suggestions how to make sure that the animal gets segmented using regionprops (or any other technique)?
Henk-Jan Ramaker
Henk-Jan Ramaker on 1 Jun 2023
The image is originally from a 3D-depth camera, so you are right about the pseudocoloring. They represent heights.
I like your conceptual idea a lot about the image without an animal. If I get you right:
Picture2 (scenery with an animal) - Picture1 (scenery without animal) = Picture3 (isolated animal).
Picture3 provides good means for further analysis. Unfortunately, I do not have such a Picture1 at this moment.
I now filter Image | BW with a combination of "imclearborder" and "bwareaopen". This results in Image | BW Filtered. After applying the blob analysis (or regionprops) I get the following:
Pratham Shah
Pratham Shah on 1 Jun 2023
I think this is what you wanted, right?

Sign in to comment.

Answers (2)

Pratham Shah
Pratham Shah on 1 Jun 2023
As @Image Analyst rightly mentioned, don't use inverted image for bounding box. Use Image | BW.
To get the bounding box around the animal; If you know the area animal the animal will cover use blobAnalysis function. To remove the white pixels from bottom-right corner you can use 'imclearborder' morphological function.
newBW=imclearborder(ImgBW,8); %You can change '8' depending on your application
blob = vision.BlobAnalysis('BoundingBoxOutputPort', true,...
'AreaOutputPort', false, 'CentroidOutputPort', false, ...
'MinimumBlobArea', 50);
box= step(blob, newBW);
Output = insertShape(Image, 'Rectangle', box, 'Color', 'red','Linewidth',2);
  1 Comment
Henk-Jan Ramaker
Henk-Jan Ramaker on 1 Jun 2023
Thanks Pratham, "imclearborder" certainly helps to clean up the picture!

Sign in to comment.

Image Analyst
Image Analyst on 1 Jun 2023
Edited: Image Analyst on 1 Jun 2023
If you don't have a background image, you can create one by taking the mode of every pixel over all frames in the video (or as many of them as you can fit in memory).
You can even get an estimate for the background if you can hand trace the animal in one frame. Then you can use regionfill to estimate the background underneath the animal. Demos for hand tracing regions are attached.\
It's kind of weird that the height of the animal is both higher and lower than the background at the left of the scene. Do you have a visible light image of the scene you can share? The animal looks like it's shaped like a trough.
Henk-Jan Ramaker
Henk-Jan Ramaker on 1 Jun 2023
Suppose I create these "empty" scenes for a number of pictures where the animals have been removed. How can I use the distrubution of colors from these "empty" pictures wisely to preprocess a new picture (that shows this scenery + animal)?
By the way, the animal is surrounded by a fence. This also shows as a "height". The 3D-depth camera is based on IR technology. As you can see, it's not always delivering up to expectations.
Image Analyst
Image Analyst on 1 Jun 2023
If you have an empty/no-animal image, then you can find the animal by using imabsdiff followed by thresholding.
diffImage = imabsdiff(emptyFrame, currentFrame);
mask = diffImage > someValue; % Threshold to find "tall" things in the scene.
% Take largest blob only.
mask = bwareafilt(mask, 1);

Sign in to comment.




Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!