Overview: Semantic segmentation allows you to label each pixel of an image with a corresponding class of what is being represented.
Steps to perform semantic segmentation:
1. Click on Label type and select Semantic painting from the top left menu of the editor.
2. Select a category/class from the dropdown.
3. Paint Selection: Click on Paint with Brush using Left-click on the left-hand sidebar. Use Right-Click on the mouse for selecting Painting Mode (Brush or Polygon) to start painting.
4. Selecting Brush/Polygon from Top Panel: Click on Paint at the top panel and select “Paint with Brush/Polygon”.
5. Use mouse left click to paint the image.
6. You can also adjust the brush size. The bigger the brush size, the more surface area it covers.
7. You need to save by clicking on Paint at the top panel or click on save or use Enable Autosave.
8. To erase, click on the eraser icon to erase the paint.
Steps to perform propagate labels in semantic segmentation:
1. Click on “Label type” and select “Semantic painting” from the top left menu of the editor.
2. Paint the complete area in the current frame.
3. On the right side, click on “Propagate paints.”
4. Select the next frame to copy the labels and click on “Copy.”
5. Move to the next frame and the copied labels will be displayed.
6. Make any necessary changes to the current frame, and repeat the above steps to copy the labels to the next frame.
Segment Anything Model (SAM): A new AI model that can “cut out” any object, in any image, with a single click.
Steps to perform Segment Anything in semantic segmentation:
Click on Label type and select Semantic Painting from the top left menu of the editor.
Click on Paint and select Paint using Segment Anything.
Users can label an object by selecting either Points or Box. The more points that are added, the higher the accuracy of the output. For better accuracy, it is advisable to place more points in the center of the object.
After selecting the point/box, click on the Generate label to preview the results. The user can either accept or reject the label.
Click on Paint and select Save to save all the changes made. It is important to note that for Semantic painting, users must manually label by clicking on Save.
Users can overwrite the painted region by selecting Overwrite painted region.
Users can unselect the Paint using the Segment Anything option and make edits using brush/polygon.