Package ai.djl.modality.cv.translator

Class InstanceSegmentationTranslator

java.lang.Object

ai.djl.modality.cv.translator.BaseImageTranslator<DetectedObjects>

ai.djl.modality.cv.translator.InstanceSegmentationTranslator

All Implemented Interfaces:

PostProcessor<DetectedObjects>, PreProcessor<Image>, Translator<Image,DetectedObjects>

public class InstanceSegmentationTranslator
extends BaseImageTranslator<DetectedObjects>

A BaseImageTranslator that post-process the NDArray into DetectedObjects with boundaries at the detailed pixel level.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	InstanceSegmentationTranslator.Builder	The builder for Instance Segmentation translator.

Nested classes/interfaces inherited from class ai.djl.modality.cv.translator.BaseImageTranslator

BaseImageTranslator.BaseBuilder<T extends BaseImageTranslator.BaseBuilder>, BaseImageTranslator.ClassificationBuilder<T extends BaseImageTranslator.BaseBuilder>, BaseImageTranslator.SynsetLoader

Field Summary

Fields inherited from class ai.djl.modality.cv.translator.BaseImageTranslator

pipeline

Constructor Summary

Constructors

Constructor	Description
InstanceSegmentationTranslator(InstanceSegmentationTranslator.Builder builder)	Creates the Instance Segmentation translator from the given builder.

Method Summary

Modifier and Type	Method	Description
static InstanceSegmentationTranslator.Builder	builder()	Creates a builder to build a InstanceSegmentationTranslator.
static InstanceSegmentationTranslator.Builder	builder(Map<String,?> arguments)	Creates a builder to build a InstanceSegmentationTranslator with specified arguments.
void	prepare(TranslatorContext ctx)	Prepares the translator with the manager and model to use.
NDList	processInput(TranslatorContext ctx, Image image)	Processes the input and converts it to NDList.
DetectedObjects	processOutput(TranslatorContext ctx, NDList list)	Processes the output NDList to the corresponding output object.

Methods inherited from class ai.djl.modality.cv.translator.BaseImageTranslator

getBatchifier

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface ai.djl.translate.Translator

getExpansions, toBatchTranslator, toBatchTranslator

Constructor Details

InstanceSegmentationTranslator

public InstanceSegmentationTranslator(InstanceSegmentationTranslator.Builder builder)

Creates the Instance Segmentation translator from the given builder.

Parameters:

builder - the builder for the translator

Method Details

prepare

public void prepare(TranslatorContext ctx)
             throws IOException

Prepares the translator with the manager and model to use.

Parameters:

ctx - the context for the Predictor.

Throws:

IOException

processInput

public NDList processInput(TranslatorContext ctx,
 Image image)

Processes the input and converts it to NDList.

Specified by:

processInput in interface PreProcessor<Image>

Overrides:

processInput in class BaseImageTranslator<DetectedObjects>

Parameters:

ctx - the toolkit for creating the input NDArray

image - the input object

Returns:

the NDList after pre-processing

processOutput

public DetectedObjects processOutput(TranslatorContext ctx,
 NDList list)

Processes the output NDList to the corresponding output object.

Parameters:

ctx - the toolkit used for post-processing

list - the output NDList after inference, usually immutable in engines like PyTorch. @see Issue 1774

Returns:

the output object of expected type

builder

public static InstanceSegmentationTranslator.Builder builder()

Creates a builder to build a InstanceSegmentationTranslator.

Returns:

a new builder

builder

public static InstanceSegmentationTranslator.Builder builder(Map<String,?> arguments)

Creates a builder to build a InstanceSegmentationTranslator with specified arguments.

Parameters:

arguments - arguments to specify builder options

Returns:

a new builder