Package ai.djl.inference.streaming
Contains classes to implement streaming inference tasks.
- See Also:
Predictor
-
Interface Summary Interface Description StreamingBlock ABlock
possessing the additional streaming forward capabilities used byPredictor.streamingPredict(Object)
.StreamingTranslator<I,O> An expansion of theTranslator
with postProcessing for theStreamingBlock
(used byPredictor.streamingPredict(Object)
. -
Class Summary Class Description ChunkedBytesSupplier A {link BytesSupplier} that supports chunked reading.IteratorBytesSupplier AnIteratorBytesSupplier
is a streamingBytesSupplier
suitable for synchronous usage.PublisherBytesSupplier AnPublisherBytesSupplier
is a streamingBytesSupplier
suitable for reactive asynchronous usage.StreamingTranslator.StreamOutput<O> AStreamingTranslator.StreamOutput
represents a streamable output type (either iterative or asynchronous). -
Enum Summary Enum Description StreamingTranslator.Support What types ofStreamingTranslator.StreamOutput
s are supported by aStreamingTranslator
.