Interface Embedder.Runtime

Enclosing interface:
Embedder

public static interface Embedder.Runtime
Runtime that is injectable through Embedder constructor.
  • Method Details

    • sampleEmbeddingLatency

      void sampleEmbeddingLatency(double millis, Embedder.Context ctx)
      Sample latency metric for embedding
    • sampleSequenceLength

      void sampleSequenceLength(long length, Embedder.Context ctx)
      Sample sequence length metric for embedding
    • testInstance

      static Embedder.Runtime testInstance()