Package tensorflow.serving

Class Predict.PredictRequest.RequestOptions

java.lang.Object
com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessage
com.google.protobuf.GeneratedMessageV3
tensorflow.serving.Predict.PredictRequest.RequestOptions
All Implemented Interfaces:
com.google.protobuf.Message, com.google.protobuf.MessageLite, com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder, Serializable, Predict.PredictRequest.RequestOptionsOrBuilder
Enclosing class:
Predict.PredictRequest
public static final class Predict.PredictRequest.RequestOptions extends com.google.protobuf.GeneratedMessageV3 implements Predict.PredictRequest.RequestOptionsOrBuilder
 Options for PredictRequest.
Protobuf type tensorflow.serving.PredictRequest.RequestOptions
See Also:

  • Field Details

    • CLIENT_ID_FIELD_NUMBER

      public static final int CLIENT_ID_FIELD_NUMBER
      See Also:

    • DETERMINISTIC_MODE_FIELD_NUMBER

      public static final int DETERMINISTIC_MODE_FIELD_NUMBER
      See Also:

    • RETURN_ADDITIONAL_ARRAYS_FROM_PREFILL_FIELD_NUMBER

      public static final int RETURN_ADDITIONAL_ARRAYS_FROM_PREFILL_FIELD_NUMBER
      See Also:

    • RETURN_STOPTOKENS_FIELD_NUMBER

      public static final int RETURN_STOPTOKENS_FIELD_NUMBER
      See Also:

  • Method Details

    • newInstance

      protected Object newInstance(com.google.protobuf.GeneratedMessageV3.UnusedPrivateParameter unused)
      Overrides:
      newInstance in class com.google.protobuf.GeneratedMessageV3

    • getDescriptor

      public static final com.google.protobuf.Descriptors.Descriptor getDescriptor()

    • internalGetFieldAccessorTable

      protected com.google.protobuf.GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()
      Specified by:
      internalGetFieldAccessorTable in class com.google.protobuf.GeneratedMessageV3

    • hasClientId

      public boolean hasClientId()
       Client identifier to group requests belonging to a specific entity.
 Example entities can be product ids, service names, user ids etc.
 Servers can use this to optimize placement, caching and colocation.
      optional bytes client_id = 1;
      Specified by:
      hasClientId in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      Whether the clientId field is set.

    • getClientId

      public com.google.protobuf.ByteString getClientId()
       Client identifier to group requests belonging to a specific entity.
 Example entities can be product ids, service names, user ids etc.
 Servers can use this to optimize placement, caching and colocation.
      optional bytes client_id = 1;
      Specified by:
      getClientId in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      The clientId.

    • hasDeterministicMode

      public boolean hasDeterministicMode()
      optional .tensorflow.serving.PredictRequest.RequestOptions.DeterministicMode deterministic_mode = 2;
      Specified by:
      hasDeterministicMode in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      Whether the deterministicMode field is set.

    • getDeterministicModeValue

      public int getDeterministicModeValue()
      optional .tensorflow.serving.PredictRequest.RequestOptions.DeterministicMode deterministic_mode = 2;
      Specified by:
      getDeterministicModeValue in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      The enum numeric value on the wire for deterministicMode.

    • getDeterministicMode

      public Predict.PredictRequest.RequestOptions.DeterministicMode getDeterministicMode()
      optional .tensorflow.serving.PredictRequest.RequestOptions.DeterministicMode deterministic_mode = 2;
      Specified by:
      getDeterministicMode in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      The deterministicMode.

    • hasReturnAdditionalArraysFromPrefill

      public boolean hasReturnAdditionalArraysFromPrefill()
       Only supported in disaggregated serving. When set, additional arrays from
 prefill will be returned if available.
      optional bool return_additional_arrays_from_prefill = 3;
      Specified by:
      hasReturnAdditionalArraysFromPrefill in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      Whether the returnAdditionalArraysFromPrefill field is set.

    • getReturnAdditionalArraysFromPrefill

      public boolean getReturnAdditionalArraysFromPrefill()
       Only supported in disaggregated serving. When set, additional arrays from
 prefill will be returned if available.
      optional bool return_additional_arrays_from_prefill = 3;
      Specified by:
      getReturnAdditionalArraysFromPrefill in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      The returnAdditionalArraysFromPrefill.

    • getReturnStoptokensList

      public List<Long> getReturnStoptokensList()
       Returns these stop tokens in response if the model stops at them. The
 model may stop at other tokens, but will not return them in the response.
      repeated int64 return_stoptokens = 4;
      Specified by:
      getReturnStoptokensList in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      A list containing the returnStoptokens.

    • getReturnStoptokensCount

      public int getReturnStoptokensCount()
       Returns these stop tokens in response if the model stops at them. The
 model may stop at other tokens, but will not return them in the response.
      repeated int64 return_stoptokens = 4;
      Specified by:
      getReturnStoptokensCount in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Returns:
      The count of returnStoptokens.

    • getReturnStoptokens

      public long getReturnStoptokens(int index)
       Returns these stop tokens in response if the model stops at them. The
 model may stop at other tokens, but will not return them in the response.
      repeated int64 return_stoptokens = 4;
      Specified by:
      getReturnStoptokens in interface Predict.PredictRequest.RequestOptionsOrBuilder
      Parameters:
      index - The index of the element to return.
      Returns:
      The returnStoptokens at the given index.

    • isInitialized

      public final boolean isInitialized()
      Specified by:
      isInitialized in interface com.google.protobuf.MessageLiteOrBuilder
      Overrides:
      isInitialized in class com.google.protobuf.GeneratedMessageV3

    • writeTo

      public void writeTo(com.google.protobuf.CodedOutputStream output) throws IOException
      Specified by:
      writeTo in interface com.google.protobuf.MessageLite
      Overrides:
      writeTo in class com.google.protobuf.GeneratedMessageV3
      Throws:
      IOException

    • getSerializedSize

      public int getSerializedSize()
      Specified by:
      getSerializedSize in interface com.google.protobuf.MessageLite
      Overrides:
      getSerializedSize in class com.google.protobuf.GeneratedMessageV3

    • equals

      public boolean equals(Object obj)
      Specified by:
      equals in interface com.google.protobuf.Message
      Overrides:
      equals in class com.google.protobuf.AbstractMessage

    • hashCode

      public int hashCode()
      Specified by:
      hashCode in interface com.google.protobuf.Message
      Overrides:
      hashCode in class com.google.protobuf.AbstractMessage

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(ByteBuffer data) throws com.google.protobuf.InvalidProtocolBufferException
      Throws:
      com.google.protobuf.InvalidProtocolBufferException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException
      Throws:
      com.google.protobuf.InvalidProtocolBufferException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(com.google.protobuf.ByteString data) throws com.google.protobuf.InvalidProtocolBufferException
      Throws:
      com.google.protobuf.InvalidProtocolBufferException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException
      Throws:
      com.google.protobuf.InvalidProtocolBufferException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(byte[] data) throws com.google.protobuf.InvalidProtocolBufferException
      Throws:
      com.google.protobuf.InvalidProtocolBufferException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException
      Throws:
      com.google.protobuf.InvalidProtocolBufferException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(InputStream input) throws IOException
      Throws:
      IOException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException
      Throws:
      IOException

    • parseDelimitedFrom

      public static Predict.PredictRequest.RequestOptions parseDelimitedFrom(InputStream input) throws IOException
      Throws:
      IOException

    • parseDelimitedFrom

      public static Predict.PredictRequest.RequestOptions parseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException
      Throws:
      IOException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(com.google.protobuf.CodedInputStream input) throws IOException
      Throws:
      IOException

    • parseFrom

      public static Predict.PredictRequest.RequestOptions parseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException
      Throws:
      IOException

    • newBuilderForType

      public Predict.PredictRequest.RequestOptions.Builder newBuilderForType()
      Specified by:
      newBuilderForType in interface com.google.protobuf.Message
      Specified by:
      newBuilderForType in interface com.google.protobuf.MessageLite

    • newBuilder

      public static Predict.PredictRequest.RequestOptions.Builder newBuilder()

    • newBuilder

      public static Predict.PredictRequest.RequestOptions.Builder newBuilder(Predict.PredictRequest.RequestOptions prototype)

    • toBuilder

      public Predict.PredictRequest.RequestOptions.Builder toBuilder()
      Specified by:
      toBuilder in interface com.google.protobuf.Message
      Specified by:
      toBuilder in interface com.google.protobuf.MessageLite

    • newBuilderForType

      protected Predict.PredictRequest.RequestOptions.Builder newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent)
      Specified by:
      newBuilderForType in class com.google.protobuf.GeneratedMessageV3

    • getDefaultInstance

      public static Predict.PredictRequest.RequestOptions getDefaultInstance()

    • parser

      public static com.google.protobuf.Parser<Predict.PredictRequest.RequestOptions> parser()

    • getParserForType

      public com.google.protobuf.Parser<Predict.PredictRequest.RequestOptions> getParserForType()
      Specified by:
      getParserForType in interface com.google.protobuf.Message
      Specified by:
      getParserForType in interface com.google.protobuf.MessageLite
      Overrides:
      getParserForType in class com.google.protobuf.GeneratedMessageV3

    • getDefaultInstanceForType

      public Predict.PredictRequest.RequestOptions getDefaultInstanceForType()
      Specified by:
      getDefaultInstanceForType in interface com.google.protobuf.MessageLiteOrBuilder
      Specified by:
      getDefaultInstanceForType in interface com.google.protobuf.MessageOrBuilder