Interface StreamingLanguageModel

    • Nested Class Summary

      Nested Classes 
      Modifier and Type Class Description
    • Field Summary

      Fields 
      Modifier and Type Field Description
    • Constructor Summary

      Constructors 
      Constructor Description
    • Enum Constant Summary

      Enum Constants 
      Enum Constant Description
    • Method Summary

      Modifier and Type Method Description
      abstract void generate(String prompt, StreamingResponseHandler<String> handler) Generates a response from the model based on a prompt.
      void generate(Prompt prompt, StreamingResponseHandler<String> handler) Generates a response from the model based on a prompt.
      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
    • Constructor Detail

    • Method Detail

      • generate

         abstract void generate(String prompt, StreamingResponseHandler<String> handler)

        Generates a response from the model based on a prompt.

        Parameters:
        prompt - The prompt.
        handler - The handler for streaming the response.
      • generate

         void generate(Prompt prompt, StreamingResponseHandler<String> handler)

        Generates a response from the model based on a prompt.

        Parameters:
        prompt - The prompt.
        handler - The handler for streaming the response.