Package dev.langchain4j.service

Interface TokenStream

All Known Implementing Classes:
AiServiceTokenStream
public interface TokenStream
Represents a token stream from language model to which you can subscribe and receive updates when a new token is available, when language model finishes streaming, or when an error occurs during streaming. It is intended to be used as a return type in AI Service.

  • Method Summary

    Modifier and Type
    Method
    Description
    OnCompleteOrOnError
    onNext(Consumer<String> tokenHandler)
    The provided consumer will be invoked every time a new token from a language model is available.

  • Method Details

    • onNext

      OnCompleteOrOnError onNext(Consumer<String> tokenHandler)
      The provided consumer will be invoked every time a new token from a language model is available.
      Parameters:
      tokenHandler - lambda that consumes tokens of the response
      Returns:
      the next step of a step-builder