Package ai.vespa.feed.client
Class DynamicThrottler
- java.lang.Object
-
- ai.vespa.feed.client.StaticThrottler
-
- ai.vespa.feed.client.DynamicThrottler
-
public class DynamicThrottler extends StaticThrottler
Samples latency as a function of inflight requests, and regularly adjusts to the optimal value.- Author:
- jonmv
-
-
Field Summary
-
Fields inherited from class ai.vespa.feed.client.StaticThrottler
maxInflight, minInflight
-
-
Constructor Summary
Constructors Constructor Description DynamicThrottler(FeedClientBuilder builder)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
sent(long __, java.util.concurrent.CompletableFuture<ai.vespa.feed.client.HttpResponse> ___)
void
success()
long
targetInflight()
void
throttled(long inflight)
-
-
-
Constructor Detail
-
DynamicThrottler
public DynamicThrottler(FeedClientBuilder builder)
-
-
Method Detail
-
sent
public void sent(long __, java.util.concurrent.CompletableFuture<ai.vespa.feed.client.HttpResponse> ___)
- Overrides:
sent
in classStaticThrottler
-
success
public void success()
- Overrides:
success
in classStaticThrottler
-
throttled
public void throttled(long inflight)
- Overrides:
throttled
in classStaticThrottler
-
targetInflight
public long targetInflight()
- Overrides:
targetInflight
in classStaticThrottler
-
-