Package ai.vespa.feed.client.impl
Class DynamicThrottler
java.lang.Object
ai.vespa.feed.client.impl.StaticThrottler
ai.vespa.feed.client.impl.DynamicThrottler
Samples latency as a function of inflight requests, and regularly adjusts to the optimal value.
- Author:
- jonmv
-
Field Summary
Fields inherited from class ai.vespa.feed.client.impl.StaticThrottler
maxInflight, minInflight
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionvoid
sent
(long __, CompletableFuture<ai.vespa.feed.client.HttpResponse> ___) void
success()
long
void
throttled
(long inflight)
-
Constructor Details
-
DynamicThrottler
-
-
Method Details
-
sent
- Overrides:
sent
in classStaticThrottler
-
success
public void success()- Overrides:
success
in classStaticThrottler
-
throttled
public void throttled(long inflight) - Overrides:
throttled
in classStaticThrottler
-
targetInflight
public long targetInflight()- Overrides:
targetInflight
in classStaticThrottler
-