public class RangeAssignor
extends org.apache.kafka.clients.consumer.internals.AbstractPartitionAssignor
The range assignor works on a per-topic basis. For each topic, we lay out the available partitions in numeric order and the consumers in lexicographic order. We then divide the number of partitions by the total number of consumers to determine the number of partitions to assign to each consumer. If it does not evenly divide, then the first few consumers will have one extra partition.
For example, suppose there are two consumers C0 and C1, two topics t0 and
t1, and each topic has 3 partitions, resulting in partitions t0p0, t0p1,
t0p2, t1p0, t1p1, and t1p2.
The assignment will be:
C0: [t0p0, t0p1, t1p0, t1p1]C1: [t0p2, t1p2]group.instance.id to make the assignment behavior more sticky.
For the above example, after one rolling bounce, group coordinator will attempt to assign new member.id towards consumers,
for example C0 -> C3 C1 -> C2.
The assignment could be completely shuffled to:
C3 (was C0): [t0p2, t1p2] (before was [t0p0, t0p1, t1p0, t1p1])
C2 (was C1): [t0p0, t0p1, t1p0, t1p1] (before was [t0p2, t1p2])
member.id relative order, and
can be avoided by setting the group.instance.id.
Consumers will have individual instance ids I1, I2. As long as
1. Number of members remain the same across generation
2. Static members' identities persist across generation
3. Subscription pattern doesn't change for any member
The assignment will always be:
I0: [t0p0, t0p1, t1p0, t1p1]
I1: [t0p2, t1p2]
org.apache.kafka.clients.consumer.internals.AbstractPartitionAssignor.MemberInfoConsumerPartitionAssignor.Assignment, ConsumerPartitionAssignor.GroupAssignment, ConsumerPartitionAssignor.GroupSubscription, ConsumerPartitionAssignor.RebalanceProtocol, ConsumerPartitionAssignor.Subscription| Modifier and Type | Field and Description |
|---|---|
static String |
RANGE_ASSIGNOR_NAME |
| Constructor and Description |
|---|
RangeAssignor() |
| Modifier and Type | Method and Description |
|---|---|
Map<String,List<TopicPartition>> |
assign(Map<String,Integer> partitionsPerTopic,
Map<String,ConsumerPartitionAssignor.Subscription> subscriptions) |
String |
name()
Unique name for this assignor (e.g.
|
assign, partitions, putclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitgetAssignorInstances, onAssignment, subscriptionUserData, supportedProtocols, versionpublic static final String RANGE_ASSIGNOR_NAME
public String name()
ConsumerPartitionAssignorConsumerConfig.PARTITION_ASSIGNMENT_STRATEGY_CONFIGpublic Map<String,List<TopicPartition>> assign(Map<String,Integer> partitionsPerTopic, Map<String,ConsumerPartitionAssignor.Subscription> subscriptions)
assign in class org.apache.kafka.clients.consumer.internals.AbstractPartitionAssignor