Uses of Class
org.apache.flink.runtime.scheduler.adaptivebatch.BlockingInputInfo
-
Packages that use BlockingInputInfo Package Description org.apache.flink.runtime.scheduler.adaptivebatch org.apache.flink.runtime.scheduler.adaptivebatch.util -
-
Uses of BlockingInputInfo in org.apache.flink.runtime.scheduler.adaptivebatch
Method parameters in org.apache.flink.runtime.scheduler.adaptivebatch with type arguments of type BlockingInputInfo Modifier and Type Method Description ParallelismAndInputInfosDefaultVertexParallelismAndInputInfosDecider. decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId, List<BlockingInputInfo> consumedResults, int vertexInitialParallelism, int vertexMinParallelism, int vertexMaxParallelism)ParallelismAndInputInfosVertexParallelismAndInputInfosDecider. decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId, List<BlockingInputInfo> consumedResults, int vertexInitialParallelism, int vertexMinParallelism, int vertexMaxParallelism)Decide the parallelism andJobVertexInputInfos for this job vertex. -
Uses of BlockingInputInfo in org.apache.flink.runtime.scheduler.adaptivebatch.util
Methods in org.apache.flink.runtime.scheduler.adaptivebatch.util that return types with arguments of type BlockingInputInfo Modifier and Type Method Description static List<BlockingInputInfo>VertexParallelismAndInputInfosDeciderUtils. getNonBroadcastInputInfos(List<BlockingInputInfo> consumedResults)Methods in org.apache.flink.runtime.scheduler.adaptivebatch.util with parameters of type BlockingInputInfo Modifier and Type Method Description static JobVertexInputInfoVertexParallelismAndInputInfosDeciderUtils. createdJobVertexInputInfoForBroadcast(BlockingInputInfo inputInfo, int parallelism)static JobVertexInputInfoVertexParallelismAndInputInfosDeciderUtils. createdJobVertexInputInfoForNonBroadcast(BlockingInputInfo inputInfo, List<IndexRange> subpartitionSliceRanges, List<SubpartitionSlice> subpartitionSlices)static voidVertexParallelismAndInputInfosDeciderUtils. logBalancedDataDistributionOptimizationResult(org.slf4j.Logger logger, JobVertexID jobVertexId, BlockingInputInfo inputInfo, JobVertexInputInfo optimizedJobVertexInputInfo)Logs the data distribution optimization info when a balanced data distribution algorithm is effectively optimized compared to the num-based data distribution algorithm.Method parameters in org.apache.flink.runtime.scheduler.adaptivebatch.util with type arguments of type BlockingInputInfo Modifier and Type Method Description static longVertexParallelismAndInputInfosDeciderUtils. calculateDataVolumePerTaskForInputsGroup(long globalDataVolumePerTask, List<BlockingInputInfo> inputsGroup, List<BlockingInputInfo> allInputs)static booleanVertexParallelismAndInputInfosDeciderUtils. checkAndGetIntraCorrelation(List<BlockingInputInfo> inputInfos)static intVertexParallelismAndInputInfosDeciderUtils. checkAndGetSubpartitionNum(List<BlockingInputInfo> consumedResults)Map<IntermediateDataSetID,JobVertexInputInfo>AllToAllVertexInputInfoComputer. compute(JobVertexID jobVertexId, List<BlockingInputInfo> inputInfos, int parallelism, int minParallelism, int maxParallelism, long dataVolumePerTask)Decide parallelism and input infos, which will make the data be evenly distributed to downstream subtasks for ALL_TO_ALL, such that different downstream subtasks consume roughly the same amount of data.Map<IntermediateDataSetID,JobVertexInputInfo>PointwiseVertexInputInfoComputer. compute(List<BlockingInputInfo> inputInfos, int parallelism, int minParallelism, int maxParallelism, long dataVolumePerTask)Decide parallelism and input infos, which will make the data be evenly distributed to downstream subtasks for POINTWISE, such that different downstream subtasks consume roughly the same amount of data.static AggregatedBlockingInputInfoAggregatedBlockingInputInfo. createAggregatedBlockingInputInfo(long defaultSkewedThreshold, double skewedFactor, long dataVolumePerTask, List<BlockingInputInfo> inputInfos)static Map<IntermediateDataSetID,JobVertexInputInfo>VertexParallelismAndInputInfosDeciderUtils. createJobVertexInputInfos(List<BlockingInputInfo> inputInfos, Map<Integer,List<SubpartitionSlice>> subpartitionSlices, List<IndexRange> subpartitionSliceRanges, Function<Integer,Integer> subpartitionSliceKeyResolver)static intVertexParallelismAndInputInfosDeciderUtils. getMaxNumPartitions(List<BlockingInputInfo> consumedResults)static List<BlockingInputInfo>VertexParallelismAndInputInfosDeciderUtils. getNonBroadcastInputInfos(List<BlockingInputInfo> consumedResults)static booleanVertexParallelismAndInputInfosDeciderUtils. hasSameNumPartitions(List<BlockingInputInfo> inputInfos)
-