Class PositionMapBasedWikiPagePartitioner

    • Constructor Detail

      • PositionMapBasedWikiPagePartitioner

        public PositionMapBasedWikiPagePartitioner()
    • Method Detail

      • split

        public java.util.List<java.util.List<WikiPage>> split​(java.util.List<WikiPage> source,
                                                              int partitionCount)
        Description copied from interface: ListPartitioner
        Splits source.
        Specified by:
        split in interface ListPartitioner<WikiPage>
        Parameters:
        source - list to split.
        partitionCount - number of partitions to create.
        Returns:
        list of partitionCount lists each containing zero or more of source's elements.
      • getFullPath

        protected java.lang.String getFullPath​(WikiPage wikiPage)
      • handleUnknownPages

        protected java.util.List<java.util.List<WikiPage>> handleUnknownPages​(java.util.List<java.util.List<WikiPage>> partitionsFromFile,
                                                                              java.util.List<WikiPage> pagesNotPresent)
      • createPartitioner

        protected ListPartitioner<WikiPage> createPartitioner​(java.util.Map<java.lang.String,​java.lang.Integer> partitionMap)
      • setPartitionMap

        public void setPartitionMap​(java.util.Map<java.lang.String,​java.lang.Integer> partitionMap)
      • getPartitionMap

        public java.util.Map<java.lang.String,​java.lang.Integer> getPartitionMap()