Class CompressedHeaderlessChannelReaderInputView

  • All Implemented Interfaces:
    DataInput, org.apache.flink.core.memory.DataInputView, org.apache.flink.runtime.io.disk.iomanager.RequestDoneCallback<org.apache.flink.runtime.io.network.buffer.Buffer>, org.apache.flink.runtime.io.network.buffer.BufferRecycler

    public class CompressedHeaderlessChannelReaderInputView
    extends org.apache.flink.runtime.io.disk.iomanager.AbstractChannelReaderInputView
    implements org.apache.flink.runtime.io.disk.iomanager.RequestDoneCallback<org.apache.flink.runtime.io.network.buffer.Buffer>, org.apache.flink.runtime.io.network.buffer.BufferRecycler
    A DataInputView that is backed by a BufferFileReader, making it effectively a data input stream. The view reads it data in blocks from the underlying channel and decompress it before returning to caller. The view can only read data that has been written by CompressedHeaderlessChannelWriterOutputView, due to block formatting.
    • Nested Class Summary

      • Nested classes/interfaces inherited from interface org.apache.flink.runtime.io.network.buffer.BufferRecycler

        org.apache.flink.runtime.io.network.buffer.BufferRecycler.DummyBufferRecycler
    • Field Summary

      • Fields inherited from class org.apache.flink.runtime.memory.AbstractPagedInputView

        headerLength
    • Constructor Summary

      Constructors 
      Constructor Description
      CompressedHeaderlessChannelReaderInputView​(org.apache.flink.runtime.io.disk.iomanager.FileIOChannel.ID id, org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager, org.apache.flink.runtime.io.compression.BlockCompressionFactory compressionCodecFactory, int compressionBlockSize, int numBlocks)  
    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      List<org.apache.flink.core.memory.MemorySegment> close()  
      org.apache.flink.runtime.io.disk.iomanager.FileIOChannel getChannel()  
      protected int getLimitForSegment​(org.apache.flink.core.memory.MemorySegment segment)  
      org.apache.flink.runtime.io.disk.iomanager.BufferFileReader getReader()  
      boolean isClosed()  
      protected org.apache.flink.core.memory.MemorySegment nextSegment​(org.apache.flink.core.memory.MemorySegment current)  
      void recycle​(org.apache.flink.core.memory.MemorySegment segment)  
      void requestFailed​(org.apache.flink.runtime.io.network.buffer.Buffer buffer, IOException e)  
      void requestSuccessful​(org.apache.flink.runtime.io.network.buffer.Buffer request)  
      • Methods inherited from class org.apache.flink.runtime.memory.AbstractPagedInputView

        advance, clear, doAdvance, getCurrentPositionInSegment, getCurrentSegment, getCurrentSegmentLimit, getHeaderLength, read, read, readBoolean, readByte, readChar, readDouble, readFloat, readFully, readFully, readInt, readLine, readLong, readShort, readUnsignedByte, readUnsignedShort, readUTF, seekInput, skipBytes, skipBytesToRead
    • Constructor Detail

      • CompressedHeaderlessChannelReaderInputView

        public CompressedHeaderlessChannelReaderInputView​(org.apache.flink.runtime.io.disk.iomanager.FileIOChannel.ID id,
                                                          org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager,
                                                          org.apache.flink.runtime.io.compression.BlockCompressionFactory compressionCodecFactory,
                                                          int compressionBlockSize,
                                                          int numBlocks)
                                                   throws IOException
        Throws:
        IOException
    • Method Detail

      • nextSegment

        protected org.apache.flink.core.memory.MemorySegment nextSegment​(org.apache.flink.core.memory.MemorySegment current)
                                                                  throws IOException
        Specified by:
        nextSegment in class org.apache.flink.runtime.memory.AbstractPagedInputView
        Throws:
        IOException
      • getReader

        public org.apache.flink.runtime.io.disk.iomanager.BufferFileReader getReader()
      • getLimitForSegment

        protected int getLimitForSegment​(org.apache.flink.core.memory.MemorySegment segment)
        Specified by:
        getLimitForSegment in class org.apache.flink.runtime.memory.AbstractPagedInputView
      • close

        public List<org.apache.flink.core.memory.MemorySegment> close()
                                                               throws IOException
        Specified by:
        close in class org.apache.flink.runtime.io.disk.iomanager.AbstractChannelReaderInputView
        Throws:
        IOException
      • getChannel

        public org.apache.flink.runtime.io.disk.iomanager.FileIOChannel getChannel()
        Specified by:
        getChannel in class org.apache.flink.runtime.io.disk.iomanager.AbstractChannelReaderInputView
      • isClosed

        public boolean isClosed()
      • requestSuccessful

        public void requestSuccessful​(org.apache.flink.runtime.io.network.buffer.Buffer request)
        Specified by:
        requestSuccessful in interface org.apache.flink.runtime.io.disk.iomanager.RequestDoneCallback<org.apache.flink.runtime.io.network.buffer.Buffer>
      • requestFailed

        public void requestFailed​(org.apache.flink.runtime.io.network.buffer.Buffer buffer,
                                  IOException e)
        Specified by:
        requestFailed in interface org.apache.flink.runtime.io.disk.iomanager.RequestDoneCallback<org.apache.flink.runtime.io.network.buffer.Buffer>
      • recycle

        public void recycle​(org.apache.flink.core.memory.MemorySegment segment)
        Specified by:
        recycle in interface org.apache.flink.runtime.io.network.buffer.BufferRecycler