SocketTransport
Related Docs:
class SocketTransport
| package remote
Deploys the remote kernel which will connect back to the server (for example by running spark-submit in a subprocess)
Deployment implementation which shells out to spark-submit
An interface to the process created by Deploy
Produces a stream of BitVectors from a SocketChannel.
Produces a stream of BitVectors from a SocketChannel. We should be able to use scodec.stream.decode.StreamDecoder.decodeChannel instead, but it doesn't seem to emit anything. So this auxiliary class is used instead.
It reads a framed message into a single ByteBuffer. The message must be framed by preceeding it with a signed 32-bit big-endian length, not including the 4 bytes of the length itself.
It also includes a method to write such a framed message to the channel from a BitVector.