Skip to content

spark-TransportContext.adoc

Latest commit

 

History

History
65 lines (46 loc) · 2.07 KB

spark-TransportContext.adoc

File metadata and controls

65 lines (46 loc) · 2.07 KB

TransportContext

TransportContext is…​FIXME

createChannelHandler Internal Method

TransportChannelHandler createChannelHandler(Channel channel, RpcHandler rpcHandler)

createChannelHandler…​FIXME

Note
 createChannelHandler is used exclusively when TransportContext is requested to initializePipeline.

initializePipeline Method

TransportChannelHandler initializePipeline(SocketChannel channel) // (1)
TransportChannelHandler initializePipeline(
  SocketChannel channel,
  RpcHandler channelRpcHandler)

  1. Simply calls the other initializePipeline with the RpcHandler

initializePipeline…​FIXME

Note

initializePipeline is used when:

  • TransportServer is requested to init

  • TransportClientFactory is requested to createClient

Creating TransportServer on Host and Port — createServer Method

TransportServer createServer()  // (1)
TransportServer createServer(int port, List<TransportServerBootstrap> bootstraps) // (2)
TransportServer createServer(List<TransportServerBootstrap> bootstraps) // (3)
TransportServer createServer(
  String host, int port, List<TransportServerBootstrap> bootstraps)

  1. Uses 0 for the port and no bootstraps. Used exclusively for testing

  2. Uses null for the host

  3. Used exclusively for testing

createServer simply creates a TransportServer (with the current TransportContext, the host, the port, the RpcHandler and the bootstraps).

Note

createServer is used when:

  • NettyBlockTransferService is requested to createServer

  • NettyRpcEnv is requested to startServer

  • ExternalShuffleService is requested to start

  • Spark on YARN’s YarnShuffleService is requested to serviceInit