org.apache.spark.deploy.yarn

YarnRMClient

trait YarnRMClient extends AnyRef

Interface that defines a Yarn RM client. Abstracts away Yarn version-specific functionality that is used by Spark's AM.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. YarnRMClient
  2. AnyRef
  3. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def getAmIpFilterParams(conf: YarnConfiguration, proxyBase: String): Map[String, String]

    Returns the configuration for the AmIpFilter to add to the Spark UI.

  2. abstract def getAttemptId(): ApplicationAttemptId

    Returns the attempt ID.

  3. abstract def getMaxRegAttempts(conf: YarnConfiguration): Int

    Returns the maximum number of attempts to register the AM.

  4. abstract def register(conf: YarnConfiguration, sparkConf: SparkConf, preferredNodeLocations: Map[String, Set[SplitInfo]], uiAddress: String, uiHistoryAddress: String, securityMgr: SecurityManager): YarnAllocator

    Registers the application master with the RM.

    Registers the application master with the RM.

    conf

    The Yarn configuration.

    sparkConf

    The Spark configuration.

    preferredNodeLocations

    Map with hints about where to allocate containers.

    uiAddress

    Address of the SparkUI.

    uiHistoryAddress

    Address of the application on the History Server.

  5. abstract def unregister(status: FinalApplicationStatus, diagnostics: String = ""): Unit

    Unregister the AM.

    Unregister the AM. Guaranteed to only be called once.

    status

    The final status of the AM.

    diagnostics

    Diagnostics message to include in the final status.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  5. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  7. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  8. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  9. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  10. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  11. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  12. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  13. final def notify(): Unit

    Definition Classes
    AnyRef

  14. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  15. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  16. def toString(): String

    Definition Classes
    AnyRef → Any

  17. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  18. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  19. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AnyRef

Inherited from Any

Ungrouped