org.apache.spark.deploy.history

HistoryServer

class HistoryServer extends WebUI with Logging

A web server that renders SparkUIs of completed applications.

For the standalone mode, MasterWebUI already achieves this functionality. Thus, the main use case of the HistoryServer is in other deploy modes (e.g. Yarn or Mesos).

The logging directory structure is as follows: Within the given base directory, each application's event logs are maintained in the application's own sub-directory. This is the same structure as maintained in the event log write code path in EventLoggingListener.

Linear Supertypes
WebUI, Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. HistoryServer
  2. WebUI
  3. Logging
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HistoryServer(conf: SparkConf, provider: ApplicationHistoryProvider, securityManager: SecurityManager, port: Int)

Value Members

  1. final def !=(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Definition Classes
    Any

  5. def attachHandler(handler: ServletContextHandler): Unit

    Attach a handler to this UI.

    Attach a handler to this UI.

    Definition Classes
    WebUI

  6. def attachPage(page: WebUIPage): Unit

    Attach a page to this UI.

    Attach a page to this UI.

    Definition Classes
    WebUI

  7. def attachTab(tab: WebUITab): Unit

    Attach a tab to this UI, along with all of its attached pages.

    Attach a tab to this UI, along with all of its attached pages.

    Definition Classes
    WebUI

  8. def bind(): Unit

    Bind to the HTTP server behind this web interface.

    Bind to the HTTP server behind this web interface.

    Definition Classes
    HistoryServer → WebUI

  9. def boundPort: Int

    Return the actual port to which this server is bound.

    Return the actual port to which this server is bound. Only valid after bind().

    Definition Classes
    WebUI

  10. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  11. def detachHandler(handler: ServletContextHandler): Unit

    Detach a handler from this UI.

    Detach a handler from this UI.

    Attributes
    protected
    Definition Classes
    WebUI

  12. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  13. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any

  14. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  15. def getApplicationList(): Iterable[ApplicationHistoryInfo]

    Returns a list of available applications, in descending order according to their end time.

    Returns a list of available applications, in descending order according to their end time.

    returns

    List of all known applications.

  16. def getBasePath: String

    Definition Classes
    WebUI

  17. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any

  18. def getHandlers: Seq[ServletContextHandler]

    Definition Classes
    WebUI

  19. def getProviderConfig(): Map[String, String]

    Returns the provider configuration to show in the listing page.

    Returns the provider configuration to show in the listing page.

    returns

    A map with the provider's configuration.

  20. def getSecurityManager: SecurityManager

    Definition Classes
    WebUI

  21. def getTabs: Seq[WebUITab]

    Definition Classes
    WebUI

  22. val handlers: ArrayBuffer[ServletContextHandler]

    Attributes
    protected
    Definition Classes
    WebUI

  23. def hashCode(): Int

    Definition Classes
    AnyRef → Any

  24. def initialize(): Unit

    Initialize the history server.

    Initialize the history server.

    This starts a background thread that periodically synchronizes information displayed on this UI with the event logs in the provided base directory.

    Definition Classes
    HistoryServer → WebUI

  25. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any

  26. def isTraceEnabled(): Boolean

    Attributes
    protected
    Definition Classes
    Logging

  27. val localHostName: String

    Attributes
    protected
    Definition Classes
    WebUI

  28. def log: Logger

    Attributes
    protected
    Definition Classes
    Logging

  29. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  30. def logDebug(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  31. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  32. def logError(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  33. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  34. def logInfo(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  35. def logName: String

    Attributes
    protected
    Definition Classes
    Logging

  36. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  37. def logTrace(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  38. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Attributes
    protected
    Definition Classes
    Logging

  39. def logWarning(msg: ⇒ String): Unit

    Attributes
    protected
    Definition Classes
    Logging

  40. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef

  41. final def notify(): Unit

    Definition Classes
    AnyRef

  42. final def notifyAll(): Unit

    Definition Classes
    AnyRef

  43. val publicHostName: String

    Attributes
    protected
    Definition Classes
    WebUI

  44. var serverInfo: Option[ServerInfo]

    Attributes
    protected
    Definition Classes
    WebUI

  45. def stop(): Unit

    Stop the server and close the file system.

    Stop the server and close the file system.

    Definition Classes
    HistoryServer → WebUI

  46. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef

  47. val tabs: ArrayBuffer[WebUITab]

    Attributes
    protected
    Definition Classes
    WebUI

  48. def toString(): String

    Definition Classes
    AnyRef → Any

  49. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  50. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  51. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from WebUI

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped