Class/Object

com.krux.hyperion.resource

SparkCluster

Related Docs: object SparkCluster | package resource

Permalink

case class SparkCluster extends BaseEmrCluster with Product with Serializable

Launch a Spark cluster (pre EMR release label 4.0.0)

Annotations
@deprecated
Deprecated

(Since version 5.0.0) Use EmrCluster with Spark Application instead

Source
SparkCluster.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, BaseEmrCluster, ResourceObject, NamedPipelineObject, PipelineObject, Ordered[PipelineObject], Comparable[PipelineObject], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkCluster
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. BaseEmrCluster
  7. ResourceObject
  8. NamedPipelineObject
  9. PipelineObject
  10. Ordered
  11. Comparable
  12. AnyRef
  13. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type Self = SparkCluster

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. def <(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  4. def <=(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  5. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  6. def >(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  7. def >=(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  8. def actionOnResourceFailure: Option[ActionOnResourceFailure]

    Permalink
    Definition Classes
    ResourceObject
  9. def actionOnTaskFailure: Option[ActionOnTaskFailure]

    Permalink
    Definition Classes
    ResourceObject
  10. def additionalMasterSecurityGroupIds: Seq[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  11. def additionalSlaveSecurityGroupIds: Seq[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  12. def amiVersion: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  13. def applications: Seq[EmrApplication]

    Permalink
    Definition Classes
    SparkClusterBaseEmrCluster
  14. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  15. def availabilityZone: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  16. val baseFields: BaseFields

    Permalink
    Definition Classes
    SparkClusterNamedPipelineObject
  17. def bootstrapAction: Seq[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  18. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. def compare(that: PipelineObject): Int

    Permalink
    Definition Classes
    PipelineObject → Ordered
  20. def compareTo(that: PipelineObject): Int

    Permalink
    Definition Classes
    Ordered → Comparable
  21. def configuration: Seq[EmrConfiguration]

    Permalink
    Definition Classes
    BaseEmrCluster
  22. def coreEbsConfiguration: Option[EmrEbsConfiguration]

    Permalink
    Definition Classes
    BaseEmrCluster
  23. def coreInstanceBidPrice: Option[HDouble]

    Permalink
    Definition Classes
    BaseEmrCluster
  24. def coreInstanceCount: HInt

    Permalink
    Definition Classes
    BaseEmrCluster
  25. def coreInstanceType: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  26. val emrClusterFields: EmrClusterFields

    Permalink
    Definition Classes
    SparkClusterBaseEmrCluster
  27. def enableDebugging: Option[HBoolean]

    Permalink
    Definition Classes
    BaseEmrCluster
  28. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  29. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  30. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  31. def groupedBy(group: String): Self

    Permalink

    Postfix the name field

    Postfix the name field

    Definition Classes
    NamedPipelineObject
  32. def hadoopSchedulerType: Option[SchedulerType]

    Permalink
    Definition Classes
    BaseEmrCluster
  33. def httpProxy: Option[HttpProxy]

    Permalink
    Definition Classes
    ResourceObject
  34. def id: PipelineObjectId

    Permalink
    Definition Classes
    NamedPipelineObjectPipelineObject
  35. def idGroupedBy(group: String): Self

    Permalink

    Have a grouping postfix in the id field

    Have a grouping postfix in the id field

    Definition Classes
    NamedPipelineObject
    Note

    Id naming is more restrictive, it is recommended to not changing the id unleass you have a good reason

  36. def idNamed(namePrefix: String): Self

    Permalink

    Id field will be prefixed with name

    Id field will be prefixed with name

    Definition Classes
    NamedPipelineObject
    Note

    Id naming is more restrictive, it is recommended to not changing the id unless you have a good reason

  37. def initTimeout: Option[HDuration]

    Permalink
    Definition Classes
    ResourceObject
  38. lazy val instanceCount: HInt

    Permalink
    Definition Classes
    BaseEmrCluster
  39. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  40. def keyPair: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  41. val logger: Logger

    Permalink
    Definition Classes
    SparkClusterBaseEmrCluster
  42. def masterEbsConfiguration: Option[EmrEbsConfiguration]

    Permalink
    Definition Classes
    BaseEmrCluster
  43. def masterInstanceBidPrice: Option[HDouble]

    Permalink
    Definition Classes
    BaseEmrCluster
  44. def masterInstanceType: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  45. def masterSecurityGroupId: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  46. def maximumRetries: Option[HInt]

    Permalink
    Definition Classes
    ResourceObject
  47. def name: Option[String]

    Permalink

    Name of the pipeline object, if not set, it will defaults to

    Name of the pipeline object, if not set, it will defaults to

    Option(id)
    Definition Classes
    NamedPipelineObject
  48. def named(namePrefix: String): Self

    Permalink

    Give the object a name prefix

    Give the object a name prefix

    Definition Classes
    NamedPipelineObject
  49. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  50. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  51. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  52. def objects: Iterable[PipelineObject]

    Permalink
    Definition Classes
    BaseEmrClusterResourceObjectPipelineObject
  53. def ref: AdpRef[AdpEmrCluster]

    Permalink
    Definition Classes
    BaseEmrClusterPipelineObject
  54. def region: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  55. def releaseLabel: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  56. val resourceFields: ResourceFields

    Permalink
    Definition Classes
    SparkClusterResourceObject
  57. def resourceRole: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  58. def role: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  59. implicit def seq2Option[A](anySeq: Seq[A]): Option[Seq[A]]

    Permalink
    Definition Classes
    PipelineObject
  60. def seqToOption[A, B](anySeq: Seq[A])(transform: (A) ⇒ B): Option[Seq[B]]

    Permalink
    Definition Classes
    PipelineObject
  61. lazy val serialize: AdpEmrCluster

    Permalink
    Definition Classes
    BaseEmrClusterPipelineObject
  62. def slaveSecurityGroupId: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  63. val sparkVersion: Option[HString]

    Permalink
  64. def standardBootstrapAction: Seq[HString]

    Permalink
    Definition Classes
    SparkClusterBaseEmrCluster
  65. def subnetId: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  66. def supportedProducts: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  67. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  68. def taskEbsConfiguration: Option[EmrEbsConfiguration]

    Permalink
    Definition Classes
    BaseEmrCluster
  69. def taskInstanceBidPrice: Option[HDouble]

    Permalink
    Definition Classes
    BaseEmrCluster
  70. def taskInstanceCount: HInt

    Permalink
    Definition Classes
    BaseEmrCluster
  71. def taskInstanceType: Option[HString]

    Permalink
    Definition Classes
    BaseEmrCluster
  72. def terminateAfter(after: HDuration): Self

    Permalink
    Definition Classes
    ResourceObject
  73. def terminateAfter: Option[HDuration]

    Permalink
    Definition Classes
    ResourceObject
  74. implicit def uniquePipelineId2String(id: PipelineObjectId): String

    Permalink
    Definition Classes
    PipelineObject
  75. def updateBaseFields(fields: BaseFields): SparkCluster

    Permalink
    Definition Classes
    SparkClusterNamedPipelineObject
  76. def updateEmrClusterFields(fields: EmrClusterFields): SparkCluster

    Permalink
    Definition Classes
    SparkClusterBaseEmrCluster
  77. def updateResourceFields(fields: ResourceFields): SparkCluster

    Permalink
    Definition Classes
    SparkClusterResourceObject
  78. def useOnDemandOnLastAttempt: Option[HBoolean]

    Permalink
    Definition Classes
    ResourceObject
  79. def visibleToAllUsers: Option[HBoolean]

    Permalink
    Definition Classes
    BaseEmrCluster
  80. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  81. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  82. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  83. def withActionOnResourceFailure(action: ActionOnResourceFailure): Self

    Permalink
    Definition Classes
    ResourceObject
  84. def withActionOnTaskFailure(action: ActionOnTaskFailure): Self

    Permalink
    Definition Classes
    ResourceObject
  85. def withAdditionalMasterSecurityGroupIds(groupIds: HString*): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  86. def withAdditionalSlaveSecurityGroupIds(groupIds: HString*): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  87. def withAmiVersion(version: HString): Self

    Permalink
  88. def withAvailabilityZone(az: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  89. def withBootstrapAction(actions: HString*): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  90. def withCoreEbsConfiguration(ebsConfig: EmrEbsConfiguration): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  91. def withCoreInstanceBidPrice(price: HDouble): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  92. def withCoreInstanceCount(count: HInt): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  93. def withCoreInstanceType(instanceType: HString): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  94. def withDebuggingEnabled(enabled: HBoolean): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  95. def withHadoopSchedulerType(scheduleType: SchedulerType): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  96. def withHttpProxy(proxy: HttpProxy): Self

    Permalink
    Definition Classes
    ResourceObject
  97. def withInitTimeout(timeout: HDuration): Self

    Permalink
    Definition Classes
    ResourceObject
  98. def withKeyPair(theKeyPair: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  99. def withMasterEbsConfiguration(ebsConfig: EmrEbsConfiguration): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  100. def withMasterInstanceBidPrice(price: HDouble): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  101. def withMasterInstanceType(instanceType: HString): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  102. def withMasterSecurityGroupId(groupId: HString): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  103. def withMaximumRetries(retries: HInt): Self

    Permalink
    Definition Classes
    ResourceObject
  104. def withRegion(r: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  105. def withResourceRole(r: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  106. def withRole(r: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  107. def withSlaveSecurityGroupId(groupId: HString): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  108. def withSparkVersion(sparkVersion: HString): SparkCluster

    Permalink
  109. def withStandardBootstrapAction(actions: HString*): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  110. def withSubnetId(subnet: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  111. def withSupportedProducts(products: HString): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  112. def withTaskEbsConfiguration(ebsConfig: EmrEbsConfiguration): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  113. def withTaskInstanceBidPrice(price: HDouble): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  114. def withTaskInstanceCount(count: HInt): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  115. def withTaskInstanceType(instanceType: HString): Self

    Permalink
    Definition Classes
    BaseEmrCluster
  116. def withUseOnDemandOnLastAttempt(use: HBoolean): Self

    Permalink
    Definition Classes
    ResourceObject
  117. def withVisibleToAllUsers(visible: HBoolean): Self

    Permalink
    Definition Classes
    BaseEmrCluster

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from BaseEmrCluster

Inherited from ResourceObject

Inherited from NamedPipelineObject

Inherited from PipelineObject

Inherited from Ordered[PipelineObject]

Inherited from Comparable[PipelineObject]

Inherited from AnyRef

Inherited from Any

Ungrouped