Class/Object

ai.catboost.spark

CatBoostRegressor

Related Docs: object CatBoostRegressor | package spark

Permalink

class CatBoostRegressor extends CatBoostRegressorBase[Vector, CatBoostRegressor, CatBoostRegressionModel] with CatBoostPredictorTrait[CatBoostRegressor, CatBoostRegressionModel] with RegressorTrainingParamsTrait

Class to train CatBoostRegressionModel The default optimized loss function is RMSE

Examples

Basic example.

val spark = SparkSession.builder()
  .master("local[*]")
  .appName("RegressorTest")
  .getOrCreate();

val srcDataSchema = Seq(
  StructField("features", SQLDataTypes.VectorType),
  StructField("label", StringType)
)

val trainData = Seq(
  Row(Vectors.dense(0.1, 0.2, 0.11), "0.12"),
  Row(Vectors.dense(0.97, 0.82, 0.33), "0.22"),
  Row(Vectors.dense(0.13, 0.22, 0.23), "0.34"),
  Row(Vectors.dense(0.8, 0.62, 0.0), "0.1")
)

val trainDf = spark.createDataFrame(spark.sparkContext.parallelize(trainData), StructType(srcDataSchema))
val trainPool = new Pool(trainDf)

val evalData = Seq(
  Row(Vectors.dense(0.22, 0.33, 0.9), "0.1"),
  Row(Vectors.dense(0.11, 0.1, 0.21), "0.9"),
  Row(Vectors.dense(0.77, 0.0, 0.0), "0.72")
)

val evalDf = spark.createDataFrame(spark.sparkContext.parallelize(evalData), StructType(srcDataSchema))
val evalPool = new Pool(evalDf)

val regressor = new CatBoostRegressor
val model = regressor.fit(trainPool, Array[Pool](evalPool))
val predictions = model.transform(evalPool.data)
predictions.show()

Example with alternative loss function.

...<initialize trainPool, evalPool>
val regressor = new CatBoostRegressor().setLossFunction("MAE")
val model = regressor.fit(trainPool, Array[Pool](evalPool))
val predictions = model.transform(evalPool.data)
predictions.show()

Serialization

Supports standard Spark MLLib serialization. Data can be saved to distributed filesystem like HDFS or local files.

Examples:

Save:

val regressor = new CatBoostRegressor().setLossFunction("MAE")
val path = "/home/user/catboost_regressors/regressor0"
regressor.write.save(path)

Load:

val path = "/home/user/catboost_regressors/regressor0"
val regressor = CatBoostRegressor.load(path)
val trainPool : Pool = ... init Pool ...
val model = regressor.fit(trainPool)
Linear Supertypes
RegressorTrainingParamsTrait, TrainingParamsTrait, QuantizationParamsTrait, ThreadCountParams, IgnoredFeaturesParams, CatBoostPredictorTrait[CatBoostRegressor, CatBoostRegressionModel], DefaultParamsWritable, MLWritable, DatasetParamsTrait, HasWeightCol, CatBoostRegressorBase[Vector, CatBoostRegressor, CatBoostRegressionModel], Regressor[Vector, CatBoostRegressor, CatBoostRegressionModel], Predictor[Vector, CatBoostRegressor, CatBoostRegressionModel], PredictorParams, HasPredictionCol, HasFeaturesCol, HasLabelCol, Estimator[CatBoostRegressionModel], PipelineStage, Logging, Params, Serializable, Serializable, Identifiable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CatBoostRegressor
  2. RegressorTrainingParamsTrait
  3. TrainingParamsTrait
  4. QuantizationParamsTrait
  5. ThreadCountParams
  6. IgnoredFeaturesParams
  7. CatBoostPredictorTrait
  8. DefaultParamsWritable
  9. MLWritable
  10. DatasetParamsTrait
  11. HasWeightCol
  12. CatBoostRegressorBase
  13. Regressor
  14. Predictor
  15. PredictorParams
  16. HasPredictionCol
  17. HasFeaturesCol
  18. HasLabelCol
  19. Estimator
  20. PipelineStage
  21. Logging
  22. Params
  23. Serializable
  24. Serializable
  25. Identifiable
  26. AnyRef
  27. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new CatBoostRegressor()

    Permalink
  2. new CatBoostRegressor(uid: String)

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  5. def addEstimatedCtrFeatures(quantizedTrainPool: Pool, quantizedEvalPools: Array[Pool], updatedCatBoostJsonParams: JObject, classTargetPreprocessor: Option[TClassTargetPreprocessor] = None, serializedLabelConverter: TVector_i8 = new TVector_i8): (Pool, Array[Pool], CtrsContext)

    Permalink

    returns

    (preprocessedTrainPool, preprocessedEvalPools, ctrsContext)

    Attributes
    protected
    Definition Classes
    CatBoostPredictorTrait
  6. final val allowConstLabel: BooleanParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  7. final val allowWritingFiles: BooleanParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  8. final val approxOnFullHistory: BooleanParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  9. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  10. final val baggingTemperature: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  11. final val bestModelMinTrees: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  12. final val bootstrapType: EnumParam[EBootstrapType]

    Permalink
    Definition Classes
    TrainingParamsTrait
  13. final val borderCount: IntParam

    Permalink
    Definition Classes
    QuantizationParamsTrait
  14. final def clear(param: Param[_]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    Params
  15. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  16. final val connectTimeout: DurationParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  17. def copy(extra: ParamMap): CatBoostRegressor

    Permalink
    Definition Classes
    CatBoostRegressor → Predictor → Estimator → PipelineStage → Params
  18. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  19. def createModel(nativeModel: TFullModel): CatBoostRegressionModel

    Permalink
    Attributes
    protected
    Definition Classes
    CatBoostRegressorCatBoostPredictorTrait
  20. final val customMetric: StringArrayParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  21. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  22. final val depth: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  23. final val diffusionTemperature: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  24. final val earlyStoppingRounds: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  25. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  26. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  27. final val evalMetric: Param[String]

    Permalink
    Definition Classes
    TrainingParamsTrait
  28. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params
  29. def explainParams(): String

    Permalink
    Definition Classes
    Params
  30. def extractLabeledPoints(dataset: Dataset[_]): RDD[LabeledPoint]

    Permalink
    Attributes
    protected
    Definition Classes
    Predictor
  31. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params
  32. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params
  33. final val featureBorderType: EnumParam[EBorderSelectionType]

    Permalink
    Definition Classes
    QuantizationParamsTrait
  34. final val featureWeightsList: DoubleArrayParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  35. final val featureWeightsMap: OrderedStringMapParam[Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  36. final val featuresCol: Param[String]

    Permalink
    Definition Classes
    HasFeaturesCol
  37. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  38. final val firstFeatureUsePenaltiesList: DoubleArrayParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  39. final val firstFeatureUsePenaltiesMap: OrderedStringMapParam[Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  40. def fit(trainPool: Pool, evalPools: Array[Pool] = Array[Pool]()): CatBoostRegressionModel

    Permalink

    Additional variant of fit method that accepts CatBoost's Pool s and allows to specify additional datasets for computing evaluation metrics and overfitting detection similarily to CatBoost's other APIs.

    Additional variant of fit method that accepts CatBoost's Pool s and allows to specify additional datasets for computing evaluation metrics and overfitting detection similarily to CatBoost's other APIs.

    trainPool

    The input training dataset.

    evalPools

    The validation datasets used for the following processes:

    • overfitting detector
    • best iteration selection
    • monitoring metrics' changes
    returns

    trained model

    Definition Classes
    CatBoostPredictorTrait
  41. def fit(dataset: Dataset[_]): CatBoostRegressionModel

    Permalink
    Definition Classes
    Predictor → Estimator
  42. def fit(dataset: Dataset[_], paramMaps: Array[ParamMap]): Seq[CatBoostRegressionModel]

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  43. def fit(dataset: Dataset[_], paramMap: ParamMap): CatBoostRegressionModel

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" )
  44. def fit(dataset: Dataset[_], firstParamPair: ParamPair[_], otherParamPairs: ParamPair[_]*): CatBoostRegressionModel

    Permalink
    Definition Classes
    Estimator
    Annotations
    @Since( "2.0.0" ) @varargs()
  45. final val foldLenMultiplier: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  46. final val foldPermutationBlock: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  47. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  48. final def getAllowConstLabel: Boolean

    Permalink
    Definition Classes
    TrainingParamsTrait
  49. final def getAllowWritingFiles: Boolean

    Permalink
    Definition Classes
    TrainingParamsTrait
  50. final def getApproxOnFullHistory: Boolean

    Permalink
    Definition Classes
    TrainingParamsTrait
  51. final def getBaggingTemperature: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  52. final def getBestModelMinTrees: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  53. final def getBootstrapType: EBootstrapType

    Permalink
    Definition Classes
    TrainingParamsTrait
  54. final def getBorderCount: Int

    Permalink
    Definition Classes
    QuantizationParamsTrait
  55. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  56. final def getConnectTimeout: Duration

    Permalink
    Definition Classes
    TrainingParamsTrait
  57. final def getCustomMetric: Array[String]

    Permalink
    Definition Classes
    TrainingParamsTrait
  58. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  59. final def getDepth: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  60. final def getDiffusionTemperature: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  61. final def getEarlyStoppingRounds: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  62. final def getEvalMetric: String

    Permalink
    Definition Classes
    TrainingParamsTrait
  63. final def getFeatureBorderType: EBorderSelectionType

    Permalink
    Definition Classes
    QuantizationParamsTrait
  64. final def getFeatureWeightsList: Array[Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  65. final def getFeatureWeightsMap: LinkedHashMap[String, Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  66. final def getFeaturesCol: String

    Permalink
    Definition Classes
    HasFeaturesCol
  67. final def getFirstFeatureUsePenaltiesList: Array[Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  68. final def getFirstFeatureUsePenaltiesMap: LinkedHashMap[String, Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  69. final def getFoldLenMultiplier: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  70. final def getFoldPermutationBlock: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  71. final def getHasTime: Boolean

    Permalink
    Definition Classes
    TrainingParamsTrait
  72. final def getIgnoredFeaturesIndices: Array[Int]

    Permalink
    Definition Classes
    IgnoredFeaturesParams
  73. final def getIgnoredFeaturesNames: Array[String]

    Permalink
    Definition Classes
    IgnoredFeaturesParams
  74. final def getInputBorders: String

    Permalink
    Definition Classes
    QuantizationParamsTrait
  75. final def getIterations: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  76. final def getL2LeafReg: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  77. final def getLabelCol: String

    Permalink
    Definition Classes
    HasLabelCol
  78. final def getLeafEstimationBacktracking: ELeavesEstimationStepBacktracking

    Permalink
    Definition Classes
    TrainingParamsTrait
  79. final def getLeafEstimationIterations: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  80. final def getLeafEstimationMethod: ELeavesEstimation

    Permalink
    Definition Classes
    TrainingParamsTrait
  81. final def getLearningRate: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  82. final def getLoggingLevel: ELoggingLevel

    Permalink
    Definition Classes
    TrainingParamsTrait
  83. final def getLossFunction: String

    Permalink
    Definition Classes
    TrainingParamsTrait
  84. final def getMetricPeriod: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  85. final def getModelShrinkMode: EModelShrinkMode

    Permalink
    Definition Classes
    TrainingParamsTrait
  86. final def getModelShrinkRate: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  87. final def getMvsReg: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  88. final def getNanMode: ENanMode

    Permalink
    Definition Classes
    QuantizationParamsTrait
  89. final def getOdPval: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  90. final def getOdType: EOverfittingDetectorType

    Permalink
    Definition Classes
    TrainingParamsTrait
  91. final def getOdWait: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  92. final def getOneHotMaxSize: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  93. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params
  94. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params
  95. final def getPenaltiesCoefficient: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  96. final def getPerFloatFeatureQuantizaton: Array[String]

    Permalink
    Definition Classes
    QuantizationParamsTrait
  97. final def getPerObjectFeaturePenaltiesList: Array[Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  98. final def getPerObjectFeaturePenaltiesMap: LinkedHashMap[String, Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  99. final def getPredictionCol: String

    Permalink
    Definition Classes
    HasPredictionCol
  100. final def getRandomSeed: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  101. final def getRandomStrength: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  102. final def getRsm: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  103. final def getSamplingFrequency: ESamplingFrequency

    Permalink
    Definition Classes
    TrainingParamsTrait
  104. final def getSamplingUnit: ESamplingUnit

    Permalink
    Definition Classes
    TrainingParamsTrait
  105. final def getSaveSnapshot: Boolean

    Permalink
    Definition Classes
    TrainingParamsTrait
  106. final def getScoreFunction: EScoreFunction

    Permalink
    Definition Classes
    TrainingParamsTrait
  107. final def getSnapshotFile: String

    Permalink
    Definition Classes
    TrainingParamsTrait
  108. final def getSnapshotInterval: Duration

    Permalink
    Definition Classes
    TrainingParamsTrait
  109. final def getSparkPartitionCount: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  110. final def getSubsample: Float

    Permalink
    Definition Classes
    TrainingParamsTrait
  111. final def getThreadCount: Int

    Permalink
    Definition Classes
    ThreadCountParams
  112. final def getTrainDir: String

    Permalink
    Definition Classes
    TrainingParamsTrait
  113. final def getUseBestModel: Boolean

    Permalink
    Definition Classes
    TrainingParamsTrait
  114. final def getWeightCol: String

    Permalink
    Definition Classes
    HasWeightCol
  115. final def getWorkerInitializationTimeout: Duration

    Permalink
    Definition Classes
    TrainingParamsTrait
  116. final def getWorkerMaxFailures: Int

    Permalink
    Definition Classes
    TrainingParamsTrait
  117. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params
  118. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params
  119. final val hasTime: BooleanParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  120. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  121. final val ignoredFeaturesIndices: IntArrayParam

    Permalink
    Definition Classes
    IgnoredFeaturesParams
  122. final val ignoredFeaturesNames: StringArrayParam

    Permalink
    Definition Classes
    IgnoredFeaturesParams
  123. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  124. def initializeLogIfNecessary(isInterpreter: Boolean): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  125. final val inputBorders: Param[String]

    Permalink
    Definition Classes
    QuantizationParamsTrait
  126. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  127. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  128. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  129. def isTraceEnabled(): Boolean

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  130. final val iterations: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  131. final val l2LeafReg: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  132. final val labelCol: Param[String]

    Permalink
    Definition Classes
    HasLabelCol
  133. final val leafEstimationBacktracking: EnumParam[ELeavesEstimationStepBacktracking]

    Permalink
    Definition Classes
    TrainingParamsTrait
  134. final val leafEstimationIterations: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  135. final val leafEstimationMethod: EnumParam[ELeavesEstimation]

    Permalink
    Definition Classes
    TrainingParamsTrait
  136. final val learningRate: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  137. def log: Logger

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  138. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  139. def logDebug(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  140. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  141. def logError(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  142. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  143. def logInfo(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  144. def logName: String

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  145. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  146. def logTrace(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  147. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  148. def logWarning(msg: ⇒ String): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    Logging
  149. final val loggingLevel: EnumParam[ELoggingLevel]

    Permalink
    Definition Classes
    TrainingParamsTrait
  150. final val lossFunction: Param[String]

    Permalink
    Definition Classes
    TrainingParamsTrait
  151. final val metricPeriod: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  152. final val modelShrinkMode: EnumParam[EModelShrinkMode]

    Permalink
    Definition Classes
    TrainingParamsTrait
  153. final val modelShrinkRate: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  154. final val mvsReg: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  155. final val nanMode: EnumParam[ENanMode]

    Permalink
    Definition Classes
    QuantizationParamsTrait
  156. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  157. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  158. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  159. final val odPval: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  160. final val odType: EnumParam[EOverfittingDetectorType]

    Permalink
    Definition Classes
    TrainingParamsTrait
  161. final val odWait: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  162. final val oneHotMaxSize: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  163. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params
  164. final val penaltiesCoefficient: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  165. final val perFloatFeatureQuantizaton: StringArrayParam

    Permalink
    Definition Classes
    QuantizationParamsTrait
  166. final val perObjectFeaturePenaltiesList: DoubleArrayParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  167. final val perObjectFeaturePenaltiesMap: OrderedStringMapParam[Double]

    Permalink
    Definition Classes
    TrainingParamsTrait
  168. final val predictionCol: Param[String]

    Permalink
    Definition Classes
    HasPredictionCol
  169. def preprocessBeforeTraining(quantizedTrainPool: Pool, quantizedEvalPools: Array[Pool]): (Pool, Array[Pool], CatBoostTrainingContext)

    Permalink

    override in descendants if necessary

    override in descendants if necessary

    returns

    (preprocessedTrainPool, preprocessedEvalPools, catBoostTrainingContext)

    Attributes
    protected
    Definition Classes
    CatBoostPredictorTrait
  170. final val randomSeed: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  171. final val randomStrength: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  172. final val rsm: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  173. final val samplingFrequency: EnumParam[ESamplingFrequency]

    Permalink
    Definition Classes
    TrainingParamsTrait
  174. final val samplingUnit: EnumParam[ESamplingUnit]

    Permalink
    Definition Classes
    TrainingParamsTrait
  175. def save(path: String): Unit

    Permalink
    Definition Classes
    MLWritable
    Annotations
    @Since( "1.6.0" ) @throws( ... )
  176. final val saveSnapshot: BooleanParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  177. final val scoreFunction: EnumParam[EScoreFunction]

    Permalink
    Definition Classes
    TrainingParamsTrait
  178. final def set(paramPair: ParamPair[_]): CatBoostRegressor.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  179. final def set(param: String, value: Any): CatBoostRegressor.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  180. final def set[T](param: Param[T], value: T): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    Params
  181. final def setAllowConstLabel(value: Boolean): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  182. final def setAllowWritingFiles(value: Boolean): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  183. final def setApproxOnFullHistory(value: Boolean): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  184. final def setBaggingTemperature(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  185. final def setBestModelMinTrees(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  186. final def setBootstrapType(value: EBootstrapType): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  187. final def setBorderCount(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    QuantizationParamsTrait
  188. final def setConnectTimeout(value: Duration): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  189. final def setCustomMetric(value: Array[String]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  190. final def setDefault(paramPairs: ParamPair[_]*): CatBoostRegressor.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  191. final def setDefault[T](param: Param[T], value: T): CatBoostRegressor.this.type

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  192. final def setDepth(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  193. final def setDiffusionTemperature(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  194. final def setEarlyStoppingRounds(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  195. final def setEvalMetric(value: String): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  196. final def setFeatureBorderType(value: EBorderSelectionType): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    QuantizationParamsTrait
  197. final def setFeatureWeightsList(value: Array[Double]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  198. final def setFeatureWeightsMap(value: LinkedHashMap[String, Double]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  199. def setFeaturesCol(value: String): CatBoostRegressor

    Permalink
    Definition Classes
    Predictor
  200. final def setFirstFeatureUsePenaltiesList(value: Array[Double]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  201. final def setFirstFeatureUsePenaltiesMap(value: LinkedHashMap[String, Double]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  202. final def setFoldLenMultiplier(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  203. final def setFoldPermutationBlock(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  204. final def setHasTime(value: Boolean): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  205. final def setIgnoredFeaturesIndices(value: Array[Int]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    IgnoredFeaturesParams
  206. final def setIgnoredFeaturesNames(value: Array[String]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    IgnoredFeaturesParams
  207. final def setInputBorders(value: String): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    QuantizationParamsTrait
  208. final def setIterations(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  209. final def setL2LeafReg(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  210. def setLabelCol(value: String): CatBoostRegressor

    Permalink
    Definition Classes
    Predictor
  211. final def setLeafEstimationBacktracking(value: ELeavesEstimationStepBacktracking): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  212. final def setLeafEstimationIterations(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  213. final def setLeafEstimationMethod(value: ELeavesEstimation): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  214. final def setLearningRate(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  215. final def setLoggingLevel(value: ELoggingLevel): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  216. final def setLossFunction(value: String): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  217. final def setMetricPeriod(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  218. final def setModelShrinkMode(value: EModelShrinkMode): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  219. final def setModelShrinkRate(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  220. final def setMvsReg(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  221. final def setNanMode(value: ENanMode): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    QuantizationParamsTrait
  222. final def setOdPval(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  223. final def setOdType(value: EOverfittingDetectorType): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  224. final def setOdWait(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  225. final def setOneHotMaxSize(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  226. final def setPenaltiesCoefficient(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  227. final def setPerFloatFeatureQuantizaton(value: Array[String]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    QuantizationParamsTrait
  228. final def setPerObjectFeaturePenaltiesList(value: Array[Double]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  229. final def setPerObjectFeaturePenaltiesMap(value: LinkedHashMap[String, Double]): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  230. def setPredictionCol(value: String): CatBoostRegressor

    Permalink
    Definition Classes
    Predictor
  231. final def setRandomSeed(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  232. final def setRandomStrength(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  233. final def setRsm(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  234. final def setSamplingFrequency(value: ESamplingFrequency): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  235. final def setSamplingUnit(value: ESamplingUnit): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  236. final def setSaveSnapshot(value: Boolean): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  237. final def setScoreFunction(value: EScoreFunction): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  238. final def setSnapshotFile(value: String): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  239. final def setSnapshotInterval(value: Duration): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  240. final def setSparkPartitionCount(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  241. final def setSubsample(value: Float): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  242. final def setThreadCount(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    ThreadCountParams
  243. final def setTrainDir(value: String): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  244. final def setUseBestModel(value: Boolean): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  245. final def setWorkerInitializationTimeout(value: Duration): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  246. final def setWorkerMaxFailures(value: Int): CatBoostRegressor.this.type

    Permalink
    Definition Classes
    TrainingParamsTrait
  247. final val snapshotFile: Param[String]

    Permalink
    Definition Classes
    TrainingParamsTrait
  248. final val snapshotInterval: DurationParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  249. final val sparkPartitionCount: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  250. final val subsample: FloatParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  251. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  252. final val threadCount: IntParam

    Permalink
    Definition Classes
    ThreadCountParams
  253. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any
  254. def train(dataset: Dataset[_]): CatBoostRegressionModel

    Permalink
    Attributes
    protected
    Definition Classes
    CatBoostPredictorTrait → Predictor
  255. final val trainDir: Param[String]

    Permalink
    Definition Classes
    TrainingParamsTrait
  256. def transformSchema(schema: StructType): StructType

    Permalink
    Definition Classes
    Predictor → PipelineStage
  257. def transformSchema(schema: StructType, logging: Boolean): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PipelineStage
    Annotations
    @DeveloperApi()
  258. val uid: String

    Permalink
    Definition Classes
    CatBoostRegressor → Identifiable
  259. final val useBestModel: BooleanParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  260. def validateAndTransformSchema(schema: StructType, fitting: Boolean, featuresDataType: DataType): StructType

    Permalink
    Attributes
    protected
    Definition Classes
    PredictorParams
  261. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  262. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  263. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  264. final val weightCol: Param[String]

    Permalink
    Definition Classes
    HasWeightCol
  265. final val workerInitializationTimeout: DurationParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  266. final val workerMaxFailures: IntParam

    Permalink
    Definition Classes
    TrainingParamsTrait
  267. def write: MLWriter

    Permalink
    Definition Classes
    DefaultParamsWritable → MLWritable

Inherited from TrainingParamsTrait

Inherited from QuantizationParamsTrait

Inherited from ThreadCountParams

Inherited from IgnoredFeaturesParams

Inherited from DefaultParamsWritable

Inherited from MLWritable

Inherited from DatasetParamsTrait

Inherited from HasWeightCol

Inherited from Regressor[Vector, CatBoostRegressor, CatBoostRegressionModel]

Inherited from Predictor[Vector, CatBoostRegressor, CatBoostRegressionModel]

Inherited from PredictorParams

Inherited from HasPredictionCol

Inherited from HasFeaturesCol

Inherited from HasLabelCol

Inherited from Estimator[CatBoostRegressionModel]

Inherited from PipelineStage

Inherited from Logging

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped