public class SparkMetricsSink extends Object implements org.apache.spark.metrics.sink.Sink
Sink
which collects Metrics from Spark
program and used SparkMetricsReporter
to report it
to MetricsContext
This full qualified name of this class is given to spark through the metrics configuration file.Constructor and Description |
---|
SparkMetricsSink(Properties properties,
com.codahale.metrics.MetricRegistry registry,
org.apache.spark.SecurityManager securityManager) |
Modifier and Type | Method and Description |
---|---|
void |
report() |
void |
start() |
void |
stop() |
static File |
writeConfig(File file)
Writes a properties file which is used to config Spark Metrics in
SparkConf . |
public SparkMetricsSink(Properties properties, com.codahale.metrics.MetricRegistry registry, org.apache.spark.SecurityManager securityManager)
public void start()
start
in interface org.apache.spark.metrics.sink.Sink
public void stop()
stop
in interface org.apache.spark.metrics.sink.Sink
public void report()
report
in interface org.apache.spark.metrics.sink.Sink
public static File writeConfig(File file) throws IOException
SparkConf
.file
- the File
where this file should be generatedIOException
Copyright © 2018 Cask Data, Inc. Licensed under the Apache License, Version 2.0.