case class AppInfo(sparkUser: String, appId: String, appName: String) extends Product with Serializable

Class for common app info.

sparkUser: Spark user.
appId: Spark Application Id.
appName: Spark App Name.

case class CancelActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index cancel event.

Index cancel event. This event is emitted when the User cancels an ongoing or failed CRUD operation.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

case class CreateActionEvent(appInfo: AppInfo, indexConfig: IndexConfig, index: Option[IndexLogEntry], originalPlan: String, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index creation event.

Index creation event. Emitted on index creation.

appInfo: AppInfo for spark application.
indexConfig: Index config used in index creation.
index: Optional index. It can be None if create index fails with invalid config.
originalPlan: Original plan which is getting indexed.
message: Message about event.

case class DeleteActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index deletion event.

Index deletion event. Emitted when delete is called on an index.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

trait EventLogger extends AnyRef

Event Logger interface.

Event Logger interface. Concrete implementations of this class implement event handling logic for hyperspace events.

trait HyperspaceEvent extends AnyRef

Trait for all Hyperspace events.

trait HyperspaceEventLogging extends AnyRef

Hyperspace event logging interface.

Hyperspace event logging interface. Extend this to enable emitting hyperspace events.

trait HyperspaceIndexCRUDEvent extends HyperspaceEvent

General index CRUD event.

case class HyperspaceIndexUsageEvent(appInfo: AppInfo, indexes: Seq[IndexLogEntry], planBeforeRule: String, planAfterRule: String, message: String) extends HyperspaceEvent with Product with Serializable

Index usage event.

Index usage event. This event is emitted when an index is picked instead of original data source by one of the hyperspace rules.

appInfo: AppInfo for spark application.
indexes: List of selected indexes for this plan.
planBeforeRule: Original plan before application of indexes.
planAfterRule: Plan after using indexes.
message: Message about event.

case class OptimizeActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index Optimize Event for index files.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

case class RefreshActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index Refresh Event.

Index Refresh Event. Emitted when refresh is called on an index.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

case class RefreshIncrementalActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index Refresh Event for incremental mode.

Index Refresh Event for incremental mode. Emitted when refresh is called on an index with "incremental" mode to handle appended/deleted source data files.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

case class RefreshQuickActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index Refresh Event for quick mode.

Index Refresh Event for quick mode. Emitted when refresh is called on an index with "quick" mode to update index metadata only for appended/deleted source data files.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

case class RestoreActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index restore event.

Index restore event. Emitted when restore is called on an index.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

case class VacuumActionEvent(appInfo: AppInfo, index: IndexLogEntry, message: String) extends HyperspaceIndexCRUDEvent with Product with Serializable

Index Vacuum Event.

Index Vacuum Event. Emitted when vacuum is called on an index.

appInfo: AppInfo for spark application.
index: Related index.
message: Message about event.

Packages

telemetry

package telemetry

Type Members

Value Members

Ungrouped