class Hyperspace extends AnyRef
- Alphabetic
- By Inheritance
- Hyperspace
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
- new Hyperspace(spark: SparkSession)
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
cancel(indexName: String): Unit
Cancel API to bring back index from an inconsistent state to the last known stable state.
Cancel API to bring back index from an inconsistent state to the last known stable state. E.g. if index fails during creation, in "CREATING" state. The index will not allow any index modifying operations unless a cancel is called.
Note: Cancel from "VACUUMING" state will move it forward to "DOESNOTEXIST" state. Note: If no previous stable state exists, cancel will move it to "DOESNOTEXIST" state.
- indexName
Name of the index to cancel.
-
def
clone(): AnyRef
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )
-
def
createIndex(df: DataFrame, indexConfig: IndexConfig): Unit
Create index.
Create index.
- df
the DataFrame object to build index on.
- indexConfig
the configuration of index to be created.
-
def
deleteIndex(indexName: String): Unit
Soft deletes the index with given index name.
Soft deletes the index with given index name.
- indexName
the name of index to delete.
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
explain(df: DataFrame, verbose: Boolean = false)(implicit redirectFunc: (String) ⇒ Unit = print): Unit
Explains how indexes will be applied to the given dataframe.
Explains how indexes will be applied to the given dataframe.
- df
dataFrame.
- verbose
Flag to enable verbose mode.
- redirectFunc
optional function to redirect output of explain.
-
def
finalize(): Unit
- Attributes
- protected[java.lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
index(indexName: String): DataFrame
Get index metadata and detailed index statistics for a given index.
Get index metadata and detailed index statistics for a given index.
- indexName
Name of the index to get stats for.
- returns
Index metadata and statistics as a DataFrame.
-
def
indexes: DataFrame
Collect all the index metadata.
Collect all the index metadata.
- returns
all index metadata as a DataFrame.
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
def
optimizeIndex(indexName: String, mode: String): Unit
Optimize index by changing the underlying index data layout (e.g., compaction).
Optimize index by changing the underlying index data layout (e.g., compaction).
Note: This API does NOT refresh (i.e. update) the index if the underlying data changes. It only rearranges the index data into a better layout, by compacting small index files. The index files larger than a threshold remain untouched to avoid rewriting large contents.
Available modes:
Quick
mode: This mode allows for fast optimization. Files smaller than a predefined threshold "spark.hyperspace.index.optimize.fileSizeThreshold" will be picked for compaction.Full
mode: This allows for slow but complete optimization. ALL index files are picked for compaction.- indexName
Name of the index to optimize.
- mode
Index optimization mode. "quick" refers to optimization of only small index files, based on a threshold. "full" refers to recreation of index.
-
def
optimizeIndex(indexName: String): Unit
Optimize index by changing the underlying index data layout (e.g., compaction).
Optimize index by changing the underlying index data layout (e.g., compaction).
Note: This API does NOT refresh (i.e. update) the index if the underlying data changes. It only rearranges the index data into a better layout, by compacting small index files. The index files larger than a threshold remain untouched to avoid rewriting large contents.
Quick
optimize mode is used by default.- indexName
Name of the index to optimize.
-
def
refreshIndex(indexName: String, mode: String): Unit
Update indexes for the latest version of the data.
Update indexes for the latest version of the data. This API provides a few supported refresh modes as listed below.
- indexName
Name of the index to refresh.
- mode
Refresh mode. Currently supported modes are
incremental
andfull
.
-
def
refreshIndex(indexName: String): Unit
Update indexes for the latest version of the data.
Update indexes for the latest version of the data.
- indexName
Name of the index to refresh.
-
def
restoreIndex(indexName: String): Unit
Restores index with given index name.
Restores index with given index name.
- indexName
Name of the index to restore.
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
vacuumIndex(indexName: String): Unit
Does hard delete of indexes marked as
DELETED
.Does hard delete of indexes marked as
DELETED
.- indexName
Name of the index to restore.
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @throws( ... )