程序包 org.apache.flink.ml.feature.tokenizer

类 Tokenizer

java.lang.Object

org.apache.flink.ml.feature.tokenizer.Tokenizer

所有已实现的接口:

Serializable, org.apache.flink.ml.api.AlgoOperator<Tokenizer>, org.apache.flink.ml.api.Stage<Tokenizer>, org.apache.flink.ml.api.Transformer<Tokenizer>, org.apache.flink.ml.common.param.HasInputCol<Tokenizer>, org.apache.flink.ml.common.param.HasOutputCol<Tokenizer>, TokenizerParams<Tokenizer>, org.apache.flink.ml.param.WithParams<Tokenizer>

public class Tokenizer
extends Object
implements org.apache.flink.ml.api.Transformer<Tokenizer>, TokenizerParams<Tokenizer>

A Transformer which converts the input string to lowercase and then splits it by white spaces.

另请参阅:

序列化表格

嵌套类概要

嵌套类

修饰符和类型	类	说明
static class	Tokenizer.TokenizerUdf	The main logic of Tokenizer, which converts the input string to an array of tokens.

字段概要

从接口继承的字段 org.apache.flink.ml.common.param.HasInputCol

INPUT_COL

从接口继承的字段 org.apache.flink.ml.common.param.HasOutputCol

OUTPUT_COL

构造器概要

构造器

构造器	说明
Tokenizer()

方法概要

修饰符和类型	方法	说明
Map<org.apache.flink.ml.param.Param<?>,Object>	getParamMap()
static Tokenizer	load(org.apache.flink.table.api.bridge.java.StreamTableEnvironment tEnv, String path)
void	save(String path)
org.apache.flink.table.api.Table[]	transform(org.apache.flink.table.api.Table... inputs)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.ml.common.param.HasInputCol

getInputCol, setInputCol

从接口继承的方法 org.apache.flink.ml.common.param.HasOutputCol

getOutputCol, setOutputCol

从接口继承的方法 org.apache.flink.ml.param.WithParams

get, getParam, set

构造器详细资料

Tokenizer

public Tokenizer()

方法详细资料

transform

public org.apache.flink.table.api.Table[] transform(org.apache.flink.table.api.Table... inputs)

指定者:

transform 在接口中 org.apache.flink.ml.api.AlgoOperator<Tokenizer>

save

public void save(String path)
          throws IOException

指定者:

save 在接口中 org.apache.flink.ml.api.Stage<Tokenizer>

抛出:

IOException

getParamMap

public Map<org.apache.flink.ml.param.Param<?>,Object> getParamMap()

指定者:

getParamMap 在接口中 org.apache.flink.ml.param.WithParams<Tokenizer>

load

public static Tokenizer load(org.apache.flink.table.api.bridge.java.StreamTableEnvironment tEnv,
                             String path)
                      throws IOException

抛出:

IOException