com.intel.analytics.zoo.feature.text
Given a wordIndex map, transform tokens to corresponding indices. Those words not in the map will be aborted. Need to tokenize first. Input key: TextFeature.tokens Output key: TextFeature.indexedTokens
Map of each word (String) and its index (integer).
Given a wordIndex map, transform tokens to corresponding indices. Those words not in the map will be aborted. Need to tokenize first. Input key: TextFeature.tokens Output key: TextFeature.indexedTokens