nlp

Type Members

1. case class Annotation(annotatorType: String, begin: Int, end: Int, result: String, metadata: Map[String, String], embeddings: Array[Float] = Array.emptyFloatArray, sentence_embeddings: Array[Float] = Array.emptyFloatArray) extends Product with Serializable

   

   represents annotator's output parts and their details

   represents annotator's output parts and their details

   annotatorType

   the type of annotation

   begin

   the index of the first character under this annotation

   end

   the index after the last character under this annotation

   metadata

   associated metadata for this annotation

2. abstract class AnnotatorApproach[M <: Model[M]] extends Estimator[M] with HasInputAnnotationCols with HasOutputAnnotationCol with HasOutputAnnotatorType with DefaultParamsWritable

   

   This class should grow once we start training on datasets and share params For now it stands as a dummy placeholder for future reference

3. abstract class AnnotatorModel[M <: Model[M]] extends Model[M] with RawAnnotator[M]

   

   This trait implements logic that applies nlp using Spark ML Pipeline transformers Should strongly change once UsedDefinedTypes are allowed https://issues.apache.org/jira/browse/SPARK-7768

4. class Chunk2Doc extends AnnotatorModel[Chunk2Doc]

   

5. class Doc2Chunk extends Model[Doc2Chunk] with RawAnnotator[Doc2Chunk]

   

   Created by saif on 06/07/17.

6. class DocumentAssembler extends Transformer with DefaultParamsWritable with HasOutputAnnotatorType with HasOutputAnnotationCol

   

   Created by saif on 06/07/17.

7. class FeaturesReader[T <: HasFeatures] extends MLReader[T]

   

8. class FeaturesWriter[T] extends MLWriter with HasFeatures

   

9. class Finisher extends Transformer with DefaultParamsWritable

   

10. trait HasFeatures extends AnyRef

    

11. trait HasInputAnnotationCols extends Params

    

12. trait HasOutputAnnotationCol extends Params

    

13. trait HasOutputAnnotatorType extends AnyRef

    

14. trait HasRecursiveFit[M <: Model[M]] extends AnyRef

    

    AnnotatorApproach'es may extend this trait in order to allow RecursivePipelines to include intermediate steps trained PipelineModel's

15. case class JavaAnnotation(annotatorType: String, begin: Int, end: Int, result: String, metadata: Map[String, String], embeddings: Array[Float] = Array.emptyFloatArray, sentenceEmbeddings: Array[Float] = Array.emptyFloatArray) extends Product with Serializable

    

16. class LightPipeline extends AnyRef

    

17. trait ParamsAndFeaturesReadable[T <: HasFeatures] extends DefaultParamsReadable[T]

    

18. trait ParamsAndFeaturesWritable extends DefaultParamsWritable with Params with HasFeatures

    

19. trait RawAnnotator[M <: Model[M]] extends Model[M] with ParamsAndFeaturesWritable with HasOutputAnnotatorType with HasInputAnnotationCols with HasOutputAnnotationCol

    

    Created by jose on 25/01/18.

20. class RecursivePipeline extends Pipeline

    

21. class TokenAssembler extends AnnotatorModel[TokenAssembler]

    

    Created by saif on 06/07/17.