Class/Object

org.clulab.processors.clu.tokenizer

RawToken

Related Docs: object RawToken | package tokenizer

Permalink

case class RawToken(raw: String, beginPosition: Int, endPosition: Int, word: String) extends Product with Serializable

Stores a token as produced by a tokenizer

raw

The EXACT text tokenized

beginPosition

beginning character offset of raw

endPosition

end character offset of raw

word

Normalized form raw, e.g., "'m" becomes "am". Note: these are NOT lemmas.

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. RawToken
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new RawToken(raw: String, beginPosition: Int, endPosition: Int, word: String)

    Permalink

    raw

    The EXACT text tokenized

    beginPosition

    beginning character offset of raw

    endPosition

    end character offset of raw

    word

    Normalized form raw, e.g., "'m" becomes "am". Note: these are NOT lemmas.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. val beginPosition: Int

    Permalink

    beginning character offset of raw

  6. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  7. val endPosition: Int

    Permalink

    end character offset of raw

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  9. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  10. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  11. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  12. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  13. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  14. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  15. val raw: String

    Permalink

    The EXACT text tokenized

  16. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  17. def toString(): String

    Permalink
    Definition Classes
    RawToken → AnyRef → Any

  18. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  19. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  20. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  21. val word: String

    Permalink

    Normalized form raw, e.g., "'m" becomes "am".

    Normalized form raw, e.g., "'m" becomes "am". Note: these are NOT lemmas.

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped