Token

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

6. final def eq(arg0: AnyRef): Boolean

   

   Definition Classes

   AnyRef

7. def extendProperty(propertyKey: Symbol, propertyValueExtension: Symbol): Token

   

   Extends the value of the specified property to include a new symbol.

   Extends the value of the specified property to include a new symbol.

   This symbol is added to the current set of symbols that the property maps to.

   propertyKey

   desired property to extend

   propertyValueExtension

   new symbol to add to the specified property's value

   returns

   a token for which the specified property's value is extended with the specified value

8. def finalize(): Unit

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( classOf[java.lang.Throwable] )

9. final def getClass(): Class[_]

   

   Definition Classes

   AnyRef → Any

10. def getDeterministicProperty(propertyName: Symbol): Symbol

    

    For singleton properties (i.e.

    For singleton properties (i.e. the value is a singleton set), this returns the single symbol in that set.

    For undefined properties, a reserved Token.propertyNotFound symbol is returned.

    An exception is thrown if the specified property is associated with a non-singleton set.

    propertyName

    the desired property

    returns

    the singleton value of the desired property

11. def getProperty(propertyName: Symbol): Set[Symbol]

    

    Retrieves the value of a specified property.

    Retrieves the value of a specified property.

    If the property is not defined, then the empty set is returned.

    propertyName

    the desired property

    returns

    the value of the desired property (a set of symbols)

12. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

13. def isPunctuation: Boolean

    

    Returns true if this token is considered punctuation.

    Returns true if this token is considered punctuation.

    Note that "." is the Google coarse part-of-speech tag for all punctuation.

    returns

    true if this token is considered punctuation

14. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

15. final def notify(): Unit

    

    Definition Classes

    AnyRef

16. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

17. val properties: Map[Symbol, Set[Symbol]]

    

    a symbol-to-symbolset map, used for annotating the token with properties

18. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

19. def updateProperty(propertyKey: Symbol, propertyValue: Set[Symbol]): Token

    

    Replaces the value of the specified property.

    Replaces the value of the specified property.

    propertyKey

    desired property to replace

    propertyValue

    new desired value for the specified property

    returns

    a token for which the specified property is mapped to the specified value

20. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

21. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

22. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

23. val word: Symbol

    

    the surface form of the token (i.e.

    the surface form of the token (i.e. the word)