Go to the source code of this file.
|
Sentences are just lists of mootToken objects |
|
Tagset (read "lexical class") type |
|
Tag-string type |
|
|
|
Token-string type |
|
|
|
|
Returns true iff is a pseudo-identifier for a non-alpha type Used during HMM and trie compilation |
|
Get the TokenType for a given token |
|
TnT compatibility hack |
|
TnT compatibility hack |
|
Convert token-types to symbolic names |
|
Useful for debugging token types |