Token Class
Token stores data relative to a specific token. Tokens are delimited according to our Tokenizer.
Attributes / Properties
Name | Type | Description |
---|---|---|
common properties | depends on property | Properties allowing access to specific data (pos, token etc.) |