Token Class
Token stores data relative to a specific token. Tokens are delimited according to our Tokenizer.
Attributes / Properties
| Name | Type | Description |
|---|---|---|
| common properties | depends on property | Properties allowing access to specific data (pos, token etc.) |