Skip to content

Token Class

Token stores data relative to a specific token. Tokens are delimited according to our Tokenizer.

Attributes / Properties

NameTypeDescription
common propertiesdepends on propertyProperties allowing access to specific data (pos, token etc.)