Document the tokeniser
GarkGarcia opened this issue · 0 comments
GarkGarcia commented
We should add some documentation on the tokenizer before releasing the package. Simple docstrings will do for now.
GarkGarcia opened this issue · 0 comments
We should add some documentation on the tokenizer before releasing the package. Simple docstrings will do for now.