v0.4.1

github-actions released this 16 Apr 22:39

· 76 commits to main since this release

6c0e061

What's Changed

Add ability to tokenize a string and return the decoded tokens using the correct BPE model by @thejohnbackes in #17

New Contributors

@thejohnbackes made their first contribution in #17

Full Changelog: v0.4.0...v0.4.1

Contributors

jackbackes

Assets 2