MyGit

v0.14.0.rc1

huggingface/tokenizers

版本发布时间: 2023-09-07 19:39:02

huggingface/tokenizers最新发布版本:v0.15.0(2023-11-15 03:06:30)

Reworks the release pipeline. Other breaking changes are mostly related to https://github.com/huggingface/tokenizers/pull/1335, where AddedToken is reworked

What's Changed

New Contributors

Full Changelog: https://github.com/huggingface/tokenizers/compare/v0.13.4.rc2...v0.14.0.rc1

相关地址:原始地址 下载(tar) 下载(zip)

查看:2023-09-07发行的版本