v1.3.0
版本发布时间: 2023-12-11 22:11:18
huggingface/text-generation-inference最新发布版本:v2.3.1(2024-10-03 21:01:49)
What's Changed
- Fix AMD documentation by @fxmarty in https://github.com/huggingface/text-generation-inference/pull/1307
- Medusa and N-Gram Speculative decoding by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1308
- Mixtral support by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1328
Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.2.0...v1.3.0