v1.4.3
版本发布时间: 2024-02-28 23:14:47
huggingface/text-generation-inference最新发布版本:v3.0.1(2024-12-12 04:13:58)
Highlights
- Add support for Starcoder 2
- Add support for Qwen2
What's Changed
- fix openapi schema by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1586
- avoid default message by @drbh in https://github.com/huggingface/text-generation-inference/pull/1579
- Revamp medusa implementation so that every model can benefit. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1588
- Support tools by @drbh in https://github.com/huggingface/text-generation-inference/pull/1587
- Fixing x-compute-time. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1606
- Fixing guidance docs. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1607
- starcoder2 by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1605
- Qwen2 by @Jason-CKY in https://github.com/huggingface/text-generation-inference/pull/1608
Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.4.2...v1.4.3