v1.3.4
版本发布时间: 2023-12-22 22:46:47
huggingface/text-generation-inference最新发布版本:v2.3.1(2024-10-03 21:01:49)
What's Changed
- feat: relax mistral requirements by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1351
- fix: fix logic if sliding window key is not present in config by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1352
- fix: fix offline (#1341) by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1347
- fix: fix gpt-q with groupsize = -1 by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1358
- Peft safetensors. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1364
- Change URL for Habana Gaudi support in doc by @regisss in https://github.com/huggingface/text-generation-inference/pull/1343
- feat: update exllamav2 kernels by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1370
- Fix local load for peft by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1373
Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.3.3...v1.3.4