v0.5.3.post1
版本发布时间: 2024-07-24 01:09:40
vllm-project/vllm最新发布版本:v0.6.1(2024-09-12 05:44:44)
Highlights
- We fixed an configuration incompatibility between vLLM (which tested against pre-released version) and the published Meta Llama 3.1 weights (#6693)
What's Changed
- [Docs] Announce llama3.1 support by @WoosukKwon in https://github.com/vllm-project/vllm/pull/6688
- [doc][distributed] fix doc argument order by @youkaichao in https://github.com/vllm-project/vllm/pull/6691
- [Bugfix] Fix a log error in chunked prefill by @WoosukKwon in https://github.com/vllm-project/vllm/pull/6694
- [BugFix] Fix RoPE error in Llama 3.1 by @WoosukKwon in https://github.com/vllm-project/vllm/pull/6693
- Bump version to 0.5.3.post1 by @simon-mo in https://github.com/vllm-project/vllm/pull/6696
Full Changelog: https://github.com/vllm-project/vllm/compare/v0.5.3...v0.5.3.post1
1、 vllm-0.5.3.post1+cu118-cp310-cp310-manylinux1_x86_64.whl 151.03MB
2、 vllm-0.5.3.post1+cu118-cp311-cp311-manylinux1_x86_64.whl 151.03MB
3、 vllm-0.5.3.post1+cu118-cp38-cp38-manylinux1_x86_64.whl 151.03MB
4、 vllm-0.5.3.post1+cu118-cp39-cp39-manylinux1_x86_64.whl 151.03MB
5、 vllm-0.5.3.post1-cp310-cp310-manylinux1_x86_64.whl 150.96MB
6、 vllm-0.5.3.post1-cp311-cp311-manylinux1_x86_64.whl 150.96MB
7、 vllm-0.5.3.post1-cp38-cp38-manylinux1_x86_64.whl 150.96MB
8、 vllm-0.5.3.post1-cp39-cp39-manylinux1_x86_64.whl 150.96MB