MyGit

v0.5.4

vllm-project/vllm

版本发布时间: 2024-08-06 06:38:28

vllm-project/vllm最新发布版本:v0.6.1(2024-09-12 05:44:44)

Highlights

Model Support

Hardware Support

Performance

We are progressing along our quest to quickly improve performance. Each of the following PRs contributed some improvements, and we anticipate more enhancements in the next release.

Production Features

Quantization

What's Changed

New Contributors

Full Changelog: https://github.com/vllm-project/vllm/compare/v0.5.3...v0.5.4

相关地址:原始地址 下载(tar) 下载(zip)

1、 vllm-0.5.4+cu118-cp310-cp310-manylinux1_x86_64.whl 118.82MB

2、 vllm-0.5.4+cu118-cp311-cp311-manylinux1_x86_64.whl 118.82MB

3、 vllm-0.5.4+cu118-cp312-cp312-manylinux1_x86_64.whl 118.82MB

4、 vllm-0.5.4+cu118-cp38-cp38-manylinux1_x86_64.whl 118.82MB

5、 vllm-0.5.4+cu118-cp39-cp39-manylinux1_x86_64.whl 118.82MB

6、 vllm-0.5.4-cp310-cp310-manylinux1_x86_64.whl 118.42MB

7、 vllm-0.5.4-cp311-cp311-manylinux1_x86_64.whl 118.42MB

8、 vllm-0.5.4-cp312-cp312-manylinux1_x86_64.whl 118.42MB

9、 vllm-0.5.4-cp38-cp38-manylinux1_x86_64.whl 118.42MB

10、 vllm-0.5.4-cp39-cp39-manylinux1_x86_64.whl 118.42MB

查看:2024-08-06发行的版本