MyGit

v0.2.25

bentoml/OpenLLM

版本发布时间: 2023-08-16 20:47:13

bentoml/OpenLLM最新发布版本:v0.6.13(2024-10-17 21:17:35)

What changed?

The long-awaited ClojureScript UI is now GA. Try it out with docker run -p 8420:80 ghcr.io/bentoml/openllm-ui-clojure:0.2.25. Thanks @GutZuFusss

Added vLLM support for Falcon, and general CQA.

Installation

pip install openllm==0.2.25

To upgrade from a previous version, use the following command:

pip install --upgrade openllm==0.2.25

Usage

All available models: openllm models

To start a LLM: python -m openllm start opt

To run OpenLLM within a container environment (requires GPUs): docker run --gpus all -it -P ghcr.io/bentoml/openllm:0.2.25 start opt

To run OpenLLM Clojure UI (community-maintained): docker run -p 8420:80 ghcr.io/bentoml/openllm-ui-clojure:0.2.25

Find more information about this release in the CHANGELOG.md

What's Changed

New Contributors

Full Changelog: https://github.com/bentoml/OpenLLM/compare/v0.2.24...v0.2.25

相关地址:原始地址 下载(tar) 下载(zip)

1、 openllm-0.2.25-py3-none-any.whl 218.86KB

2、 openllm-0.2.25.tar.gz 168.17KB

3、 openllm-0.2.25-cp38-cp38-macosx_10_16_x86_64.whl 519.98KB

4、 openllm-0.2.25-cp39-cp39-macosx_10_16_x86_64.whl 527.53KB

5、 openllm-0.2.25-cp310-cp310-macosx_10_16_x86_64.whl 528.08KB

6、 openllm-0.2.25-cp311-cp311-macosx_10_16_x86_64.whl 520.59KB

7、 openllm-0.2.25-cp38-cp38-macosx_10_16_universal2.whl 813.33KB

8、 openllm-0.2.25-cp39-cp39-macosx_10_16_universal2.whl 826.96KB

9、 openllm-0.2.25-cp310-cp310-macosx_10_16_universal2.whl 827.81KB

10、 openllm-0.2.25-cp311-cp311-macosx_10_16_universal2.whl 812.21KB

11、 openllm-0.2.25-cp38-cp38-macosx_10_16_arm64.whl 514.9KB

12、 openllm-0.2.25-cp39-cp39-macosx_10_16_arm64.whl 520.38KB

13、 openllm-0.2.25-cp310-cp310-macosx_10_16_arm64.whl 520.53KB

14、 openllm-0.2.25-cp311-cp311-macosx_10_16_arm64.whl 513.35KB

15、 openllm-0.2.25-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 1.11MB

16、 openllm-0.2.25-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 1.14MB

17、 openllm-0.2.25-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 1.14MB

18、 openllm-0.2.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl 1.1MB

查看:2023-08-16发行的版本