v0.4.42
版本发布时间: 2024-02-02 20:31:07
bentoml/OpenLLM最新发布版本:v0.6.13(2024-10-17 21:17:35)
Installation
pip install openllm==0.4.42
To upgrade from a previous version, use the following command:
pip install --upgrade openllm==0.4.42
Usage
All available models: openllm models
To start a LLM: python -m openllm start HuggingFaceH4/zephyr-7b-beta
To run OpenLLM within a container environment (requires GPUs): docker run --gpus all -it -P -v $PWD/data:$HOME/.cache/huggingface/ ghcr.io/bentoml/openllm:0.4.42 start HuggingFaceH4/zephyr-7b-beta
Find more information about this release in the CHANGELOG.md
What's Changed
- docs: Update opt example to ms-phi by @Sherlock113 in https://github.com/bentoml/OpenLLM/pull/805
- chore(script): run vendored scripts by @aarnphm in https://github.com/bentoml/OpenLLM/pull/808
- docs: README.md typo by @weibeu in https://github.com/bentoml/OpenLLM/pull/819
- ci: pre-commit autoupdate [pre-commit.ci] by @pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/818
- chore(deps): bump docker/metadata-action from 5.3.0 to 5.4.0 by @dependabot in https://github.com/bentoml/OpenLLM/pull/814
- chore(deps): bump taiki-e/install-action from 2.22.5 to 2.23.1 by @dependabot in https://github.com/bentoml/OpenLLM/pull/813
- chore(deps): bump github/codeql-action from 3.22.11 to 3.22.12 by @dependabot in https://github.com/bentoml/OpenLLM/pull/815
- ci: pre-commit autoupdate [pre-commit.ci] by @pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/825
- chore(deps): bump crazy-max/ghaction-import-gpg from 6.0.0 to 6.1.0 by @dependabot in https://github.com/bentoml/OpenLLM/pull/824
- chore(deps): bump taiki-e/install-action from 2.23.1 to 2.23.7 by @dependabot in https://github.com/bentoml/OpenLLM/pull/823
- docs: Add Llamaindex in freedom to build by @Sherlock113 in https://github.com/bentoml/OpenLLM/pull/826
- ci: pre-commit autoupdate [pre-commit.ci] by @pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/836
- chore(deps): bump docker/metadata-action from 5.4.0 to 5.5.0 by @dependabot in https://github.com/bentoml/OpenLLM/pull/834
- chore(deps): bump aquasecurity/trivy-action from 0.16.0 to 0.16.1 by @dependabot in https://github.com/bentoml/OpenLLM/pull/832
- chore(deps): bump taiki-e/install-action from 2.23.7 to 2.24.1 by @dependabot in https://github.com/bentoml/OpenLLM/pull/833
- chore(deps): bump vllm to 0.2.7 by @aarnphm in https://github.com/bentoml/OpenLLM/pull/837
- chore: update discord link by @aarnphm in https://github.com/bentoml/OpenLLM/pull/838
- improv(package): use python slim base image and let pytorch install cuda by @larme in https://github.com/bentoml/OpenLLM/pull/807
- fix(dockerfile): conflict deps by @aarnphm in https://github.com/bentoml/OpenLLM/pull/841
- chore: fix typo in list_models pydoc by @fuzzie360 in https://github.com/bentoml/OpenLLM/pull/847
- docs: update README.md telemetry code link by @fuzzie360 in https://github.com/bentoml/OpenLLM/pull/842
- chore(deps): bump taiki-e/install-action from 2.24.1 to 2.25.1 by @dependabot in https://github.com/bentoml/OpenLLM/pull/846
- chore(deps): bump github/codeql-action from 3.22.12 to 3.23.0 by @dependabot in https://github.com/bentoml/OpenLLM/pull/844
- ci: pre-commit autoupdate [pre-commit.ci] by @pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/848
- ci: pre-commit autoupdate [pre-commit.ci] by @pre-commit-ci in https://github.com/bentoml/OpenLLM/pull/858
- chore(deps): bump taiki-e/install-action from 2.25.1 to 2.25.9 by @dependabot in https://github.com/bentoml/OpenLLM/pull/856
- chore(deps): bump github/codeql-action from 3.23.0 to 3.23.1 by @dependabot in https://github.com/bentoml/OpenLLM/pull/855
- fix: proper SSE handling for vllm by @larme in https://github.com/bentoml/OpenLLM/pull/877
- chore: set stop to empty list by default by @larme in https://github.com/bentoml/OpenLLM/pull/878
- fix: all runners sse output by @larme in https://github.com/bentoml/OpenLLM/pull/880
New Contributors
- @weibeu made their first contribution in https://github.com/bentoml/OpenLLM/pull/819
- @fuzzie360 made their first contribution in https://github.com/bentoml/OpenLLM/pull/847
Full Changelog: https://github.com/bentoml/OpenLLM/compare/v0.4.41...v0.4.42
1、 openllm-0.4.42-aarch64-apple-darwin.tar.gz 1.9MB
2、 openllm-0.4.42-aarch64-unknown-linux-gnu.tar.gz 1.97MB
3、 openllm-0.4.42-i686-unknown-linux-gnu.tar.gz 2.03MB
4、 openllm-0.4.42-powerpc64le-unknown-linux-gnu.tar.gz 2.21MB
5、 openllm-0.4.42-py3-none-any.whl 120.41KB
6、 openllm-0.4.42-x86_64-apple-darwin.tar.gz 2.01MB
7、 openllm-0.4.42-x86_64-unknown-linux-gnu.tar.gz 2.16MB
8、 openllm-0.4.42-x86_64-unknown-linux-musl.tar.gz 2.2MB
9、 openllm-0.4.42.tar.gz 113.72KB
10、 openllm-dive-bentos-0.4.42-aarch64-apple-darwin.tar.gz 1.9MB
11、 openllm-dive-bentos-0.4.42-aarch64-unknown-linux-gnu.tar.gz 1.97MB
12、 openllm-dive-bentos-0.4.42-i686-unknown-linux-gnu.tar.gz 2.03MB
13、 openllm-dive-bentos-0.4.42-powerpc64le-unknown-linux-gnu.tar.gz 2.21MB
14、 openllm-dive-bentos-0.4.42-x86_64-apple-darwin.tar.gz 2.01MB
15、 openllm-dive-bentos-0.4.42-x86_64-unknown-linux-gnu.tar.gz 2.16MB
16、 openllm-dive-bentos-0.4.42-x86_64-unknown-linux-musl.tar.gz 2.2MB
17、 openllm-get-containerfile-0.4.42-aarch64-apple-darwin.tar.gz 1.9MB
18、 openllm-get-containerfile-0.4.42-aarch64-unknown-linux-gnu.tar.gz 1.97MB
19、 openllm-get-containerfile-0.4.42-i686-unknown-linux-gnu.tar.gz 2.03MB
20、 openllm-get-containerfile-0.4.42-powerpc64le-unknown-linux-gnu.tar.gz 2.21MB
21、 openllm-get-containerfile-0.4.42-x86_64-apple-darwin.tar.gz 2.01MB
22、 openllm-get-containerfile-0.4.42-x86_64-unknown-linux-gnu.tar.gz 2.16MB
23、 openllm-get-containerfile-0.4.42-x86_64-unknown-linux-musl.tar.gz 2.2MB
24、 openllm-get-prompt-0.4.42-aarch64-apple-darwin.tar.gz 1.9MB
25、 openllm-get-prompt-0.4.42-aarch64-unknown-linux-gnu.tar.gz 1.97MB
26、 openllm-get-prompt-0.4.42-i686-unknown-linux-gnu.tar.gz 2.03MB
27、 openllm-get-prompt-0.4.42-powerpc64le-unknown-linux-gnu.tar.gz 2.21MB
28、 openllm-get-prompt-0.4.42-x86_64-apple-darwin.tar.gz 2.01MB
29、 openllm-get-prompt-0.4.42-x86_64-unknown-linux-gnu.tar.gz 2.16MB
30、 openllm-get-prompt-0.4.42-x86_64-unknown-linux-musl.tar.gz 2.2MB
31、 openllm-list-bentos-0.4.42-aarch64-apple-darwin.tar.gz 1.9MB
32、 openllm-list-bentos-0.4.42-aarch64-unknown-linux-gnu.tar.gz 1.97MB
33、 openllm-list-bentos-0.4.42-i686-unknown-linux-gnu.tar.gz 2.03MB
34、 openllm-list-bentos-0.4.42-powerpc64le-unknown-linux-gnu.tar.gz 2.21MB
35、 openllm-list-bentos-0.4.42-x86_64-apple-darwin.tar.gz 2.01MB
36、 openllm-list-bentos-0.4.42-x86_64-unknown-linux-gnu.tar.gz 2.16MB
37、 openllm-list-bentos-0.4.42-x86_64-unknown-linux-musl.tar.gz 2.2MB
38、 openllm-list-models-0.4.42-aarch64-apple-darwin.tar.gz 1.9MB
39、 openllm-list-models-0.4.42-aarch64-unknown-linux-gnu.tar.gz 1.97MB
40、 openllm-list-models-0.4.42-i686-unknown-linux-gnu.tar.gz 2.03MB
41、 openllm-list-models-0.4.42-powerpc64le-unknown-linux-gnu.tar.gz 2.21MB
42、 openllm-list-models-0.4.42-x86_64-apple-darwin.tar.gz 2.01MB
43、 openllm-list-models-0.4.42-x86_64-unknown-linux-gnu.tar.gz 2.16MB
44、 openllm-list-models-0.4.42-x86_64-unknown-linux-musl.tar.gz 2.2MB
45、 openllm-playground-0.4.42-aarch64-apple-darwin.tar.gz 1.9MB
46、 openllm-playground-0.4.42-aarch64-unknown-linux-gnu.tar.gz 1.97MB
47、 openllm-playground-0.4.42-i686-unknown-linux-gnu.tar.gz 2.03MB
48、 openllm-playground-0.4.42-powerpc64le-unknown-linux-gnu.tar.gz 2.21MB
49、 openllm-playground-0.4.42-x86_64-apple-darwin.tar.gz 2.01MB
50、 openllm-playground-0.4.42-x86_64-unknown-linux-gnu.tar.gz 2.16MB
51、 openllm-playground-0.4.42-x86_64-unknown-linux-musl.tar.gz 2.2MB
52、 openllm_client-0.4.42-py3-none-any.whl 18.74KB
53、 openllm_client-0.4.42.tar.gz 20.52KB
54、 openllm_core-0.4.42-py3-none-any.whl 70.97KB
55、 openllm_core-0.4.42.tar.gz 56.87KB