v0.2.3
版本发布时间: 2024-07-29 02:52:03
EricLBuehler/mistral.rs最新发布版本:v0.3.1(2024-09-29 23:39:44)
What's Changed
- Implement min-p sampling by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/625
- Tweak handling when PA cannot allocate by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/632
- Update deps by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/633
- Improve penalty context window calculation by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/636
- Allow setting PagedAttention KV cache allocation from context size by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/640
- Bump version to 0.2.3 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/638
Full Changelog: https://github.com/EricLBuehler/mistral.rs/compare/v0.2.2...v0.2.3
Install mistralrs-server 0.2.3
Install prebuilt binaries via shell script
curl --proto '=https' --tlsv1.2 -LsSf https://github.com/EricLBuehler/mistral.rs/releases/download/v0.2.3/mistralrs-server-installer.sh | sh
Download mistralrs-server 0.2.3
| File | Platform | Checksum |
|---|---|---|
| mistralrs-server-aarch64-apple-darwin.tar.xz | Apple Silicon macOS | checksum |
| mistralrs-server-x86_64-apple-darwin.tar.xz | Intel macOS | checksum |
| mistralrs-server-x86_64-unknown-linux-gnu.tar.xz | x64 Linux | checksum |
1、 dist-manifest.json 12.81KB
2、 mistralrs-server-aarch64-apple-darwin-update 5.79MB
3、 mistralrs-server-aarch64-apple-darwin.tar.xz 7.58MB
4、 mistralrs-server-aarch64-apple-darwin.tar.xz.sha256 111B
5、 mistralrs-server-installer.sh 30.87KB
6、 mistralrs-server-x86_64-apple-darwin-update 6.01MB
7、 mistralrs-server-x86_64-apple-darwin.tar.xz 8.19MB
8、 mistralrs-server-x86_64-apple-darwin.tar.xz.sha256 110B
9、 mistralrs-server-x86_64-unknown-linux-gnu-update 11.39MB
10、 mistralrs-server-x86_64-unknown-linux-gnu.tar.xz 8.83MB
11、 mistralrs-server-x86_64-unknown-linux-gnu.tar.xz.sha256 115B
12、 source.tar.gz 410.32KB
13、 source.tar.gz.sha256 80B