v0.1.2
版本发布时间: 2024-04-30 17:52:58
EricLBuehler/mistral.rs最新发布版本:v0.1.2(2024-04-30 17:52:58)
New features
- Initial
async
integrations (#198, #236) thanks to @lucasavila00. - More flexibility with
bos
andeos
tokens (#248) - Intermediate loading for ISQ models on CPU (#229)
- Fixed Phi 3 128k finally, it is fully working now! (#251)
Changelog
- Update README.md by @KPCOFGS in https://github.com/EricLBuehler/mistral.rs/pull/224
- Fix api_dir_list! and show better error by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/225
- Default to
none
when cannot find token by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/226 - docs: update ADAPTER_MODELS.md by @eltociear in https://github.com/EricLBuehler/mistral.rs/pull/227
- Fix debug log timing of first token by @lucasavila00 in https://github.com/EricLBuehler/mistral.rs/pull/231
- Implement intermediate loading for ISQ on CPU by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/229
- Async sampling by @lucasavila00 in https://github.com/EricLBuehler/mistral.rs/pull/198
- Fix quantized example by @lucasavila00 in https://github.com/EricLBuehler/mistral.rs/pull/237
- Source bos, eos tokens from generation_config.json by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/243
- Sliding window for phi3 by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/244
- Fix docker images by @LLukas22 in https://github.com/EricLBuehler/mistral.rs/pull/249
- Remove forced max seq len for llama models by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/250
- Fix Phi3 128k finally: use position ids to switch between short/long scaling by @EricLBuehler in https://github.com/EricLBuehler/mistral.rs/pull/251
- Update README.md by @criminact in https://github.com/EricLBuehler/mistral.rs/pull/253
- Async channels by @lucasavila00 in https://github.com/EricLBuehler/mistral.rs/pull/236
New Contributors
- @KPCOFGS made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/224
- @eltociear made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/227
- @criminact made their first contribution in https://github.com/EricLBuehler/mistral.rs/pull/253
Full Changelog: https://github.com/EricLBuehler/mistral.rs/compare/v0.1.0...v0.1.2