What's new in 0.3.0 (2023-09-04)

These are the changes in inference v0.3.0.

Enhancements

• ENH: help message for CLI by @Bojun-Feng in https://github.com/xorbitsai/inference/pull/367

Bug fixes

• BUG: Asking to pad but the tokenizer does not have a padding token by @jiayini1119 in https://github.com/xorbitsai/inference/pull/407
• BUG: empty results for non-stream inference by @UranusSeven in https://github.com/xorbitsai/inference/pull/415
• BUG: Make context_length optional in model family by @Bojun-Feng in https://github.com/xorbitsai/inference/pull/394

Others

• EHN: auto retry download on network errors by @jiayini1119 in https://github.com/xorbitsai/inference/pull/405
• FEAT : Add Model Dashboard by @Bojun-Feng in https://github.com/xorbitsai/inference/pull/366

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.2.3...v0.3.0