What's new in 0.5.1 (2023-09-26)

These are the changes in inference v0.5.1.

Enhancements

• ENH: Safe iterate stream of ggml model by @codingl2k1 in https://github.com/xorbitsai/inference/pull/449
• ENH: Skip download if model exists by @aresnow1 in https://github.com/xorbitsai/inference/pull/495

Documentation

• DOC: vLLM by @UranusSeven in https://github.com/xorbitsai/inference/pull/491

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.5.0...v0.5.1