What's new in 0.10.3 (2024-04-24)

These are the changes in inference v0.10.3.

New features

• FEAT: support llama-3 family by @qinxuye in https://github.com/xorbitsai/inference/pull/1332
• FEAT: Add Belle-whisper-large-v3-zh by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1351

Enhancements

• ENH: fix the max length of codeqwen-7B-chat by @mikeshi80 in https://github.com/xorbitsai/inference/pull/1354
• ENH: Clear cache for embedding and rerank by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1360

Bug fixes

• BUG: Fix Launching embedding or reranking models from commandline fails due to PEFT by @hainaweiben in https://github.com/xorbitsai/inference/pull/1343
• BUG: Fix extra parameters issue when auto-recovering models by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/1348
• BUG: Fix old rerank models use flag rerank issue by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1350

Documentation

• DOC: Add new models to README by @qinxuye in https://github.com/xorbitsai/inference/pull/1346
• DOC: Update README, add FastGPT to integrations by @yangchuansheng in https://github.com/xorbitsai/inference/pull/1355

New Contributors

• @yangchuansheng made their first contribution in https://github.com/xorbitsai/inference/pull/1355

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.10.2.post1...v0.10.3