What's new in 0.11.3 (2024-05-31)

These are the changes in inference v0.11.3.

New features

• FEAT: support Yi-1.5-chat-16k by @qinxuye in https://github.com/xorbitsai/inference/pull/1544
• FEAT: Support XINFERENCE_DISABLE_METRICS env by @codingl2k1 in https://github.com/xorbitsai/inference/pull/1547
• FEAT: Support new model CogVLM by @amumu96 in https://github.com/xorbitsai/inference/pull/1551
• FEAT: telechat model by @LIKEGAKKI in https://github.com/xorbitsai/inference/pull/1567

Enhancements

• ENH: added engines options to model launch details by @qinxuye in https://github.com/xorbitsai/inference/pull/1546
• ENH: rm mini-internvl by @amumu96 in https://github.com/xorbitsai/inference/pull/1563
• ENH: add additional_option at vl gradio by @amumu96 in https://github.com/xorbitsai/inference/pull/1561
• ENH: add real paths column by @hainaweiben in https://github.com/xorbitsai/inference/pull/1555

Bug fixes

• BUG: fix launch model error when use torch 2.3.0 by @amumu96 in https://github.com/xorbitsai/inference/pull/1543
• BUG: fix vl-model img path error by @amumu96 in https://github.com/xorbitsai/inference/pull/1559
• BUG: Fix validation errors when define a custom baichuan-chat LLM model by @buptzyf in https://github.com/xorbitsai/inference/pull/1557

Documentation

• DOC: update readme and fix description about model engine by @qinxuye in https://github.com/xorbitsai/inference/pull/1566

Others

• Correct ModelActor import path in worker & supervisor by @frostyplanet in https://github.com/xorbitsai/inference/pull/1550

New Contributors

• @buptzyf made their first contribution in https://github.com/xorbitsai/inference/pull/1557
• @LIKEGAKKI made their first contribution in https://github.com/xorbitsai/inference/pull/1567

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.11.2...v0.11.3