v0.14.3
版本发布时间: 2024-08-23 18:53:46
xorbitsai/inference最新发布版本:v1.1.0(2024-12-13 18:29:37)
What's new in 0.14.3 (2024-08-23)
These are the changes in inference v0.14.3.
New features
- FEAT: ChatTTS speech voice support encoded speaker str by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2096
- FEAT: [UI] Add other parameters to other models besides the LLM model. by @yiboyasss in https://github.com/xorbitsai/inference/pull/2129
- FEAT: support SD3-medium inpainting by @qinxuye in https://github.com/xorbitsai/inference/pull/2137
- feat: 🎸 Added the model dtype parameter for embedding (currently only supported for models gte-Qwen2). by @Zzzz1111 in https://github.com/xorbitsai/inference/pull/2120
- FEAT: Support fish speech model by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2119
- FEAT: support CogVLM2-video by @Minamiyama in https://github.com/xorbitsai/inference/pull/2110
- FEAT: Support LMDeploy for internvl2 and fix finish reasion miss at internvl stream by @amumu96 in https://github.com/xorbitsai/inference/pull/2145
Enhancements
- ENH: make internvl2 support video by @Minamiyama in https://github.com/xorbitsai/inference/pull/2104
- ENH: support process_image with padding for image_to_image by @qinxuye in https://github.com/xorbitsai/inference/pull/2109
- REF: use utils._decode_image replacing same codes in individual vl files by @Minamiyama in https://github.com/xorbitsai/inference/pull/2105
Bug fixes
- BUG: fix asyncio.Queue error in benchmark by @Dawnfz-Lenfeng in https://github.com/xorbitsai/inference/pull/2113
- BUG: fix deleting cache by @qinxuye in https://github.com/xorbitsai/inference/pull/2114
- Bug: fix audio ability errorwhen get instance info by @amumu96 in https://github.com/xorbitsai/inference/pull/2147
Documentation
- DOC: add more doc about ChatTTS by @qinxuye in https://github.com/xorbitsai/inference/pull/2108
- DOC: remove models deleted by @qinxuye in https://github.com/xorbitsai/inference/pull/2122
- DOC: Add doc for fish speech and cogvlm2 video by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2149
Others
- [Bug]: Fix concurrent ops in worker initialization by @frostyplanet in https://github.com/xorbitsai/inference/pull/2125
New Contributors
- @Zzzz1111 made their first contribution in https://github.com/xorbitsai/inference/pull/2120
Full Changelog: https://github.com/xorbitsai/inference/compare/v0.14.2...v0.14.3