v0.8.0

版本发布时间: 2024-01-11 21:55:03

xorbitsai/inference最新发布版本:v0.16.2(2024-11-01 18:09:08)

What's new in 0.8.0 (2024-01-11)

These are the changes in inference v0.8.0.

ENH: Stream use xoscar generator by @codingl2k1 in https://github.com/xorbitsai/inference/pull/859
ENH: UI supports registering custom gptq models by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/875
ENH: make the size param of *_to_image more compatible by @liunux4odoo in https://github.com/xorbitsai/inference/pull/881
BLD: Update package-lock.json by @aresnow1 in https://github.com/xorbitsai/inference/pull/886
REF: Add model_hub property in EmbeddingModelSpec by @aresnow1 in https://github.com/xorbitsai/inference/pull/877

BUG: Fix image model b64_json output by @codingl2k1 in https://github.com/xorbitsai/inference/pull/874
BUG: fix libcuda.so.1: cannot open shared object file by @superhuahua in https://github.com/xorbitsai/inference/pull/883
BUG: Fix auto recover kwargs by @codingl2k1 in https://github.com/xorbitsai/inference/pull/885

DOC: docker image translation by @aresnow1 in https://github.com/xorbitsai/inference/pull/865
DOC: register model with model_family by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/863
DOC: Add OpenAI Client API doc by @codingl2k1 in https://github.com/xorbitsai/inference/pull/864
DOC: add docker instructions by @onesuper in https://github.com/xorbitsai/inference/pull/878

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.7.5...v0.8.0