What's new in 0.16.3 (2024-11-08)

These are the changes in inference v0.16.3.

New features

• feat: Add support for Llama 3.2-Vision models by @vikrantrathore in https://github.com/xorbitsai/inference/pull/2376

Enhancements

• ENH: Display model name in process by @frostyplanet in https://github.com/xorbitsai/inference/pull/1891
• REF: Remove replica total count in internal replica_model_uid by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/2516

Bug fixes

• BUG: Compat with ChatTTS 0.2.1 by @codingl2k1 in https://github.com/xorbitsai/inference/pull/2520
• BUG: transformers logs missing by @ChengjieLi28 in https://github.com/xorbitsai/inference/pull/2530

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.16.2...v0.16.3