Highlights

• DBRX support https://github.com/huggingface/text-generation-inference/pull/1685. See #1679 on how to prompt the model.

What's Changed

• fix: adjust logprob response logic by @drbh in https://github.com/huggingface/text-generation-inference/pull/1682
• fix: handle batches with and without grammars by @drbh in https://github.com/huggingface/text-generation-inference/pull/1676
• feat: Add dbrx support by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1685

Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.4.4...v1.4.5