v1.2.0
版本发布时间: 2024-09-25 04:26:47
zhudotexe/kani最新发布版本:v1.2.0(2024-09-25 04:26:47)
New Features
- Hugging Face: Models loaded through the
HuggingEngine
now use chat templates for conversational prompting and tool usage if available by default. This should make it much easier to get started with a Hugging Face model in Kani. - Added the ability to supply a custom tokenizer to the
OpenAIEngine
(e.g., for using OpenAI-compatible APIs)\
Fixes/Improvements
- Fixed a missing dependency in the
llama
extra - The
HuggingEngine
will now automatically setdevice_map="auto"
if theaccelerate
library is installed