What's new in 0.2.2 (2023-08-25)

These are the changes in inference v0.2.2.

New features

• FEAT: Support Llama-2 PyTorch model by @jiayini1119 in https://github.com/xorbitsai/inference/pull/387
• FEAT: code-llama by @UranusSeven in https://github.com/xorbitsai/inference/pull/402

Enhancements

• ENH: Update max_tokens to 32k by @Bojun-Feng in https://github.com/xorbitsai/inference/pull/386

Bug fixes

• BUG: last token is duplicated by @UranusSeven in https://github.com/xorbitsai/inference/pull/398

Documentation

• DOC: readme enhancements by @aresnow1 in https://github.com/xorbitsai/inference/pull/390

Others

• fix chatglm params by @Bojun-Feng in https://github.com/xorbitsai/inference/pull/400

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.2.1...v0.2.2