What's new in 0.4.0 (2023-09-06)

These are the changes in inference v0.4.0.

New features

• FEAT: Support CodeLlama-Instruct by @jiayini1119 in https://github.com/xorbitsai/inference/pull/414
• FEAT: Add embedding models support by @aresnow1 in https://github.com/xorbitsai/inference/pull/418
• FEAT: Support replica by @codingl2k1 in https://github.com/xorbitsai/inference/pull/410
• FEAT: support baichuan2 by @UranusSeven in https://github.com/xorbitsai/inference/pull/425

Bug fixes

• BUG: cmdline chat duplicates user msg by @UranusSeven in https://github.com/xorbitsai/inference/pull/428
• BUG: llama_cpp model context length by @UranusSeven in https://github.com/xorbitsai/inference/pull/429

Documentation

• DOC: update readme by @UranusSeven in https://github.com/xorbitsai/inference/pull/423

New Contributors

• @codingl2k1 made their first contribution in https://github.com/xorbitsai/inference/pull/410

Full Changelog: https://github.com/xorbitsai/inference/compare/v0.3.0...v0.4.0