This release brings many enhancements, fixes, and a special thanks to the community for the amazing work and contributions!

We now have sycl images for Intel GPUs, ROCm images for AMD GPUs,and much more:

• You can find the AMD GPU images tags between the container images available - look for hipblas. For example, master-hipblas-ffmpeg-core. Thanks to @fenfir for this nice contribution!
• Intel GPU images are tagged with sycl. You can find images with two flavors, sycl-f16 and sycl-f32 respectively. For example, master-sycl-f16. Work is in progress to support also diffusers and transformers on Intel GPUs.
• Thanks to @christ66 first efforts in supporting the Assistant API were made, and we are planning to support the Assistant API! Stay tuned for more!
• Now LocalAI supports the Tools API endpoint - it also supports the (now deprecated) functions API call as usual. We now also have support for SSE with function calling. See https://github.com/mudler/LocalAI/pull/1726 for more
• Support for Gemma models - did you hear? Google released OSS models and LocalAI supports it already!
• Thanks to @dave-gray101 in https://github.com/mudler/LocalAI/pull/1728 to put efforts in refactoring parts of the code - we are going to support soon more ways to interface with LocalAI, and not only restful api!

Support the project

First off, a massive thank you to each and every one of you who've chipped in to squash bugs and suggest cool new features for LocalAI. Your help, kind words, and brilliant ideas are truly appreciated - more than words can say!

And to those of you who've been heros, giving up your own time to help out fellow users on Discord and in our repo, you're absolutely amazing. We couldn't have asked for a better community.

Just so you know, LocalAI doesn't have the luxury of big corporate sponsors behind it. It's all us, folks. So, if you've found value in what we're building together and want to keep the momentum going, consider showing your support. A little shoutout on your favorite social platforms using @LocalAI_OSS and @mudler_it or joining our sponsorship program can make a big difference.

Also, if you haven't yet joined our Discord, come on over! Here's the link: https://discord.gg/uJAeKSAGDy

Every bit of support, every mention, and every star adds up and helps us keep this ship sailing. Let's keep making LocalAI awesome together!

Thanks a ton, and here's to more exciting times ahead with LocalAI! 🚀

What's Changed

Bug fixes :bug:

• Add TTS dependency for cuda based builds fixes #1727 by @blob42 in https://github.com/mudler/LocalAI/pull/1730

Exciting New Features 🎉

• Build docker container for ROCm by @fenfir in https://github.com/mudler/LocalAI/pull/1595
• feat(tools): support Tool calls in the API by @mudler in https://github.com/mudler/LocalAI/pull/1715
• Initial implementation of upload files api. by @christ66 in https://github.com/mudler/LocalAI/pull/1703
• feat(tools): Parallel function calling by @mudler in https://github.com/mudler/LocalAI/pull/1726
• refactor: move part of api packages to core by @dave-gray101 in https://github.com/mudler/LocalAI/pull/1728
• deps(llama.cpp): update, support Gemma models by @mudler in https://github.com/mudler/LocalAI/pull/1734

👒 Dependencies

• deps(llama.cpp): update by @mudler in https://github.com/mudler/LocalAI/pull/1714
• :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/1740

Other Changes

• :arrow_up: Update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/1718
• :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/1705
• Update README.md by @lunamidori5 in https://github.com/mudler/LocalAI/pull/1739
• :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/1750

New Contributors

• @fenfir made their first contribution in https://github.com/mudler/LocalAI/pull/1595
• @christ66 made their first contribution in https://github.com/mudler/LocalAI/pull/1703
• @blob42 made their first contribution in https://github.com/mudler/LocalAI/pull/1730

Full Changelog: https://github.com/mudler/LocalAI/compare/v2.8.2...v2.9.0