This release is a patch release to fix well known issues from 2.19.x

What's Changed

Bug fixes :bug:

• fix: pin setuptools 69.5.1 by @fakezeta in https://github.com/mudler/LocalAI/pull/2949
• fix(cuda): downgrade to 12.0 to increase compatibility range by @mudler in https://github.com/mudler/LocalAI/pull/2994
• fix(llama.cpp): do not set anymore lora_base by @mudler in https://github.com/mudler/LocalAI/pull/2999

Exciting New Features 🎉

• ci(Makefile): reduce binary size by compressing by @mudler in https://github.com/mudler/LocalAI/pull/2947
• feat(p2p): warn the user to start with --p2p by @mudler in https://github.com/mudler/LocalAI/pull/2993

🧠 Models

• models(gallery): add tulu 8b and 70b by @mudler in https://github.com/mudler/LocalAI/pull/2931
• models(gallery): add suzume-orpo by @mudler in https://github.com/mudler/LocalAI/pull/2932
• models(gallery): add archangel_sft_pythia2-8b by @mudler in https://github.com/mudler/LocalAI/pull/2933
• models(gallery): add celestev1.2 by @mudler in https://github.com/mudler/LocalAI/pull/2937
• models(gallery): add calme-2.3-phi3-4b by @mudler in https://github.com/mudler/LocalAI/pull/2939
• models(gallery): add calme-2.8-qwen2-7b by @mudler in https://github.com/mudler/LocalAI/pull/2940
• models(gallery): add StellarDong-72b by @mudler in https://github.com/mudler/LocalAI/pull/2941
• models(gallery): add calme-2.4-llama3-70b by @mudler in https://github.com/mudler/LocalAI/pull/2942
• models(gallery): add llama3.1 70b and 8b by @mudler in https://github.com/mudler/LocalAI/pull/3000

📖 Documentation and examples

• docs: add federation by @mudler in https://github.com/mudler/LocalAI/pull/2929
• docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/2935

👒 Dependencies

• chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2936
• chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2943
• chore(deps): Bump grpcio from 1.64.1 to 1.65.1 in /backend/python/openvoice by @dependabot in https://github.com/mudler/LocalAI/pull/2956
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/sentencetransformers by @dependabot in https://github.com/mudler/LocalAI/pull/2955
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/bark by @dependabot in https://github.com/mudler/LocalAI/pull/2951
• chore(deps): Bump docs/themes/hugo-theme-relearn from 1b2e139 to 7aec99b by @dependabot in https://github.com/mudler/LocalAI/pull/2952
• chore(deps): Bump langchain from 0.2.8 to 0.2.10 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2959
• chore(deps): Bump numpy from 1.26.4 to 2.0.1 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2958
• chore(deps): Bump sqlalchemy from 2.0.30 to 2.0.31 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2957
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/vllm by @dependabot in https://github.com/mudler/LocalAI/pull/2964
• chore(deps): Bump llama-index from 0.10.55 to 0.10.56 in /examples/chainlit by @dependabot in https://github.com/mudler/LocalAI/pull/2966
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/common/template by @dependabot in https://github.com/mudler/LocalAI/pull/2963
• chore(deps): Bump weaviate-client from 4.6.5 to 4.6.7 in /examples/chainlit by @dependabot in https://github.com/mudler/LocalAI/pull/2965
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/transformers by @dependabot in https://github.com/mudler/LocalAI/pull/2970
• chore(deps): Bump openai from 1.35.13 to 1.37.0 in /examples/functions by @dependabot in https://github.com/mudler/LocalAI/pull/2973
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/diffusers by @dependabot in https://github.com/mudler/LocalAI/pull/2969
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/exllama2 by @dependabot in https://github.com/mudler/LocalAI/pull/2971
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/rerankers by @dependabot in https://github.com/mudler/LocalAI/pull/2974
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/coqui by @dependabot in https://github.com/mudler/LocalAI/pull/2980
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/parler-tts by @dependabot in https://github.com/mudler/LocalAI/pull/2982
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/vall-e-x by @dependabot in https://github.com/mudler/LocalAI/pull/2981
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/transformers-musicgen by @dependabot in https://github.com/mudler/LocalAI/pull/2990
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/autogptq by @dependabot in https://github.com/mudler/LocalAI/pull/2984
• chore(deps): Bump llama-index from 0.10.55 to 0.10.56 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/2986
• chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/mamba by @dependabot in https://github.com/mudler/LocalAI/pull/2989
• chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2992
• chore(deps): Bump langchain-community from 0.2.7 to 0.2.9 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2960
• chore(deps): Bump openai from 1.35.13 to 1.37.0 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2961
• chore(deps): Bump langchain from 0.2.8 to 0.2.10 in /examples/functions by @dependabot in https://github.com/mudler/LocalAI/pull/2975
• chore(deps): Bump openai from 1.35.13 to 1.37.0 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/2988
• chore(deps): Bump langchain from 0.2.8 to 0.2.10 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/2987
• chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2995

Other Changes

• ci(Makefile): enable p2p on cross-arm64 builds by @mudler in https://github.com/mudler/LocalAI/pull/2928

Full Changelog: https://github.com/mudler/LocalAI/compare/v2.19.1...v2.19.2