What's Changed

Bug fixes :bug:

• fix(vllm): images and videos are base64 by default by @mudler in https://github.com/mudler/LocalAI/pull/3867
• fix(dependencies): pin pytorch version by @mudler in https://github.com/mudler/LocalAI/pull/3872
• fix(dependencies): move deps that brings pytorch by @mudler in https://github.com/mudler/LocalAI/pull/3873
• fix(vllm): do not set videos if we don't have any by @mudler in https://github.com/mudler/LocalAI/pull/3885

Exciting New Features 🎉

• feat(templates): extract text from multimodal requests by @mudler in https://github.com/mudler/LocalAI/pull/3866
• feat(templates): add sprig to multimodal templates by @mudler in https://github.com/mudler/LocalAI/pull/3868

🧠 Models

• models(gallery): add llama-3_8b_unaligned_beta by @mudler in https://github.com/mudler/LocalAI/pull/3818
• models(gallery): add llama3.1-flammades-70b by @mudler in https://github.com/mudler/LocalAI/pull/3819
• models(gallery): add llama3.1-gutenberg-doppel-70b by @mudler in https://github.com/mudler/LocalAI/pull/3820
• models(gallery): add llama-3.1-8b-arliai-formax-v1.0-iq-arm-imatrix by @mudler in https://github.com/mudler/LocalAI/pull/3821
• models(gallery): add supernova-medius by @mudler in https://github.com/mudler/LocalAI/pull/3822
• models(gallery): add hermes-3-llama-3.1-70b-lorablated by @mudler in https://github.com/mudler/LocalAI/pull/3823
• models(gallery): add hermes-3-llama-3.1-8b-lorablated by @mudler in https://github.com/mudler/LocalAI/pull/3824
• models(gallery): add eva-qwen2.5-14b-v0.1-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3825
• models(gallery): add cursorcore-qw2.5-7b-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3826
• models(gallery): add cursorcore-qw2.5-1.5b-lc-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3827
• models(gallery): add cursorcore-ds-6.7b-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3828
• models(gallery): add cursorcore-yi-9b by @mudler in https://github.com/mudler/LocalAI/pull/3829
• models(gallery): add edgerunner-command-nested-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3830
• models(gallery): add llama-3.2-chibi-3b by @mudler in https://github.com/mudler/LocalAI/pull/3843
• models(gallery): add llama-3.2-3b-reasoning-time by @mudler in https://github.com/mudler/LocalAI/pull/3844
• models(gallery): add ml-ms-etheris-123b by @mudler in https://github.com/mudler/LocalAI/pull/3845
• models(gallery): add doctoraifinetune-3.1-8b-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3846
• models(gallery): add astral-fusion-neural-happy-l3.1-8b by @mudler in https://github.com/mudler/LocalAI/pull/3848
• models(gallery): add tsunami-0.5x-7b-instruct-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3849
• models(gallery): add mahou-1.5-llama3.1-70b-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3850
• models(gallery): add llama-3.1-nemotron-70b-instruct-hf by @mudler in https://github.com/mudler/LocalAI/pull/3854
• models(gallery): add qevacot-7b-v2 by @mudler in https://github.com/mudler/LocalAI/pull/3855
• models(gallery): add l3.1-etherealrainbow-v1.0-rc1-8b by @mudler in https://github.com/mudler/LocalAI/pull/3856
• models(gallery): add phi-3.5-mini-titanfusion-0.2 by @mudler in https://github.com/mudler/LocalAI/pull/3857
• models(gallery): add mn-lulanum-12b-fix-i1 by @mudler in https://github.com/mudler/LocalAI/pull/3859
• models(gallery): add apollo2-9b by @mudler in https://github.com/mudler/LocalAI/pull/3860
• models(gallery): add theia-llama-3.1-8b-v1 by @mudler in https://github.com/mudler/LocalAI/pull/3861
• models(gallery): add tor-8b by @mudler in https://github.com/mudler/LocalAI/pull/3862
• models(gallery): add darkens-8b by @mudler in https://github.com/mudler/LocalAI/pull/3863
• models(gallery): add baldur-8b by @mudler in https://github.com/mudler/LocalAI/pull/3864
• models(gallery): add meissa-qwen2.5-7b-instruct by @mudler in https://github.com/mudler/LocalAI/pull/3865
• models(gallery): add phi-3 vision by @mudler in https://github.com/mudler/LocalAI/pull/3890

👒 Dependencies

• chore(deps): Bump docs/themes/hugo-theme-relearn from d5a0ee0 to e1a1f01 by @dependabot in https://github.com/mudler/LocalAI/pull/3798
• chore(deps): Bump mxschmitt/action-tmate from 3.18 to 3.19 by @dependabot in https://github.com/mudler/LocalAI/pull/3799
• chore(deps): Bump sentence-transformers from 3.1.1 to 3.2.0 in /backend/python/sentencetransformers by @dependabot in https://github.com/mudler/LocalAI/pull/3801
• chore(deps): Bump langchain from 0.3.2 to 0.3.3 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3803
• chore(deps): Bump llama-index from 0.11.16 to 0.11.17 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/3804
• chore(deps): Bump python from 3.12-bullseye to 3.13-bullseye in /examples/langchain by @dependabot in https://github.com/mudler/LocalAI/pull/3805
• chore(deps): Bump openai from 1.51.1 to 1.51.2 in /examples/functions by @dependabot in https://github.com/mudler/LocalAI/pull/3806
• chore(deps): Bump llama-index from 0.11.16 to 0.11.17 in /examples/chainlit by @dependabot in https://github.com/mudler/LocalAI/pull/3807
• chore(deps): Bump langchain from 0.3.1 to 0.3.3 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/3809
• chore(deps): Bump openai from 1.51.1 to 1.51.2 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3808
• chore(deps): Bump yarl from 1.13.1 to 1.15.1 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3816
• chore(deps): Bump chromadb from 0.5.11 to 0.5.13 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/3811
• chore(deps): Bump langchain from 0.3.2 to 0.3.3 in /examples/functions by @dependabot in https://github.com/mudler/LocalAI/pull/3802
• chore(deps): Bump debugpy from 1.8.6 to 1.8.7 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3814
• chore(deps): Bump aiohttp from 3.10.9 to 3.10.10 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3812
• chore(deps): Bump openai from 1.51.1 to 1.51.2 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/3810
• chore(deps): Bump charset-normalizer from 3.3.2 to 3.4.0 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3834
• chore(deps): Bump langchain-community from 0.3.1 to 0.3.2 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3831
• chore(deps): Bump yarl from 1.15.1 to 1.15.2 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3832
• chore(deps): Bump numpy from 2.1.1 to 2.1.2 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/3833
• chore(deps): Bump docs/themes/hugo-theme-relearn from e1a1f01 to 007cc20 by @dependabot in https://github.com/mudler/LocalAI/pull/3835
• chore(deps): Bump gradio from 3.48.0 to 5.0.0 in /backend/python/openvoice in the pip group by @dependabot in https://github.com/mudler/LocalAI/pull/3880
• chore(deps): bump llama-cpp to cda0e4b648dde8fac162b3430b14a99597d3d74f by @mudler in https://github.com/mudler/LocalAI/pull/3884

Other Changes

• docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/3796
• chore: dependabot ignore generated grpc go package by @dave-gray101 in https://github.com/mudler/LocalAI/pull/3795
• chore: :arrow_up: Update ggerganov/llama.cpp to edc265661cd707327297b6ec4d83423c43cb50a5 by @localai-bot in https://github.com/mudler/LocalAI/pull/3797
• chore: :arrow_up: Update ggerganov/llama.cpp to d4c19c0f5cdb1e512573e8c86c79e8d0238c73c4 by @localai-bot in https://github.com/mudler/LocalAI/pull/3817
• chore: :arrow_up: Update ggerganov/llama.cpp to a89f75e1b7b90cb2d4d4c52ca53ef9e9b466aa45 by @localai-bot in https://github.com/mudler/LocalAI/pull/3837
• chore: :arrow_up: Update ggerganov/whisper.cpp to 06a1da9daff94c1bf1b1d38950628264fe443f76 by @localai-bot in https://github.com/mudler/LocalAI/pull/3836
• Update integrations.md with LLPhant by @f-lombardo in https://github.com/mudler/LocalAI/pull/3838
• fix(llama.cpp): consider also native builds by @mudler in https://github.com/mudler/LocalAI/pull/3839
• chore: :arrow_up: Update ggerganov/whisper.cpp to b6049060dd2341b7816d2bce7dc7451c1665828e by @localai-bot in https://github.com/mudler/LocalAI/pull/3842
• chore: :arrow_up: Update ggerganov/llama.cpp to 755a9b2bf00fbae988e03a47e852b66eaddd113a by @localai-bot in https://github.com/mudler/LocalAI/pull/3841
• chore(deps): bump grpcio to 1.67.0 by @mudler in https://github.com/mudler/LocalAI/pull/3851
• chore: :arrow_up: Update ggerganov/llama.cpp to 9e041024481f6b249ab8918e18b9477f873b5a5e by @localai-bot in https://github.com/mudler/LocalAI/pull/3853
• chore: :arrow_up: Update ggerganov/whisper.cpp to d3f7137cc9befa6d74dc4085de2b664b97b7c8bb by @localai-bot in https://github.com/mudler/LocalAI/pull/3852
• fix(mamba): pin torch version by @mudler in https://github.com/mudler/LocalAI/pull/3871
• chore: :arrow_up: Update ggerganov/llama.cpp to 99bd4ac28c32cd17c0e337ff5601393b033dc5fc by @localai-bot in https://github.com/mudler/LocalAI/pull/3869
• chore: :arrow_up: Update ggerganov/whisper.cpp to a5abfe6a90495f7bf19fe70d016ecc255e97359c by @localai-bot in https://github.com/mudler/LocalAI/pull/3870
• chore(deps): pin packaging by @mudler in https://github.com/mudler/LocalAI/pull/3875
• chore(deps): pin numpy by @mudler in https://github.com/mudler/LocalAI/pull/3876
• chore(deps): pin networkx by @mudler in https://github.com/mudler/LocalAI/pull/3878
• chore: :arrow_up: Update ggerganov/llama.cpp to afd9909a6481402844aecefa8a8908afdd7f52f1 by @localai-bot in https://github.com/mudler/LocalAI/pull/3879
• Revert "chore(deps): Bump gradio from 3.48.0 to 5.0.0 in /backend/python/openvoice in the pip group" by @mudler in https://github.com/mudler/LocalAI/pull/3881
• chore: :arrow_up: Update ggerganov/llama.cpp to 45f097645efb11b6d09a5b4adbbfd7c312ac0126 by @localai-bot in https://github.com/mudler/LocalAI/pull/3889

New Contributors

• @f-lombardo made their first contribution in https://github.com/mudler/LocalAI/pull/3838

Full Changelog: https://github.com/mudler/LocalAI/compare/v2.22.0...v2.22.1