MyGit

v2.19.1

mudler/LocalAI

版本发布时间: 2024-07-20 15:16:46

mudler/LocalAI最新发布版本:v2.19.3(2024-07-28 20:24:10)

local-ai-release-219-shadow

LocalAI 2.19.1 is out! :mega:

TLDR; Summary spotlight

🖧 LocalAI Federation and AI swarms

LocalAI is revolutionizing the future of distributed AI workloads by making it simpler and more accessible. No more complex setups, Docker or Kubernetes configurations – LocalAI allows you to create your own AI cluster with minimal friction. By auto-discovering and sharing work or weights of the LLM model across your existing devices, LocalAI aims to scale both horizontally and vertically with ease.

How it works?

Starting LocalAI with --p2p generates a shared token for connecting multiple instances: and that's all you need to create AI clusters, eliminating the need for intricate network setups. Simply navigate to the "Swarm" section in the WebUI and follow the on-screen instructions.

For fully shared instances, initiate LocalAI with --p2p --federated and adhere to the Swarm section's guidance. This feature, while still experimental, offers a tech preview quality experience.

Federated LocalAI

Launch multiple LocalAI instances and cluster them together to share requests across the cluster. The "Swarm" tab in the WebUI provides one-liner instructions on connecting various LocalAI instances using a shared token. Instances will auto-discover each other, even across different networks.

346663124-1d2324fd-8b55-4fa2-9856-721a467969c2

Check out a demonstration video: Watch now

LocalAI P2P Workers

Distribute weights across nodes by starting multiple LocalAI workers, currently available only on the llama.cpp backend, with plans to expand to other backends soon.

346663124-1d2324fd-8b55-4fa2-9856-721a467969c2

Check out a demonstration video: Watch now

What's Changed

Bug fixes :bug:

🖧 P2P area

Exciting New Features 🎉

🧠 Models

📖 Documentation and examples

👒 Dependencies

Other Changes

New Contributors

Full Changelog: https://github.com/mudler/LocalAI/compare/v2.18.1...v2.19.0

相关地址:原始地址 下载(tar) 下载(zip)

1、 local-ai-Darwin-arm64 442.96MB

2、 local-ai-Darwin-arm64.sha256 96B

3、 local-ai-Darwin-x86_64 454.44MB

4、 local-ai-Darwin-x86_64.sha256 97B

5、 local-ai-Linux-arm64 150.66MB

6、 local-ai-Linux-arm64.sha256 95B

7、 local-ai-Linux-x86_64 1.32GB

8、 local-ai-Linux-x86_64.sha256 96B

9、 stablediffusion 44.5MB

查看:2024-07-20发行的版本