What's Changed

• fix(utils.py): correctly log streaming cache hits (#5417) by @krrishdholakia in https://github.com/BerriAI/litellm/pull/5426
• fix(google_ai_studio): working context caching by @krrishdholakia in https://github.com/BerriAI/litellm/pull/5421
• [Fix-Proxy] /health check for provider wildcard models (fireworks/*) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/5431
• (bedrock): Add new cross-region inference support for Bedrock. by @Manouchehri in https://github.com/BerriAI/litellm/pull/5430
• [Feat-Proxy] Pass through Vertex Endpoint - allow forwarding vertex credentials by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/5435
• [Feat-Proxy] Set tags per team - (use tag based routing for team) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/5432

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.44.10...v1.44.11-stable

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.44.11-stable

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results