v1.35.10
版本发布时间: 2024-04-18 00:31:00
BerriAI/litellm最新发布版本:v1.37.3(2024-05-11 11:16:52)
What's Changed
- add vertex_ai/text-embedding-preview-0409 by @Dev-Khant in https://github.com/BerriAI/litellm/pull/2999
- Fix Anthropic system message handling by @ligaz in https://github.com/BerriAI/litellm/pull/3019
- Update: gpt-4-turbo-preview pricing and context. Included in docs. by @ryanwclark1 in https://github.com/BerriAI/litellm/pull/2817
- docs: add langfuse to callback docs by @marcklingen in https://github.com/BerriAI/litellm/pull/3044
- test - setting up langfuse callback on proxy + assert logs written by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3067
- [Fix + Test] - Return correct params from
/user/newby @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3066 - (feat): Add Claude v3 Opus on Amazon Bedrock. by @Manouchehri in https://github.com/BerriAI/litellm/pull/3069
- fix(proxy_server.py): ensure id used in delete deployment matches id used in litellm Router by @krrishdholakia in https://github.com/BerriAI/litellm/pull/3077
- UI - Save / Edit router settings UI by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3079
- [FEAT] - View router settings (backend) by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3076
- UI - view router settings on UI by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3078
- build(ui): view_key_table.tsx by @krrishdholakia in https://github.com/BerriAI/litellm/pull/3081
- [Fix] Prometheus /metrics - don't log user_api_key to prometheus by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3084
- Fix - show
model,deploymentandmodel_groupin vertex exceptions by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3087 - fix(vertex_ai.py): accept credentials as a json string by @krrishdholakia in https://github.com/BerriAI/litellm/pull/3082
- Use
max_input_tokenfortrim_messagesby @cwang in https://github.com/BerriAI/litellm/pull/3062
New Contributors
- @ligaz made their first contribution in https://github.com/BerriAI/litellm/pull/3019
- @ryanwclark1 made their first contribution in https://github.com/BerriAI/litellm/pull/2817
- @marcklingen made their first contribution in https://github.com/BerriAI/litellm/pull/3044
- @cwang made their first contribution in https://github.com/BerriAI/litellm/pull/3062
Full Changelog: https://github.com/BerriAI/litellm/compare/v1.35.8.dev1...v1.35.10
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 42 | 49.6385708482911 | 1.5629026707638956 | 0.0 | 468 | 0 | 36.01543100000981 | 1183.660677999967 |
| /health/liveliness | Passed ✅ | 26 | 29.30218259242742 | 15.699156955686053 | 0.0 | 4701 | 0 | 23.077996000040457 | 1128.3300599999961 |
| /health/readiness | Passed ✅ | 26 | 28.14200395417242 | 15.448691784089275 | 0.0 | 4626 | 0 | 23.042472000042835 | 1140.643462000014 |
| Aggregated | Passed ✅ | 26 | 29.725913406432227 | 32.710751410539224 | 0.0 | 9795 | 0 | 23.042472000042835 | 1183.660677999967 |
1、 load_test.html 1.59MB
2、 load_test_stats.csv 839B