1.35.5.dev2
版本发布时间: 2024-04-14 10:48:28
BerriAI/litellm最新发布版本:v1.44.15-stable(2024-09-04 00:07:25)
What's Changed
- UI - fix - adding azure OpenAI on admin ui by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3004
- [test] - Test /health endpoints by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3003
- [Fix] Load proxy models when proxy starts up by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3005
- UI - edit Langfuse vars on ui by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3006
- [UI] Show Errors for 20s by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3008
- UI - test langfuse callbacks on Admin UI by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3007
- [UI] QA fixes adding langfuse callback by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3010
- [UI] Add / Test Slack Alerting by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3011
- Admin UI -run /health check through admin ui by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3014
- Litellm prometheus service metrics by @krrishdholakia in https://github.com/BerriAI/litellm/pull/3017
Full Changelog: https://github.com/BerriAI/litellm/compare/v1.35.4...1.35.5.dev2
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Passed ✅ | 80 | 85.68544724824264 | 1.4263860259563899 | 0.0 | 427 | 0 | 75.07200899999589 | 949.8076319999882 |
/health/liveliness | Passed ✅ | 65 | 68.0963399051023 | 15.38292189585287 | 0.0 | 4605 | 0 | 63.464997000096446 | 851.2580190000563 |
/health/readiness | Passed ✅ | 65 | 68.89657557841379 | 15.506519748219116 | 0.0 | 4642 | 0 | 63.50266200001897 | 1345.5118699999957 |
Aggregated | Passed ✅ | 65 | 69.25669165526033 | 32.315827670028376 | 0.0 | 9674 | 0 | 63.464997000096446 | 1345.5118699999957 |
1、 load_test.html 1.59MB
2、 load_test_stats.csv 837B