v1.36.1
版本发布时间: 2024-05-07 22:36:15
BerriAI/litellm最新发布版本:v1.44.15-stable(2024-09-04 00:07:25)
🚨 Known Issue with Slack Alerting + Redis Cache on this Version
Last stable version = 1.36.0
What's Changed
- [Feat] show
key alias
andteam alias
in slack alerts by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3488 - [UI] Set Router Retry Policy by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3461
- [UI] Fixes for getting/setting Retry Policy by Model Group by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3492
- Feat - send slack alerts on
model/new
by @ishaan-jaff in https://github.com/BerriAI/litellm/pull/3489 - build(deps): bump jinja2 from 3.1.3 to 3.1.4 by @dependabot in https://github.com/BerriAI/litellm/pull/3487
- feat(slack_alerting.py): support sending daily reports on deployments by @krrishdholakia in https://github.com/BerriAI/litellm/pull/3491
Full Changelog: https://github.com/BerriAI/litellm/compare/v1.36.0...v1.36.1
Don't want to maintain your internal proxy? get in touch 🎉
Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat
Load Test LiteLLM Proxy Results
Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
---|---|---|---|---|---|---|---|---|---|
/chat/completions | Passed ✅ | 77 | 82.17942278026948 | 1.4893326985503708 | 0.0 | 446 | 0 | 71.08463500000539 | 1285.614862999978 |
/health/liveliness | Passed ✅ | 61 | 65.19868741610614 | 15.384205700048337 | 0.006678621966593591 | 4607 | 2 | 58.9997550000021 | 1581.6415380000421 |
/health/readiness | Passed ✅ | 62 | 64.47610141605732 | 15.514438828396912 | 0.0 | 4646 | 0 | 58.92144300000268 | 1383.0270929999813 |
Aggregated | Passed ✅ | 62 | 65.63339959428805 | 32.38797722699562 | 0.006678621966593591 | 9699 | 2 | 58.92144300000268 | 1581.6415380000421 |
1、 load_test.html 1.59MB
2、 load_test_stats.csv 886B