v1.31.14
版本发布时间: 2024-03-15 23:44:55
BerriAI/litellm最新发布版本:v1.44.15-stable(2024-09-04 00:07:25)
What's Changed
- (feat) add groq/gemma-7b-it by @snekkenull in https://github.com/BerriAI/litellm/pull/2529
New Contributors
- @snekkenull made their first contribution in https://github.com/BerriAI/litellm/pull/2529
Full Changelog: https://github.com/BerriAI/litellm/compare/v1.31.13...v1.31.14
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 88 | 97.8719389956135 | 1.5238205426081837 | 0.0 | 456 | 0 | 80.47983800003067 | 1042.1901939999998 |
| /health/liveliness | Passed ✅ | 62 | 64.17129267745518 | 15.178054615189408 | 0.0 | 4542 | 0 | 59.447291000026325 | 1284.6712140000136 |
| /health/readiness | Passed ✅ | 180.0 | 180.3285143601241 | 14.967526777065908 | 0.0 | 4479 | 0 | 123.18138000000545 | 1374.4275610000045 |
| Aggregated | Passed ✅ | 90 | 120.690833738736 | 31.6694019348635 | 0.0 | 9477 | 0 | 59.447291000026325 | 1374.4275610000045 |
1、 load_test.html 1.59MB
2、 load_test_stats.csv 870B