v1.35.8.dev1
版本发布时间: 2024-04-16 12:36:31
BerriAI/litellm最新发布版本:v1.37.3(2024-05-11 11:16:52)
Full Changelog: https://github.com/BerriAI/litellm/compare/v1.35.8...v1.35.8.dev1
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 77 | 82.5702124211668 | 1.5464604092525411 | 0.0 | 463 | 0 | 71.67428100001416 | 632.83159599996 |
| /health/liveliness | Passed ✅ | 62 | 64.37648616077583 | 15.498004965295445 | 0.0 | 4640 | 0 | 59.29384199998822 | 1162.1818330000337 |
| /health/readiness | Passed ✅ | 62 | 64.627800058514 | 15.240818244966189 | 0.006680174554006657 | 4563 | 2 | 59.27756900001668 | 1378.9221950000297 |
| Aggregated | Passed ✅ | 62 | 65.36660002110477 | 32.285283619514175 | 0.006680174554006657 | 9666 | 2 | 59.27756900001668 | 1378.9221950000297 |
1、 load_test.html 1.59MB
2、 load_test_stats.csv 879B