v1.35.8
版本发布时间: 2024-04-16 10:07:45
BerriAI/litellm最新发布版本:v1.37.3(2024-05-11 11:16:52)
Full Changelog: https://github.com/BerriAI/litellm/compare/v1.35.7...v1.35.8
Load Test LiteLLM Proxy Results
| Name | Status | Median Response Time (ms) | Average Response Time (ms) | Requests/s | Failures/s | Request Count | Failure Count | Min Response Time (ms) | Max Response Time (ms) |
|---|---|---|---|---|---|---|---|---|---|
| /chat/completions | Passed ✅ | 80 | 87.1989655181834 | 1.4698687495954712 | 0.0 | 440 | 0 | 74.66019299999971 | 1033.186795000006 |
| /health/liveliness | Passed ✅ | 65 | 68.48147806584099 | 15.373490876450814 | 0.0 | 4602 | 0 | 63.30231800001229 | 1396.735858999989 |
| /health/readiness | Passed ✅ | 65 | 68.18094052773615 | 15.59731179968467 | 0.0 | 4669 | 0 | 63.406801999974505 | 1063.5555970000041 |
| Aggregated | Passed ✅ | 65 | 69.18506005674008 | 32.440671425730955 | 0.0 | 9711 | 0 | 63.30231800001229 | 1396.735858999989 |
1、 load_test.html 1.59MB
2、 load_test_stats.csv 839B