MyGit

1.35.5.dev2

BerriAI/litellm

版本发布时间: 2024-04-14 10:48:28

BerriAI/litellm最新发布版本:v1.44.15-stable(2024-09-04 00:07:25)

What's Changed

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.35.4...1.35.5.dev2

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 80 85.68544724824264 1.4263860259563899 0.0 427 0 75.07200899999589 949.8076319999882
/health/liveliness Passed ✅ 65 68.0963399051023 15.38292189585287 0.0 4605 0 63.464997000096446 851.2580190000563
/health/readiness Passed ✅ 65 68.89657557841379 15.506519748219116 0.0 4642 0 63.50266200001897 1345.5118699999957
Aggregated Passed ✅ 65 69.25669165526033 32.315827670028376 0.0 9674 0 63.464997000096446 1345.5118699999957

相关地址:原始地址 下载(tar) 下载(zip)

1、 load_test.html 1.59MB

2、 load_test_stats.csv 837B

查看:2024-04-14发行的版本