MyGit

v1.35.4

BerriAI/litellm

版本发布时间: 2024-04-13 15:07:21

BerriAI/litellm最新发布版本:v1.44.15-stable(2024-09-04 00:07:25)

What's Changed

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.35.3...v1.35.4

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 55 61.81466973473701 1.5865369739586979 0.0 475 0 50.56273999997529 1291.203577999994
/health/liveliness Passed ✅ 40 43.40270568389331 15.511321488556195 0.0 4644 0 38.63372099999651 1381.9246239999927
/health/readiness Passed ✅ 41 42.992702731896564 15.497961177196542 0.003340077839913048 4640 1 38.45442200000093 1314.9427230000015
Aggregated Passed ✅ 41 44.103932164771024 32.595819639711436 0.003340077839913048 9759 1 38.45442200000093 1381.9246239999927

相关地址:原始地址 下载(tar) 下载(zip)

1、 load_test.html 1.59MB

2、 load_test_stats.csv 887B

查看:2024-04-13发行的版本