v0.1.0
版本发布时间: 2024-04-23 21:08:48
Lightning-AI/LitServe最新发布版本:v0.2.1(2024-08-26 19:51:31)
Release v0.1.0
Additions
- dynamic batching https://github.com/Lightning-AI/litserve/pull/20
- streaming https://github.com/Lightning-AI/litserve/pull/37
- accelerator="auto" https://github.com/Lightning-AI/litserve/pull/44
Improvements
- concurrency