v0.3.1
版本发布时间: 2023-02-24 20:27:56
huggingface/text-generation-inference最新发布版本:v2.0.1(2024-04-18 23:22:51)
Features
- server: allocate full attention mask to decrease latency
- server: enable hf-transfer for insane download speeds
- router: add CORS options
Fix
- server: remove position_ids from galactica forward