v1.4.4
版本发布时间: 2023-08-16 23:46:57
josStorer/RWKV-Runner最新发布版本:v1.8.7(2024-08-29 15:46:58)
Changes
- webgpu support (AMD, Intel, Nvidia, Apple) (https://github.com/cgisky1980/ai00_rwkv_server)
- add rwkv-cuda-beta support (faster)
- add misc API (
/modelsand/dashboard/billing/credit_grants) - allow multiple systems
- allow completions input to be null
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
WebGPU Mode
1、 RWKV-Runner_darwin_universal 51.39MB
2、 RWKV-Runner_linux_x64 9.24MB
3、 RWKV-Runner_macos_universal.zip 17.88MB
4、 RWKV-Runner_windows_x64.exe 11.31MB