v1.7.3
版本发布时间: 2024-03-11 19:15:28
josStorer/RWKV-Runner最新发布版本:v1.8.2(2024-05-16 14:00:12)
Changes
Features
- add Docker support (#291) @LonghronShen
Fixes
- fix a generation exception caused by potentially dangerous regex being passed into the stop array
- fix max_tokens parameter of Chat page not being passed to backend
- fix the issue where penalty_decay and global_penalty are not being passed to the backend default config when running the model through client
Improvements
- prevent 'torch' has no attribute 'cuda' error in torch_gc, so user can use CPU or WebGPU (#302)
Chores
- bump dependencies
- add pre-release workflow
- dep_check.py now ignores GPUtil
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
1、 RWKV-Runner_darwin_universal 59.18MB
2、 RWKV-Runner_linux_x64 7.97MB
3、 RWKV-Runner_macos_universal.zip 20.9MB
4、 RWKV-Runner_windows_x64.exe 11.22MB