v1.8.1
版本发布时间: 2024-05-12 23:45:33
josStorer/RWKV-Runner最新发布版本:v1.8.7(2024-08-29 15:46:58)
Changes
Features
- add support for dynamic state-tuned models
Upgrades
- bump webgpu mode ai00_server v0.4.8
Improvements
- add tps console output
- add torch cnMirror
- disable pre_ffn and head_qk
- improve frontend details
Chores
- update manifest.json and defaultModelConfigs
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
1、 RWKV-Runner_darwin_universal 73.61MB
2、 RWKV-Runner_linux_x64 9.92MB
3、 RWKV-Runner_macos_universal.zip 26.66MB
4、 RWKV-Runner_windows_x64.exe 13.28MB