English version

New Features

1. Support dtype settings in LoRA
2. Support deactivated tuners offloading
3. Support deployment with OpenAI format restful API
4. Make LongLoRA supports the latest llama2 code

新feature

1. 支持LoRA设置dtype类型
2. 支持将不使用的tuners offloading到cpu和meta设备上
3. 支持OpenAI restful API方式的部署
4. LongLoRA支持最新的llama2代码

What's Changed

• update docs by @tastelikefeet in https://github.com/modelscope/swift/pull/269
• Update benchmark 0101 by @Jintao-Huang in https://github.com/modelscope/swift/pull/271
• update benchmark by @Jintao-Huang in https://github.com/modelscope/swift/pull/276
• Support dtype in lora by @tastelikefeet in https://github.com/modelscope/swift/pull/278
• Support deploy by @Jintao-Huang in https://github.com/modelscope/swift/pull/275
• update deploy client by @Jintao-Huang in https://github.com/modelscope/swift/pull/279
• Support offload by @tastelikefeet in https://github.com/modelscope/swift/pull/281
• fix tuner bug by @Jintao-Huang in https://github.com/modelscope/swift/pull/285
• Support lora_modules_to_save by @Jintao-Huang in https://github.com/modelscope/swift/pull/284
• update template by @Jintao-Huang in https://github.com/modelscope/swift/pull/286
• support ModuleToSave original module offloading by @tastelikefeet in https://github.com/modelscope/swift/pull/282
• Fix offload by @tastelikefeet in https://github.com/modelscope/swift/pull/288
• fix scedit bug by @tastelikefeet in https://github.com/modelscope/swift/pull/290
• fix bnb qwen bug by @Jintao-Huang in https://github.com/modelscope/swift/pull/289
• update readme by @Jintao-Huang in https://github.com/modelscope/swift/pull/291
• update readme by @Jintao-Huang in https://github.com/modelscope/swift/pull/292
• Fix/longlora by @tastelikefeet in https://github.com/modelscope/swift/pull/294
• support additional_trainable_parameters by @Jintao-Huang in https://github.com/modelscope/swift/pull/295
• fix webui by @tastelikefeet in https://github.com/modelscope/swift/pull/296
• fix trainer push to hub by @Jintao-Huang in https://github.com/modelscope/swift/pull/297

Full Changelog: https://github.com/modelscope/swift/compare/v1.5.0...v1.5.1