v0.4.11
版本发布时间: 2024-08-24 01:42:08
Lightning-AI/litgpt最新发布版本:v0.4.11(2024-08-24 01:42:08)
What's Changed
- Add distribute=None to python-api.md by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1676
- Make LitGPT LLM API compatible with PyTorch Lightning Trainer 1/2 by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1667
- Auto device handling in LLM API by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1677
- Fix KV cache issue in LLM API by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1678
- Improved benchmark utils by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1679
- Add PR benchmark util for internal use by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1680
- Added git hash to benchmark utility. by @apaz-cli in https://github.com/Lightning-AI/litgpt/pull/1681
- Spelling fix by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1685
- Add Microsoft Phi 3.5 checkpoint by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1687
- Update check_nvlink_connectivity by @sanderland in https://github.com/Lightning-AI/litgpt/pull/1684
- Make number of generated tokens consistent with CLI by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1690
- Avoid error when executing benchmark util outside a git folder by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1691
- Combine
generate()functions by @apaz-cli in https://github.com/Lightning-AI/litgpt/pull/1675 - Bumb version to 0.4.11 by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1695
- Fix falcon prompt template by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1696
New Contributors
- @sanderland made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1684
Full Changelog: https://github.com/Lightning-AI/litgpt/compare/v0.4.10...v0.4.11