v0.4.3
版本发布时间: 2024-07-06 02:42:48
Lightning-AI/litgpt最新发布版本:v0.4.11(2024-08-24 01:42:08)
What's Changed
- Fix Twine Build Issue by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1530
- Fix Mixtral prompt style by @janEbert in https://github.com/Lightning-AI/litgpt/pull/1531
- Raise warning when loading a large model on a CPU device by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1532
- Tutorial
convert_from_litgpt
doc fix to removeoutput_dir
command argument by @jentfoo in https://github.com/Lightning-AI/litgpt/pull/1533 - Test against eager attention on GPTNeoX by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1537
- Bump to 0.4.3.dev0 version by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1536
- Fix for LM Eval harness 0.4.3 by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1542
- Add
Phi-3-mini-4k-instruct
checkpoint by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1341 - Update phi-3 prompt template by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1544
- Add progress bar for weight loading by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1534
- Remove redundant code in checkpoint conversion script by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1547
- Update how evaluate tasks are listed by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1550
- Fix generate issue in finetuning script when finetuning with small datasets by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1551
- Tokenizer: check that
bos
andeos
tokens are applied w.r.t. to a provided config/args by @Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1527 - Add num_nodes argument by @janEbert in https://github.com/Lightning-AI/litgpt/pull/1546
- Add Phi-3 Configs by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1553
- Update to version 0.4.3 for new release by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1554
New Contributors
- @janEbert made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1531
- @jentfoo made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1533
Full Changelog: https://github.com/Lightning-AI/litgpt/compare/v0.4.2...v0.4.3