What's Changed

• Set litdata < 0.2.6 by @carmocca in https://github.com/Lightning-AI/litgpt/pull/1400
• Remove per-file CLIs by @carmocca in https://github.com/Lightning-AI/litgpt/pull/1397
• Simillar -> Similar by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1405
• LitData: set iterate_over_all to False for CombinedStreamingDataset by @Andrei-Aksionov in https://github.com/Lightning-AI/litgpt/pull/1404
• Allow multiline prompts by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1279
• Explain dataset options by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1407
• Support no_sync with Thunder FSDP by @carmocca in https://github.com/Lightning-AI/litgpt/pull/1414
• Minimal Python example by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1410
• Fix bug where LitData doesn't use seed by @bradfordlynch in https://github.com/Lightning-AI/litgpt/pull/1425
• Add prompt style mapping for llama3 by @davmacario in https://github.com/Lightning-AI/litgpt/pull/1406
• Simplify code by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1429
• OptimizerArgs by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1409
• Fix optimizer init with fused=True by @carmocca in https://github.com/Lightning-AI/litgpt/pull/1434
• Fix learning rate calculation in pretrain by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1435
• Align readme by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1438
• Pin litdata by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1440
• Fix README.md alignment by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1439
• Update README.md for one last time by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1442
• A more centered look by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1449
• New CLI by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1437
• Update error message by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1453
• Explain how to list all available models by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1455
• Detect tensor cores by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1456
• Check checkpoint_dir and add checkpoints to path by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1454
• Add MicroLlama training support by @keeeeenw in https://github.com/Lightning-AI/litgpt/pull/1457
• Streaming for serving with chat's generate function by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1426
• Fix sequence length bug by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1462
• Add lr_warmup_steps, max_steps values validation by @shenxiangzhuang in https://github.com/Lightning-AI/litgpt/pull/1460
• Fix issue where path in merge_lora is overwritten by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1465
• Option to skip expensive final validation by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1372
• Allow batch size "auto" setting in evaluate by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1469
• Warn users when there is a bnb mismatch by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1468
• Allow batch argument with batch recomputation by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1470
• LitGPT Python API draft by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1459
• Bump version for PyPI release by @rasbt in https://github.com/Lightning-AI/litgpt/pull/1476

New Contributors

• @bradfordlynch made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1425
• @davmacario made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1406
• @keeeeenw made their first contribution in https://github.com/Lightning-AI/litgpt/pull/1457

Full Changelog: https://github.com/Lightning-AI/litgpt/compare/v0.3.1...v0.4.0