Overview

This patch includes support for fine-tuning Llama3 with torchtune as well as various improvements to the library.

New Features & Improvements

Recipes

• Added configuration for Llama2 13B QLoRA (#779)
• Added support for Llama2 70B LoRA (#788)

Models

• Added support for Llama3 (#793)

Utils

• Improvements to Weights & Biases logger (#772, #777)

Documentation

• Added Llama3 tutorial (#793)
• Updated E2E tutorial with instructions for uploading to the Hugging Face Hub (#773)
• Updates to the README (#775, #778, #786)
• Added instructions for installing torchtune nightly (#792)