axolotl/examples/llama-3/README.md

Llama-3

https://llama.meta.com/llama3/

8B Base Model

• Full Fine Tune
  • Single GPU @ 48GB VRAM
• LoRA
  • Single GPU @ 11GB VRAM

70B Base Model

• QLORA+FSDP
  • Dual GPU @ 21GB VRAM