14 lines
361 B
Markdown
14 lines
361 B
Markdown
# Llama-3
|
|
|
|
https://llama.meta.com/llama3/
|
|
|
|
[8B Base Model](https://huggingface.co/meta-llama/Meta-Llama-3-8B)
|
|
- [Full Fine Tune](./fft-8b.yaml)
|
|
- Single GPU @ 48GB VRAM
|
|
- [LoRA](./lora-8b.yml)
|
|
- Single GPU @ 11GB VRAM
|
|
|
|
[70B Base Model](https://huggingface.co/meta-llama/Meta-Llama-3-70B)
|
|
- [QLORA+FSDP](./qlora-fsdp-70b.yaml)
|
|
- Dual GPU @ 21GB VRAM
|