Files

Sunny Liu 1c14c4a15c Add hub model id config options to all example yml files (#2196 ) [skip ci]

* added hub model_id in example yml

* add hub model id to example yml

2024-12-17 11:24:30 -05:00

fft-8b-liger-fsdp.yaml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

fft-8b.yaml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

instruct-dpo-lora-8b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

instruct-lora-8b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-1b-deduplicate-dpo.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-1b-deduplicate-sft.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-1b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-8b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora-1b-kto.yaml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora-1b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora-fsdp-70b.yaml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora-fsdp-405b.yaml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

README.md

llama-3 examples (#1537 )

2024-04-18 14:28:03 -04:00

README.md

Llama-3

https://llama.meta.com/llama3/

8B Base Model

Full Fine Tune
- Single GPU @ 48GB VRAM
LoRA
- Single GPU @ 11GB VRAM

70B Base Model

QLORA+FSDP
- Dual GPU @ 21GB VRAM