tocmo0nlord/axolotl

Files

History

salman ac471a697a updating to fused (#2293 )

2025-01-30 11:45:56 -05:00

..

fft-8b-liger-fsdp.yaml

updating to fused (#2293 )

2025-01-30 11:45:56 -05:00

fft-8b.yaml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

instruct-dpo-lora-8b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

instruct-lora-8b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-1b-deduplicate-dpo.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-1b-deduplicate-sft.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-1b-ray.yml

Ray Train Axolotl Integration (#2251 )

2025-01-29 00:10:19 -05:00

lora-1b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

lora-8b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora-1b-kto.yaml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora-1b.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

qlora-fsdp-70b.yaml

updating to fused (#2293 )

2025-01-30 11:45:56 -05:00

qlora-fsdp-405b.yaml

updating to fused (#2293 )

2025-01-30 11:45:56 -05:00

qlora.yml

Add hub model id config options to all example yml files (#2196 ) [skip ci]

2024-12-17 11:24:30 -05:00

README.md

llama-3 examples (#1537 )

2024-04-18 14:28:03 -04:00

README.md

Llama-3

https://llama.meta.com/llama3/

Full Fine Tune
- Single GPU @ 48GB VRAM
LoRA
- Single GPU @ 11GB VRAM

QLORA+FSDP
- Dual GPU @ 21GB VRAM