tocmo0nlord/axolotl

Files

History

Wing Lian ba47adc24b replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

..

fft-8b-liger-fsdp.yaml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

fft-8b.yaml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

instruct-dpo-lora-8b.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

instruct-lora-8b.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

lora-1b-deduplicate-dpo.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

lora-1b-deduplicate-sft.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

lora-1b-kernels.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

lora-1b-ray.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

lora-1b-sample-packing-sequentially.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

lora-1b.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

lora-8b.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qlora-1b-kto.yaml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qlora-1b.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qlora-fsdp-70b.yaml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qlora-fsdp-405b.yaml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

qlora.yml

replace attention in the yaml config with an enum

2025-05-07 17:10:18 +07:00

README.md

llama-3 examples (#1537 )

2024-04-18 14:28:03 -04:00

sparse-finetuning.yaml

Add: Sparse Finetuning Integration with llmcompressor (#2479 )

2025-05-01 12:25:16 -04:00

README.md

Llama-3

https://llama.meta.com/llama3/

Full Fine Tune
- Single GPU @ 48GB VRAM
LoRA
- Single GPU @ 11GB VRAM

QLORA+FSDP
- Dual GPU @ 21GB VRAM