tocmo0nlord/axolotl

Files

History

Wing Lian 39226623d2 migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

..

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

3b-fp8-fsdp2.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

3b-qat-fsdp2.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

3b-qat-mxfp4.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

3b-qat-nvfp4.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

fft-8b-liger-fsdp.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

fft-8b.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

instruct-dpo-lora-8b.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

instruct-lora-8b.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

lora-1b-deduplicate-dpo.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

lora-1b-deduplicate-sft.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

lora-1b-kernels.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

lora-1b-ray.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

lora-1b-sample-packing-sequentially.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

lora-1b.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

lora-8b.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

opentelemetry-qlora.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

qlora-1b-gdpo.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

qlora-1b-kto.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

qlora-1b.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

qlora-fsdp-70b.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

qlora-fsdp-405b.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

qlora.yml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

README.md

llama-3 examples (#1537 )

2024-04-18 14:28:03 -04:00

sparse-finetuning.yaml

migrate example configs to canonical attn_implementation

2026-04-23 22:27:01 +00:00

README.md

Llama-3

https://llama.meta.com/llama3/

Full Fine Tune
- Single GPU @ 48GB VRAM
LoRA
- Single GPU @ 11GB VRAM

QLORA+FSDP
- Dual GPU @ 21GB VRAM