tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
159f0531f99b8f916aa83227c1db48bf4dd24bb3
axolotl/examples/llama-3
History
Wing Lian b2274d430b support for QAT w RL (DPO) (#2776)
2025-06-13 10:00:35 -04:00
..
3b-qat-fsdp2.yaml
QAT (#2590)
2025-05-28 12:35:47 +01:00
fft-8b-liger-fsdp.yaml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
fft-8b.yaml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
instruct-dpo-lora-8b.yml
support for QAT w RL (DPO) (#2776)
2025-06-13 10:00:35 -04:00
instruct-lora-8b.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
lora-1b-deduplicate-dpo.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
lora-1b-deduplicate-sft.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
lora-1b-kernels.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
lora-1b-ray.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
lora-1b-sample-packing-sequentially.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
lora-1b.yml
Rank 0-only logging (#2608)
2025-05-28 14:57:30 +01:00
lora-8b.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
qlora-1b-kto.yaml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
qlora-1b.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
qlora-fsdp-70b.yaml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
qlora-fsdp-405b.yaml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
qlora.yml
remove strict=false from example yamls [skip ci] (#2523) [skip ci]
2025-04-12 07:25:11 -07:00
README.md
llama-3 examples (#1537)
2024-04-18 14:28:03 -04:00
sparse-finetuning.yaml
Add: Sparse Finetuning Integration with llmcompressor (#2479)
2025-05-01 12:25:16 -04:00

README.md

Llama-3

https://llama.meta.com/llama3/

8B Base Model

70B Base Model

Reference in New Issue View Git Blame Copy Permalink