tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
af8d257aa22f9030b0f39d5bc7b150eed459eb9a
axolotl/examples/llama-3
History
Wing Lian af8d257aa2 make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci] 
* make pad_to_sequence_len default to the same value as sample_packing

* remove duplicate validation

* fix test

* update description meta

Co-authored-by: NanoCode012 <nano@axolotl.ai>

---------

Co-authored-by: NanoCode012 <nano@axolotl.ai>
2025-07-21 11:40:56 -04:00
..
3b-qat-fsdp2.yaml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
fft-8b-liger-fsdp.yaml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
fft-8b.yaml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
instruct-dpo-lora-8b.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
instruct-lora-8b.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
lora-1b-deduplicate-dpo.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
lora-1b-deduplicate-sft.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
lora-1b-kernels.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
lora-1b-ray.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
lora-1b-sample-packing-sequentially.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
lora-1b.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
lora-8b.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
qlora-1b-kto.yaml
checkpoint model on first step callback (#2906)
2025-07-15 15:00:48 -04:00
qlora-1b.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
qlora-fsdp-70b.yaml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
qlora-fsdp-405b.yaml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
qlora.yml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00
README.md
llama-3 examples (#1537)
2024-04-18 14:28:03 -04:00
sparse-finetuning.yaml
make pad_to_sequence_len default to the same value as sample_packing (#2941) [skip ci]
2025-07-21 11:40:56 -04:00

README.md

Llama-3

https://llama.meta.com/llama3/

8B Base Model

70B Base Model

Reference in New Issue View Git Blame Copy Permalink