tocmo0nlord/axolotl

Files

History

Wing Lian 34d3c8dcfb [docs] Update README Quickstart to use CLI (#2137 )

* update quickstart for new CLI

* add blurb about bleeding edge builds

* missed a yaml reference

* prefer lora over qlora for examples

* fix commands for parity with previous instructions

* consistency on pip/pip3 install

* one more parity pip=>pip3

* remove extraneous options in example yaml

Co-authored-by: NanoCode012 <nano@axolotl.ai>

* update copy

* update badges and for discord and socials in readme

* Fix a few broken links

* bump version to 0.6.0 for release

---------

Co-authored-by: NanoCode012 <nano@axolotl.ai>

2024-12-09 14:03:19 -05:00

..

fft-8b-liger-fsdp.yaml

upgrade liger to 0.4.0 (#1973 )

2024-11-07 12:53:34 -05:00

fft-8b.yaml

add liger example (#1864 )

2024-08-23 12:37:50 -04:00

instruct-dpo-lora-8b.yml

examples: Fix config llama3 (#1833 ) [skip ci]

2024-10-14 16:00:48 -04:00

instruct-lora-8b.yml

examples: Fix config llama3 (#1833 ) [skip ci]

2024-10-14 16:00:48 -04:00

lora-1b-deduplicate-dpo.yml

Add Exact Deduplication Feature to Preprocessing Pipeline (#2072 )

2024-12-02 08:47:10 -05:00

lora-1b-deduplicate-sft.yml

Add Exact Deduplication Feature to Preprocessing Pipeline (#2072 )

2024-12-02 08:47:10 -05:00

lora-1b.yml

[docs] Update README Quickstart to use CLI (#2137 )

2024-12-09 14:03:19 -05:00

lora-8b.yml

bump transformers and set roundup_power2_divisions for more VRAM improvements, low bit ao optimizers (#1769 )

2024-07-19 00:47:07 -04:00

qlora-1b-kto.yaml

feat: add kto example (#2158 ) [skip ci]

2024-12-09 08:17:27 -05:00

qlora-1b.yml

[docs] Update README Quickstart to use CLI (#2137 )

2024-12-09 14:03:19 -05:00

qlora-fsdp-70b.yaml

update outputs path so that we can mount workspace to /workspace/data (#1623 )

2024-05-15 12:44:13 -04:00

qlora-fsdp-405b.yaml

qlora-fsdp ram efficient loading with hf trainer (#1791 )

2024-07-30 19:21:38 -04:00

qlora.yml

bump transformers and set roundup_power2_divisions for more VRAM improvements, low bit ao optimizers (#1769 )

2024-07-19 00:47:07 -04:00

README.md

llama-3 examples (#1537 )

2024-04-18 14:28:03 -04:00

README.md

Llama-3

https://llama.meta.com/llama3/

Full Fine Tune
- Single GPU @ 48GB VRAM
LoRA
- Single GPU @ 11GB VRAM

QLORA+FSDP
- Dual GPU @ 21GB VRAM