This website requires JavaScript.
Explore
Help
Sign In
tocmo0nlord
/
axolotl
Watch
1
Star
0
Fork
0
You've already forked axolotl
Code
Issues
Pull Requests
Actions
3
Packages
Projects
Releases
Wiki
Activity
Files
olmo-no-position_ids
Add File
New File
Upload File
Apply Patch
axolotl
/
examples
/
llama-3
History
NanoCode012
0e8f340945
fix(yml): update llama-3 config (
#1543
) [skip ci]
2024-04-19 20:44:46 +09:00
..
fft-8b.yaml
llama-3 examples (
#1537
)
2024-04-18 14:28:03 -04:00
lora-8b.yml
fix(yml): update llama-3 config (
#1543
) [skip ci]
2024-04-19 20:44:46 +09:00
qlora-fsdp-70b.yaml
llama-3 examples (
#1537
)
2024-04-18 14:28:03 -04:00
qlora.yml
Adding Llama-3 qlora (
#1536
)
2024-04-18 21:27:32 +02:00
README.md
llama-3 examples (
#1537
)
2024-04-18 14:28:03 -04:00
README.md
Llama-3
https://llama.meta.com/llama3/
8B Base Model
Full Fine Tune
Single GPU @ 48GB VRAM
LoRA
Single GPU @ 11GB VRAM
70B Base Model
QLORA+FSDP
Dual GPU @ 21GB VRAM
Reference in New Issue
View Git Blame
Copy Permalink