This website requires JavaScript.
Explore
Help
Sign In
tocmo0nlord
/
axolotl
Watch
1
Star
0
Fork
0
You've already forked axolotl
Code
Issues
Pull Requests
Actions
3
Packages
Projects
Releases
Wiki
Activity
Files
fix-l3-lora
Add File
New File
Upload File
Apply Patch
axolotl
/
examples
/
llama-3
History
Wing Lian
3ce9b0760b
fix the lora yaml for l3
2024-04-19 07:28:07 -04:00
..
fft-8b.yaml
llama-3 examples (
#1537
)
2024-04-18 14:28:03 -04:00
lora-8b.yml
fix the lora yaml for l3
2024-04-19 07:28:07 -04:00
qlora-fsdp-70b.yaml
llama-3 examples (
#1537
)
2024-04-18 14:28:03 -04:00
qlora.yml
Adding Llama-3 qlora (
#1536
)
2024-04-18 21:27:32 +02:00
README.md
llama-3 examples (
#1537
)
2024-04-18 14:28:03 -04:00
README.md
Llama-3
https://llama.meta.com/llama3/
8B Base Model
Full Fine Tune
Single GPU @ 48GB VRAM
LoRA
Single GPU @ 11GB VRAM
70B Base Model
QLORA+FSDP
Dual GPU @ 21GB VRAM
Reference in New Issue
View Git Blame
Copy Permalink