tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
deb01959d2020206cd31ae8fb0297d525cbeae26
axolotl/examples/llama-4
History
Wing Lian bf9efe2a09 [llama4] fix the mm yaml, add scout single gpu yaml (#2510) 
* [llama4] fix the mm yaml, add scout single gpu yaml

* add README for llama4

* rename to specify fsdp
2025-04-09 02:52:45 -04:00
..
README.md
[llama4] fix the mm yaml, add scout single gpu yaml (#2510)
2025-04-09 02:52:45 -04:00
scout-qlora-fsdp1.yaml
Llama4 linearized (#2502)
2025-04-07 20:47:00 -04:00
scout-qlora-single-h100.yaml
[llama4] fix the mm yaml, add scout single gpu yaml (#2510)
2025-04-09 02:52:45 -04:00
scout-vision-qlora-fsdp.yaml
[llama4] fix the mm yaml, add scout single gpu yaml (#2510)
2025-04-09 02:52:45 -04:00

README.md

Llama 4 by Meta AI

Available Examples

Llama 4 Scout 17Bx16Experts (109B)

Our Single GPU implementation for Llama 4 Scout uses only 68.5GB VRAM for post-training with 4k context length @ 546 tokens/second.

Reference in New Issue View Git Blame Copy Permalink