add README for llama4

2025-04-09 02:15:09 -04:00
parent dc4809f7dd
commit 3036ca349f
2 changed files with 10 additions and 0 deletions
--- a/examples/llama-4/README.md
+++ b/examples/llama-4/README.md
@@ -0,0 +1,10 @@
+# Llama 4 by Meta AI
+
+## Available Examples
+
+### Llama 4 Scout 17Bx16Experts (109B)
+- [Multi-Modal/Vision QLoRA w/ FSDP1](./scout-vision-qlora.yaml)
+- [Text Single GPU (H100) QLoRA](./scout-qlora-single-h100.yaml)
+- [Text Multi GPU QLoRA w/ FSDP1](./scout-qlora-fsdp1.yaml)
+
+Our Single GPU implementation for Llama 4 Scout uses only 68.5GB VRAM for post-training with 4k context length @ 546 tokens/second.
--- a/examples/llama-4/multimodal/scout-lora.yaml
+++ b/examples/llama-4/multimodal/scout-lora.yaml