From 3c8b9b33d6e0cdbbda0e0d82842249f0c332bc4a Mon Sep 17 00:00:00 2001 From: NanoCode012 Date: Wed, 7 May 2025 21:29:47 +0700 Subject: [PATCH] fix(doc): clarify instruction to delinearize llama4 similar to cli doc (#2644) [skip ci] --- examples/llama-4/README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/examples/llama-4/README.md b/examples/llama-4/README.md index f5fc908a6..653da155c 100644 --- a/examples/llama-4/README.md +++ b/examples/llama-4/README.md @@ -34,3 +34,5 @@ We provide a script to delinearize Llama 4 linearized models into regular Huggin ```bash axolotl delinearize-llama4 --model path/to/model_dir --output path/to/output_dir ``` + +Note: This only works with the non-quantized linearized model. If you have an adapter, merge it with the *non-quantized linearized* model before delinearizing.