tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

quick formatting fix for LoRA optims doc (#2349)

Browse Source
This commit is contained in:
Dan Saunders
2025-02-19 09:23:31 -05:00
committed by GitHub
parent 8dfadc2b3c
commit 954e192f38
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docs/lora_optims.qmd
View File

@@ -12,6 +12,7 @@ to leverage operator fusion and tensor re-use in order to improve speed and redu
memory usage during the forward and backward passes of these calculations. memory usage during the forward and backward passes of these calculations.
We currently support several common model architectures, including (but not limited to): We currently support several common model architectures, including (but not limited to):
- `llama` - `llama`
- `mistral` - `mistral`
- `qwen2` - `qwen2`