tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

update lora optims doc

Browse Source
This commit is contained in:
Dan Saunders
2025-09-25 12:24:25 -04:00
parent f9748c4dc5
commit 2fc430d365
1 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
docs/lora_optims.qmd
View File

@@ -131,6 +131,5 @@ computation path.
## Future Work ## Future Work
- Support for additional model architectures - Support for additional model architectures
- Support for the FSDP setting - Support for dropout
- Support for dropout and bias
- Additional operator fusions - Additional operator fusions