tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

adding torchtitan link (#2945) [skip ci]

Browse Source
This commit is contained in:
salman
2025-07-19 18:54:14 +01:00
committed by GitHub
parent 109d9c7442
commit e5734e5cf0
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/multi-gpu.qmd
View File

@@ -98,8 +98,8 @@ fsdp_cpu_ram_efficient_loading | cpu_ram_efficient_loading
fsdp_state_dict_type | state_dict_type fsdp_state_dict_type | state_dict_type
fsdp_use_orig_params | **REMOVED** fsdp_use_orig_params | **REMOVED**
For more details, please see the migration guide in the [torchtitan repo](https://github.com/pytorch/torchtitan/blob/main/docs/fsdp.md). In Axolotl,
For example, if you were using the following FSDP1 config: if you were using the following FSDP1 config:
```{.yaml} ```{.yaml}
fsdp_version: 1 fsdp_version: 1