diff --git a/docs/multi-gpu.qmd b/docs/multi-gpu.qmd index 2571d31b6..71676bc84 100644 --- a/docs/multi-gpu.qmd +++ b/docs/multi-gpu.qmd @@ -98,8 +98,8 @@ fsdp_cpu_ram_efficient_loading | cpu_ram_efficient_loading fsdp_state_dict_type | state_dict_type fsdp_use_orig_params | **REMOVED** - -For example, if you were using the following FSDP1 config: +For more details, please see the migration guide in the [torchtitan repo](https://github.com/pytorch/torchtitan/blob/main/docs/fsdp.md). In Axolotl, +if you were using the following FSDP1 config: ```{.yaml} fsdp_version: 1