utils.gradient_checkpointing.offload_cpu

utils.gradient_checkpointing.offload_cpu

CPU offloaded checkpointing

Classes

Name	Description
CPU_Offloaded_Gradient_Checkpointer	Saves VRAM by smartly offloading to RAM.

CPU_Offloaded_Gradient_Checkpointer

utils.gradient_checkpointing.offload_cpu.CPU_Offloaded_Gradient_Checkpointer()

Saves VRAM by smartly offloading to RAM. Tiny hit to performance, since we mask the movement via non blocking calls.