Files
axolotl/requirements-dev.txt
Wing Lian 7aa57803e1 fix optimizer reset for relora sft (#1414)
* fix optimizer reset

* set states to reset for 8bit optimizers and handle quantile runtime error for embeddings

* fix relora test to check grad_norm

* use flash attn for relora and tweak hyperparams for test

* fix messages field for test dataset
2024-12-04 12:33:29 -05:00

5 lines
37 B
Plaintext

pre-commit
black
mypy
types-requests