Wing Lian 7830fe04b5 Unsloth rope (#1767) ...

* Add unsloth rope embeddings support

* support for models weights in 4bit and do some memory gc

* use accelerate logger

* add unsloth llama rms norm optims

* update docs for unsloth

* more docs info

2024-07-18 14:54:41 -04:00

1.2 KiB

Raw Blame History

View Raw