Wing Lian 96deb6bd67 recast loralayer, norm, lmhead + embed token weights per original qlora (#393) ...

* recast loralayer, norm, lmhead + embed token weights per original qlora

* try again for the fix

* refactor torch dtype picking

* linter fixes

* missing import for LoraLayer

* fix install for tests now that peft is involved

2023-08-21 18:41:12 -04:00

1.2 KiB

Raw Blame History

View Raw