Commit Graph

3 Commits

Author SHA1 Message Date
mhenrichsen
4fecbfe5e1 default model changed 2023-09-24 18:52:53 +02:00
Wing Lian
343714972b recommend padding when using sample packing (#531) 2023-09-06 17:00:21 -04:00
Charles O. Goddard
fe4d6baf92 Add example Llama 2 ReLoRA config (#471)
* Add example Llama 2 ReLoRA config

* Use adamw_bnb_8bit in example relora config
2023-08-27 10:08:34 +09:00