4 Commits

Author	SHA1	Message	Date
Wing Lian	e50a64e85e	prepared dataset caching, other misc fixes (#665) ... * prepared dataset caching, other misc fixes * also don't load from disk cache unless explicit	2023-10-02 21:07:24 -04:00
mhenrichsen	4fecbfe5e1	default model changed	2023-09-24 18:52:53 +02:00
Wing Lian	343714972b	recommend padding when using sample packing (#531)	2023-09-06 17:00:21 -04:00
Charles O. Goddard	fe4d6baf92	Add example Llama 2 ReLoRA config (#471) ... * Add example Llama 2 ReLoRA config * Use adamw_bnb_8bit in example relora config	2023-08-27 10:08:34 +09:00