3 Commits

Author	SHA1	Message	Date
Wing Lian	c2a0792680	swap batch size for gradient accumulation steps to decouple from num gpu	2023-05-31 09:38:12 -04:00
Viktorius Suwandi	0736f4f9c1	Update wandb_log_model on llama_13B_alpaca.yml	2023-05-29 15:43:20 +07:00
Wing Lian	097d367af6	tweaks to data loading, 8 bit adam, accelerate and deepspeed	2023-04-24 09:41:35 -04:00