4 Commits

Author	SHA1	Message	Date
Wing Lian	adea682316	add support for opimum bettertransformers	2023-05-31 16:39:35 -04:00
Wing Lian	c2a0792680	swap batch size for gradient accumulation steps to decouple from num gpu	2023-05-31 09:38:12 -04:00
Viktorius Suwandi	84fc217f79	Update wandb_log_model on gpt_neox_20b.yml	2023-05-29 15:41:24 +07:00
Wing Lian	6045345d6b	WIP large refactor to make finetune script a little more manageable (#3)	2023-04-18 14:01:38 -04:00