4 Commits

Author	SHA1	Message	Date
Wing Lian	5f79b8242f	new evals_per_epoch and saves_per_epoch to make things cleaner (#944) ... * new evals_per_epoch and saves_per_epoch to make things cleaner * update per PR feedback	2023-12-12 15:35:23 -05:00
NanoCode012	a1da39cd48	Feat(wandb): Refactor to be more flexible (#767) ... * Feat: Update to handle wandb env better * chore: rename wandb_run_id to wandb_name * feat: add new recommendation and update config * fix: indent and pop disabled env if project passed * feat: test env set for wandb and recommendation * feat: update to use wandb_name and allow id * chore: add info to readme	2023-12-04 22:17:25 +09:00
NanoCode012	a48dbf6561	fix: remove FA for qwen examples (#900) ... * fix: remove FA for qwen lora * fix: remove FA for qlora	2023-11-27 21:23:54 +09:00
NanoCode012	1115c501b8	Feat: Add Qwen (#894) ... * Feat: Add Qwen * feat: add qwen lora example * feat: update matrix * fix: add trust_remote_code * fix: disable gradient checkpointing * chore: add warning about gradient checkpointing * fix: config * fix: turn off sample packing for this example and reduce seq len * chore: add comment on seq len	2023-11-26 00:05:01 +09:00