9 Commits

Author	SHA1	Message	Date
Wing Lian	5f79b8242f	new evals_per_epoch and saves_per_epoch to make things cleaner (#944) ... * new evals_per_epoch and saves_per_epoch to make things cleaner * update per PR feedback	2023-12-12 15:35:23 -05:00
NanoCode012	a1da39cd48	Feat(wandb): Refactor to be more flexible (#767) ... * Feat: Update to handle wandb env better * chore: rename wandb_run_id to wandb_name * feat: add new recommendation and update config * fix: indent and pop disabled env if project passed * feat: test env set for wandb and recommendation * feat: update to use wandb_name and allow id * chore: add info to readme	2023-12-04 22:17:25 +09:00
Wing Lian	f544ab2bed	don't compile deepspeed or bitsandbytes from source (#837)	2023-11-08 19:49:55 -05:00
Wing Lian	2d8def68dc	simplify by removing duplicate base_model_config (#772)	2023-10-23 01:42:38 -04:00
Wing Lian	e50a64e85e	prepared dataset caching, other misc fixes (#665) ... * prepared dataset caching, other misc fixes * also don't load from disk cache unless explicit	2023-10-02 21:07:24 -04:00
Wing Lian	674c57692d	more sane defaults for openllama 3b used for quickstarts (#602) ... * more sane defaults for openllama 3b used for quickstarts * don't use bf16 for quickstart to simplify gpu compatibility * use the update openlm-research/open_llama_3b_v2 models	2023-09-19 09:15:10 -04:00
Morgan McGuire	7019509daa	Add wandb_entity to wandb options, update example configs, update README (#361) ... * Update wandb_entity and add wandb descriptions * add wandb to config section * remove trailing whitespace for pre-commit hook * remove trailing whitespace for pre-commit hook --------- Co-authored-by: Morgan McGuire <morganmcguire@Morgans-MacBook-Pro.local> Co-authored-by: Wing Lian <wing.lian@gmail.com>	2023-08-12 12:17:11 -04:00
Aman Karmani	36fefcf94b	set group_by_length to false in examples	2023-08-06 23:59:09 -07:00
Wing Lian	d0d7eaa4f3	update openllama and clean up paths	2023-06-11 11:03:31 -04:00