8 Commits

Author	SHA1	Message	Date
Wing Lian	5f79b8242f	new evals_per_epoch and saves_per_epoch to make things cleaner (#944) ... * new evals_per_epoch and saves_per_epoch to make things cleaner * update per PR feedback	2023-12-12 15:35:23 -05:00
NanoCode012	a1da39cd48	Feat(wandb): Refactor to be more flexible (#767) ... * Feat: Update to handle wandb env better * chore: rename wandb_run_id to wandb_name * feat: add new recommendation and update config * fix: indent and pop disabled env if project passed * feat: test env set for wandb and recommendation * feat: update to use wandb_name and allow id * chore: add info to readme	2023-12-04 22:17:25 +09:00
Wing Lian	f544ab2bed	don't compile deepspeed or bitsandbytes from source (#837)	2023-11-08 19:49:55 -05:00
Wing Lian	8b79ff0e94	fix eval_steps to be a sane default (#797) ... * fix eval_steps to be a sane default * update docs for fractional eval_steps	2023-10-27 22:36:30 -04:00
Wing Lian	2d8def68dc	simplify by removing duplicate base_model_config (#772)	2023-10-23 01:42:38 -04:00
Wing Lian	e50a64e85e	prepared dataset caching, other misc fixes (#665) ... * prepared dataset caching, other misc fixes * also don't load from disk cache unless explicit	2023-10-02 21:07:24 -04:00
Wing Lian	faecff9798	support to disable exllama for gptq (#604) ... * support to disable exllama for gptq * update property instead of item * fix config key	2023-09-19 17:51:08 -04:00
Wing Lian	3355706e22	Add support for GPTQ using native transformers/peft (#468) ... * auto gptq support * more tweaks and add yml * remove old gptq docker * don't need explicit peft install for tests * fix setup.py to use extra index url install torch for tests fix cuda version for autogptq index set torch in requirements so that it installs properly move gptq install around to work with github cicd * gptq doesn't play well with sample packing * address pr feedback * remove torch install for now * set quantization_config from model config * Fix the implementation for getting quant config from model config	2023-09-05 12:43:22 -04:00