8 Commits

Author	SHA1	Message	Date
Wing Lian	9bf854e59c	Phi update 202311 (#876) ... * add phi modeling from hf * update for packing and use new modeling class for phi * update e2e tests for phi to use new model name * update example phi to also use new phi model name * use AutoModelForCausalLM for phi lora since sample packing isn't supported	2023-11-17 12:47:17 -05:00
Wing Lian	6dc68a653f	use temp_dir kwarg instead	2023-11-06 18:33:01 -05:00
Wing Lian	7de6a5639c	missing dunder-init	2023-11-06 18:33:01 -05:00
Wing Lian	c74f045ba7	chore: lint	2023-11-06 18:33:01 -05:00
Wing Lian	0402d19759	make sure to cleanup tmp output_dir for e2e tests	2023-11-06 18:33:01 -05:00
Wing Lian	2d8def68dc	simplify by removing duplicate base_model_config (#772)	2023-10-23 01:42:38 -04:00
Wing Lian	03e59077a0	misc fixes to add gptq tests (#621) ... * misc fixes to add gptq tests * set bf16 needed for fa2	2023-09-21 21:52:12 -04:00
Wing Lian	12a2dbbc2c	Support Sample packing for phi arch (#586) ... * phi sequence packing * sample packing fixes * fix linting * fix inference and phi e2e tests * update phi example now that sample packing works * wandb import keeps getting moved around	2023-09-15 15:46:54 -04:00