10 Commits

Author	SHA1	Message	Date
Wing Lian	b3a61e8ce2	add e2e tests for checking functionality of resume from checkpoint (#865) ... * use tensorboard to see if resume from checkpoint works * make sure e2e test is either fp16 or bf16 * set max_steps and save limit so we have the checkpoint when testing resuming * fix test parameters	2023-11-15 23:05:55 -05:00
Wing Lian	6dc68a653f	use temp_dir kwarg instead	2023-11-06 18:33:01 -05:00
Wing Lian	7de6a5639c	missing dunder-init	2023-11-06 18:33:01 -05:00
Wing Lian	c74f045ba7	chore: lint	2023-11-06 18:33:01 -05:00
Wing Lian	0402d19759	make sure to cleanup tmp output_dir for e2e tests	2023-11-06 18:33:01 -05:00
Wing Lian	2d8def68dc	simplify by removing duplicate base_model_config (#772)	2023-10-23 01:42:38 -04:00
Wing Lian	03e59077a0	misc fixes to add gptq tests (#621) ... * misc fixes to add gptq tests * set bf16 needed for fa2	2023-09-21 21:52:12 -04:00
Wing Lian	12a2dbbc2c	Support Sample packing for phi arch (#586) ... * phi sequence packing * sample packing fixes * fix linting * fix inference and phi e2e tests * update phi example now that sample packing works * wandb import keeps getting moved around	2023-09-15 15:46:54 -04:00
Wing Lian	24146733db	E2e device cuda (#575) ... * use torch.cuda.current_device() instead of local_rank * ignore NVML errors for gpu stats * llama lora packing e2e tests	2023-09-14 22:49:27 -04:00
Wing Lian	9218ebecd2	e2e testing (#574)	2023-09-14 21:56:11 -04:00