4 Commits

Author	SHA1	Message	Date
Wing Lian	03e59077a0	misc fixes to add gptq tests (#621) ... * misc fixes to add gptq tests * set bf16 needed for fa2	2023-09-21 21:52:12 -04:00
Wing Lian	12a2dbbc2c	Support Sample packing for phi arch (#586) ... * phi sequence packing * sample packing fixes * fix linting * fix inference and phi e2e tests * update phi example now that sample packing works * wandb import keeps getting moved around	2023-09-15 15:46:54 -04:00
Wing Lian	24146733db	E2e device cuda (#575) ... * use torch.cuda.current_device() instead of local_rank * ignore NVML errors for gpu stats * llama lora packing e2e tests	2023-09-14 22:49:27 -04:00
Wing Lian	9218ebecd2	e2e testing (#574)	2023-09-14 21:56:11 -04:00