5 Commits

Author	SHA1	Message	Date
Wing Lian	68b227a7d8	Mixtral multipack (#928) ... * mixtral multipack * use mixtral model * sample yml * calculate cu_seqlens properly * use updated flash ettention setting * attn var checks * force use of flash attention 2 for packing * lint * disable future fix for now * update support table	2023-12-09 21:26:30 -05:00
Wing Lian	12a2dbbc2c	Support Sample packing for phi arch (#586) ... * phi sequence packing * sample packing fixes * fix linting * fix inference and phi e2e tests * update phi example now that sample packing works * wandb import keeps getting moved around	2023-09-15 15:46:54 -04:00
Wing Lian	ad0ea6aaab	black formatting ... ignore copied file fix linting	2023-05-30 23:50:29 -04:00
NanoCode012	f1232b35ba	Update mypy dependencies	2023-05-31 02:53:53 +09:00
NanoCode012	741a3f2edc	Add mypy	2023-05-31 02:53:53 +09:00