2 Commits

Author	SHA1	Message	Date
Wing Lian	35f9b0f149	update to latest transformers for mixstral support (#929) ... * update to latest transformers for mixstral support * pin transformers * fix typo	2023-12-10 10:32:27 -05:00
Wing Lian	68b227a7d8	Mixtral multipack (#928) ... * mixtral multipack * use mixtral model * sample yml * calculate cu_seqlens properly * use updated flash ettention setting * attn var checks * force use of flash attention 2 for packing * lint * disable future fix for now * update support table	2023-12-09 21:26:30 -05:00