Wing Lian 68b227a7d8 Mixtral multipack (#928) ...

* mixtral multipack

* use mixtral model

* sample yml

* calculate cu_seqlens properly

* use updated flash ettention setting

* attn var checks

* force use of flash attention 2 for packing

* lint

* disable future fix for now

* update support table

2023-12-09 21:26:30 -05:00

..

Dockerfile

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

Dockerfile-base

don't compile deepspeed or bitsandbytes from source (#837)

2023-11-08 19:49:55 -05:00

Dockerfile-runpod

Mixtral multipack (#928)

2023-12-09 21:26:30 -05:00