Wing Lian d1aed4c8e5 deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

2023-04-16 06:59:47 -04:00

..

cerebras_1_3B_alpaca.yml

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

2023-04-16 06:59:47 -04:00

llama_7B_alpaca.yml

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

2023-04-16 06:59:47 -04:00

llama_65B_alpaca.yml

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

2023-04-16 06:59:47 -04:00

pythia_1_2B_alpaca.yml

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

2023-04-16 06:59:47 -04:00