Wing Lian d1aed4c8e5 deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

2023-04-16 06:59:47 -04:00

..

alpaca_json_to_jsonl.py

black formatting

2023-04-14 07:25:52 -04:00

finetune.py

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

2023-04-16 06:59:47 -04:00