Wing Lian 1f623e6cc8 transformers 4.47.1 (#2187) ...

* transformers 4.47.1

* drop monkeypatches

* can't remove patches yet

* make flash attention forward ignore the loss kwargs

* patch the flash attention in the modeling arch too

* remove fsdp and deepspeed patches

* cleanup PR

* bump accelerate and torchao, also logically reorder/group requirements

* meant to include torchao

* use official patch release

2024-12-17 11:01:21 -05:00

..

chat_datasets.py

add warning that sharegpt will be deprecated (#1957)

2024-10-11 13:33:20 -04:00

cloud-entrypoint-term.sh

more fixes to work with runpod + skypilot (#1629)

2024-05-16 00:05:56 -04:00

cloud-entrypoint.sh

fix env var extraction (#2043) [skip ci]

2024-11-14 12:58:06 -05:00

cutcrossentropy_install.py

prepare plugins needs to happen so registration can occur to build the plugin args (#2119)

2024-12-03 15:06:09 -05:00

finetune.py

Create preprocess CLI (#785)

2023-10-26 09:35:42 -04:00

motd

fix build w pyproject to respect insalled torch version (#2168)

2024-12-10 16:25:25 -05:00

unsloth_install.py

transformers 4.47.1 (#2187)

2024-12-17 11:01:21 -05:00