Wing Lian d87df2c776 prepare plugins needs to happen so registration can occur to build the plugin args (#2119) ...

* prepare plugins needs to happen so registration can occur to build the plugin args

use yaml.dump

include dataset and more assertions

* attempt to manually register plugins rather than use fn

* fix fixture

* remove fixture

* move cli test to patched dir

* fix cce validation

2024-12-03 15:06:09 -05:00

..

integrations

feat: add cut_cross_entropy (#2091)

2024-12-03 08:22:22 -05:00

multigpu

add finetome dataset to fixtures, check eval_loss in test (#2106) [skip ci]

2024-11-29 20:37:32 -05:00

patched

prepare plugins needs to happen so registration can occur to build the plugin args (#2119)

2024-12-03 15:06:09 -05:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_dpo.py

Add weighted optimisation support for trl DPO trainer integration (#2016)

2024-11-08 11:29:11 -05:00

test_embeddings_lr.py

support seperate lr for embeddings, similar to loraplus (#1910) [skip ci]

2024-11-29 20:38:20 -05:00

test_falcon.py

Falcon embeddings (#1149) [skip docker]

2024-01-22 21:01:42 -05:00

test_imports.py

Bump deepspeed 20240727 (#1790)

2024-07-27 10:24:11 -04:00

test_llama_pretrain.py

fixes to accelerator so that iterable pretraining datasets work (#1759)

2024-07-17 10:58:38 -04:00

test_llama_vision.py

fix(vlm): handle legacy conversation data format and check image in data (#2018) [skip ci]

2024-12-03 00:01:31 -05:00

test_llama.py

Update get_unpad_data patching for multipack (#2013)

2024-11-15 20:35:50 -05:00

test_load_model.py

Refactor func load_model to class ModelLoader (#1909)

2024-10-25 09:06:56 -04:00

test_lora_llama.py

fix(vlm): handle legacy conversation data format and check image in data (#2018) [skip ci]

2024-12-03 00:01:31 -05:00

test_mamba.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_mistral.py

use temp_dir kwarg instead

2023-11-06 18:33:01 -05:00

test_mixtral.py

fix broken linting (#1541)

2024-04-19 01:03:04 -04:00

test_optimizers.py

fix(vlm): handle legacy conversation data format and check image in data (#2018) [skip ci]

2024-12-03 00:01:31 -05:00

test_packing_loss.py

optim e2e tests to run a bit faster (#2069) [skip ci]

2024-11-18 12:35:31 -05:00

test_phi.py

re-enable phi for tests in modal ci (#1373)

2024-05-29 15:41:46 -04:00

test_qwen.py

remove the bos token from dpo outputs (#1733) [skip ci]

2024-11-15 19:09:20 -05:00

test_relora_llama.py

fix optimizer reset for relora sft (#1414)

2024-12-03 08:58:23 -05:00

test_reward_model_llama.py

Reward model (#1879)

2024-10-13 15:11:13 -04:00

utils.py

Check torch version for ADOPT optimizer + integrating new ADOPT updates (#2104)

2024-12-02 20:15:39 -05:00