Wing Lian 0f985e12fe more fixes 20240228 (#1342) [skip ci] ...

* add missing evals_per_epoch setting

* more pydantic fixes

* more fixes

* move test from normalization to validation

* increase eval size for sample packing tests

2024-02-28 12:57:45 -05:00

..

patched

more fixes 20240228 (#1342) [skip ci]

2024-02-28 12:57:45 -05:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_dpo.py

DPO cleanup (#1126)

2024-01-23 00:40:37 -05:00

test_falcon.py

Falcon embeddings (#1149) [skip docker]

2024-01-22 21:01:42 -05:00

test_lora_llama.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_mamba.py

attempt to also run e2e tests that needs gpus (#1070)

2024-01-09 21:23:23 -05:00

test_mistral.py

use temp_dir kwarg instead

2023-11-06 18:33:01 -05:00

test_mixtral.py

keep gate in fp32 for 16 bit loras (#1105)

2024-01-12 14:58:21 -05:00

test_phi.py

Phi2 multipack (#1173)

2024-01-23 12:54:36 -05:00

test_relora_llama.py

relora: magnitude pruning of the optimizer (#1245)

2024-02-06 00:35:30 -05:00

utils.py

support for true batches with multipack (#1230)

2024-02-01 10:18:42 -05:00