NanoCode012 a620d481e2 fix: drop long seq even if not sample packing (#2211) ...

* fix: drop long seq even if not sample packing

* fix: logging import

* fix: cfg passed being none

* fix: try to fix logging

* fix: refactor call to not use accelerate log

* fix: try to fix circular import issue

* fix: don't drop when skip prepare

* chore: remove duplicate line

* fix: update warning to mention that sequences will be trimmed

* fix: do not drop seq if input_ids don't exist

* fix: increase RM unittest sequence length to reduce trim warnings

* fix: solve conflicts

* fix: default min_seq_len in case of None

2025-02-04 09:43:35 -05:00

..

integrations

KD Trainer w logprobs (#2303)

2025-01-31 20:18:52 -05:00

multigpu

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

patched

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

solo

support for latest transformers release 4.48.1 (#2256)

2025-01-23 21:17:57 -05:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_dpo.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_embeddings_lr.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_falcon.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_imports.py

Bump deepspeed 20240727 (#1790)

2024-07-27 10:24:11 -04:00

test_llama_pretrain.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_llama_vision.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_llama.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_load_model.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_lora_llama.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_mamba.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_mistral.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_mixtral.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_optimizers.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_packing_loss.py

updating to fused (#2293)

2025-01-30 11:45:56 -05:00

test_phi.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_process_reward_model_smollm2.py

Misc fixes 20250130 (#2301)

2025-01-31 08:58:04 -05:00

test_qwen.py

remove the bos token from dpo outputs (#1733) [skip ci]

2024-11-15 19:09:20 -05:00

test_reward_model_smollm2.py

fix: drop long seq even if not sample packing (#2211)

2025-02-04 09:43:35 -05:00

utils.py

Misc fixes 20250130 (#2301)

2025-01-31 08:58:04 -05:00