NanoCode012 cba5a457d9 fix: use text_column even when not packing for pretraining (#2254) ...

* fix: use text_column even when not packing for pretraining

* feat: update test to check when not packing

* chore: lint

* Update src/axolotl/utils/data/pretraining.py

Co-authored-by: Wing Lian <wing.lian@gmail.com>

---------

Co-authored-by: Wing Lian <wing@axolotl.ai>
Co-authored-by: Wing Lian <wing.lian@gmail.com>

2025-01-14 22:08:56 -05:00

..

integrations

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

multigpu

need to update deepspeed version in extras too (#2161) [skip ci]

2024-12-09 14:01:44 -05:00

patched

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_dpo.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_embeddings_lr.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_falcon.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_imports.py

Bump deepspeed 20240727 (#1790)

2024-07-27 10:24:11 -04:00

test_llama_pretrain.py

fix: use text_column even when not packing for pretraining (#2254)

2025-01-14 22:08:56 -05:00

test_llama_vision.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_llama.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_load_model.py

Refactor func load_model to class ModelLoader (#1909)

2024-10-25 09:06:56 -04:00

test_lora_llama.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_mamba.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_mistral.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_mixtral.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_optimizers.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_packing_loss.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_phi.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_qwen.py

remove the bos token from dpo outputs (#1733) [skip ci]

2024-11-15 19:09:20 -05:00

test_relora_llama.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

test_reward_model_llama.py

CLI cleanup and documentation (#2244)

2025-01-13 17:55:29 +00:00

utils.py

add helper to verify the correct model output file exists (#2245)

2025-01-13 10:43:29 -05:00