Dan Saunders 1b53c49e1a text diffusion training plugin (#3067) ...

* diffusion training plugin

* cleanup

* nits

* fixes + improvements

* add back in reinit_weights (clobbered?); masking / pretrain fixes

* nits

* cleanup; tests draft

* sample generation, tests fixes

* fixes

* nits

* add inference support; add auto-mask token support

* nits

* nits

* progress

* simplify logging

* lint

* prefix args with diffusion_

* coderabbito

* tests fix

* nit

* nits

* cleanup + nits

* nits

* fix SFT sample gen

* fixes

* fix

* comments

* comments

* lint

* reward model lora fix

* cleanup; fix pretraining_dataset case

* gradio inference

* update cfgs

* update cfgs

* train, generation parity, cleanup

* fix

* simplify

* test

* test fix

2025-09-10 20:27:00 -04:00

..

integrations

Streaming SFT support (#3101)

2025-09-02 12:08:44 -04:00

kernels

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

multigpu

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

patched

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

solo

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

__init__.py

missing dunder-init

2023-11-06 18:33:01 -05:00

.gitignore

Support Sample packing for phi arch (#586)

2023-09-15 15:46:54 -04:00

test_activation_offloading.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_deepseekv3.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_diffusion.py

text diffusion training plugin (#3067)

2025-09-10 20:27:00 -04:00

test_dpo.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_embeddings_lr.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_evaluate.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_falcon.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_gemma2.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_gemma3_text.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_imports.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_llama_pretrain.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_llama_vision.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_llama.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_load_model.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_lora_llama.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_mamba.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_mistral.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_mixtral.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_optimizers.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_packing_loss.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_phi.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_preprocess.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_process_reward_model_smollm2.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_profiler.py

allow profiling in mid-training rather from the start (#2899) [skip ci]

2025-07-14 20:11:11 -04:00

test_qat.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_quantization.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_qwen.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_reward_model_smollm2.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_save_first_step.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_schedulers.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

test_streaming.py

Streaming SFT support (#3101)

2025-09-02 12:08:44 -04:00

test_tokenizer.py

add tokenizer_save_jinja_files to keep legacy behavior of including chat template in tokenizer_config.json (#3093)

2025-08-26 09:30:04 -04:00

utils.py

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00