NanoCode012 09959fac70 Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165) ...

* feat: update mistral common

* feat: add mistral3processor

* fix: loading

* fix: cast pixel_values to fp32

* fix: image tensor conversion

* feat: add FA2 support for pixtral based models

* fix: update mistral small 3.1 to use native tokenizer

* fix: install tips

* fix: improve info on sample dataset files

* chore: move mistral configs into subfolders

* fix: remove unneeded patch

* fix: indent

* feat: add integration tests

* chore: move

* feat: add magistral 2509 docs and example

* fix: convert tensor to bool

* feat: expand tests

* chore: move tests

2025-09-18 15:42:20 +07:00

..

dataset-formats

feat(doc): update gpt-oss readme (#3029) [skip ci]

2025-08-07 09:26:42 -04:00

images

Ray Train Axolotl Integration (#2251)

2025-01-29 00:10:19 -05:00

scripts

Add ruff, remove black, isort, flake8, pylint (#3092)

2025-08-23 23:37:33 -04:00

.gitignore

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

amd_hpc.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

batch_vs_grad.qmd

Feat: update doc (#1475) [skip ci]

2024-04-04 13:43:40 +09:00

cli.qmd

CLI: add --launcher option, support launcher args, cleanup, refactor (#2924)

2025-07-30 15:46:56 -04:00

custom_integrations.qmd

densemixer plugin integration (#2868)

2025-07-07 17:05:19 -04:00

dataset_loading.qmd

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

dataset_preprocessing.qmd

Autodoc generation with quartodoc (#2419)

2025-03-21 12:26:47 -04:00

debugging.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

docker.qmd

feat(doc): re-add docker 2.7.0 tag back (#2902) [skip ci]

2025-07-12 11:40:01 -04:00

faq.qmd

Act offload lora fix (#2928) [skip ci]

2025-07-24 16:10:04 -04:00

fsdp_qlora.qmd

Fix link in FSDP + QLoRA docs. (#2879) [skip ci]

2025-07-08 09:19:09 -04:00

getting-started.qmd

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

gradient_checkpointing.qmd

Activation Offloading w CUDA Streams (#2900) [skip ci]

2025-07-14 20:10:20 -04:00

inference.qmd

Feat: minor docs improvements for RLHF and faq on embeddings (#2401) [skip ci]

2025-03-17 08:39:04 -04:00

input_output.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

installation.qmd

feat(doc): improve visibility for colab notebooks (#3110) [skip ci]

2025-09-03 01:40:53 -04:00

lora_optims.qmd

feat(doc): note lora kernel incompat with RLHF (#2706) [skip ci]

2025-05-28 15:48:40 +07:00

lr_groups.qmd

support for custom lr groups for non-embedding modules (#2213)

2025-01-24 12:56:28 -05:00

mac.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

mixed_precision.qmd

basic torchao fp8 mixed precision training (#2926)

2025-07-22 16:27:47 -04:00

multi-gpu.qmd

automatically set env vars for single gpu deepspeed zero3 (#3118) [skip ci]

2025-08-29 13:36:47 -04:00

multi-node.qmd

CLI: add --launcher option, support launcher args, cleanup, refactor (#2924)

2025-07-30 15:46:56 -04:00

multimodal.qmd

Feat: add Magistral Small 2509 and native mistral3 tokenizer support (#3165)

2025-09-18 15:42:20 +07:00

multipack.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

nccl.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

nd_parallelism.qmd

feat: update nd parallelism readme (#3039)

2025-08-08 12:45:36 +01:00

optimizers.qmd

feat: add complete optimizer docs (#3017) [skip ci]

2025-08-06 08:01:51 -04:00

qat.qmd

qat doc updates (#3162) [skip-ci]

2025-09-17 10:38:15 +01:00

quantize.qmd

qat doc updates (#3162) [skip-ci]

2025-09-17 10:38:15 +01:00

ray-integration.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

reward_modelling.qmd

Center rewards coefficient (#3124)

2025-09-03 16:22:37 -04:00

rlhf.qmd

fix: customized dataset with simpo (#2894) [skip ci]

2025-07-12 11:40:30 -04:00

sequence_parallelism.qmd

Distributed/ND-Parallel (#2977)

2025-07-31 15:25:02 -04:00

streaming.qmd

Streaming SFT support (#3101)

2025-09-02 12:08:44 -04:00

torchao.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

unsloth.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00