NanoCode012 5a961ecadf Fix: do not call preprocess in multimodal or pretraining case (#2861) ...

* fix: let users know to not call preprocess for vision mode

* fix: improve ux for pretraining dataset and skip prepare ds

* feat: add info to doc

* Update src/axolotl/cli/preprocess.py following comment

Co-authored-by: salman <salman.mohammadi@outlook.com>

---------

Co-authored-by: salman <salman.mohammadi@outlook.com>

2025-07-06 21:55:33 -04:00

..

dataset-formats

fix(doc): default messages example used wrong key (#2832)

2025-06-26 10:47:31 -04:00

images

Ray Train Axolotl Integration (#2251)

2025-01-29 00:10:19 -05:00

scripts

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

.gitignore

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

amd_hpc.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

batch_vs_grad.qmd

Feat: update doc (#1475) [skip ci]

2024-04-04 13:43:40 +09:00

cli.qmd

QAT (#2590)

2025-05-28 12:35:47 +01:00

custom_integrations.qmd

Add: Sparse Finetuning Integration with llmcompressor (#2479)

2025-05-01 12:25:16 -04:00

dataset_loading.qmd

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

dataset_preprocessing.qmd

Autodoc generation with quartodoc (#2419)

2025-03-21 12:26:47 -04:00

debugging.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

docker.qmd

feat(doc): update docker tag examples (#2851) [skip ci]

2025-07-02 08:05:01 -04:00

faq.qmd

Fix: do not call preprocess in multimodal or pretraining case (#2861)

2025-07-06 21:55:33 -04:00

fsdp_qlora.qmd

github urls (#1734)

2024-07-11 09:19:29 -04:00

getting-started.qmd

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

inference.qmd

Feat: minor docs improvements for RLHF and faq on embeddings (#2401) [skip ci]

2025-03-17 08:39:04 -04:00

input_output.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

installation.qmd

Fix: logging on py310 (#2802)

2025-06-18 15:46:27 -04:00

lora_optims.qmd

feat(doc): note lora kernel incompat with RLHF (#2706) [skip ci]

2025-05-28 15:48:40 +07:00

lr_groups.qmd

support for custom lr groups for non-embedding modules (#2213)

2025-01-24 12:56:28 -05:00

mac.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

multi-gpu.qmd

SP dataloader patching + removing custom sampler / dataloader logic (#2686)

2025-05-21 11:20:20 -04:00

multi-node.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

multimodal.qmd

bump hf deps (#2735) [skip ci]

2025-06-05 07:20:33 -07:00

multipack.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

nccl.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

qat.qmd

QAT docfix (#2778) [skip ci]

2025-06-12 13:22:40 -04:00

quantize.qmd

Config doc autogen (#2718)

2025-06-18 15:36:53 -04:00

ray-integration.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

reward_modelling.qmd

chore(docs): add cookbook/blog link to docs (#2410) [skip ci]

2025-03-17 08:38:19 -04:00

rlhf.qmd

fix: grpo doc link (#2788) [skip ci]

2025-06-13 12:03:47 -07:00

sequence_parallelism.qmd

SP dataloader patching + removing custom sampler / dataloader logic (#2686)

2025-05-21 11:20:20 -04:00

torchao.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00

unsloth.qmd

Feat(doc): Reorganize documentation, fix broken syntax, update notes (#2348)

2025-02-25 16:09:37 +07:00