Motoki Wu 98c25e15cb Add ORPO example and e2e test (#1572) ...

* add example for mistral orpo

* sample_packing: false for orpo

* go to load_dataset (since load_rl_datasets require a transfom_fn, which only dpo uses currently)

2024-04-27 12:07:06 -04:00

..

dataset-formats

Feat: update doc (#1475) [skip ci]

2024-04-04 13:43:40 +09:00

images

support for true batches with multipack (#1230)

2024-02-01 10:18:42 -05:00

.gitignore

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

batch_vs_grad.qmd

Feat: update doc (#1475) [skip ci]

2024-04-04 13:43:40 +09:00

config.qmd

feat(doc): Add example for pad_token (#1535)

2024-04-19 02:20:20 +09:00

dataset_preprocessing.qmd

add docs around pre-processing (#1529)

2024-04-16 19:45:46 -04:00

debugging.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

faq.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

fsdp_qlora.qmd

Reorganize Docs (#1468)

2024-04-01 08:00:52 -07:00

input_output.qmd

Feat: update doc (#1475) [skip ci]

2024-04-04 13:43:40 +09:00

mac.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

multi-node.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

multipack.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

nccl.qmd

Bootstrap Hosted Axolotl Docs w/Quarto (#1429)

2024-03-21 22:28:36 -07:00

rlhf.qmd

Add ORPO example and e2e test (#1572)

2024-04-27 12:07:06 -04:00