Axolotl
-

+

+

Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
Features: - Train various Huggingface models such as llama, pythia, falcon, mpt - Supports fullfinetune, lora, qlora, relora, and gptq - Customize configurations using a simple yaml file or CLI overwrite - Load different dataset formats, use custom formats, or bring your own tokenized datasets - Integrated with xformer, flash attention, liger kernel, rope scaling, and multipacking - Works with single GPU or multiple GPUs via FSDP or Deepspeed - Easily run with Docker locally or on the cloud - Log results and optionally checkpoints to wandb, mlflow or Comet - And more!
diff --git a/sitemap.xml b/sitemap.xml
index 1be74c3e0..f9c78dbbd 100644
--- a/sitemap.xml
+++ b/sitemap.xml
@@ -2,110 +2,110 @@
https://axolotl-ai-cloud.github.io/axolotl/index.html
- 2024-11-18T16:53:50.128Z
+ 2024-11-18T18:59:45.713Z
https://axolotl-ai-cloud.github.io/axolotl/examples/colab-notebooks/colab-axolotl-example.html
- 2024-11-18T16:53:50.120Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/amd_hpc.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/multipack.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/fsdp_qlora.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/batch_vs_grad.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/multimodal.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/unsloth.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/index.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/pretraining.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/inst_tune.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/debugging.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/faq.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/TODO.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.697Z
https://axolotl-ai-cloud.github.io/axolotl/FAQS.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.697Z
https://axolotl-ai-cloud.github.io/axolotl/docs/multi-node.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/mac.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/tokenized.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/conversation.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/template_free.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/config.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/rlhf.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/torchao.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset_preprocessing.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/input_output.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/docs/nccl.html
- 2024-11-18T16:53:50.116Z
+ 2024-11-18T18:59:45.701Z
https://axolotl-ai-cloud.github.io/axolotl/src/axolotl/integrations/LICENSE.html
- 2024-11-18T16:53:50.132Z
+ 2024-11-18T18:59:45.717Z