Axolotl
+

Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
Features: - Train various Huggingface models such as llama, pythia, falcon, mpt - Supports fullfinetune, lora, qlora, relora, and gptq - Customize configurations using a simple yaml file or CLI overwrite - Load different dataset formats, use custom formats, or bring your own tokenized datasets - Integrated with xformer, flash attention, rope scaling, and multipacking - Works with single GPU or multiple GPUs via FSDP or Deepspeed - Easily run with Docker locally or on the cloud - Log results and optionally checkpoints to wandb or mlflow - And more!
diff --git a/sitemap.xml b/sitemap.xml
index e6bf63a8a..9193952be 100644
--- a/sitemap.xml
+++ b/sitemap.xml
@@ -2,98 +2,98 @@
https://axolotl-ai-cloud.github.io/axolotl/index.html
- 2024-08-22T15:47:45.769Z
+ 2024-08-22T17:11:07.261Z
https://axolotl-ai-cloud.github.io/axolotl/FAQS.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.245Z
https://axolotl-ai-cloud.github.io/axolotl/docs/multipack.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/batch_vs_grad.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/input_output.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/multi-node.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/index.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/tokenized.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/template_free.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/faq.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/torchao.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/nccl.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/TODO.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/config.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset_preprocessing.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/pretraining.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/inst_tune.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/conversation.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/mac.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/debugging.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/fsdp_qlora.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/rlhf.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/docs/unsloth.html
- 2024-08-22T15:47:45.757Z
+ 2024-08-22T17:11:07.249Z
https://axolotl-ai-cloud.github.io/axolotl/examples/colab-notebooks/colab-axolotl-example.html
- 2024-08-22T15:47:45.761Z
+ 2024-08-22T17:11:07.249Z