Axolotl
-

+

Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
Features: - Train various Huggingface models such as llama, pythia, falcon, mpt - Supports fullfinetune, lora, qlora, relora, and gptq - Customize configurations using a simple yaml file or CLI overwrite - Load different dataset formats, use custom formats, or bring your own tokenized datasets - Integrated with xformer, flash attention, rope scaling, and multipacking - Works with single GPU or multiple GPUs via FSDP or Deepspeed - Easily run with Docker locally or on the cloud - Log results and optionally checkpoints to wandb or mlflow - And more!
diff --git a/sitemap.xml b/sitemap.xml
index 9193952be..c730aa039 100644
--- a/sitemap.xml
+++ b/sitemap.xml
@@ -2,98 +2,98 @@
https://axolotl-ai-cloud.github.io/axolotl/index.html
- 2024-08-22T17:11:07.261Z
+ 2024-08-22T17:13:43.607Z
https://axolotl-ai-cloud.github.io/axolotl/FAQS.html
- 2024-08-22T17:11:07.245Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/multipack.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/batch_vs_grad.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/input_output.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/multi-node.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/index.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/tokenized.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/template_free.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/faq.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/torchao.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.599Z
https://axolotl-ai-cloud.github.io/axolotl/docs/nccl.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.599Z
https://axolotl-ai-cloud.github.io/axolotl/TODO.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/config.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset_preprocessing.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/pretraining.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/inst_tune.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/conversation.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/mac.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/debugging.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/fsdp_qlora.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.595Z
https://axolotl-ai-cloud.github.io/axolotl/docs/rlhf.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.599Z
https://axolotl-ai-cloud.github.io/axolotl/docs/unsloth.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.599Z
https://axolotl-ai-cloud.github.io/axolotl/examples/colab-notebooks/colab-axolotl-example.html
- 2024-08-22T17:11:07.249Z
+ 2024-08-22T17:13:43.599Z