diff --git a/.nojekyll b/.nojekyll index c8b597ace..bc088e57d 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -2247c440 \ No newline at end of file +6c994354 \ No newline at end of file diff --git a/docs/dataset-formats/index.html b/docs/dataset-formats/index.html index 9f629d201..a3c260e46 100644 --- a/docs/dataset-formats/index.html +++ b/docs/dataset-formats/index.html @@ -357,7 +357,7 @@ Description - + Pre-training @@ -365,7 +365,7 @@ Description Data format for a pre-training completion task. - + Instruction Tuning @@ -373,7 +373,7 @@ Description Instruction tuning formats for supervised fine-tuning. - + Conversation @@ -381,7 +381,7 @@ Description Conversation format for supervised fine-tuning. - + Template-Free @@ -389,7 +389,7 @@ Description Construct prompts without a template. - + Custom Pre-Tokenized Dataset diff --git a/index.html b/index.html index 2afac44de..abb3ff068 100644 --- a/index.html +++ b/index.html @@ -356,7 +356,7 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin

Axolotl

-

tests multigpu-semi-weekly tests

+

tests tests-nightly multigpu-semi-weekly tests

Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.

Features: - Train various Huggingface models such as llama, pythia, falcon, mpt - Supports fullfinetune, lora, qlora, relora, and gptq - Customize configurations using a simple yaml file or CLI overwrite - Load different dataset formats, use custom formats, or bring your own tokenized datasets - Integrated with xformer, flash attention, rope scaling, and multipacking - Works with single GPU or multiple GPUs via FSDP or Deepspeed - Easily run with Docker locally or on the cloud - Log results and optionally checkpoints to wandb or mlflow - And more!

phorm.ai

diff --git a/sitemap.xml b/sitemap.xml index 9193952be..c730aa039 100644 --- a/sitemap.xml +++ b/sitemap.xml @@ -2,98 +2,98 @@ https://axolotl-ai-cloud.github.io/axolotl/index.html - 2024-08-22T17:11:07.261Z + 2024-08-22T17:13:43.607Z https://axolotl-ai-cloud.github.io/axolotl/FAQS.html - 2024-08-22T17:11:07.245Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/multipack.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/batch_vs_grad.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/input_output.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/multi-node.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/index.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/tokenized.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/template_free.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/faq.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/torchao.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.599Z https://axolotl-ai-cloud.github.io/axolotl/docs/nccl.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.599Z https://axolotl-ai-cloud.github.io/axolotl/TODO.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/config.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset_preprocessing.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/pretraining.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/inst_tune.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/conversation.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/mac.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/debugging.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/fsdp_qlora.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.595Z https://axolotl-ai-cloud.github.io/axolotl/docs/rlhf.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.599Z https://axolotl-ai-cloud.github.io/axolotl/docs/unsloth.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.599Z https://axolotl-ai-cloud.github.io/axolotl/examples/colab-notebooks/colab-axolotl-example.html - 2024-08-22T17:11:07.249Z + 2024-08-22T17:13:43.599Z