diff --git a/.nojekyll b/.nojekyll index 6327e7b51..49f83546d 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -c9feaaa0 \ No newline at end of file +db3e05af \ No newline at end of file diff --git a/FAQS.html b/FAQS.html index a7b1ed389..704b6bd90 100644 --- a/FAQS.html +++ b/FAQS.html @@ -2,7 +2,7 @@ - + diff --git a/TODO.html b/TODO.html index fb68aa769..1e0b66146 100644 --- a/TODO.html +++ b/TODO.html @@ -2,7 +2,7 @@ - + diff --git a/docs/batch_vs_grad.html b/docs/batch_vs_grad.html index d1d61d880..99c931882 100644 --- a/docs/batch_vs_grad.html +++ b/docs/batch_vs_grad.html @@ -2,7 +2,7 @@ - + diff --git a/docs/config.html b/docs/config.html index 8b27085b5..7677e1ba8 100644 --- a/docs/config.html +++ b/docs/config.html @@ -2,7 +2,7 @@ - + diff --git a/docs/dataset-formats/conversation.html b/docs/dataset-formats/conversation.html index 8cd975aae..9ed219fa4 100644 --- a/docs/dataset-formats/conversation.html +++ b/docs/dataset-formats/conversation.html @@ -2,7 +2,7 @@ - + diff --git a/docs/dataset-formats/index.html b/docs/dataset-formats/index.html index cf0d4e217..8d3268e22 100644 --- a/docs/dataset-formats/index.html +++ b/docs/dataset-formats/index.html @@ -2,7 +2,7 @@ - + @@ -357,7 +357,7 @@ Description - + Pre-training @@ -365,7 +365,7 @@ Description Data format for a pre-training completion task. - + Instruction Tuning @@ -373,7 +373,7 @@ Description Instruction tuning formats for supervised fine-tuning. - + Conversation @@ -381,7 +381,7 @@ Description Conversation format for supervised fine-tuning. - + Template-Free @@ -389,7 +389,7 @@ Description Construct prompts without a template. - + Custom Pre-Tokenized Dataset diff --git a/docs/dataset-formats/inst_tune.html b/docs/dataset-formats/inst_tune.html index 70e13d72c..eae8d10c2 100644 --- a/docs/dataset-formats/inst_tune.html +++ b/docs/dataset-formats/inst_tune.html @@ -2,7 +2,7 @@ - + diff --git a/docs/dataset-formats/pretraining.html b/docs/dataset-formats/pretraining.html index 6798fbfdf..adad8fdc8 100644 --- a/docs/dataset-formats/pretraining.html +++ b/docs/dataset-formats/pretraining.html @@ -2,7 +2,7 @@ - + diff --git a/docs/dataset-formats/template_free.html b/docs/dataset-formats/template_free.html index 8589008d5..eab6c14b9 100644 --- a/docs/dataset-formats/template_free.html +++ b/docs/dataset-formats/template_free.html @@ -2,7 +2,7 @@ - + diff --git a/docs/dataset-formats/tokenized.html b/docs/dataset-formats/tokenized.html index 2eb20208a..2409963e3 100644 --- a/docs/dataset-formats/tokenized.html +++ b/docs/dataset-formats/tokenized.html @@ -2,7 +2,7 @@ - + diff --git a/docs/dataset_preprocessing.html b/docs/dataset_preprocessing.html index 8632bbe80..b2bfee28a 100644 --- a/docs/dataset_preprocessing.html +++ b/docs/dataset_preprocessing.html @@ -2,7 +2,7 @@ - + diff --git a/docs/debugging.html b/docs/debugging.html index b5f4ca163..a5ead52bc 100644 --- a/docs/debugging.html +++ b/docs/debugging.html @@ -2,7 +2,7 @@ - + diff --git a/docs/faq.html b/docs/faq.html index 1dd498c09..497284121 100644 --- a/docs/faq.html +++ b/docs/faq.html @@ -2,7 +2,7 @@ - + diff --git a/docs/fsdp_qlora.html b/docs/fsdp_qlora.html index 5ee64778a..a5aff2d61 100644 --- a/docs/fsdp_qlora.html +++ b/docs/fsdp_qlora.html @@ -2,7 +2,7 @@ - + diff --git a/docs/input_output.html b/docs/input_output.html index be037c345..40f1b3d34 100644 --- a/docs/input_output.html +++ b/docs/input_output.html @@ -2,7 +2,7 @@ - + diff --git a/docs/mac.html b/docs/mac.html index 6f8fd5a85..0b04837cd 100644 --- a/docs/mac.html +++ b/docs/mac.html @@ -2,7 +2,7 @@ - + diff --git a/docs/multi-node.html b/docs/multi-node.html index 3c566b187..9805cd4bb 100644 --- a/docs/multi-node.html +++ b/docs/multi-node.html @@ -2,7 +2,7 @@ - + diff --git a/docs/multipack.html b/docs/multipack.html index f8ca73a50..70ae352cf 100644 --- a/docs/multipack.html +++ b/docs/multipack.html @@ -2,7 +2,7 @@ - + diff --git a/docs/nccl.html b/docs/nccl.html index ee556ae2e..81f8c8937 100644 --- a/docs/nccl.html +++ b/docs/nccl.html @@ -2,7 +2,7 @@ - + diff --git a/docs/rlhf.html b/docs/rlhf.html index ddd5bce96..4bcf7a951 100644 --- a/docs/rlhf.html +++ b/docs/rlhf.html @@ -2,7 +2,7 @@ - + diff --git a/docs/torchao.html b/docs/torchao.html index 8ac691ea8..0b2ef6a51 100644 --- a/docs/torchao.html +++ b/docs/torchao.html @@ -2,7 +2,7 @@ - + diff --git a/docs/unsloth.html b/docs/unsloth.html index 0fc85721c..1ddebb0f7 100644 --- a/docs/unsloth.html +++ b/docs/unsloth.html @@ -2,7 +2,7 @@ - + diff --git a/examples/colab-notebooks/colab-axolotl-example.html b/examples/colab-notebooks/colab-axolotl-example.html index b91f1fd40..fadddd82b 100644 --- a/examples/colab-notebooks/colab-axolotl-example.html +++ b/examples/colab-notebooks/colab-axolotl-example.html @@ -2,7 +2,7 @@ - + diff --git a/index.html b/index.html index 142f2d476..5bd40c1ca 100644 --- a/index.html +++ b/index.html @@ -2,7 +2,7 @@ - + @@ -358,7 +358,7 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin

Axolotl

tests tests-nightly multigpu-semi-weekly tests

Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.

-

Features: - Train various Huggingface models such as llama, pythia, falcon, mpt - Supports fullfinetune, lora, qlora, relora, and gptq - Customize configurations using a simple yaml file or CLI overwrite - Load different dataset formats, use custom formats, or bring your own tokenized datasets - Integrated with xformer, flash attention, rope scaling, and multipacking - Works with single GPU or multiple GPUs via FSDP or Deepspeed - Easily run with Docker locally or on the cloud - Log results and optionally checkpoints to wandb or mlflow - And more!

+

Features: - Train various Huggingface models such as llama, pythia, falcon, mpt - Supports fullfinetune, lora, qlora, relora, and gptq - Customize configurations using a simple yaml file or CLI overwrite - Load different dataset formats, use custom formats, or bring your own tokenized datasets - Integrated with xformer, flash attention, liger kernel, rope scaling, and multipacking - Works with single GPU or multiple GPUs via FSDP or Deepspeed - Easily run with Docker locally or on the cloud - Log results and optionally checkpoints to wandb or mlflow - And more!

phorm.ai

Axolotl supports

diff --git a/sitemap.xml b/sitemap.xml index e9ff72169..6ea8c41dd 100644 --- a/sitemap.xml +++ b/sitemap.xml @@ -2,102 +2,102 @@ https://axolotl-ai-cloud.github.io/axolotl/index.html - 2024-08-28T03:52:50.106Z + 2024-09-01T01:59:59.039Z https://axolotl-ai-cloud.github.io/axolotl/src/axolotl/integrations/LICENSE.html - 2024-08-28T03:52:50.110Z + 2024-09-01T01:59:59.039Z https://axolotl-ai-cloud.github.io/axolotl/docs/unsloth.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/docs/rlhf.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/docs/fsdp_qlora.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/debugging.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/mac.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/conversation.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/inst_tune.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/pretraining.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset_preprocessing.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/config.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/TODO.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/nccl.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/docs/torchao.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/docs/faq.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/template_free.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/tokenized.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/index.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/multi-node.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/docs/input_output.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/docs/batch_vs_grad.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/docs/multipack.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.027Z https://axolotl-ai-cloud.github.io/axolotl/FAQS.html - 2024-08-28T03:52:50.094Z + 2024-09-01T01:59:59.023Z https://axolotl-ai-cloud.github.io/axolotl/examples/colab-notebooks/colab-axolotl-example.html - 2024-08-28T03:52:50.098Z + 2024-09-01T01:59:59.027Z diff --git a/src/axolotl/integrations/LICENSE.html b/src/axolotl/integrations/LICENSE.html index d03454cf5..6e946ebe3 100644 --- a/src/axolotl/integrations/LICENSE.html +++ b/src/axolotl/integrations/LICENSE.html @@ -2,7 +2,7 @@ - +