diff --git a/.nojekyll b/.nojekyll index b0532e970..e1b123edd 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -6fb18589 \ No newline at end of file +1d43a3d7 \ No newline at end of file diff --git a/FAQS.html b/FAQS.html index 3aa04ba1c..29023c65a 100644 --- a/FAQS.html +++ b/FAQS.html @@ -2,7 +2,7 @@ - + @@ -32,14 +32,15 @@ ul.task-list li input[type="checkbox"] { + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + diff --git a/docs/multi-gpu.html b/docs/multi-gpu.html index 9c110ec36..360512d02 100644 --- a/docs/multi-gpu.html +++ b/docs/multi-gpu.html @@ -2,7 +2,7 @@ - + @@ -67,14 +67,15 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin + - + - + diff --git a/docs/multi-node.html b/docs/multi-node.html index a4fd61d25..059e4f76e 100644 --- a/docs/multi-node.html +++ b/docs/multi-node.html @@ -2,7 +2,7 @@ - + @@ -68,14 +68,15 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + - + - + + @@ -67,14 +67,15 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin + - + - + - + - + @@ -128,7 +129,8 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
@@ -154,6 +156,10 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
-
import os
+
import os
 
 # Optionally, upload your own JSONL to your Google Drive
 GOOGLE_DRIVE_PATH = ""  # ex: "MyDrive/Colab\ Notebooks/train.jsonl"
@@ -585,7 +591,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
     # make sure file exists
     if not os.path.isfile(tmp_path):
         raise ValueError(f"File {tmp_path} does not exist")
-    dataset_id = tmp_path

+    dataset_id = tmp_path
@@ -593,7 +599,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});

Configure for Supervised Fine-Tuning (SFT)

-
from axolotl.cli.config import load_cfg
+
from axolotl.cli.config import load_cfg
 from axolotl.utils.dict import DictDefault
 
 # Axolotl provides full control and transparency over model and training configuration
@@ -657,7 +663,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
 )
 
 # validates the configuration
-cfg = load_cfg(config)

+cfg = load_cfg(config)
[2025-05-08 13:40:27,488] [INFO] [root.register:348] [PID:174] Attempting to load plugin: axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin
@@ -685,21 +691,21 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
-
from axolotl.utils import patch_optimized_env
+
from axolotl.utils import patch_optimized_env
 
 # speedup downloads from HF 🤗 and set "PYTORCH_CUDA_ALLOC_CONF" env to save memory
-patch_optimized_env()

+patch_optimized_env()

Datasets

Axolotl has a robust suite of loaders and transforms to parse most open datasets of any format into the appropriate chat template for your model. Axolotl will mask input tokens from the user’s prompt so that the train loss is only calculated against the model’s response. For more information, see our documentation on dataset preparation.

-
from axolotl.common.datasets import load_datasets
+
from axolotl.common.datasets import load_datasets
 
 # Load, parse and tokenize the datasets to be formatted with qwen3 chat template
 # Drop long samples from the dataset that overflow the max sequence length
-dataset_meta = load_datasets(cfg=cfg)

+dataset_meta = load_datasets(cfg=cfg)
+ - + - + + - + - + + - + - +