Built site for gh-pages

.nojekyll

@@ -1 +1 @@
-1d43a3d7
+e807e5c1

docs/qat.html

@@ -544,10 +544,16 @@ and the QAT documentation in the <a href="https://github.com/pytorch/ao/tree/mai
 <h2 class="anchored" data-anchor-id="configuring-qat-in-axolotl">Configuring QAT in Axolotl</h2>
 <p>To enable QAT in axolotl, add the following to your configuration file:</p>
 <div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb1"><pre class="sourceCode yaml code-with-copy"><code class="sourceCode yaml"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a><span class="fu">qat</span><span class="kw">:</span></span>
-<span id="cb1-2"><a href="#cb1-2" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">activation_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for activation quantization. Valid options are "int4" and "int8"</span></span>
-<span id="cb1-3"><a href="#cb1-3" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">weight_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for weight quantization. Valid options are "int4" and "int8"</span></span>
+<span id="cb1-2"><a href="#cb1-2" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">activation_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for activation quantization. Valid options are "int4", "int8", "float8"</span></span>
+<span id="cb1-3"><a href="#cb1-3" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">weight_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for weight quantization. Valid options are "int4", "fp8", and "nvfp4".</span></span>
 <span id="cb1-4"><a href="#cb1-4" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">group_size</span><span class="kw">:</span><span class="co"> # Optional[int] = 32. The number of elements in each group for per-group fake quantization</span></span>
 <span id="cb1-5"><a href="#cb1-5" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">fake_quant_after_n_steps</span><span class="kw">:</span><span class="co"> # Optional[int] = None. The number of steps to apply fake quantization after</span></span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
+<p>We support the following quantization schemas:
+- <code>Int4WeightOnly</code> (requires the <code>fbgemm-gpu</code> extra when installing Axolotl)
+- <code>Int8DynamicActivationInt4Weight</code>
+- <code>Float8DynamicActivationFloat8Weight</code>
+- <code>Float8DynamicActivationInt4Weight</code>
+- <code>NVFP4</code></p>
 <p>Once you have finished training, you must quantize your model by using the same quantization configuration which you used to train the model with. You can use the <a href="../docs/quantize.html"><code>quantize</code></a> command to do this.</p>
 
 

docs/quantize.html

@@ -548,8 +548,8 @@ Note
 <p>Quantization is configured using the <code>quantization</code> key in your configuration file.</p>
 <div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb1"><pre class="sourceCode yaml code-with-copy"><code class="sourceCode yaml"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a><span class="fu">base_model</span><span class="kw">:</span><span class="co"> # The path to the model to quantize.</span></span>
 <span id="cb1-2"><a href="#cb1-2" aria-hidden="true" tabindex="-1"></a><span class="fu">quantization</span><span class="kw">:</span></span>
-<span id="cb1-3"><a href="#cb1-3" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">weight_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for weight quantization. Valid options are uintX for X in [1, 2, 3, 4, 5, 6, 7], or int4, or int8</span></span>
-<span id="cb1-4"><a href="#cb1-4" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">activation_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for activation quantization. Valid options are "int4" and "int8"</span></span>
+<span id="cb1-3"><a href="#cb1-3" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">activation_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for activation quantization. Valid options are "int4", "int8", "float8"</span></span>
+<span id="cb1-4"><a href="#cb1-4" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">weight_dtype</span><span class="kw">:</span><span class="co"> # Optional[str] = "int8". Fake quantization layout to use for weight quantization. Valid options are "int4", "fp8", and "nvfp4".</span></span>
 <span id="cb1-5"><a href="#cb1-5" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">group_size</span><span class="kw">:</span><span class="co"> # Optional[int] = 32. The number of elements in each group for per-group fake quantization</span></span>
 <span id="cb1-6"><a href="#cb1-6" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">quantize_embedding</span><span class="kw">:</span><span class="co"> # Optional[bool] = False. Whether to quantize the embedding layer.</span></span>
 <span id="cb1-7"><a href="#cb1-7" aria-hidden="true" tabindex="-1"></a></span>
@@ -560,11 +560,10 @@ you used to train the model:</p>
 <div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb2"><pre class="sourceCode yaml code-with-copy"><code class="sourceCode yaml"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a><span class="co"># qat.yml</span></span>
 <span id="cb2-2"><a href="#cb2-2" aria-hidden="true" tabindex="-1"></a><span class="fu">qat</span><span class="kw">:</span></span>
 <span id="cb2-3"><a href="#cb2-3" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">activation_dtype</span><span class="kw">:</span><span class="at"> int8</span></span>
-<span id="cb2-4"><a href="#cb2-4" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">weight_dtype</span><span class="kw">:</span><span class="at"> int8</span></span>
+<span id="cb2-4"><a href="#cb2-4" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">weight_dtype</span><span class="kw">:</span><span class="at"> int4</span></span>
 <span id="cb2-5"><a href="#cb2-5" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">group_size</span><span class="kw">:</span><span class="at"> </span><span class="dv">256</span></span>
-<span id="cb2-6"><a href="#cb2-6" aria-hidden="true" tabindex="-1"></a><span class="at">  </span><span class="fu">quantize_embedding</span><span class="kw">:</span><span class="at"> </span><span class="ch">true</span></span>
-<span id="cb2-7"><a href="#cb2-7" aria-hidden="true" tabindex="-1"></a></span>
-<span id="cb2-8"><a href="#cb2-8" aria-hidden="true" tabindex="-1"></a><span class="fu">output_dir</span><span class="kw">:</span><span class="co"> # The path to the output directory used during training where the final checkpoint has been saved.</span></span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
+<span id="cb2-6"><a href="#cb2-6" aria-hidden="true" tabindex="-1"></a></span>
+<span id="cb2-7"><a href="#cb2-7" aria-hidden="true" tabindex="-1"></a><span class="fu">output_dir</span><span class="kw">:</span><span class="co"> # The path to the output directory used during training where the final checkpoint has been saved.</span></span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
 <div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb3"><pre class="sourceCode bash code-with-copy"><code class="sourceCode bash"><span id="cb3-1"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a><span class="ex">axolotl</span> quantize qat.yml</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
 <p>This ensures that an identical quantization configuration is used to quantize the model as was used to train it.</p>
 <div class="callout callout-style-default callout-note callout-titled">

search.json

@@ -208,7 +208,7 @@
     "href": "docs/quantize.html#configuring-quantization-in-axolotl",
     "title": "Quantization with torchao",
     "section": "Configuring Quantization in Axolotl",
-    "text": "Configuring Quantization in Axolotl\nQuantization is configured using the quantization key in your configuration file.\nbase_model: # The path to the model to quantize.\nquantization:\n  weight_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for weight quantization. Valid options are uintX for X in [1, 2, 3, 4, 5, 6, 7], or int4, or int8\n  activation_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for activation quantization. Valid options are \"int4\" and \"int8\"\n  group_size: # Optional[int] = 32. The number of elements in each group for per-group fake quantization\n  quantize_embedding: # Optional[bool] = False. Whether to quantize the embedding layer.\n\noutput_dir:  # The path to the output directory.\nOnce quantization is complete, your quantized model will be saved in the {output_dir}/quantized directory.\nYou may also use the quantize command to quantize a model which has been trained with QAT - you can do this by using the existing QAT configuration file which\nyou used to train the model:\n# qat.yml\nqat:\n  activation_dtype: int8\n  weight_dtype: int8\n  group_size: 256\n  quantize_embedding: true\n\noutput_dir: # The path to the output directory used during training where the final checkpoint has been saved.\naxolotl quantize qat.yml\nThis ensures that an identical quantization configuration is used to quantize the model as was used to train it.\n\n\n\n\n\n\nNote\n\n\n\nIf you have configured pushing to hub with hub_model_id, your model hub name will have the quantization schema appended to it,\ne.g. axolotl-ai-cloud/qat-nvfp4-llama3B will become axolotl-ai-cloud/qat-nvfp4-llama3B-nvfp4w",
+    "text": "Configuring Quantization in Axolotl\nQuantization is configured using the quantization key in your configuration file.\nbase_model: # The path to the model to quantize.\nquantization:\n  activation_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for activation quantization. Valid options are \"int4\", \"int8\", \"float8\"\n  weight_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for weight quantization. Valid options are \"int4\", \"fp8\", and \"nvfp4\".\n  group_size: # Optional[int] = 32. The number of elements in each group for per-group fake quantization\n  quantize_embedding: # Optional[bool] = False. Whether to quantize the embedding layer.\n\noutput_dir:  # The path to the output directory.\nOnce quantization is complete, your quantized model will be saved in the {output_dir}/quantized directory.\nYou may also use the quantize command to quantize a model which has been trained with QAT - you can do this by using the existing QAT configuration file which\nyou used to train the model:\n# qat.yml\nqat:\n  activation_dtype: int8\n  weight_dtype: int4\n  group_size: 256\n\noutput_dir: # The path to the output directory used during training where the final checkpoint has been saved.\naxolotl quantize qat.yml\nThis ensures that an identical quantization configuration is used to quantize the model as was used to train it.\n\n\n\n\n\n\nNote\n\n\n\nIf you have configured pushing to hub with hub_model_id, your model hub name will have the quantization schema appended to it,\ne.g. axolotl-ai-cloud/qat-nvfp4-llama3B will become axolotl-ai-cloud/qat-nvfp4-llama3B-nvfp4w",
     "crumbs": [
       "How To Guides",
       "Quantization with torchao"
@@ -4038,7 +4038,7 @@
     "href": "docs/qat.html#configuring-qat-in-axolotl",
     "title": "Quantization Aware Training (QAT)",
     "section": "Configuring QAT in Axolotl",
-    "text": "Configuring QAT in Axolotl\nTo enable QAT in axolotl, add the following to your configuration file:\nqat:\n  activation_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for activation quantization. Valid options are \"int4\" and \"int8\"\n  weight_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for weight quantization. Valid options are \"int4\" and \"int8\"\n  group_size: # Optional[int] = 32. The number of elements in each group for per-group fake quantization\n  fake_quant_after_n_steps: # Optional[int] = None. The number of steps to apply fake quantization after\nOnce you have finished training, you must quantize your model by using the same quantization configuration which you used to train the model with. You can use the quantize command to do this.",
+    "text": "Configuring QAT in Axolotl\nTo enable QAT in axolotl, add the following to your configuration file:\nqat:\n  activation_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for activation quantization. Valid options are \"int4\", \"int8\", \"float8\"\n  weight_dtype: # Optional[str] = \"int8\". Fake quantization layout to use for weight quantization. Valid options are \"int4\", \"fp8\", and \"nvfp4\".\n  group_size: # Optional[int] = 32. The number of elements in each group for per-group fake quantization\n  fake_quant_after_n_steps: # Optional[int] = None. The number of steps to apply fake quantization after\nWe support the following quantization schemas:\n- Int4WeightOnly (requires the fbgemm-gpu extra when installing Axolotl)\n- Int8DynamicActivationInt4Weight\n- Float8DynamicActivationFloat8Weight\n- Float8DynamicActivationInt4Weight\n- NVFP4\nOnce you have finished training, you must quantize your model by using the same quantization configuration which you used to train the model with. You can use the quantize command to do this.",
     "crumbs": [
       "How To Guides",
       "Quantization Aware Training (QAT)"

sitemap.xml

@@ -2,794 +2,794 @@
 <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
   <url>
     <loc>https://docs.axolotl.ai/examples/colab-notebooks/colab-axolotl-example.html</loc>
-    <lastmod>2025-09-16T18:53:10.076Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.776Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/src/axolotl/integrations/LICENSE.html</loc>
-    <lastmod>2025-09-16T18:53:10.093Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.792Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/FAQS.html</loc>
-    <lastmod>2025-09-16T18:53:10.066Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.766Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/unsloth.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.772Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/reward_modelling.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/docker.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/batch_vs_grad.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.767Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/streaming.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.772Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/nccl.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/quantize.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/nd_parallelism.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/custom_integrations.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.767Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/debugging.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/gradient_checkpointing.html</loc>
-    <lastmod>2025-09-16T18:53:10.069Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/multimodal.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset_loading.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/integrations.spectrum.args.html</loc>
-    <lastmod>2025-09-16T18:56:42.167Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.684Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/loaders.adapter.html</loc>
-    <lastmod>2025-09-16T18:56:41.303Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.825Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.builders.base.html</loc>
-    <lastmod>2025-09-16T18:56:40.934Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.462Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.merge_sharded_fsdp_weights.html</loc>
-    <lastmod>2025-09-16T18:56:41.138Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.662Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.cloud.modal_.html</loc>
-    <lastmod>2025-09-16T18:56:41.168Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.692Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.stablelm_attn_hijack_flash.html</loc>
-    <lastmod>2025-09-16T18:56:41.723Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.244Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/integrations.kd.trainer.html</loc>
-    <lastmod>2025-09-16T18:56:42.157Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.674Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.delinearize_llama4.html</loc>
-    <lastmod>2025-09-16T18:56:41.103Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.627Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.evaluate.html</loc>
-    <lastmod>2025-09-16T18:56:41.049Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.575Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.model.html</loc>
-    <lastmod>2025-09-16T18:56:41.936Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.454Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.art.html</loc>
-    <lastmod>2025-09-16T18:56:41.073Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.598Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.llama3.html</loc>
-    <lastmod>2025-09-16T18:56:41.487Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.009Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.chat.format.llama3x.html</loc>
-    <lastmod>2025-09-16T18:56:40.983Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.510Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.kto.chatml.html</loc>
-    <lastmod>2025-09-16T18:56:41.518Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.040Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.args.html</loc>
-    <lastmod>2025-09-16T18:56:41.070Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.594Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.gradient_checkpointing.offload_cpu.html</loc>
-    <lastmod>2025-09-16T18:56:41.749Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.269Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/evaluate.html</loc>
-    <lastmod>2025-09-16T18:56:40.857Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.384Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.input_output.html</loc>
-    <lastmod>2025-09-16T18:56:41.449Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.971Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.vllm_serve.html</loc>
-    <lastmod>2025-09-16T18:56:41.158Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.682Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.quantize.html</loc>
-    <lastmod>2025-09-16T18:56:41.151Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.675Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.utils.sweeps.html</loc>
-    <lastmod>2025-09-16T18:56:41.198Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.722Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.builders.rl.html</loc>
-    <lastmod>2025-09-16T18:56:40.944Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.472Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.chatml.html</loc>
-    <lastmod>2025-09-16T18:56:41.497Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.019Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.metharme.html</loc>
-    <lastmod>2025-09-16T18:56:41.460Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.982Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.passthrough.html</loc>
-    <lastmod>2025-09-16T18:56:41.502Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.023Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.datasets.chat.html</loc>
-    <lastmod>2025-09-16T18:56:40.989Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.517Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.distributed.html</loc>
-    <lastmod>2025-09-16T18:56:41.871Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.390Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/integrations.base.html</loc>
-    <lastmod>2025-09-16T18:56:42.144Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.662Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/index.html</loc>
-    <lastmod>2025-09-16T18:56:40.787Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.315Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.gradient_checkpointing.offload_disk.html</loc>
-    <lastmod>2025-09-16T18:56:41.775Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.295Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.quantization.html</loc>
-    <lastmod>2025-09-16T18:56:41.913Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.431Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.dict.html</loc>
-    <lastmod>2025-09-16T18:56:41.877Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.396Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.dpo.trainer.html</loc>
-    <lastmod>2025-09-16T18:56:41.253Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.776Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.config.html</loc>
-    <lastmod>2025-09-16T18:56:41.929Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.447Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.orcamini.html</loc>
-    <lastmod>2025-09-16T18:56:41.464Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.986Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.collators.mamba.html</loc>
-    <lastmod>2025-09-16T18:56:42.213Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.728Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/datasets.html</loc>
-    <lastmod>2025-09-16T18:56:40.863Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.391Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/convert.html</loc>
-    <lastmod>2025-09-16T18:56:40.876Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.404Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.kto.llama3.html</loc>
-    <lastmod>2025-09-16T18:56:41.510Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.032Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.tokenization.html</loc>
-    <lastmod>2025-09-16T18:56:41.782Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.302Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.base.html</loc>
-    <lastmod>2025-09-16T18:56:41.225Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.748Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_expand_mask.html</loc>
-    <lastmod>2025-09-16T18:56:41.677Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.198Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/loaders.model.html</loc>
-    <lastmod>2025-09-16T18:56:41.288Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.810Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/logging_config.html</loc>
-    <lastmod>2025-09-16T18:56:40.928Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.456Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.chat.format.shared.html</loc>
-    <lastmod>2025-09-16T18:56:40.984Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.512Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/models.mamba.modeling_mamba.html</loc>
-    <lastmod>2025-09-16T18:56:42.186Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.704Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.enums.html</loc>
-    <lastmod>2025-09-16T18:56:42.000Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.518Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.callbacks.profiler.html</loc>
-    <lastmod>2025-09-16T18:56:42.269Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.783Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.bench.html</loc>
-    <lastmod>2025-09-16T18:56:41.798Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.317Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.samplers.multipack.html</loc>
-    <lastmod>2025-09-16T18:56:42.259Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.773Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.mamba.html</loc>
-    <lastmod>2025-09-16T18:56:41.246Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.769Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_chat.html</loc>
-    <lastmod>2025-09-16T18:56:41.403Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.925Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.btlm_attn_hijack_flash.html</loc>
-    <lastmod>2025-09-16T18:56:41.716Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.236Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.chat.messages.html</loc>
-    <lastmod>2025-09-16T18:56:40.980Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.507Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_patch_multipack.html</loc>
-    <lastmod>2025-09-16T18:56:41.717Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.238Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.mixtral.html</loc>
-    <lastmod>2025-09-16T18:56:41.745Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.265Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.mixins.scheduler.html</loc>
-    <lastmod>2025-09-16T18:56:41.330Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.852Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/loaders.patch_manager.html</loc>
-    <lastmod>2025-09-16T18:56:41.313Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.835Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.optimizers.adopt.html</loc>
-    <lastmod>2025-09-16T18:56:41.884Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.403Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_attn_hijack_xformers.html</loc>
-    <lastmod>2025-09-16T18:56:41.669Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.190Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.callbacks.perplexity.html</loc>
-    <lastmod>2025-09-16T18:56:42.266Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.780Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/loaders.tokenizer.html</loc>
-    <lastmod>2025-09-16T18:56:41.296Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.819Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.pygmalion.html</loc>
-    <lastmod>2025-09-16T18:56:41.471Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.993Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.lora.html</loc>
-    <lastmod>2025-09-16T18:56:41.789Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.308Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.user_defined.html</loc>
-    <lastmod>2025-09-16T18:56:41.424Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.946Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.mixins.rng_state_loader.html</loc>
-    <lastmod>2025-09-16T18:56:41.323Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.846Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.user_defined.html</loc>
-    <lastmod>2025-09-16T18:56:41.500Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.022Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/kernels.swiglu.html</loc>
-    <lastmod>2025-09-16T18:56:41.653Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.174Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.multimodal.html</loc>
-    <lastmod>2025-09-16T18:56:41.978Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.497Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.main.html</loc>
-    <lastmod>2025-09-16T18:56:41.032Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.559Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.ctx_managers.sequence_parallel.html</loc>
-    <lastmod>2025-09-16T18:56:41.354Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.876Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.multipack.html</loc>
-    <lastmod>2025-09-16T18:56:41.672Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.193Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.chat.format.chatml.html</loc>
-    <lastmod>2025-09-16T18:56:40.981Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.509Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.cloud.base.html</loc>
-    <lastmod>2025-09-16T18:56:41.162Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.686Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.trl.html</loc>
-    <lastmod>2025-09-16T18:56:41.240Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.763Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/mixed_precision.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/installation.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/mac.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/sequence_parallelism.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.772Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/faq.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset-formats/tokenized.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset-formats/stepwise_supervised.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset-formats/pretraining.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset-formats/template_free.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset-formats/index.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.767Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset-formats/conversation.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.767Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset-formats/inst_tune.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/lr_groups.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/inference.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/lora_optims.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/multipack.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/amd_hpc.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.767Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.trainer_fsdp_optim.html</loc>
-    <lastmod>2025-09-16T18:56:41.727Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.247Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.inference.html</loc>
-    <lastmod>2025-09-16T18:56:41.118Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.642Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.collators.mm_chat.html</loc>
-    <lastmod>2025-09-16T18:56:42.218Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.732Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.model_shard_quant.html</loc>
-    <lastmod>2025-09-16T18:56:41.794Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.314Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_attn_hijack_flash.html</loc>
-    <lastmod>2025-09-16T18:56:41.668Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.189Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/integrations.grokfast.optimizer.html</loc>
-    <lastmod>2025-09-16T18:56:42.149Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.666Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.training.html</loc>
-    <lastmod>2025-09-16T18:56:41.943Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.461Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.integrations.html</loc>
-    <lastmod>2025-09-16T18:56:41.991Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.509Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.utils.html</loc>
-    <lastmod>2025-09-16T18:56:42.005Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.523Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.checks.html</loc>
-    <lastmod>2025-09-16T18:56:41.080Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.604Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.callbacks.qat.html</loc>
-    <lastmod>2025-09-16T18:56:42.285Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.799Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.mistral_attn_hijack_flash.html</loc>
-    <lastmod>2025-09-16T18:56:41.671Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.192Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.data.sft.html</loc>
-    <lastmod>2025-09-16T18:56:41.892Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.411Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.chat_templates.html</loc>
-    <lastmod>2025-09-16T18:56:41.784Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.303Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.utils.html</loc>
-    <lastmod>2025-09-16T18:56:41.714Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.235Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.utils.fetch.html</loc>
-    <lastmod>2025-09-16T18:56:41.186Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.710Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.builders.causal.html</loc>
-    <lastmod>2025-09-16T18:56:40.939Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.467Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.trl.html</loc>
-    <lastmod>2025-09-16T18:56:41.973Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.491Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.data.streaming.html</loc>
-    <lastmod>2025-09-16T18:56:41.886Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.405Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.unsloth_.html</loc>
-    <lastmod>2025-09-16T18:56:41.735Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.255Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.base.html</loc>
-    <lastmod>2025-09-16T18:56:41.355Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.878Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.merge_lora.html</loc>
-    <lastmod>2025-09-16T18:56:41.126Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.650Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_instruct.html</loc>
-    <lastmod>2025-09-16T18:56:41.404Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.926Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/loaders.constants.html</loc>
-    <lastmod>2025-09-16T18:56:41.314Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.837Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.transformers_fa_utils.html</loc>
-    <lastmod>2025-09-16T18:56:41.733Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.253Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.relora.html</loc>
-    <lastmod>2025-09-16T18:56:41.676Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.197Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schedulers.html</loc>
-    <lastmod>2025-09-16T18:56:41.851Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.370Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/kernels.lora.html</loc>
-    <lastmod>2025-09-16T18:56:41.632Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.153Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.collators.batching.html</loc>
-    <lastmod>2025-09-16T18:56:42.209Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.724Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.completion.html</loc>
-    <lastmod>2025-09-16T18:56:41.443Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.965Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.grpo.trainer.html</loc>
-    <lastmod>2025-09-16T18:56:41.264Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.787Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/common.architectures.html</loc>
-    <lastmod>2025-09-16T18:56:42.168Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.686Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.utils.html</loc>
-    <lastmod>2025-09-16T18:56:41.169Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.693Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.orpo.chat_template.html</loc>
-    <lastmod>2025-09-16T18:56:41.540Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.061Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.training_args.html</loc>
-    <lastmod>2025-09-16T18:56:40.957Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.484Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.datasets.html</loc>
-    <lastmod>2025-09-16T18:56:41.961Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.479Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.chat_template.html</loc>
-    <lastmod>2025-09-16T18:56:41.389Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.911Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_w_system.html</loc>
-    <lastmod>2025-09-16T18:56:41.416Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.938Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/integrations.cut_cross_entropy.args.html</loc>
-    <lastmod>2025-09-16T18:56:42.148Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.665Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/common.const.html</loc>
-    <lastmod>2025-09-16T18:56:42.170Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.687Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.lora_kernels.html</loc>
-    <lastmod>2025-09-16T18:56:41.706Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.227Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/kernels.quantize.html</loc>
-    <lastmod>2025-09-16T18:56:41.661Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.182Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.config.html</loc>
-    <lastmod>2025-09-16T18:56:41.098Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.622Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.llama2_chat.html</loc>
-    <lastmod>2025-09-16T18:56:41.437Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.959Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.zephyr.html</loc>
-    <lastmod>2025-09-16T18:56:41.499Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.020Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/kernels.geglu.html</loc>
-    <lastmod>2025-09-16T18:56:41.643Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.164Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.freeze.html</loc>
-    <lastmod>2025-09-16T18:56:41.806Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.325Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.callbacks.mlflow_.html</loc>
-    <lastmod>2025-09-16T18:56:42.275Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.788Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.grpo.sampler.html</loc>
-    <lastmod>2025-09-16T18:56:41.276Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.799Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.utils.train.html</loc>
-    <lastmod>2025-09-16T18:56:41.210Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.734Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.utils.load.html</loc>
-    <lastmod>2025-09-16T18:56:41.192Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.716Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.collators.core.html</loc>
-    <lastmod>2025-09-16T18:56:42.188Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.705Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/integrations.liger.args.html</loc>
-    <lastmod>2025-09-16T18:56:42.160Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.677Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.preprocess.html</loc>
-    <lastmod>2025-09-16T18:56:41.146Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.671Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/kernels.utils.html</loc>
-    <lastmod>2025-09-16T18:56:41.662Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.183Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.callbacks.lisa.html</loc>
-    <lastmod>2025-09-16T18:56:42.271Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.785Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/monkeypatch.data.batch_dataset_fetcher.html</loc>
-    <lastmod>2025-09-16T18:56:41.744Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.264Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.mixins.optimizer.html</loc>
-    <lastmod>2025-09-16T18:56:41.320Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.842Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/loaders.processor.html</loc>
-    <lastmod>2025-09-16T18:56:41.297Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.820Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.trainers.utils.html</loc>
-    <lastmod>2025-09-16T18:56:41.278Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.801Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.chat_template.html</loc>
-    <lastmod>2025-09-16T18:56:41.476Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.998Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_tokenizers.html</loc>
-    <lastmod>2025-09-16T18:56:40.918Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.446Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.callbacks.comet_.html</loc>
-    <lastmod>2025-09-16T18:56:42.278Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.792Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/core.datasets.transforms.chat_builder.html</loc>
-    <lastmod>2025-09-16T18:56:40.997Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.525Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.trainer.html</loc>
-    <lastmod>2025-09-16T18:56:41.823Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.343Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.train.html</loc>
-    <lastmod>2025-09-16T18:56:41.041Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.567Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/integrations.lm_eval.args.html</loc>
-    <lastmod>2025-09-16T18:56:42.163Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.681Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.messages.chat.html</loc>
-    <lastmod>2025-09-16T18:56:41.475Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.997Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/utils.schemas.peft.html</loc>
-    <lastmod>2025-09-16T18:56:41.970Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.488Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.bradley_terry.llama3.html</loc>
-    <lastmod>2025-09-16T18:56:41.544Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.065Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/cli.utils.args.html</loc>
-    <lastmod>2025-09-16T18:56:41.181Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.705Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.stepwise_supervised.html</loc>
-    <lastmod>2025-09-16T18:56:41.453Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.975Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/common.datasets.html</loc>
-    <lastmod>2025-09-16T18:56:42.185Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.703Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/prompt_strategies.kto.user_defined.html</loc>
-    <lastmod>2025-09-16T18:56:41.519Z</lastmod>
+    <lastmod>2025-09-17T09:41:55.041Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/api/train.html</loc>
-    <lastmod>2025-09-16T18:56:40.846Z</lastmod>
+    <lastmod>2025-09-17T09:41:54.374Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/multi-node.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/input_output.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/ray-integration.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/getting-started.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/optimizers.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/multi-gpu.html</loc>
-    <lastmod>2025-09-16T18:53:10.071Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/dataset_preprocessing.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/torchao.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.772Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/config-reference.html</loc>
-    <lastmod>2025-09-16T18:56:57.625Z</lastmod>
+    <lastmod>2025-09-17T09:42:11.046Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/rlhf.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.772Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/cli.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.767Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/fsdp_qlora.html</loc>
-    <lastmod>2025-09-16T18:53:10.068Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.768Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/docs/qat.html</loc>
-    <lastmod>2025-09-16T18:53:10.072Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.771Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/src/axolotl/integrations/cut_cross_entropy/ACKNOWLEDGEMENTS.html</loc>
-    <lastmod>2025-09-16T18:53:10.093Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.792Z</lastmod>
   </url>
   <url>
     <loc>https://docs.axolotl.ai/index.html</loc>
-    <lastmod>2025-09-16T18:53:10.088Z</lastmod>
+    <lastmod>2025-09-17T09:38:24.788Z</lastmod>
   </url>
 </urlset>