Built site for gh-pages

This commit is contained in:
Quarto GHA Workflow Runner
2025-04-09 06:55:50 +00:00
parent c36ff6ab70
commit 1180757295
5 changed files with 210 additions and 178 deletions

View File

@@ -1 +1 @@
c64b1d3f
76f28c70

1
CNAME
View File

@@ -1 +0,0 @@
docs.axolotl.ai

View File

@@ -446,6 +446,10 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin
<ul>
<li><a href="#axolotl.monkeypatch.lora_kernels" id="toc-axolotl.monkeypatch.lora_kernels" class="nav-link active" data-scroll-target="#axolotl.monkeypatch.lora_kernels">monkeypatch.lora_kernels</a>
<ul class="collapse">
<li><a href="#classes" id="toc-classes" class="nav-link" data-scroll-target="#classes">Classes</a>
<ul class="collapse">
<li><a href="#axolotl.monkeypatch.lora_kernels.FakeMLP" id="toc-axolotl.monkeypatch.lora_kernels.FakeMLP" class="nav-link" data-scroll-target="#axolotl.monkeypatch.lora_kernels.FakeMLP">FakeMLP</a></li>
</ul></li>
<li><a href="#functions" id="toc-functions" class="nav-link" data-scroll-target="#functions">Functions</a>
<ul class="collapse">
<li><a href="#axolotl.monkeypatch.lora_kernels.apply_lora_kernel_patches" id="toc-axolotl.monkeypatch.lora_kernels.apply_lora_kernel_patches" class="nav-link" data-scroll-target="#axolotl.monkeypatch.lora_kernels.apply_lora_kernel_patches">apply_lora_kernel_patches</a></li>
@@ -468,6 +472,28 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin
<h1>monkeypatch.lora_kernels</h1>
<p><code>monkeypatch.lora_kernels</code></p>
<p>Module for patching custom LoRA Triton kernels and <code>torch.autograd</code> functions.</p>
<section id="classes" class="level2">
<h2 class="anchored" data-anchor-id="classes">Classes</h2>
<table class="caption-top table">
<thead>
<tr class="header">
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td><a href="#axolotl.monkeypatch.lora_kernels.FakeMLP">FakeMLP</a></td>
<td>placeholder MLP for triton patching</td>
</tr>
</tbody>
</table>
<section id="axolotl.monkeypatch.lora_kernels.FakeMLP" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.monkeypatch.lora_kernels.FakeMLP">FakeMLP</h3>
<div class="sourceCode" id="cb1"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.FakeMLP(<span class="va">self</span>, gate_proj, up_proj, down_proj)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>placeholder MLP for triton patching</p>
</section>
</section>
<section id="functions" class="level2">
<h2 class="anchored" data-anchor-id="functions">Functions</h2>
<table class="caption-top table">
@@ -502,7 +528,7 @@ pre > code.sourceCode > span > a:first-child::before { text-decoration: underlin
</table>
<section id="axolotl.monkeypatch.lora_kernels.apply_lora_kernel_patches" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.monkeypatch.lora_kernels.apply_lora_kernel_patches">apply_lora_kernel_patches</h3>
<div class="sourceCode" id="cb1"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.apply_lora_kernel_patches(model, cfg)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<div class="sourceCode" id="cb2"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.apply_lora_kernel_patches(model, cfg)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Applies optimized Triton kernel patches to a PEFT model.</p>
<p>Patches a PEFT model with optimized implementations for MLP and attention
computations. The optimizations include custom Triton kernels for activation
@@ -606,7 +632,7 @@ function will skip patching if these conditions arent met.</p>
</section>
<section id="axolotl.monkeypatch.lora_kernels.get_attention_cls_from_config" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.monkeypatch.lora_kernels.get_attention_cls_from_config">get_attention_cls_from_config</h3>
<div class="sourceCode" id="cb2"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.get_attention_cls_from_config(cfg)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<div class="sourceCode" id="cb3"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb3-1"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.get_attention_cls_from_config(cfg)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Get the appropriate attention class by inspecting the model config.
Uses dynamic import to support any model architecture that follows
the standard transformers naming convention.</p>
@@ -693,7 +719,7 @@ the standard transformers naming convention.</p>
</section>
<section id="axolotl.monkeypatch.lora_kernels.original_apply_o" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.monkeypatch.lora_kernels.original_apply_o">original_apply_o</h3>
<div class="sourceCode" id="cb3"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb3-1"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.original_apply_o(<span class="va">self</span>, hidden_states)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<div class="sourceCode" id="cb4"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb4-1"><a href="#cb4-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.original_apply_o(<span class="va">self</span>, hidden_states)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Original implementation of output projection without optimizations.</p>
<section id="parameters-2" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-2">Parameters</h4>
@@ -750,7 +776,7 @@ the standard transformers naming convention.</p>
</section>
<section id="axolotl.monkeypatch.lora_kernels.original_apply_qkv" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.monkeypatch.lora_kernels.original_apply_qkv">original_apply_qkv</h3>
<div class="sourceCode" id="cb4"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb4-1"><a href="#cb4-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.original_apply_qkv(<span class="va">self</span>, hidden_states)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<div class="sourceCode" id="cb5"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb5-1"><a href="#cb5-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.original_apply_qkv(<span class="va">self</span>, hidden_states)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Original implementation of QKV projection without optimizations.</p>
<section id="parameters-3" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-3">Parameters</h4>
@@ -812,7 +838,7 @@ the standard transformers naming convention.</p>
</section>
<section id="axolotl.monkeypatch.lora_kernels.patch_self_attn_lora" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.monkeypatch.lora_kernels.patch_self_attn_lora">patch_self_attn_lora</h3>
<div class="sourceCode" id="cb5"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb5-1"><a href="#cb5-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.patch_self_attn_lora(cfg)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<div class="sourceCode" id="cb6"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb6-1"><a href="#cb6-1" aria-hidden="true" tabindex="-1"></a>monkeypatch.lora_kernels.patch_self_attn_lora(cfg)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Given an <code>axolotl</code> config, this method patches the inferred attention class forward
pass with optimized LoRA implementations.</p>
<p>It modifies the attention class to use optimized QKV and output projections. The

View File

@@ -2807,7 +2807,14 @@
"href": "docs/api/monkeypatch.lora_kernels.html",
"title": "monkeypatch.lora_kernels",
"section": "",
"text": "monkeypatch.lora_kernels\nModule for patching custom LoRA Triton kernels and torch.autograd functions.\n\n\n\n\n\nName\nDescription\n\n\n\n\napply_lora_kernel_patches\nApplies optimized Triton kernel patches to a PEFT model.\n\n\nget_attention_cls_from_config\nGet the appropriate attention class by inspecting the model config.\n\n\noriginal_apply_o\nOriginal implementation of output projection without optimizations.\n\n\noriginal_apply_qkv\nOriginal implementation of QKV projection without optimizations.\n\n\npatch_self_attn_lora\nGiven an axolotl config, this method patches the inferred attention class forward\n\n\n\n\n\nmonkeypatch.lora_kernels.apply_lora_kernel_patches(model, cfg)\nApplies optimized Triton kernel patches to a PEFT model.\nPatches a PEFT model with optimized implementations for MLP and attention\ncomputations. The optimizations include custom Triton kernels for activation\nfunctions and specialized autograd functions for LoRA computations.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nmodel\nPeftModelForCausalLM\nA PEFT model to be patched with optimized kernels.\nrequired\n\n\ncfg\nDictDefault\nDictionary mapping axolotl config keys to values.\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\nPeftModelForCausalLM\nPeftModelForCausalLM\nThe patched model with optimized kernels.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nTypeError\nIf the provided model is not a PeftModelForCausalLM.\n\n\n\nNotImplementedError\nIf the model type is not supported.\n\n\n\nAssertionError\nIf multiple adapters are active (currently unsupported).\n\n\n\n\n\n\nThe optimizations require LoRA adapters with no dropout and no bias terms. The\nfunction will skip patching if these conditions arent met.\n\n\n\n\nmonkeypatch.lora_kernels.get_attention_cls_from_config(cfg)\nGet the appropriate attention class by inspecting the model config.\nUses dynamic import to support any model architecture that follows\nthe standard transformers naming convention.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\ncfg\nDictDefault\nDictionary mapping axolotl config keys to values.\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nType[nn.Module]\nThe appropriate attention class for the model.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nValueError\nIf base_model not specified or attention class cannot be imported\n\n\n\nImportError\nIf the model module or attention class doesnt exist\n\n\n\n\n\n\n\nmonkeypatch.lora_kernels.original_apply_o(self, hidden_states)\nOriginal implementation of output projection without optimizations.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nself\nnn.Module\nThe attention module instance.\nrequired\n\n\nhidden_states\ntorch.Tensor\nInput tensor of shape [batch_size, seq_len, hidden_dim]`.\nrequired\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\ntorch.Tensor\nThe output projection result.\n\n\n\n\n\n\n\nmonkeypatch.lora_kernels.original_apply_qkv(self, hidden_states)\nOriginal implementation of QKV projection without optimizations.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nself\nnn.Module\nThe attention module instance.\nrequired\n\n\nhidden_states\ntorch.Tensor\nInput tensor of shape [batch_size, seq_len, hidden_dim].\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\ntuple[torch.Tensor, torch.Tensor, torch.Tensor]\nA tuple (query_states, key_states, value_states) containing the projected states for query, key, and value.\n\n\n\n\n\n\n\nmonkeypatch.lora_kernels.patch_self_attn_lora(cfg)\nGiven an axolotl config, this method patches the inferred attention class forward\npass with optimized LoRA implementations.\nIt modifies the attention class to use optimized QKV and output projections. The\noriginal implementation is preserved and can be restored if needed.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\ncfg\nDictDefault\nDictionary mapping axolotl config keys to values.\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nAssertionError\nIf the required code blocks are not found in the attention implementation."
"text": "monkeypatch.lora_kernels\nModule for patching custom LoRA Triton kernels and torch.autograd functions.\n\n\n\n\n\nName\nDescription\n\n\n\n\nFakeMLP\nplaceholder MLP for triton patching\n\n\n\n\n\nmonkeypatch.lora_kernels.FakeMLP(self, gate_proj, up_proj, down_proj)\nplaceholder MLP for triton patching\n\n\n\n\n\n\n\nName\nDescription\n\n\n\n\napply_lora_kernel_patches\nApplies optimized Triton kernel patches to a PEFT model.\n\n\nget_attention_cls_from_config\nGet the appropriate attention class by inspecting the model config.\n\n\noriginal_apply_o\nOriginal implementation of output projection without optimizations.\n\n\noriginal_apply_qkv\nOriginal implementation of QKV projection without optimizations.\n\n\npatch_self_attn_lora\nGiven an axolotl config, this method patches the inferred attention class forward\n\n\n\n\n\nmonkeypatch.lora_kernels.apply_lora_kernel_patches(model, cfg)\nApplies optimized Triton kernel patches to a PEFT model.\nPatches a PEFT model with optimized implementations for MLP and attention\ncomputations. The optimizations include custom Triton kernels for activation\nfunctions and specialized autograd functions for LoRA computations.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nmodel\nPeftModelForCausalLM\nA PEFT model to be patched with optimized kernels.\nrequired\n\n\ncfg\nDictDefault\nDictionary mapping axolotl config keys to values.\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\nPeftModelForCausalLM\nPeftModelForCausalLM\nThe patched model with optimized kernels.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nTypeError\nIf the provided model is not a PeftModelForCausalLM.\n\n\n\nNotImplementedError\nIf the model type is not supported.\n\n\n\nAssertionError\nIf multiple adapters are active (currently unsupported).\n\n\n\n\n\n\nThe optimizations require LoRA adapters with no dropout and no bias terms. The\nfunction will skip patching if these conditions arent met.\n\n\n\n\nmonkeypatch.lora_kernels.get_attention_cls_from_config(cfg)\nGet the appropriate attention class by inspecting the model config.\nUses dynamic import to support any model architecture that follows\nthe standard transformers naming convention.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\ncfg\nDictDefault\nDictionary mapping axolotl config keys to values.\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nType[nn.Module]\nThe appropriate attention class for the model.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nValueError\nIf base_model not specified or attention class cannot be imported\n\n\n\nImportError\nIf the model module or attention class doesnt exist\n\n\n\n\n\n\n\nmonkeypatch.lora_kernels.original_apply_o(self, hidden_states)\nOriginal implementation of output projection without optimizations.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nself\nnn.Module\nThe attention module instance.\nrequired\n\n\nhidden_states\ntorch.Tensor\nInput tensor of shape [batch_size, seq_len, hidden_dim]`.\nrequired\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\ntorch.Tensor\nThe output projection result.\n\n\n\n\n\n\n\nmonkeypatch.lora_kernels.original_apply_qkv(self, hidden_states)\nOriginal implementation of QKV projection without optimizations.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\nself\nnn.Module\nThe attention module instance.\nrequired\n\n\nhidden_states\ntorch.Tensor\nInput tensor of shape [batch_size, seq_len, hidden_dim].\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\ntuple[torch.Tensor, torch.Tensor, torch.Tensor]\nA tuple (query_states, key_states, value_states) containing the projected states for query, key, and value.\n\n\n\n\n\n\n\nmonkeypatch.lora_kernels.patch_self_attn_lora(cfg)\nGiven an axolotl config, this method patches the inferred attention class forward\npass with optimized LoRA implementations.\nIt modifies the attention class to use optimized QKV and output projections. The\noriginal implementation is preserved and can be restored if needed.\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\nDefault\n\n\n\n\ncfg\nDictDefault\nDictionary mapping axolotl config keys to values.\nrequired\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nName\nType\nDescription\n\n\n\n\n\nAssertionError\nIf the required code blocks are not found in the attention implementation."
},
{
"objectID": "docs/api/monkeypatch.lora_kernels.html#classes",
"href": "docs/api/monkeypatch.lora_kernels.html#classes",
"title": "monkeypatch.lora_kernels",
"section": "",
"text": "Name\nDescription\n\n\n\n\nFakeMLP\nplaceholder MLP for triton patching\n\n\n\n\n\nmonkeypatch.lora_kernels.FakeMLP(self, gate_proj, up_proj, down_proj)\nplaceholder MLP for triton patching"
},
{
"objectID": "docs/api/monkeypatch.lora_kernels.html#functions",

View File

@@ -2,682 +2,682 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/examples/colab-notebooks/colab-axolotl-example.html</loc>
<lastmod>2025-04-07T21:12:39.574Z</lastmod>
<lastmod>2025-04-09T06:53:29.055Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/stepwise_supervised.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/template_free.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/tokenized.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/nccl.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/amd_hpc.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/config.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/multi-gpu.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/installation.html</loc>
<lastmod>2025-04-07T21:12:39.572Z</lastmod>
<lastmod>2025-04-09T06:53:29.053Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/torchao.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/reward_modelling.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/input_output.html</loc>
<lastmod>2025-04-07T21:12:39.572Z</lastmod>
<lastmod>2025-04-09T06:53:29.053Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/multimodal.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.callbacks.mlflow_.html</loc>
<lastmod>2025-04-07T21:13:08.528Z</lastmod>
<lastmod>2025-04-09T06:54:15.412Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.trainer_fsdp_optim.html</loc>
<lastmod>2025-04-07T21:13:08.128Z</lastmod>
<lastmod>2025-04-09T06:54:15.007Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.data.batch_dataset_fetcher.html</loc>
<lastmod>2025-04-07T21:13:08.144Z</lastmod>
<lastmod>2025-04-09T06:54:15.023Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.stepwise_supervised.html</loc>
<lastmod>2025-04-07T21:13:07.839Z</lastmod>
<lastmod>2025-04-09T06:54:14.713Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.mistral_attn_hijack_flash.html</loc>
<lastmod>2025-04-07T21:13:08.077Z</lastmod>
<lastmod>2025-04-09T06:54:14.953Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.dpo.user_defined.html</loc>
<lastmod>2025-04-07T21:13:07.885Z</lastmod>
<lastmod>2025-04-09T06:54:14.759Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/integrations.liger.args.html</loc>
<lastmod>2025-04-07T21:13:08.446Z</lastmod>
<lastmod>2025-04-09T06:54:15.329Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.training.html</loc>
<lastmod>2025-04-07T21:13:08.311Z</lastmod>
<lastmod>2025-04-09T06:54:15.193Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/datasets.html</loc>
<lastmod>2025-04-07T21:13:07.344Z</lastmod>
<lastmod>2025-04-09T06:54:14.214Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/kernels.geglu.html</loc>
<lastmod>2025-04-07T21:13:08.018Z</lastmod>
<lastmod>2025-04-09T06:54:14.894Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.llama_attn_hijack_flash.html</loc>
<lastmod>2025-04-07T21:13:08.061Z</lastmod>
<lastmod>2025-04-09T06:54:14.938Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.sweeps.html</loc>
<lastmod>2025-04-07T21:13:07.675Z</lastmod>
<lastmod>2025-04-09T06:54:14.548Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.freeze.html</loc>
<lastmod>2025-04-07T21:13:08.214Z</lastmod>
<lastmod>2025-04-09T06:54:15.095Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.multipack.html</loc>
<lastmod>2025-04-07T21:13:08.078Z</lastmod>
<lastmod>2025-04-09T06:54:14.955Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.main.html</loc>
<lastmod>2025-04-07T21:13:07.572Z</lastmod>
<lastmod>2025-04-09T06:54:14.444Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.trainers.trl.html</loc>
<lastmod>2025-04-07T21:13:07.750Z</lastmod>
<lastmod>2025-04-09T06:54:14.623Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.dpo.passthrough.html</loc>
<lastmod>2025-04-07T21:13:07.886Z</lastmod>
<lastmod>2025-04-09T06:54:14.761Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.chat.format.llama3x.html</loc>
<lastmod>2025-04-07T21:13:07.527Z</lastmod>
<lastmod>2025-04-09T06:54:14.399Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.datasets.transforms.chat_builder.html</loc>
<lastmod>2025-04-07T21:13:07.541Z</lastmod>
<lastmod>2025-04-09T06:54:14.414Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.kto.user_defined.html</loc>
<lastmod>2025-04-07T21:13:07.904Z</lastmod>
<lastmod>2025-04-09T06:54:14.778Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.collators.mamba.html</loc>
<lastmod>2025-04-07T21:13:08.500Z</lastmod>
<lastmod>2025-04-09T06:54:15.385Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/integrations.base.html</loc>
<lastmod>2025-04-07T21:13:08.431Z</lastmod>
<lastmod>2025-04-09T06:54:15.314Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.bench.html</loc>
<lastmod>2025-04-07T21:13:08.207Z</lastmod>
<lastmod>2025-04-09T06:54:15.087Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/kernels.swiglu.html</loc>
<lastmod>2025-04-07T21:13:08.027Z</lastmod>
<lastmod>2025-04-09T06:54:14.904Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.chat.format.shared.html</loc>
<lastmod>2025-04-07T21:13:07.528Z</lastmod>
<lastmod>2025-04-09T06:54:14.401Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/integrations.cut_cross_entropy.args.html</loc>
<lastmod>2025-04-07T21:13:08.434Z</lastmod>
<lastmod>2025-04-09T06:54:15.318Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.datasets.chat.html</loc>
<lastmod>2025-04-07T21:13:07.534Z</lastmod>
<lastmod>2025-04-09T06:54:14.406Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.callbacks.lisa.html</loc>
<lastmod>2025-04-07T21:13:08.524Z</lastmod>
<lastmod>2025-04-09T06:54:15.409Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/integrations.grokfast.optimizer.html</loc>
<lastmod>2025-04-07T21:13:08.435Z</lastmod>
<lastmod>2025-04-09T06:54:15.319Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.alpaca_chat.html</loc>
<lastmod>2025-04-07T21:13:07.789Z</lastmod>
<lastmod>2025-04-09T06:54:14.663Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.alpaca_instruct.html</loc>
<lastmod>2025-04-07T21:13:07.791Z</lastmod>
<lastmod>2025-04-09T06:54:14.664Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.kto.chatml.html</loc>
<lastmod>2025-04-07T21:13:07.902Z</lastmod>
<lastmod>2025-04-09T06:54:14.777Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.integrations.html</loc>
<lastmod>2025-04-07T21:13:08.357Z</lastmod>
<lastmod>2025-04-09T06:54:15.239Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.trl.html</loc>
<lastmod>2025-04-07T21:13:08.339Z</lastmod>
<lastmod>2025-04-09T06:54:15.222Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_tokenizers.html</loc>
<lastmod>2025-04-07T21:13:07.398Z</lastmod>
<lastmod>2025-04-09T06:54:14.269Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.data.sft.html</loc>
<lastmod>2025-04-07T21:13:08.288Z</lastmod>
<lastmod>2025-04-09T06:54:15.170Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schedulers.html</loc>
<lastmod>2025-04-07T21:13:08.255Z</lastmod>
<lastmod>2025-04-09T06:54:15.136Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.chat_templates.html</loc>
<lastmod>2025-04-07T21:13:08.190Z</lastmod>
<lastmod>2025-04-09T06:54:15.070Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.models.html</loc>
<lastmod>2025-04-07T21:13:08.174Z</lastmod>
<lastmod>2025-04-09T06:54:15.053Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.dpo.chatml.html</loc>
<lastmod>2025-04-07T21:13:07.882Z</lastmod>
<lastmod>2025-04-09T06:54:14.757Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.distributed.html</loc>
<lastmod>2025-04-07T21:13:08.275Z</lastmod>
<lastmod>2025-04-09T06:54:15.157Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.utils.html</loc>
<lastmod>2025-04-07T21:13:08.116Z</lastmod>
<lastmod>2025-04-09T06:54:14.996Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.utils.html</loc>
<lastmod>2025-04-07T21:13:08.369Z</lastmod>
<lastmod>2025-04-09T06:54:15.252Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.llama_expand_mask.html</loc>
<lastmod>2025-04-07T21:13:08.086Z</lastmod>
<lastmod>2025-04-09T06:54:14.963Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/common.datasets.html</loc>
<lastmod>2025-04-07T21:13:08.471Z</lastmod>
<lastmod>2025-04-09T06:54:15.355Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/logging_config.html</loc>
<lastmod>2025-04-07T21:13:07.403Z</lastmod>
<lastmod>2025-04-09T06:54:14.274Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/kernels.quantize.html</loc>
<lastmod>2025-04-07T21:13:08.035Z</lastmod>
<lastmod>2025-04-09T06:54:14.911Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.llama_patch_multipack.html</loc>
<lastmod>2025-04-07T21:13:08.119Z</lastmod>
<lastmod>2025-04-09T06:54:14.999Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.model.html</loc>
<lastmod>2025-04-07T21:13:08.306Z</lastmod>
<lastmod>2025-04-09T06:54:15.188Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.stablelm_attn_hijack_flash.html</loc>
<lastmod>2025-04-07T21:13:08.125Z</lastmod>
<lastmod>2025-04-09T06:54:15.004Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.mixtral.html</loc>
<lastmod>2025-04-07T21:13:08.145Z</lastmod>
<lastmod>2025-04-09T06:54:15.025Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.tokenization.html</loc>
<lastmod>2025-04-07T21:13:08.180Z</lastmod>
<lastmod>2025-04-09T06:54:15.060Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/integrations.kd.trainer.html</loc>
<lastmod>2025-04-07T21:13:08.442Z</lastmod>
<lastmod>2025-04-09T06:54:15.326Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.datasets.html</loc>
<lastmod>2025-04-07T21:13:08.328Z</lastmod>
<lastmod>2025-04-09T06:54:15.211Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.collators.core.html</loc>
<lastmod>2025-04-07T21:13:08.473Z</lastmod>
<lastmod>2025-04-09T06:54:15.358Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.btlm_attn_hijack_flash.html</loc>
<lastmod>2025-04-07T21:13:08.118Z</lastmod>
<lastmod>2025-04-09T06:54:14.997Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.optimizers.adopt.html</loc>
<lastmod>2025-04-07T21:13:08.285Z</lastmod>
<lastmod>2025-04-09T06:54:15.167Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.input_output.html</loc>
<lastmod>2025-04-07T21:13:07.835Z</lastmod>
<lastmod>2025-04-09T06:54:14.709Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/index.html</loc>
<lastmod>2025-04-07T21:13:07.267Z</lastmod>
<lastmod>2025-04-09T06:54:14.136Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.cloud.modal_.html</loc>
<lastmod>2025-04-07T21:13:07.720Z</lastmod>
<lastmod>2025-04-09T06:54:14.592Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.dpo.llama3.html</loc>
<lastmod>2025-04-07T21:13:07.872Z</lastmod>
<lastmod>2025-04-09T06:54:14.747Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.train.html</loc>
<lastmod>2025-04-07T21:13:07.580Z</lastmod>
<lastmod>2025-04-09T06:54:14.452Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.trainer_builder.html</loc>
<lastmod>2025-04-07T21:13:07.418Z</lastmod>
<lastmod>2025-04-09T06:54:14.289Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.callbacks.perplexity.html</loc>
<lastmod>2025-04-07T21:13:08.519Z</lastmod>
<lastmod>2025-04-09T06:54:15.404Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/getting-started.html</loc>
<lastmod>2025-04-07T21:12:39.570Z</lastmod>
<lastmod>2025-04-09T06:53:29.051Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset_loading.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/batch_vs_grad.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/faq.html</loc>
<lastmod>2025-04-07T21:12:39.570Z</lastmod>
<lastmod>2025-04-09T06:53:29.051Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/debugging.html</loc>
<lastmod>2025-04-07T21:12:39.570Z</lastmod>
<lastmod>2025-04-09T06:53:29.051Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/lr_groups.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.053Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/TODO.html</loc>
<lastmod>2025-04-07T21:12:39.568Z</lastmod>
<lastmod>2025-04-09T06:53:29.049Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/src/axolotl/integrations/LICENSE.html</loc>
<lastmod>2025-04-07T21:12:39.588Z</lastmod>
<lastmod>2025-04-09T06:53:29.069Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/index.html</loc>
<lastmod>2025-04-07T21:12:39.585Z</lastmod>
<lastmod>2025-04-09T06:53:29.066Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/src/axolotl/integrations/cut_cross_entropy/ACKNOWLEDGEMENTS.html</loc>
<lastmod>2025-04-07T21:12:39.589Z</lastmod>
<lastmod>2025-04-09T06:53:29.070Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/FAQS.html</loc>
<lastmod>2025-04-07T21:12:39.568Z</lastmod>
<lastmod>2025-04-09T06:53:29.048Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/multi-node.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/sequence_parallelism.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/multipack.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/inference.html</loc>
<lastmod>2025-04-07T21:12:39.572Z</lastmod>
<lastmod>2025-04-09T06:53:29.053Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/lora_optims.html</loc>
<lastmod>2025-04-07T21:12:39.572Z</lastmod>
<lastmod>2025-04-09T06:53:29.053Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.lora_embeddings.html</loc>
<lastmod>2025-04-07T21:13:08.198Z</lastmod>
<lastmod>2025-04-09T06:54:15.078Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/kernels.utils.html</loc>
<lastmod>2025-04-07T21:13:08.036Z</lastmod>
<lastmod>2025-04-09T06:54:14.913Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.chat_template.html</loc>
<lastmod>2025-04-07T21:13:07.776Z</lastmod>
<lastmod>2025-04-09T06:54:14.649Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/convert.html</loc>
<lastmod>2025-04-07T21:13:07.358Z</lastmod>
<lastmod>2025-04-09T06:54:14.228Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/common.const.html</loc>
<lastmod>2025-04-07T21:13:08.455Z</lastmod>
<lastmod>2025-04-09T06:54:15.339Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.cloud.base.html</loc>
<lastmod>2025-04-07T21:13:07.714Z</lastmod>
<lastmod>2025-04-09T06:54:14.586Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.relora.html</loc>
<lastmod>2025-04-07T21:13:08.085Z</lastmod>
<lastmod>2025-04-09T06:54:14.962Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.lora.html</loc>
<lastmod>2025-04-07T21:13:08.194Z</lastmod>
<lastmod>2025-04-09T06:54:15.075Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.merge_lora.html</loc>
<lastmod>2025-04-07T21:13:07.650Z</lastmod>
<lastmod>2025-04-09T06:54:14.522Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.bradley_terry.llama3.html</loc>
<lastmod>2025-04-07T21:13:07.927Z</lastmod>
<lastmod>2025-04-09T06:54:14.802Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.merge_sharded_fsdp_weights.html</loc>
<lastmod>2025-04-07T21:13:07.661Z</lastmod>
<lastmod>2025-04-09T06:54:14.534Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/integrations.spectrum.args.html</loc>
<lastmod>2025-04-07T21:13:08.452Z</lastmod>
<lastmod>2025-04-09T06:54:15.336Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/models.mamba.modeling_mamba.html</loc>
<lastmod>2025-04-07T21:13:08.472Z</lastmod>
<lastmod>2025-04-09T06:54:15.356Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/common.architectures.html</loc>
<lastmod>2025-04-07T21:13:08.453Z</lastmod>
<lastmod>2025-04-09T06:54:15.337Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.trainer.html</loc>
<lastmod>2025-04-07T21:13:08.231Z</lastmod>
<lastmod>2025-04-09T06:54:15.111Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.callbacks.comet_.html</loc>
<lastmod>2025-04-07T21:13:08.531Z</lastmod>
<lastmod>2025-04-09T06:54:15.416Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.vllm_serve.html</loc>
<lastmod>2025-04-07T21:13:07.710Z</lastmod>
<lastmod>2025-04-09T06:54:14.583Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.multimodal.html</loc>
<lastmod>2025-04-07T21:13:08.344Z</lastmod>
<lastmod>2025-04-09T06:54:15.228Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.gradient_checkpointing.unsloth.html</loc>
<lastmod>2025-04-07T21:13:08.292Z</lastmod>
<lastmod>2025-04-09T06:54:15.174Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.trainers.base.html</loc>
<lastmod>2025-04-07T21:13:07.733Z</lastmod>
<lastmod>2025-04-09T06:54:14.606Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.unsloth_.html</loc>
<lastmod>2025-04-07T21:13:08.135Z</lastmod>
<lastmod>2025-04-09T06:54:15.015Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.samplers.multipack.html</loc>
<lastmod>2025-04-07T21:13:08.513Z</lastmod>
<lastmod>2025-04-09T06:54:15.397Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.callbacks.profiler.html</loc>
<lastmod>2025-04-07T21:13:08.523Z</lastmod>
<lastmod>2025-04-09T06:54:15.407Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/integrations.lm_eval.args.html</loc>
<lastmod>2025-04-07T21:13:08.449Z</lastmod>
<lastmod>2025-04-09T06:54:15.333Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.data.pretraining.html</loc>
<lastmod>2025-04-07T21:13:08.287Z</lastmod>
<lastmod>2025-04-09T06:54:15.169Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/evaluate.html</loc>
<lastmod>2025-04-07T21:13:07.337Z</lastmod>
<lastmod>2025-04-09T06:54:14.207Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.dict.html</loc>
<lastmod>2025-04-07T21:13:08.278Z</lastmod>
<lastmod>2025-04-09T06:54:15.160Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.utils.html</loc>
<lastmod>2025-04-07T21:13:07.706Z</lastmod>
<lastmod>2025-04-09T06:54:14.578Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.pygmalion.html</loc>
<lastmod>2025-04-07T21:13:07.856Z</lastmod>
<lastmod>2025-04-09T06:54:14.731Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.training_args.html</loc>
<lastmod>2025-04-07T21:13:07.502Z</lastmod>
<lastmod>2025-04-09T06:54:14.374Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.inference.html</loc>
<lastmod>2025-04-07T21:13:07.641Z</lastmod>
<lastmod>2025-04-09T06:54:14.514Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/kernels.lora.html</loc>
<lastmod>2025-04-07T21:13:08.007Z</lastmod>
<lastmod>2025-04-09T06:54:14.883Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.evaluate.html</loc>
<lastmod>2025-04-07T21:13:07.588Z</lastmod>
<lastmod>2025-04-09T06:54:14.460Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.collators.batching.html</loc>
<lastmod>2025-04-07T21:13:08.497Z</lastmod>
<lastmod>2025-04-09T06:54:15.381Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.completion.html</loc>
<lastmod>2025-04-07T21:13:07.829Z</lastmod>
<lastmod>2025-04-09T06:54:14.703Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.dpo.zephyr.html</loc>
<lastmod>2025-04-07T21:13:07.883Z</lastmod>
<lastmod>2025-04-09T06:54:14.758Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.metharme.html</loc>
<lastmod>2025-04-07T21:13:07.846Z</lastmod>
<lastmod>2025-04-09T06:54:14.720Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.orpo.chat_template.html</loc>
<lastmod>2025-04-07T21:13:07.923Z</lastmod>
<lastmod>2025-04-09T06:54:14.799Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.alpaca_w_system.html</loc>
<lastmod>2025-04-07T21:13:07.803Z</lastmod>
<lastmod>2025-04-09T06:54:14.676Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.model_shard_quant.html</loc>
<lastmod>2025-04-07T21:13:08.203Z</lastmod>
<lastmod>2025-04-09T06:54:15.083Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.config.html</loc>
<lastmod>2025-04-07T21:13:07.628Z</lastmod>
<lastmod>2025-04-09T06:54:14.500Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.enums.html</loc>
<lastmod>2025-04-07T21:13:08.363Z</lastmod>
<lastmod>2025-04-09T06:54:15.246Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.preprocess.html</loc>
<lastmod>2025-04-07T21:13:07.669Z</lastmod>
<lastmod>2025-04-09T06:54:14.542Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.chat.messages.html</loc>
<lastmod>2025-04-07T21:13:07.524Z</lastmod>
<lastmod>2025-04-09T06:54:14.396Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.dpo.chat_template.html</loc>
<lastmod>2025-04-07T21:13:07.862Z</lastmod>
<lastmod>2025-04-09T06:54:14.736Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.peft.html</loc>
<lastmod>2025-04-07T21:13:08.336Z</lastmod>
<lastmod>2025-04-09T06:54:15.219Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/train.html</loc>
<lastmod>2025-04-07T21:13:07.327Z</lastmod>
<lastmod>2025-04-09T06:54:14.197Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.messages.chat.html</loc>
<lastmod>2025-04-07T21:13:07.860Z</lastmod>
<lastmod>2025-04-09T06:54:14.735Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.orcamini.html</loc>
<lastmod>2025-04-07T21:13:07.850Z</lastmod>
<lastmod>2025-04-09T06:54:14.724Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.collators.mm_chat.html</loc>
<lastmod>2025-04-07T21:13:08.505Z</lastmod>
<lastmod>2025-04-09T06:54:15.389Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.kto.llama3.html</loc>
<lastmod>2025-04-07T21:13:07.894Z</lastmod>
<lastmod>2025-04-09T06:54:14.769Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.attention.mllama.html</loc>
<lastmod>2025-04-07T21:13:08.142Z</lastmod>
<lastmod>2025-04-09T06:54:15.022Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.checks.html</loc>
<lastmod>2025-04-07T21:13:07.611Z</lastmod>
<lastmod>2025-04-09T06:54:14.483Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.transformers_fa_utils.html</loc>
<lastmod>2025-04-07T21:13:08.134Z</lastmod>
<lastmod>2025-04-09T06:54:15.014Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.llama_attn_hijack_xformers.html</loc>
<lastmod>2025-04-07T21:13:08.062Z</lastmod>
<lastmod>2025-04-09T06:54:14.939Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.trainers.dpo.trainer.html</loc>
<lastmod>2025-04-07T21:13:07.757Z</lastmod>
<lastmod>2025-04-09T06:54:14.630Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.user_defined.html</loc>
<lastmod>2025-04-07T21:13:07.811Z</lastmod>
<lastmod>2025-04-09T06:54:14.684Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/cli.args.html</loc>
<lastmod>2025-04-07T21:13:07.604Z</lastmod>
<lastmod>2025-04-09T06:54:14.477Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.llama2_chat.html</loc>
<lastmod>2025-04-07T21:13:07.823Z</lastmod>
<lastmod>2025-04-09T06:54:14.697Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/utils.schemas.config.html</loc>
<lastmod>2025-04-07T21:13:08.299Z</lastmod>
<lastmod>2025-04-09T06:54:15.182Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.trainers.grpo.trainer.html</loc>
<lastmod>2025-04-07T21:13:07.760Z</lastmod>
<lastmod>2025-04-09T06:54:14.633Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/core.chat.format.chatml.html</loc>
<lastmod>2025-04-07T21:13:07.526Z</lastmod>
<lastmod>2025-04-09T06:54:14.398Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/monkeypatch.lora_kernels.html</loc>
<lastmod>2025-04-07T21:13:08.108Z</lastmod>
<lastmod>2025-04-09T06:54:14.988Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/api/prompt_strategies.base.html</loc>
<lastmod>2025-04-07T21:13:07.761Z</lastmod>
<lastmod>2025-04-09T06:54:14.634Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/rlhf.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/cli.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/unsloth.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/fsdp_qlora.html</loc>
<lastmod>2025-04-07T21:12:39.570Z</lastmod>
<lastmod>2025-04-09T06:53:29.051Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset_preprocessing.html</loc>
<lastmod>2025-04-07T21:12:39.570Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/custom_integrations.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/mac.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/docker.html</loc>
<lastmod>2025-04-07T21:12:39.570Z</lastmod>
<lastmod>2025-04-09T06:53:29.051Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/ray-integration.html</loc>
<lastmod>2025-04-07T21:12:39.573Z</lastmod>
<lastmod>2025-04-09T06:53:29.054Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/index.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/conversation.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/pretraining.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
<url>
<loc>https://axolotl-ai-cloud.github.io/axolotl/docs/dataset-formats/inst_tune.html</loc>
<lastmod>2025-04-07T21:12:39.569Z</lastmod>
<lastmod>2025-04-09T06:53:29.050Z</lastmod>
</url>
</urlset>