tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Built site for gh-pages

Browse Source
This commit is contained in:
Quarto GHA Workflow Runner
2025-06-10 23:55:31 +00:00
parent 15858cd29a
commit 89d7105f8f
8 changed files with 453 additions and 288 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
.nojekyll
View File

@@ -1 +1 @@
cccf8acd
30fb2d4a

88
docs/api/common.datasets.html
View File

@@ -539,7 +539,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</tr>
<tr class="odd">
<td><a href="#axolotl.common.datasets.sample_dataset">sample_dataset</a></td>
<td>Randomly sample <code>num_samples</code> samples from <code>dataset</code>.</td>
<td>Randomly sample <code>num_samples</code> samples with replacement from <code>dataset</code>.</td>
</tr>
</tbody>
</table>
@@ -547,15 +547,15 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<h3 class="anchored" data-anchor-id="axolotl.common.datasets.load_datasets">load_datasets</h3>
<div class="sourceCode" id="cb2"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a>common.datasets.load_datasets(cfg, cli_args<span class="op">=</span><span class="va">None</span>, debug<span class="op">=</span><span class="va">False</span>)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Loads one or more training or evaluation datasets, calling
<code>axolotl.utils.data.prepare_dataset</code>. Optionally, logs out debug information.</p>
<code>axolotl.utils.data.prepare_datasets</code>. Optionally, logs out debug information.</p>
<section id="parameters" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 8%">
<col style="width: 37%">
<col style="width: 44%">
<col style="width: 10%">
<col style="width: 4%">
<col style="width: 22%">
<col style="width: 67%">
<col style="width: 5%">
</colgroup>
<thead>
<tr class="header">
@@ -581,7 +581,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<tr class="odd">
<td>debug</td>
<td>bool</td>
<td>Whether to print out tokenization of sample</td>
<td>Whether to print out tokenization of sample. This is duplicated in <code>cfg</code> and <code>cli_args</code>, but is kept due to use in our Colab notebooks.</td>
<td><code>False</code></td>
</tr>
</tbody>
@@ -591,9 +591,9 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<h4 class="doc-section doc-section-returns anchored" data-anchor-id="returns">Returns</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 7%">
<col style="width: 17%">
<col style="width: 74%">
<col style="width: 6%">
<col style="width: 14%">
<col style="width: 78%">
</colgroup>
<thead>
<tr class="header">
@@ -606,12 +606,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<tr class="odd">
<td></td>
<td>TrainDatasetMeta</td>
<td>Dataclass with fields for training and evaluation datasets and the computed</td>
</tr>
<tr class="even">
<td></td>
<td>TrainDatasetMeta</td>
<td><code>total_num_steps</code>.</td>
<td>Dataclass with fields for training and evaluation datasets and the computed <code>total_num_steps</code>.</td>
</tr>
</tbody>
</table>
@@ -621,15 +616,15 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<h3 class="anchored" data-anchor-id="axolotl.common.datasets.load_preference_datasets">load_preference_datasets</h3>
<div class="sourceCode" id="cb3"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb3-1"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a>common.datasets.load_preference_datasets(cfg, cli_args)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Loads one or more training or evaluation datasets for RL training using paired
preference data, calling <code>axolotl.utils.data.rl.load_prepare_preference_datasets</code>.
preference data, calling <code>axolotl.utils.data.rl.prepare_preference_datasets</code>.
Optionally, logs out debug information.</p>
<section id="parameters-1" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-1">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 8%">
<col style="width: 36%">
<col style="width: 44%">
<col style="width: 33%">
<col style="width: 47%">
<col style="width: 10%">
</colgroup>
<thead>
@@ -649,7 +644,7 @@ Optionally, logs out debug information.</p>
</tr>
<tr class="even">
<td>cli_args</td>
<td>Union[PreprocessCliArgs, TrainerCliArgs]</td>
<td>PreprocessCliArgs | TrainerCliArgs</td>
<td>Command-specific CLI arguments.</td>
<td><em>required</em></td>
</tr>
@@ -689,63 +684,12 @@ Optionally, logs out debug information.</p>
<section id="axolotl.common.datasets.sample_dataset" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.common.datasets.sample_dataset">sample_dataset</h3>
<div class="sourceCode" id="cb4"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb4-1"><a href="#cb4-1" aria-hidden="true" tabindex="-1"></a>common.datasets.sample_dataset(dataset, num_samples)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Randomly sample <code>num_samples</code> samples from <code>dataset</code>.</p>
<section id="parameters-2" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-2">Parameters</h4>
<table class="caption-top table">
<thead>
<tr class="header">
<th>Name</th>
<th>Type</th>
<th>Description</th>
<th>Default</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td>dataset</td>
<td>Dataset</td>
<td>Dataset.</td>
<td><em>required</em></td>
</tr>
<tr class="even">
<td>num_samples</td>
<td>int</td>
<td>Number of samples to return.</td>
<td><em>required</em></td>
</tr>
</tbody>
</table>
</section>
<section id="returns-2" class="level4 doc-section doc-section-returns">
<h4 class="doc-section doc-section-returns anchored" data-anchor-id="returns-2">Returns</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 10%">
<col style="width: 11%">
<col style="width: 77%">
</colgroup>
<thead>
<tr class="header">
<th>Name</th>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td></td>
<td>Dataset</td>
<td>Random sample (with replacement) of examples in <code>dataset</code>.</td>
</tr>
</tbody>
</table>
<p>Randomly sample <code>num_samples</code> samples with replacement from <code>dataset</code>.</p>
</section>
</section>
</section>
</section>
</main> <!-- /main -->
<script id="quarto-html-after-body" type="application/javascript">

100
docs/api/datasets.html
View File

@@ -500,7 +500,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<tbody>
<tr class="odd">
<td><a href="#axolotl.datasets.ConstantLengthDataset">ConstantLengthDataset</a></td>
<td>Iterable dataset that returns constant length chunks of tokens from stream of text files.</td>
<td>Iterable dataset that returns constant length chunks of tokens from stream of</td>
</tr>
<tr class="even">
<td><a href="#axolotl.datasets.TokenizedPromptDataset">TokenizedPromptDataset</a></td>
@@ -511,11 +511,47 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<section id="axolotl.datasets.ConstantLengthDataset" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.datasets.ConstantLengthDataset">ConstantLengthDataset</h3>
<div class="sourceCode" id="cb1"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a>datasets.ConstantLengthDataset(tokenizer, datasets, seq_length<span class="op">=</span><span class="dv">2048</span>)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Iterable dataset that returns constant length chunks of tokens from stream of text files.
Args:
tokenizer (Tokenizer): The processor used for processing the data.
dataset (dataset.Dataset): Dataset with text files.
seq_length (int): Length of token sequences to return.</p>
<p>Iterable dataset that returns constant length chunks of tokens from stream of
text files.</p>
<section id="parameters" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 15%">
<col style="width: 10%">
<col style="width: 58%">
<col style="width: 15%">
</colgroup>
<thead>
<tr class="header">
<th>Name</th>
<th>Type</th>
<th>Description</th>
<th>Default</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td>tokenizer</td>
<td></td>
<td>The processor used for processing the data.</td>
<td><em>required</em></td>
</tr>
<tr class="even">
<td>dataset</td>
<td></td>
<td>Dataset with text files.</td>
<td><em>required</em></td>
</tr>
<tr class="odd">
<td>seq_length</td>
<td></td>
<td>Length of token sequences to return.</td>
<td><code>2048</code></td>
</tr>
</tbody>
</table>
</section>
</section>
<section id="axolotl.datasets.TokenizedPromptDataset" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.datasets.TokenizedPromptDataset">TokenizedPromptDataset</h3>
@@ -526,17 +562,57 @@ seq_length (int): Length of token sequences to return.</p>
<span id="cb2-5"><a href="#cb2-5" aria-hidden="true" tabindex="-1"></a> keep_in_memory<span class="op">=</span><span class="va">False</span>,</span>
<span id="cb2-6"><a href="#cb2-6" aria-hidden="true" tabindex="-1"></a> <span class="op">**</span>kwargs,</span>
<span id="cb2-7"><a href="#cb2-7" aria-hidden="true" tabindex="-1"></a>)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Dataset that returns tokenized prompts from a stream of text files.
Args:
prompt_tokenizer (PromptTokenizingStrategy): The prompt tokenizing method for processing the data.
dataset (dataset.Dataset): Dataset with text files.
process_count (int): Number of processes to use for tokenizing.
keep_in_memory (bool): Whether to keep the tokenized dataset in memory.</p>
<p>Dataset that returns tokenized prompts from a stream of text files.</p>
<section id="parameters-1" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-1">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 16%">
<col style="width: 23%">
<col style="width: 49%">
<col style="width: 10%">
</colgroup>
<thead>
<tr class="header">
<th>Name</th>
<th>Type</th>
<th>Description</th>
<th>Default</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td>prompt_tokenizer</td>
<td>PromptTokenizingStrategy</td>
<td>The prompt tokenizing method for processing the data.</td>
<td><em>required</em></td>
</tr>
<tr class="even">
<td>dataset</td>
<td>Dataset</td>
<td>Dataset with text files.</td>
<td><em>required</em></td>
</tr>
<tr class="odd">
<td>process_count</td>
<td>int | None</td>
<td>Number of processes to use for tokenizing.</td>
<td><code>None</code></td>
</tr>
<tr class="even">
<td>keep_in_memory</td>
<td>bool | None</td>
<td>Whether to keep the tokenized dataset in memory.</td>
<td><code>False</code></td>
</tr>
</tbody>
</table>
</section>
</section>
</section>
</section>
</main> <!-- /main -->
<script id="quarto-html-after-body" type="application/javascript">

2
docs/api/index.html
View File

@@ -981,7 +981,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</tr>
<tr class="odd">
<td><a href="../../docs/api/utils.data.sft.html#axolotl.utils.data.sft">utils.data.sft</a></td>
<td>data handling specific to SFT</td>
<td>Data handling specific to SFT.</td>
</tr>
<tr class="even">
<td><a href="../../docs/api/utils.quantization.html#axolotl.utils.quantization">utils.quantization</a></td>

5
docs/api/train.html
View File

@@ -534,7 +534,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</tr>
<tr class="odd">
<td><a href="#axolotl.train.setup_model_and_tokenizer">setup_model_and_tokenizer</a></td>
<td>Load the tokenizer, processor (for multimodal models), and model based on configuration.</td>
<td>Load the tokenizer, processor (for multimodal models), and model based on</td>
</tr>
<tr class="even">
<td><a href="#axolotl.train.setup_model_and_trainer">setup_model_and_trainer</a></td>
@@ -861,7 +861,8 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<section id="axolotl.train.setup_model_and_tokenizer" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.train.setup_model_and_tokenizer">setup_model_and_tokenizer</h3>
<div class="sourceCode" id="cb7"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb7-1"><a href="#cb7-1" aria-hidden="true" tabindex="-1"></a>train.setup_model_and_tokenizer(cfg)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Load the tokenizer, processor (for multimodal models), and model based on configuration.</p>
<p>Load the tokenizer, processor (for multimodal models), and model based on
configuration.</p>
<section id="parameters-6" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-6">Parameters</h4>
<table class="caption-top table">

141
docs/api/utils.data.sft.html
View File

@@ -20,6 +20,41 @@ ul.task-list li input[type="checkbox"] {
margin: 0 0.8em 0.2em -1em; /* quarto-specific, see https://github.com/quarto-dev/quarto-cli/issues/4556 */
vertical-align: middle;
}
/* CSS for syntax highlighting */
html { -webkit-text-size-adjust: 100%; }
pre > code.sourceCode { white-space: pre; position: relative; }
pre > code.sourceCode > span { display: inline-block; line-height: 1.25; }
pre > code.sourceCode > span:empty { height: 1.2em; }
.sourceCode { overflow: visible; }
code.sourceCode > span { color: inherit; text-decoration: inherit; }
div.sourceCode { margin: 1em 0; }
pre.sourceCode { margin: 0; }
@media screen {
div.sourceCode { overflow: auto; }
}
@media print {
pre > code.sourceCode { white-space: pre-wrap; }
pre > code.sourceCode > span { text-indent: -5em; padding-left: 5em; }
}
pre.numberSource code
{ counter-reset: source-line 0; }
pre.numberSource code > span
{ position: relative; left: -4em; counter-increment: source-line; }
pre.numberSource code > span > a:first-child::before
{ content: counter(source-line);
position: relative; left: -1em; text-align: right; vertical-align: baseline;
border: none; display: inline-block;
-webkit-touch-callout: none; -webkit-user-select: none;
-khtml-user-select: none; -moz-user-select: none;
-ms-user-select: none; user-select: none;
padding: 0 4px; width: 4em;
}
pre.numberSource { margin-left: 3em; padding-left: 4px; }
div.sourceCode
{ }
@media screen {
pre > code.sourceCode > span > a:first-child::before { text-decoration: underline; }
}
</style>
@@ -432,7 +467,13 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<h2 id="toc-title">On this page</h2>
<ul>
<li><a href="#axolotl.utils.data.sft" id="toc-axolotl.utils.data.sft" class="nav-link active" data-scroll-target="#axolotl.utils.data.sft">utils.data.sft</a></li>
<li><a href="#axolotl.utils.data.sft" id="toc-axolotl.utils.data.sft" class="nav-link active" data-scroll-target="#axolotl.utils.data.sft">utils.data.sft</a>
<ul class="collapse">
<li><a href="#functions" id="toc-functions" class="nav-link" data-scroll-target="#functions">Functions</a>
<ul class="collapse">
<li><a href="#axolotl.utils.data.sft.prepare_datasets" id="toc-axolotl.utils.data.sft.prepare_datasets" class="nav-link" data-scroll-target="#axolotl.utils.data.sft.prepare_datasets">prepare_datasets</a></li>
</ul></li>
</ul></li>
</ul>
</nav>
</div>
@@ -445,9 +486,105 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<section id="axolotl.utils.data.sft" class="level1">
<h1>utils.data.sft</h1>
<p><code>utils.data.sft</code></p>
<p>data handling specific to SFT</p>
<p>Data handling specific to SFT.</p>
<section id="functions" class="level2">
<h2 class="anchored" data-anchor-id="functions">Functions</h2>
<table class="caption-top table">
<thead>
<tr class="header">
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td><a href="#axolotl.utils.data.sft.prepare_datasets">prepare_datasets</a></td>
<td>Prepare training and evaluation datasets based on configuration.</td>
</tr>
</tbody>
</table>
<section id="axolotl.utils.data.sft.prepare_datasets" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.utils.data.sft.prepare_datasets">prepare_datasets</h3>
<div class="sourceCode" id="cb1"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a>utils.data.sft.prepare_datasets(</span>
<span id="cb1-2"><a href="#cb1-2" aria-hidden="true" tabindex="-1"></a> cfg,</span>
<span id="cb1-3"><a href="#cb1-3" aria-hidden="true" tabindex="-1"></a> tokenizer,</span>
<span id="cb1-4"><a href="#cb1-4" aria-hidden="true" tabindex="-1"></a> processor<span class="op">=</span><span class="va">None</span>,</span>
<span id="cb1-5"><a href="#cb1-5" aria-hidden="true" tabindex="-1"></a> preprocess_iterable<span class="op">=</span><span class="va">False</span>,</span>
<span id="cb1-6"><a href="#cb1-6" aria-hidden="true" tabindex="-1"></a>)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Prepare training and evaluation datasets based on configuration.</p>
<section id="parameters" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 19%">
<col style="width: 21%">
<col style="width: 48%">
<col style="width: 10%">
</colgroup>
<thead>
<tr class="header">
<th>Name</th>
<th>Type</th>
<th>Description</th>
<th>Default</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td>cfg</td>
<td>DictDefault</td>
<td>Dictionary mapping <code>axolotl</code> config keys to values.</td>
<td><em>required</em></td>
</tr>
<tr class="even">
<td>tokenizer</td>
<td>PreTrainedTokenizer</td>
<td>Tokenizer to use for processing text.</td>
<td><em>required</em></td>
</tr>
<tr class="odd">
<td>processor</td>
<td>ProcessorMixin | None</td>
<td>Optional processor for multimodal datasets.</td>
<td><code>None</code></td>
</tr>
<tr class="even">
<td>preprocess_iterable</td>
<td>bool</td>
<td>Whether to use iterable preprocessing.</td>
<td><code>False</code></td>
</tr>
</tbody>
</table>
</section>
<section id="returns" class="level4 doc-section doc-section-returns">
<h4 class="doc-section doc-section-returns anchored" data-anchor-id="returns">Returns</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 5%">
<col style="width: 53%">
<col style="width: 41%">
</colgroup>
<thead>
<tr class="header">
<th>Name</th>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr class="odd">
<td></td>
<td>tuple[IterableDataset | Dataset, Dataset | None, int, list[Prompter | None]]</td>
<td>Tuple of (train_dataset, eval_dataset, total_steps, prompters).</td>
</tr>
</tbody>
</table>
</section>
</section>
</section>
</section>
</main> <!-- /main -->

25
search.json
View File

File diff suppressed because one or more lines are too long

378
sitemap.xml
View File

@@ -2,758 +2,758 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://docs.axolotl.ai/FAQS.html</loc>
<lastmod>2025-06-10T17:03:50.696Z</lastmod>
<lastmod>2025-06-10T23:53:16.119Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/src/axolotl/integrations/cut_cross_entropy/ACKNOWLEDGEMENTS.html</loc>
<lastmod>2025-06-10T17:03:50.719Z</lastmod>
<lastmod>2025-06-10T23:53:16.142Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/examples/colab-notebooks/colab-axolotl-example.html</loc>
<lastmod>2025-06-10T17:03:50.703Z</lastmod>
<lastmod>2025-06-10T23:53:16.126Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/lr_groups.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/lora_optims.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/rlhf.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/qat.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/fsdp_qlora.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.122Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/custom_integrations.html</loc>
<lastmod>2025-06-10T17:03:50.698Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset-formats/pretraining.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset-formats/template_free.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset-formats/conversation.html</loc>
<lastmod>2025-06-10T17:03:50.698Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset-formats/tokenized.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/multipack.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/mac.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/input_output.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.124Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/quantize.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/cli.html</loc>
<lastmod>2025-06-10T17:03:50.698Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/multi-node.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/nccl.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.data.sft.html</loc>
<lastmod>2025-06-10T17:04:22.063Z</lastmod>
<lastmod>2025-06-10T23:53:45.878Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.datasets.transforms.chat_builder.html</loc>
<lastmod>2025-06-10T17:04:21.178Z</lastmod>
<lastmod>2025-06-10T23:53:44.995Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/evaluate.html</loc>
<lastmod>2025-06-10T17:04:20.945Z</lastmod>
<lastmod>2025-06-10T23:53:44.772Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.mixtral.html</loc>
<lastmod>2025-06-10T17:04:21.919Z</lastmod>
<lastmod>2025-06-10T23:53:45.730Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_w_system.html</loc>
<lastmod>2025-06-10T17:04:21.565Z</lastmod>
<lastmod>2025-06-10T23:53:45.381Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/integrations.spectrum.args.html</loc>
<lastmod>2025-06-10T17:04:22.315Z</lastmod>
<lastmod>2025-06-10T23:53:46.127Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.builders.rl.html</loc>
<lastmod>2025-06-10T17:04:21.050Z</lastmod>
<lastmod>2025-06-10T23:53:44.865Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/common.const.html</loc>
<lastmod>2025-06-10T17:04:22.318Z</lastmod>
<lastmod>2025-06-10T23:53:46.130Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/kernels.geglu.html</loc>
<lastmod>2025-06-10T17:04:21.787Z</lastmod>
<lastmod>2025-06-10T23:53:45.603Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/index.html</loc>
<lastmod>2025-06-10T17:04:20.869Z</lastmod>
<lastmod>2025-06-10T23:53:44.699Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/integrations.cut_cross_entropy.args.html</loc>
<lastmod>2025-06-10T17:04:22.296Z</lastmod>
<lastmod>2025-06-10T23:53:46.108Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.user_defined.html</loc>
<lastmod>2025-06-10T17:04:21.573Z</lastmod>
<lastmod>2025-06-10T23:53:45.390Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.mixins.scheduler.html</loc>
<lastmod>2025-06-10T17:04:21.489Z</lastmod>
<lastmod>2025-06-10T23:53:45.306Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.datasets.chat.html</loc>
<lastmod>2025-06-10T17:04:21.170Z</lastmod>
<lastmod>2025-06-10T23:53:44.987Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/train.html</loc>
<lastmod>2025-06-10T17:04:20.932Z</lastmod>
<lastmod>2025-06-10T23:53:44.761Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.preprocess.html</loc>
<lastmod>2025-06-10T17:04:21.313Z</lastmod>
<lastmod>2025-06-10T23:53:45.130Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.zephyr.html</loc>
<lastmod>2025-06-10T17:04:21.648Z</lastmod>
<lastmod>2025-06-10T23:53:45.463Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.training_args.html</loc>
<lastmod>2025-06-10T17:04:21.138Z</lastmod>
<lastmod>2025-06-10T23:53:44.954Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/datasets.html</loc>
<lastmod>2025-06-10T17:04:20.954Z</lastmod>
<lastmod>2025-06-10T23:53:44.782Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/models.mamba.modeling_mamba.html</loc>
<lastmod>2025-06-10T17:04:22.336Z</lastmod>
<lastmod>2025-06-10T23:53:46.147Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/kernels.utils.html</loc>
<lastmod>2025-06-10T17:04:21.806Z</lastmod>
<lastmod>2025-06-10T23:53:45.622Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/loaders.adapter.html</loc>
<lastmod>2025-06-10T17:04:21.464Z</lastmod>
<lastmod>2025-06-10T23:53:45.281Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.chat.format.chatml.html</loc>
<lastmod>2025-06-10T17:04:21.162Z</lastmod>
<lastmod>2025-06-10T23:53:44.979Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.dpo.trainer.html</loc>
<lastmod>2025-06-10T17:04:21.415Z</lastmod>
<lastmod>2025-06-10T23:53:45.231Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.cloud.modal_.html</loc>
<lastmod>2025-06-10T17:04:21.367Z</lastmod>
<lastmod>2025-06-10T23:53:45.184Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.stepwise_supervised.html</loc>
<lastmod>2025-06-10T17:04:21.602Z</lastmod>
<lastmod>2025-06-10T23:53:45.418Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.passthrough.html</loc>
<lastmod>2025-06-10T17:04:21.651Z</lastmod>
<lastmod>2025-06-10T23:53:45.466Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.relora.html</loc>
<lastmod>2025-06-10T17:04:21.856Z</lastmod>
<lastmod>2025-06-10T23:53:45.672Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/kernels.swiglu.html</loc>
<lastmod>2025-06-10T17:04:21.797Z</lastmod>
<lastmod>2025-06-10T23:53:45.613Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.cloud.base.html</loc>
<lastmod>2025-06-10T17:04:21.360Z</lastmod>
<lastmod>2025-06-10T23:53:45.178Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/common.datasets.html</loc>
<lastmod>2025-06-10T17:04:22.335Z</lastmod>
<lastmod>2025-06-10T23:53:46.145Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.grpo.sampler.html</loc>
<lastmod>2025-06-10T17:04:21.437Z</lastmod>
<lastmod>2025-06-10T23:53:45.255Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.merge_lora.html</loc>
<lastmod>2025-06-10T17:04:21.292Z</lastmod>
<lastmod>2025-06-10T23:53:45.110Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.model_shard_quant.html</loc>
<lastmod>2025-06-10T17:04:21.976Z</lastmod>
<lastmod>2025-06-10T23:53:45.786Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.llama3.html</loc>
<lastmod>2025-06-10T17:04:21.636Z</lastmod>
<lastmod>2025-06-10T23:53:45.452Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/integrations.liger.args.html</loc>
<lastmod>2025-06-10T17:04:22.308Z</lastmod>
<lastmod>2025-06-10T23:53:46.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.callbacks.profiler.html</loc>
<lastmod>2025-06-10T17:04:22.416Z</lastmod>
<lastmod>2025-06-10T23:53:46.226Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.chat_templates.html</loc>
<lastmod>2025-06-10T17:04:21.965Z</lastmod>
<lastmod>2025-06-10T23:53:45.776Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.builders.base.html</loc>
<lastmod>2025-06-10T17:04:21.038Z</lastmod>
<lastmod>2025-06-10T23:53:44.853Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.mamba.html</loc>
<lastmod>2025-06-10T17:04:21.404Z</lastmod>
<lastmod>2025-06-10T23:53:45.220Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.orpo.chat_template.html</loc>
<lastmod>2025-06-10T17:04:21.689Z</lastmod>
<lastmod>2025-06-10T23:53:45.505Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.data.pretraining.html</loc>
<lastmod>2025-06-10T17:04:22.061Z</lastmod>
<lastmod>2025-06-10T23:53:45.871Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.peft.html</loc>
<lastmod>2025-06-10T17:04:22.134Z</lastmod>
<lastmod>2025-06-10T23:53:45.948Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.trainer_fsdp_optim.html</loc>
<lastmod>2025-06-10T17:04:21.908Z</lastmod>
<lastmod>2025-06-10T23:53:45.719Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.chat_template.html</loc>
<lastmod>2025-06-10T17:04:21.538Z</lastmod>
<lastmod>2025-06-10T23:53:45.354Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.kto.chatml.html</loc>
<lastmod>2025-06-10T17:04:21.667Z</lastmod>
<lastmod>2025-06-10T23:53:45.483Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.btlm_attn_hijack_flash.html</loc>
<lastmod>2025-06-10T17:04:21.897Z</lastmod>
<lastmod>2025-06-10T23:53:45.708Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.chat.format.shared.html</loc>
<lastmod>2025-06-10T17:04:21.165Z</lastmod>
<lastmod>2025-06-10T23:53:44.982Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/logging_config.html</loc>
<lastmod>2025-06-10T17:04:21.031Z</lastmod>
<lastmod>2025-06-10T23:53:44.847Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.sweeps.html</loc>
<lastmod>2025-06-10T17:04:21.318Z</lastmod>
<lastmod>2025-06-10T23:53:45.135Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.chat_template.html</loc>
<lastmod>2025-06-10T17:04:21.625Z</lastmod>
<lastmod>2025-06-10T23:53:45.441Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_tokenizers.html</loc>
<lastmod>2025-06-10T17:04:21.022Z</lastmod>
<lastmod>2025-06-10T23:53:44.837Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/kernels.quantize.html</loc>
<lastmod>2025-06-10T17:04:21.805Z</lastmod>
<lastmod>2025-06-10T23:53:45.621Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.callbacks.mlflow_.html</loc>
<lastmod>2025-06-10T17:04:22.421Z</lastmod>
<lastmod>2025-06-10T23:53:46.231Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.trl.html</loc>
<lastmod>2025-06-10T17:04:22.137Z</lastmod>
<lastmod>2025-06-10T23:53:45.952Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.config.html</loc>
<lastmod>2025-06-10T17:04:22.095Z</lastmod>
<lastmod>2025-06-10T23:53:45.910Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.unsloth_.html</loc>
<lastmod>2025-06-10T17:04:21.916Z</lastmod>
<lastmod>2025-06-10T23:53:45.727Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.checks.html</loc>
<lastmod>2025-06-10T17:04:21.252Z</lastmod>
<lastmod>2025-06-10T23:53:45.069Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.chat.messages.html</loc>
<lastmod>2025-06-10T17:04:21.161Z</lastmod>
<lastmod>2025-06-10T23:53:44.977Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/loaders.patch_manager.html</loc>
<lastmod>2025-06-10T17:04:21.472Z</lastmod>
<lastmod>2025-06-10T23:53:45.289Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_expand_mask.html</loc>
<lastmod>2025-06-10T17:04:21.858Z</lastmod>
<lastmod>2025-06-10T23:53:45.673Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.utils.html</loc>
<lastmod>2025-06-10T17:04:22.172Z</lastmod>
<lastmod>2025-06-10T23:53:45.985Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/integrations.base.html</loc>
<lastmod>2025-06-10T17:04:22.292Z</lastmod>
<lastmod>2025-06-10T23:53:46.105Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.samplers.multipack.html</loc>
<lastmod>2025-06-10T17:04:22.406Z</lastmod>
<lastmod>2025-06-10T23:53:46.216Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.completion.html</loc>
<lastmod>2025-06-10T17:04:21.592Z</lastmod>
<lastmod>2025-06-10T23:53:45.408Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.collators.mamba.html</loc>
<lastmod>2025-06-10T17:04:22.360Z</lastmod>
<lastmod>2025-06-10T23:53:46.171Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.model.html</loc>
<lastmod>2025-06-10T17:04:22.102Z</lastmod>
<lastmod>2025-06-10T23:53:45.917Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.training.html</loc>
<lastmod>2025-06-10T17:04:22.107Z</lastmod>
<lastmod>2025-06-10T23:53:45.922Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.kto.llama3.html</loc>
<lastmod>2025-06-10T17:04:21.659Z</lastmod>
<lastmod>2025-06-10T23:53:45.475Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.utils.html</loc>
<lastmod>2025-06-10T17:04:21.439Z</lastmod>
<lastmod>2025-06-10T23:53:45.256Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.mixins.optimizer.html</loc>
<lastmod>2025-06-10T17:04:21.479Z</lastmod>
<lastmod>2025-06-10T23:53:45.296Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.merge_sharded_fsdp_weights.html</loc>
<lastmod>2025-06-10T17:04:21.304Z</lastmod>
<lastmod>2025-06-10T23:53:45.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset_loading.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/amd_hpc.html</loc>
<lastmod>2025-06-10T17:03:50.698Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/TODO.html</loc>
<lastmod>2025-06-10T17:03:50.697Z</lastmod>
<lastmod>2025-06-10T23:53:16.119Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/debugging.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.122Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/multi-gpu.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.utils.html</loc>
<lastmod>2025-06-10T17:04:21.350Z</lastmod>
<lastmod>2025-06-10T23:53:45.167Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.freeze.html</loc>
<lastmod>2025-06-10T17:04:21.987Z</lastmod>
<lastmod>2025-06-10T23:53:45.798Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/common.architectures.html</loc>
<lastmod>2025-06-10T17:04:22.316Z</lastmod>
<lastmod>2025-06-10T23:53:46.129Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schedulers.html</loc>
<lastmod>2025-06-10T17:04:22.029Z</lastmod>
<lastmod>2025-06-10T23:53:45.839Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.collators.core.html</loc>
<lastmod>2025-06-10T17:04:22.337Z</lastmod>
<lastmod>2025-06-10T23:53:46.148Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.multimodal.html</loc>
<lastmod>2025-06-10T17:04:22.143Z</lastmod>
<lastmod>2025-06-10T23:53:45.957Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.distributed.html</loc>
<lastmod>2025-06-10T17:04:22.049Z</lastmod>
<lastmod>2025-06-10T23:53:45.859Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.datasets.html</loc>
<lastmod>2025-06-10T17:04:22.125Z</lastmod>
<lastmod>2025-06-10T23:53:45.940Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.kto.user_defined.html</loc>
<lastmod>2025-06-10T17:04:21.669Z</lastmod>
<lastmod>2025-06-10T23:53:45.484Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.utils.html</loc>
<lastmod>2025-06-10T17:04:21.895Z</lastmod>
<lastmod>2025-06-10T23:53:45.707Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.integrations.html</loc>
<lastmod>2025-06-10T17:04:22.155Z</lastmod>
<lastmod>2025-06-10T23:53:45.969Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.mixins.rng_state_loader.html</loc>
<lastmod>2025-06-10T17:04:21.483Z</lastmod>
<lastmod>2025-06-10T23:53:45.299Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/integrations.lm_eval.args.html</loc>
<lastmod>2025-06-10T17:04:22.311Z</lastmod>
<lastmod>2025-06-10T23:53:46.124Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/loaders.processor.html</loc>
<lastmod>2025-06-10T17:04:21.459Z</lastmod>
<lastmod>2025-06-10T23:53:45.276Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.trl.html</loc>
<lastmod>2025-06-10T17:04:21.399Z</lastmod>
<lastmod>2025-06-10T23:53:45.215Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/loaders.constants.html</loc>
<lastmod>2025-06-10T17:04:21.474Z</lastmod>
<lastmod>2025-06-10T23:53:45.291Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_attn_hijack_flash.html</loc>
<lastmod>2025-06-10T17:04:21.832Z</lastmod>
<lastmod>2025-06-10T23:53:45.648Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.args.html</loc>
<lastmod>2025-06-10T17:04:21.246Z</lastmod>
<lastmod>2025-06-10T23:53:45.063Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.builders.causal.html</loc>
<lastmod>2025-06-10T17:04:21.042Z</lastmod>
<lastmod>2025-06-10T23:53:44.858Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.input_output.html</loc>
<lastmod>2025-06-10T17:04:21.597Z</lastmod>
<lastmod>2025-06-10T23:53:45.414Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.chat.format.llama3x.html</loc>
<lastmod>2025-06-10T17:04:21.163Z</lastmod>
<lastmod>2025-06-10T23:53:44.980Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.train.html</loc>
<lastmod>2025-06-10T17:04:21.218Z</lastmod>
<lastmod>2025-06-10T23:53:45.035Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/convert.html</loc>
<lastmod>2025-06-10T17:04:20.972Z</lastmod>
<lastmod>2025-06-10T23:53:44.796Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.optimizers.adopt.html</loc>
<lastmod>2025-06-10T17:04:22.060Z</lastmod>
<lastmod>2025-06-10T23:53:45.870Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.pygmalion.html</loc>
<lastmod>2025-06-10T17:04:21.619Z</lastmod>
<lastmod>2025-06-10T23:53:45.436Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/integrations.kd.trainer.html</loc>
<lastmod>2025-06-10T17:04:22.305Z</lastmod>
<lastmod>2025-06-10T23:53:46.117Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.callbacks.qat.html</loc>
<lastmod>2025-06-10T17:04:22.431Z</lastmod>
<lastmod>2025-06-10T23:53:46.241Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.callbacks.lisa.html</loc>
<lastmod>2025-06-10T17:04:22.417Z</lastmod>
<lastmod>2025-06-10T23:53:46.227Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/loaders.tokenizer.html</loc>
<lastmod>2025-06-10T17:04:21.457Z</lastmod>
<lastmod>2025-06-10T23:53:45.274Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.main.html</loc>
<lastmod>2025-06-10T17:04:21.209Z</lastmod>
<lastmod>2025-06-10T23:53:45.026Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.data.batch_dataset_fetcher.html</loc>
<lastmod>2025-06-10T17:04:21.917Z</lastmod>
<lastmod>2025-06-10T23:53:45.728Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.evaluate.html</loc>
<lastmod>2025-06-10T17:04:21.226Z</lastmod>
<lastmod>2025-06-10T23:53:45.043Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.bench.html</loc>
<lastmod>2025-06-10T17:04:21.980Z</lastmod>
<lastmod>2025-06-10T23:53:45.790Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.transformers_fa_utils.html</loc>
<lastmod>2025-06-10T17:04:21.914Z</lastmod>
<lastmod>2025-06-10T23:53:45.725Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_patch_multipack.html</loc>
<lastmod>2025-06-10T17:04:21.898Z</lastmod>
<lastmod>2025-06-10T23:53:45.710Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.mistral_attn_hijack_flash.html</loc>
<lastmod>2025-06-10T17:04:21.848Z</lastmod>
<lastmod>2025-06-10T23:53:45.664Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.ctx_managers.sequence_parallel.html</loc>
<lastmod>2025-06-10T17:04:21.512Z</lastmod>
<lastmod>2025-06-10T23:53:45.329Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/integrations.grokfast.optimizer.html</loc>
<lastmod>2025-06-10T17:04:22.297Z</lastmod>
<lastmod>2025-06-10T23:53:46.109Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.callbacks.comet_.html</loc>
<lastmod>2025-06-10T17:04:22.424Z</lastmod>
<lastmod>2025-06-10T23:53:46.234Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.multipack.html</loc>
<lastmod>2025-06-10T17:04:21.850Z</lastmod>
<lastmod>2025-06-10T23:53:45.665Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.collators.mm_chat.html</loc>
<lastmod>2025-06-10T17:04:22.364Z</lastmod>
<lastmod>2025-06-10T23:53:46.175Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.tokenization.html</loc>
<lastmod>2025-06-10T17:04:21.955Z</lastmod>
<lastmod>2025-06-10T23:53:45.766Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.metharme.html</loc>
<lastmod>2025-06-10T17:04:21.609Z</lastmod>
<lastmod>2025-06-10T23:53:45.425Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.collators.batching.html</loc>
<lastmod>2025-06-10T17:04:22.356Z</lastmod>
<lastmod>2025-06-10T23:53:46.167Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.base.html</loc>
<lastmod>2025-06-10T17:04:21.382Z</lastmod>
<lastmod>2025-06-10T23:53:45.199Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.grpo.trainer.html</loc>
<lastmod>2025-06-10T17:04:21.425Z</lastmod>
<lastmod>2025-06-10T23:53:45.242Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.chatml.html</loc>
<lastmod>2025-06-10T17:04:21.646Z</lastmod>
<lastmod>2025-06-10T23:53:45.462Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.quantization.html</loc>
<lastmod>2025-06-10T17:04:22.084Z</lastmod>
<lastmod>2025-06-10T23:53:45.899Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.llama2_chat.html</loc>
<lastmod>2025-06-10T17:04:21.585Z</lastmod>
<lastmod>2025-06-10T23:53:45.402Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.quantize.html</loc>
<lastmod>2025-06-10T17:04:21.372Z</lastmod>
<lastmod>2025-06-10T23:53:45.189Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_instruct.html</loc>
<lastmod>2025-06-10T17:04:21.553Z</lastmod>
<lastmod>2025-06-10T23:53:45.369Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.vllm_serve.html</loc>
<lastmod>2025-06-10T17:04:21.357Z</lastmod>
<lastmod>2025-06-10T23:53:45.174Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.alpaca_chat.html</loc>
<lastmod>2025-06-10T17:04:21.551Z</lastmod>
<lastmod>2025-06-10T23:53:45.367Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.bradley_terry.llama3.html</loc>
<lastmod>2025-06-10T17:04:21.693Z</lastmod>
<lastmod>2025-06-10T23:53:45.509Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.dict.html</loc>
<lastmod>2025-06-10T17:04:22.052Z</lastmod>
<lastmod>2025-06-10T23:53:45.862Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.dpo.user_defined.html</loc>
<lastmod>2025-06-10T17:04:21.649Z</lastmod>
<lastmod>2025-06-10T23:53:45.465Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.llama_attn_hijack_xformers.html</loc>
<lastmod>2025-06-10T17:04:21.834Z</lastmod>
<lastmod>2025-06-10T23:53:45.649Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.lora.html</loc>
<lastmod>2025-06-10T17:04:21.971Z</lastmod>
<lastmod>2025-06-10T23:53:45.781Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.gradient_checkpointing.offload_cpu.html</loc>
<lastmod>2025-06-10T17:04:21.922Z</lastmod>
<lastmod>2025-06-10T23:53:45.733Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.trainer.html</loc>
<lastmod>2025-06-10T17:04:22.004Z</lastmod>
<lastmod>2025-06-10T23:53:45.815Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.orcamini.html</loc>
<lastmod>2025-06-10T17:04:21.613Z</lastmod>
<lastmod>2025-06-10T23:53:45.429Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.messages.chat.html</loc>
<lastmod>2025-06-10T17:04:21.623Z</lastmod>
<lastmod>2025-06-10T23:53:45.440Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.lora_kernels.html</loc>
<lastmod>2025-06-10T17:04:21.887Z</lastmod>
<lastmod>2025-06-10T23:53:45.699Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.schemas.enums.html</loc>
<lastmod>2025-06-10T17:04:22.166Z</lastmod>
<lastmod>2025-06-10T23:53:45.980Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.config.html</loc>
<lastmod>2025-06-10T17:04:21.270Z</lastmod>
<lastmod>2025-06-10T23:53:45.087Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.gradient_checkpointing.offload_disk.html</loc>
<lastmod>2025-06-10T17:04:21.948Z</lastmod>
<lastmod>2025-06-10T23:53:45.759Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/monkeypatch.stablelm_attn_hijack_flash.html</loc>
<lastmod>2025-06-10T17:04:21.904Z</lastmod>
<lastmod>2025-06-10T23:53:45.716Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/kernels.lora.html</loc>
<lastmod>2025-06-10T17:04:21.776Z</lastmod>
<lastmod>2025-06-10T23:53:45.592Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/prompt_strategies.base.html</loc>
<lastmod>2025-06-10T17:04:21.514Z</lastmod>
<lastmod>2025-06-10T23:53:45.331Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/core.trainers.relora.html</loc>
<lastmod>2025-06-10T17:04:21.408Z</lastmod>
<lastmod>2025-06-10T23:53:45.225Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/loaders.model.html</loc>
<lastmod>2025-06-10T17:04:21.449Z</lastmod>
<lastmod>2025-06-10T23:53:45.266Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/utils.callbacks.perplexity.html</loc>
<lastmod>2025-06-10T17:04:22.412Z</lastmod>
<lastmod>2025-06-10T23:53:46.222Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/api/cli.inference.html</loc>
<lastmod>2025-06-10T17:04:21.284Z</lastmod>
<lastmod>2025-06-10T23:53:45.101Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/batch_vs_grad.html</loc>
<lastmod>2025-06-10T17:03:50.698Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/sequence_parallelism.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/getting-started.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.122Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/torchao.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset_preprocessing.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.122Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/docker.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.122Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/ray-integration.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset-formats/inst_tune.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset-formats/stepwise_supervised.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/dataset-formats/index.html</loc>
<lastmod>2025-06-10T17:03:50.698Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/multimodal.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/reward_modelling.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/faq.html</loc>
<lastmod>2025-06-10T17:03:50.699Z</lastmod>
<lastmod>2025-06-10T23:53:16.122Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/installation.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.124Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/unsloth.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.125Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/config.html</loc>
<lastmod>2025-06-10T17:03:50.698Z</lastmod>
<lastmod>2025-06-10T23:53:16.121Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/docs/inference.html</loc>
<lastmod>2025-06-10T17:03:50.702Z</lastmod>
<lastmod>2025-06-10T23:53:16.124Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/src/axolotl/integrations/LICENSE.html</loc>
<lastmod>2025-06-10T17:03:50.719Z</lastmod>
<lastmod>2025-06-10T23:53:16.142Z</lastmod>
</url>
<url>
<loc>https://docs.axolotl.ai/index.html</loc>
<lastmod>2025-06-10T17:03:50.715Z</lastmod>
<lastmod>2025-06-10T23:53:16.138Z</lastmod>
</url>
</urlset>