tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Built site for gh-pages

Browse Source
This commit is contained in:
Quarto GHA Workflow Runner
2026-01-27 22:15:35 +00:00
parent 4c48b9b508
commit 4934c2f06a
9 changed files with 812 additions and 842 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
docs/api/cli.merge_sharded_fsdp_weights.html
View File

@@ -852,12 +852,10 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb3"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb3-1"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a>cli.merge_sharded_fsdp_weights.merge_fsdp_weights(</span>
<span id="cb3-2"><a href="#cb3-2" aria-hidden="true" tabindex="-1"></a> checkpoint_dir,</span>
<span id="cb3-3"><a href="#cb3-3" aria-hidden="true" tabindex="-1"></a> output_path,</span>
<span id="cb3-4"><a href="#cb3-4" aria-hidden="true" tabindex="-1"></a> safe_serialization<span class="op">=</span><span class="va">False</span>,</span>
<span id="cb3-5"><a href="#cb3-5" aria-hidden="true" tabindex="-1"></a> remove_checkpoint_dir<span class="op">=</span><span class="va">False</span>,</span>
<span id="cb3-6"><a href="#cb3-6" aria-hidden="true" tabindex="-1"></a>)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<span id="cb3-4"><a href="#cb3-4" aria-hidden="true" tabindex="-1"></a> remove_checkpoint_dir<span class="op">=</span><span class="va">False</span>,</span>
<span id="cb3-5"><a href="#cb3-5" aria-hidden="true" tabindex="-1"></a>)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<p>Merge the weights from sharded FSDP model checkpoints into a single combined checkpoint. Should be used if
<code>SHARDED_STATE_DICT</code> was used for the model. Weights will be saved to <code>{output_path}/model.safetensors</code> if
<code>safe_serialization</code> else <code>pytorch_model.bin</code>.</p>
<code>SHARDED_STATE_DICT</code> was used for the model. Weights will be saved to <code>{output_path}/model.safetensors</code>.</p>
<p>Note: this is a CPU-bound process.</p>
<section id="parameters-1" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-1">Parameters</h4>
@@ -890,12 +888,6 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<td><em>required</em></td>
</tr>
<tr class="odd">
<td>safe_serialization</td>
<td><code>bool</code>, <em>optional</em>, defaults to <code>True</code></td>
<td>Whether to save the merged weights with safetensors (recommended).</td>
<td><code>False</code></td>
</tr>
<tr class="even">
<td>remove_checkpoint_dir</td>
<td><code>bool</code>, <em>optional</em>, defaults to <code>False</code></td>
<td>Whether to remove the checkpoint directory after merging.</td>

52
docs/api/train.html
View File

@@ -912,21 +912,15 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</section>
<section id="axolotl.train.handle_untrained_tokens_fix" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.train.handle_untrained_tokens_fix">handle_untrained_tokens_fix</h3>
<div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb3"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb3-1"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a>train.handle_untrained_tokens_fix(</span>
<span id="cb3-2"><a href="#cb3-2" aria-hidden="true" tabindex="-1"></a> cfg,</span>
<span id="cb3-3"><a href="#cb3-3" aria-hidden="true" tabindex="-1"></a> model,</span>
<span id="cb3-4"><a href="#cb3-4" aria-hidden="true" tabindex="-1"></a> tokenizer,</span>
<span id="cb3-5"><a href="#cb3-5" aria-hidden="true" tabindex="-1"></a> train_dataset,</span>
<span id="cb3-6"><a href="#cb3-6" aria-hidden="true" tabindex="-1"></a> safe_serialization,</span>
<span id="cb3-7"><a href="#cb3-7" aria-hidden="true" tabindex="-1"></a>)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb3"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb3-1"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a>train.handle_untrained_tokens_fix(cfg, model, tokenizer, train_dataset)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<p>Apply fixes for untrained tokens if configured.</p>
<section id="parameters-2" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-2">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 18%">
<col style="width: 19%">
<col style="width: 50%">
<col style="width: 14%">
<col style="width: 20%">
<col style="width: 52%">
<col style="width: 11%">
</colgroup>
<thead>
@@ -962,12 +956,6 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<td>The training dataset to use.</td>
<td><em>required</em></td>
</tr>
<tr class="odd">
<td>safe_serialization</td>
<td>bool</td>
<td>Whether to use safe serialization when saving.</td>
<td><em>required</em></td>
</tr>
</tbody>
</table>
</section>
@@ -1024,16 +1012,16 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</section>
<section id="axolotl.train.save_trained_model" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.train.save_trained_model">save_trained_model</h3>
<div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb5"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb5-1"><a href="#cb5-1" aria-hidden="true" tabindex="-1"></a>train.save_trained_model(cfg, trainer, model, safe_serialization)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb5"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb5-1"><a href="#cb5-1" aria-hidden="true" tabindex="-1"></a>train.save_trained_model(cfg, trainer, model)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<p>Save the trained model according to configuration and training setup.</p>
<section id="parameters-4" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-4">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 19%">
<col style="width: 16%">
<col style="width: 51%">
<col style="width: 11%">
<col style="width: 9%">
<col style="width: 18%">
<col style="width: 58%">
<col style="width: 13%">
</colgroup>
<thead>
<tr class="header">
@@ -1062,12 +1050,6 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<td>The trained model to save.</td>
<td><em>required</em></td>
</tr>
<tr class="even">
<td>safe_serialization</td>
<td>bool</td>
<td>Whether to use safe serialization.</td>
<td><em>required</em></td>
</tr>
</tbody>
</table>
</section>
@@ -1288,16 +1270,16 @@ trainer setup.</p>
</section>
<section id="axolotl.train.setup_signal_handler" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.train.setup_signal_handler">setup_signal_handler</h3>
<div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb10"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb10-1"><a href="#cb10-1" aria-hidden="true" tabindex="-1"></a>train.setup_signal_handler(cfg, model, safe_serialization)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<div class="code-copy-outer-scaffold"><div class="sourceCode" id="cb10"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb10-1"><a href="#cb10-1" aria-hidden="true" tabindex="-1"></a>train.setup_signal_handler(cfg, model)</span></code></pre></div><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></div>
<p>Set up signal handler for graceful termination.</p>
<section id="parameters-9" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-9">Parameters</h4>
<table class="caption-top table">
<colgroup>
<col style="width: 19%">
<col style="width: 16%">
<col style="width: 51%">
<col style="width: 11%">
<col style="width: 8%">
<col style="width: 18%">
<col style="width: 58%">
<col style="width: 13%">
</colgroup>
<thead>
<tr class="header">
@@ -1320,12 +1302,6 @@ trainer setup.</p>
<td>The model to save on termination</td>
<td><em>required</em></td>
</tr>
<tr class="odd">
<td>safe_serialization</td>
<td>bool</td>
<td>Whether to use safe serialization when saving</td>
<td><em>required</em></td>
</tr>
</tbody>
</table>
</section>