tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Built site for gh-pages

Browse Source
This commit is contained in:
Quarto GHA Workflow Runner
2025-06-18 19:48:08 +00:00
parent b1b81d070b
commit 88d1832ff5
193 changed files with 5541 additions and 5131 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/quantize.html
View File

@@ -193,7 +193,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</li>
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="../docs/config.html" class="sidebar-item-text sidebar-link">
<a href="../docs/config-reference.html" class="sidebar-item-text sidebar-link">
<span class="menu-text">Config Reference</span></a>
</div>
</li>
@@ -519,7 +519,7 @@ Note
<span id="cb1-7"><a href="#cb1-7" aria-hidden="true" tabindex="-1"></a></span>
<span id="cb1-8"><a href="#cb1-8" aria-hidden="true" tabindex="-1"></a><span class="fu">output_dir</span><span class="kw">:</span><span class="co"> # The path to the output directory.</span></span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Once quantization is complete, your quantized model will be saved in the <code>{output_dir}/quantized</code> directory.</p>
<p>You may also use the <code>quantize</code> command to quantize a model which has been trained with <a href="./qat.md">QAT</a> - you can do this by using the existing QAT configuration file which
<p>You may also use the <code>quantize</code> command to quantize a model which has been trained with <a href="../docs/qat.html">QAT</a> - you can do this by using the existing QAT configuration file which
you used to train the model:</p>
<div class="sourceCode" id="cb2"><pre class="sourceCode yaml code-with-copy"><code class="sourceCode yaml"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a><span class="co"># qat.yml</span></span>
<span id="cb2-2"><a href="#cb2-2" aria-hidden="true" tabindex="-1"></a><span class="fu">qat</span><span class="kw">:</span></span>