tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Built site for gh-pages

Browse Source
This commit is contained in:
Quarto GHA Workflow Runner
2025-03-21 17:30:33 +00:00
parent 486fc53c93
commit 127f9229b5
171 changed files with 127099 additions and 1001 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
docs/fsdp_qlora.html
View File

@@ -144,7 +144,7 @@ ul.task-list li input[type="checkbox"] {
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="../docs/cli.html" class="sidebar-item-text sidebar-link">
<span class="menu-text">CLI Reference</span></a>
<span class="menu-text">Command Line Interface (CLI)</span></a>
</div>
</li>
<li class="sidebar-item">
@@ -152,6 +152,12 @@ ul.task-list li input[type="checkbox"] {
<a href="../docs/config.html" class="sidebar-item-text sidebar-link">
<span class="menu-text">Config Reference</span></a>
</div>
</li>
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="../docs/api" class="sidebar-item-text sidebar-link">
<span class="menu-text">API Reference</span></a>
</div>
</li>
</ul>
</li>
@@ -436,7 +442,8 @@ ul.task-list li input[type="checkbox"] {
<h2 class="anchored" data-anchor-id="usage">Usage</h2>
<p>To enable <code>QLoRA</code> with <code>FSDP</code>, you need to perform the following steps:</p>
<blockquote class="blockquote">
<p>![Tip] See the <a href="#example-config">example config</a> file in addition to reading these instructions.</p>
<p>![Tip]
See the <a href="#example-config">example config</a> file in addition to reading these instructions.</p>
</blockquote>
<ol type="1">
<li>Set <code>adapter: qlora</code> in your axolotl config file.</li>