tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Built site for gh-pages

Browse Source
This commit is contained in:
Quarto GHA Workflow Runner
2025-06-18 19:48:08 +00:00
parent b1b81d070b
commit 88d1832ff5
193 changed files with 5541 additions and 5131 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/dataset-formats/conversation.html
View File

@@ -194,7 +194,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</li>
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="../../docs/config.html" class="sidebar-item-text sidebar-link">
<a href="../../docs/config-reference.html" class="sidebar-item-text sidebar-link">
<span class="menu-text">Config Reference</span></a>
</div>
</li>
@@ -514,7 +514,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</div>
<div class="sourceCode" id="cb1" data-filename="data.jsonl"><pre class="sourceCode json code-with-copy"><code class="sourceCode json"><span id="cb1-1"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a><span class="fu">{</span><span class="dt">"conversations"</span><span class="fu">:</span> <span class="ot">[</span><span class="fu">{</span><span class="dt">"role"</span><span class="fu">:</span> <span class="st">"..."</span><span class="fu">,</span> <span class="dt">"content"</span><span class="fu">:</span> <span class="st">"..."</span><span class="fu">}</span><span class="ot">]</span><span class="fu">}</span></span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
</div>
<p>See <a href="../../docs/config.html">configs</a> for full configs and supported templates.</p>
<p>See <a href="../../docs/config-reference.html">configs</a> for full configs and supported templates.</p>
<section id="migrating-from-sharegpt" class="level3">
<h3 class="anchored" data-anchor-id="migrating-from-sharegpt">Migrating from sharegpt</h3>
<p>Most configs can be adapted as follows:</p>
@@ -649,7 +649,7 @@ Tip
</div>
</div>
<div class="callout-body-container callout-body">
<p>See <a href="../../docs/config.html">config documentation</a> for detailed explanations of “turn”, “last”, and “all” options for training on tokens.</p>
<p>See <a href="../../docs/config-reference.html">config documentation</a> for detailed explanations of “turn”, “last”, and “all” options for training on tokens.</p>
</div>
</div>
<div class="callout callout-style-default callout-note callout-titled">
@@ -663,7 +663,7 @@ Note
</div>
<div class="callout-body-container callout-body">
<p>Using <code>eot_tokens</code> requires each token that exists in <code>chat_template</code> to be a single token in the tokenizer. Otherwise, the tokenizer will split the token and cause unexpected behavior.</p>
<p>You can add those tokens as new tokens under <code>tokens:</code> or (recommended) override unused added_tokens via <code>added_tokens_overrides:</code>. See <a href="../../docs/config.html">config</a> for more details.</p>
<p>You can add those tokens as new tokens under <code>tokens:</code> or (recommended) override unused added_tokens via <code>added_tokens_overrides:</code>. See <a href="../../docs/config-reference.html">config</a> for more details.</p>
</div>
</div>
<ul>