tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Built site for gh-pages

Browse Source
This commit is contained in:
Quarto GHA Workflow Runner
2025-09-11 00:33:02 +00:00
parent ab0619cc51
commit 1541d0d193
9 changed files with 1865 additions and 1653 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/api/cli.inference.html
View File

@@ -536,7 +536,7 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
</tr>
<tr class="even">
<td><a href="#axolotl.cli.inference.do_inference">do_inference</a></td>
<td>Runs inference on the command line in a loop. User input is accepted, a chat template</td>
<td>Runs inference on the command line in a loop. User input is accepted, a chat</td>
</tr>
<tr class="odd">
<td><a href="#axolotl.cli.inference.do_inference_gradio">do_inference_gradio</a></td>
@@ -589,9 +589,9 @@ gtag('config', 'G-9KYCVJBNMQ', { 'anonymize_ip': true});
<section id="axolotl.cli.inference.do_inference" class="level3">
<h3 class="anchored" data-anchor-id="axolotl.cli.inference.do_inference">do_inference</h3>
<div class="sourceCode" id="cb2"><pre class="sourceCode python code-with-copy"><code class="sourceCode python"><span id="cb2-1"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a>cli.inference.do_inference(cfg, cli_args)</span></code><button title="Copy to Clipboard" class="code-copy-button"><i class="bi"></i></button></pre></div>
<p>Runs inference on the command line in a loop. User input is accepted, a chat template
is (optionally) applied, and the model specified in the <code>axolotl</code> config is used to
generate completions according to a default generation config.</p>
<p>Runs inference on the command line in a loop. User input is accepted, a chat
template is (optionally) applied, and the model specified in the <code>axolotl</code> config is
used to generate completions according to a default generation config.</p>
<section id="parameters-1" class="level4 doc-section doc-section-parameters">
<h4 class="doc-section doc-section-parameters anchored" data-anchor-id="parameters-1">Parameters</h4>
<table class="caption-top table">