tocmo0nlord/axolotl
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

fix: clarify how to use lm_eval plugin (#3404) [skip ci]

Browse Source
This commit is contained in:
NanoCode012
2026-02-15 19:52:30 +07:00
committed by GitHub
parent d6a2532dd7
commit 4f1b5ad29f
4 changed files with 69 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/cli.qmd
View File

@@ -210,6 +210,8 @@ axolotl lm-eval config.yml
Configuration options:
```yaml
lm_eval_model: # model to evaluate (local or hf path)
# List of tasks to evaluate
lm_eval_tasks:
- arc_challenge
@@ -218,7 +220,7 @@ lm_eval_batch_size: # Batch size for evaluation
output_dir: # Directory to save evaluation results
```
See [LM Eval Harness](https://github.com/EleutherAI/lm-evaluation-harness) for more details.
See [LM Eval Harness integration docs](https://docs.axolotl.ai/docs/custom_integrations.html#language-model-evaluation-harness-lm-eval) for full configuration details.
### delinearize-llama4