13 lines
285 B
Plaintext
13 lines
285 B
Plaintext
---
|
|
title: Custom Pre-Tokenized Dataset
|
|
description: How to use a custom pre-tokenized dataset.
|
|
order: 5
|
|
---
|
|
|
|
- Do not pass a `type:` in your axolotl config.
|
|
- Columns in Dataset must be exactly `input_ids`, `attention_mask`, `labels`
|
|
|
|
```{.yaml filename="config.yml"}
|
|
- path: ...
|
|
```
|