Axolotl
Dataset Formats
Custom Pre-Tokenized Dataset
Home
How-To Guides
Debugging
Multipack (Sample Packing)
FDSP + QLoRA
Template-free prompt construction
RLHF (Beta)
NCCL
Mac M-series
Multi Node
Dataset Formats
Pre-training
Instruction Tuning
Conversation
Template-Free
Custom Pre-Tokenized Dataset
Reference
Config options
FAQ
Dataset Formats
Custom Pre-Tokenized Dataset
Custom Pre-Tokenized Dataset
How to use a custom pre-tokenized dataset.
Do not pass a
type:
in your axolotl config.
Columns in Dataset must be exactly
input_ids
,
attention_mask
,
labels
config.yml
-
path
:
...