Pre-training

Data format for a pre-training completion task.

Note

Pre-training documentation has been consolidated:

• Streaming pretraining (large datasets): See Streaming Datasets
• Non-streaming pretraining (type: completion): See Dataset Formats