---
title: Pre-training
description: Data format for a pre-training completion task.
order: 1
---

::: {.callout-note}
Pre-training documentation has been consolidated:

- **Streaming pretraining** (large datasets): See [Streaming Datasets](../streaming.qmd#pretraining-with-streaming)
- **Non-streaming pretraining** (`type: completion`): See [Dataset Formats](index.qmd#pre-training)
:::