Dataset

A dataset is the raw material of training — the vast collection of text, images, or other data the model learns from. The quality, diversity, and biases of the dataset directly shape everything the model knows and how it behaves. Most large language models are trained on a substantial portion of the public internet, plus books, code, and other curated sources.