← back to glossary

models

Pre-Training

The initial, large-scale training phase where a model learns language and general knowledge by processing vast amounts of text data before any task-specific work begins.

Last updated 2026-05-12