Transformer

The Transformer is the fundamental design behind virtually all modern language models — GPT, Claude, Gemini, and others. Introduced in 2017, its key innovation was the attention mechanism, which allows the model to process entire sequences in parallel rather than word by word. The name "Transformer" refers to how it transforms input sequences into output sequences through stacked layers of attention.