Timeline milestone
The Transformer rewrites the architecture of language AI
-
Research
The Transformer rewrites the architecture of language AI
“Attention Is All You Need” introduced an architecture based on attention rather than recurrent processing.
Transformers process relationships between tokens in parallel, making training easier to scale than earlier recurrent approaches. The original paper focused on translation, but its architecture became the foundation of most modern large language models and many multimodal systems.Sources & references 1 source
