Transformer

The foundational architecture behind most modern language models, which uses an "attention" mechanism to understand relationships between words.