GLOSSARY > TRANSFORMER ARCHITECTURE
Transformer Architecture
A deep learning architecture based on the self-attention mechanism, which weighs the significance of each part of the input data differently.
The Transformer Architecture is the foundational breakthrough that catalyzed the current AI era. By utilizing 'self-attention', Transformers can process entire sequences of text in parallel (unlike sequential RNNs), allowing them to grasp long-range dependencies and context, which forms the basis for all modern LLMs.
Explore More