Back to Tags
Attention Mechanism
2 items tagged with "attention-mechanism"
Filter by type:
Glossaries2
Glossary
Transformer
A transformer is a neural network architecture built around self-attention that processes sequences in parallel, forming the basis of modern large language models.
Glossary
Attention Mechanism
An attention mechanism lets a model weigh the relevance of different parts of its input when producing each output, focusing on the most pertinent tokens.