AI glossary

What is Transformer?

The neural network architecture behind modern LLMs, built from stacked attention and feed-forward layers.

Introduced in "Attention Is All You Need" (Vaswani et al., 2017). Attention lets each token draw information from other tokens in the context.

Related terms