A modern AI design that looks at all the words (or parts of an input) at once and figures out which parts should pay attention to each other. This makes it possible to build powerful language and vision models like GPT.
"Modern chatbots like ChatGPT are built on transformer models that can understand and generate text at scale."
