What is a transformer in AI?

02 · See it in action

Follow the steps

1. Write two sentences where the same word has different meanings.
2. Identify nearby words that disambiguate it.
3. Imagine assigning different relevance weights to those words.
4. Explain how a context-sensitive representation differs from a fixed dictionary lookup.

Worked example

"She sat by the river bank."
"She deposited money at the bank."
The tokens "river" and "money" provide different context.
Attention is learned numeric computation, not a human reading rule.

Read the example once, then explain each part aloud in your own words. If it includes Python, you can understand the idea first and run the code later in a local Python environment. Code is shown as text; this page does not execute it.

Sign in to save your reading progress.