Skip to content
✳AI UNIVERSITYBY COMMONJOBS
Deep Learning

What is a transformer in AI?

Attention lets a model combine information from different positions using learned relevance weights.

✳ Beginner◷ 5–10 min + practiceTEXT-BASED LEARNING

Start from zero. Learn the meaning, explore a worked example and practise in three short text lessons. No previous AI experience is needed.

Start here · beginner

03 · Practise and check

Try this yourself

Use "bat" in a sports sentence and an animal sentence. Identify the evidence that distinguishes the meanings.

Check your understanding

Context can change the useful representation of the same token. Attention weights alone are not a reliable explanation of a model’s complete decision.

A mistake to avoid

Do not interpret a fluent generated continuation as verified knowledge. Sequence modelling and fact-checking are different tasks.

Before looking at the answer, write a short explanation and one example of your own. Finish by naming one limitation of the method. Use Mark as read when you are ready, or return to the previous lesson if a term is unclear.

Sign in to save your reading progress.

Sign in
LET’S TALK

Find your next step.

Share a little about yourself. We’ll get in touch.

COMMONJOBS AI
✦ GEN Z’S WAY OF LEARNING

Your next era.
Powered by AI.

Make your next 5 days count.
Join the CommonJobs AI Bootcamp.

5-DAY AI BOOTCAMP12 Oct 2026

WE START IN

00Days
00Hours
00Minutes
00Seconds
Join Now

Learn AI. Build your next chapter.