Interview Q&A / AI & Generative AI
AI & Generative AI interview questions
LLMs, tokens, embeddings, RAG and prompt engineering, the questions every AI role now asks.
Prefer rapid revision? Practise AI & Generative AI short interview answers →
- What is a causal mask in a decoder-only model?
A causal mask blocks each token from attending to later tokens, so position n sees only positions up to n. It matches generation, where future tokens do not exist yet, and lets training predict every position in parallel without cheating.
IntermediateQuick answer1 min read