Interview Q&A / AI & Generative AI
AI & Generative AI interview questions
LLMs, tokens, embeddings, RAG and prompt engineering, the questions every AI role now asks.
Prefer rapid revision? Practise AI & Generative AI short interview answers →
- What is the difference between an LLM and a chatbot?
An LLM is the underlying model that turns input text into output text. A chatbot is a full product around it, with a chat interface, instructions, memory handling, safety checks, and often tools or company data.
BeginnerQuick answer1 min read - Why did transformers replace RNNs for most language tasks?
RNNs read tokens one at a time and squeeze history into a single state, which is slow to train and forgets distant words. Transformers process all tokens in parallel and connect any two directly through attention, so they train faster and use long context better.
BeginnerQuick answer1 min read - What is the difference between encoder-only, decoder-only and encoder-decoder models?
Encoder-only models like BERT read the whole input in both directions and suit classification and embeddings. Decoder-only models generate text left to right and power most chat LLMs. Encoder-decoder models read an input then generate an output, as in translation.
IntermediateQuick answer1 min read