Interview Q&A / AI & Generative AI
AI & Generative AI interview questions
LLMs, tokens, embeddings, RAG and prompt engineering, the questions every AI role now asks.
Prefer rapid revision? Practise AI & Generative AI short interview answers →
- What is self-consistency in prompting?
Self-consistency samples several independent reasoning answers to the same question at a non-zero temperature and picks the most common final answer. It improves accuracy on reasoning tasks at the price of multiplying token cost and latency.
AdvancedQuick answer1 min read - What is the difference between a bi-encoder and a cross-encoder?
A bi-encoder embeds the query and each document separately, so document vectors can be precomputed and searched fast. A cross-encoder reads query and document together for a more accurate score, but must run for every pair, so it is used on a short candidate list.
AdvancedQuick answer1 min read