Interview Q&A / AI & Generative AI

INTERVIEW Q&A · 61 QUESTIONS

AI & Generative AI interview questions

LLMs, tokens, embeddings, RAG and prompt engineering, the questions every AI role now asks.

  1. How do you choose chunk size in a RAG system?

    Small chunks give precise matches but may lose surrounding context. Large chunks keep context but dilute the embedding and waste prompt space. Pick a starting size from the document type, then tune it by measuring retrieval quality on real questions.

    IntermediateQuick answer1 min read
  2. Should you change temperature and top-p at the same time?

    Usually adjust one and leave the other at its default. Both reshape the randomness of the choice, so changing both makes it hard to tell which caused a difference and can overshoot, giving output that is either too rigid or too erratic.

    IntermediateQuick answer1 min read