Interview Q&A / AI & Generative AI

INTERVIEW Q&A · 61 QUESTIONS

AI & Generative AI interview questions

LLMs, tokens, embeddings, RAG and prompt engineering, the questions every AI role now asks.

  1. How would you evaluate an LLM application before launching it?

    Build a test set of realistic inputs with expected outcomes, define metrics tied to the real goal, run automated checks plus human review on a sample, include edge cases and adversarial inputs, set pass thresholds, and keep the set to catch regressions later.

    BeginnerQuick answer1 min read
  2. What is a golden dataset in LLM evaluation?

    A golden dataset is a curated set of inputs paired with verified expected answers or grading criteria, reviewed by people. It is the fixed benchmark you re-run after every change to see whether quality improved or regressed on your real use case.

    BeginnerQuick answer1 min read