Interview Q&A / AI & Generative AI

INTERVIEW Q&A · 61 QUESTIONS

AI & Generative AI interview questions

LLMs, tokens, embeddings, RAG and prompt engineering, the questions every AI role now asks.

  1. What is the difference between a base model and an instruction-tuned model?

    A base model is trained only to continue text, so it may ramble or continue your question with more questions. An instruction-tuned model is further trained on examples of instructions and good answers, so it follows requests and replies helpfully.

    BeginnerQuick answer1 min read
  2. What is the difference between training and inference in an LLM?

    Training adjusts the model's weights by learning from data and costs enormous compute once. Inference uses the finished, frozen weights to answer a prompt and happens on every request. A chat message never changes the weights.

    BeginnerQuick answer1 min read