Interview Q&A / AI & Generative AI

INTERVIEW Q&A · 61 QUESTIONS

AI & Generative AI interview questions

LLMs, tokens, embeddings, RAG and prompt engineering, the questions every AI role now asks.

  1. What are embeddings, and how is vector similarity used to compare text?

    An embedding is a list of numbers that represents the meaning of a piece of text, so texts with similar meaning get vectors that point in similar directions. Similarity measures such as cosine similarity compare these vectors to find related text.

    IntermediateIn-depth3 min read
  2. What is the difference between token embeddings and sentence embeddings?

    A token embedding is the vector for one token that goes into the model's layers. A sentence embedding is a single vector summarising a whole text, produced by an embedding model, and used for search, clustering and similarity.

    IntermediateQuick answer1 min read