RAG — Interview Guide
13 sections across 3 parts — click any card to start
Latest from the Blog
All posts →LLM Evaluation Metrics That Actually Matter
Eval scores rising while users complain is rarely a broken metric — it is a metric that stopped describing production and kept returning a number anyway. Here are the three layers that answer three different questions, seven metrics and what each is blind to, why retrieval has to be scored separately from generation, how to validate an LLM judge like the classifier it is, and how to build the two hundred examples that decide whether any of it tells the truth.
AI System Design Interview — A Support Agent, Designed Out Loud
Everyone draws roughly the same diagram, which is why the diagram is not what separates candidates. Here is one problem worked end to end: the four scoping questions that actually change the design, the cost arithmetic that turns a triage box into an architectural argument, the five-stage architecture with the four points interviewers push on, what a strong answer sounds like at each, and the failure modes worth naming before you are asked.
How to Prevent Prompt Injection — A Defence Checklist
Jailbreaking is a user talking a model into saying something; injection is a third party getting your agent to do something — and once the agent has tools, that is a security problem, not a content one. Here is why the two are different, the five sources of untrusted text that all land in one window, the defence layers ranked by what they actually buy you, a checklist split into blast radius, input handling and detection, and how to red-team from the tool list rather than the prompt.