1:1 mentoring with Big Tech AI engineers
Q1

What's the difference between a chatbot and an agent?

Fundamentals & Architecture

AgentsArchitectureTool Use

How to Answer

"A chatbot is a single LLM call — input in, text out, stateless. An agent is an LLM inside a loop. The loop gives it tools, memory, and the ability to take actions in the world. The agent decides what to do next based on observations. The key difference is autonomy — an agent can reason, act, observe, and iterate until a task is complete. The 'agent' is actually the while-loop your code runs around the LLM, not the LLM itself."