RAG and retrieval

Hallucination interview questions

The hallucination questions that keep coming up in AI engineer interviews. The first 3 come with full answers.

Updated 2026-09-05

01

What exactly is a hallucination, and what makes it dangerous to a reader?

A hallucination is output that's stated with total confidence but is simply not true. What makes it dangerous is that it arrives in the same fluent, assured tone as a correct answer — complete with plausible names, dates, or citations — so there's no nervous wobble to warn the reader. You can't catch it by feel; a bluff reads identically to a fact. That's exactly why you need grounding, citations, and automatic verification instead of trusting the output's confidence.
02

Why does a model trained to predict plausible next tokens produce confident falsehoods when it lacks knowledge?

Its only training objective is to predict the next token that fits the pattern — nowhere does it check a claim against reality, and fluency and accuracy are separate skills it only optimizes the first of. So when it hits something it doesn't know, it doesn't fall silent; it emits the most statistically natural continuation, which often reads like a real answer with invented specifics. There's no built-in uncertainty signal, so the confident guess comes out in the exact same voice as a fact.
03

Which mitigations reduce hallucination, and why is grounding with RAG the biggest lever?

The ladder: ground with RAG (fetch real documents, answer only from them), allow "I don't know" so it stops feeling pressure to invent, lower temperature for factual tasks, and ask for citations so claims are traceable. Grounding is the biggest lever because it removes the root cause — answering about things the model was never given. The others tighten behaviour; grounding changes where the facts come from, swapping fuzzy memory for a real page it can even cite.

Also asked in interviews

These 3 run inside the bootcamp as recall drills and voice mock interviews. You answer, the AI grades.

Knowing an answer and saying it under pressure are two different days. Inside Skillumen you answer these out loud and get graded on the spot. Foundations is free.

Try it free →

The open-source companion list, Awesome AI Engineer Interview Questions, curates 105 of these on GitHub.