Esc

Hallucination

A fluent, confident answer that is plain wrong: an invented citation, function, statistic or fact.

Nothing has broken when a model hallucinates. It produced the most plausible continuation, and a made-up reference that looks like a real one is very plausible. Smooth wording says nothing about accuracy.

The cases that catch people are specific and easy to check: library functions that do not exist, papers with real-sounding authors, legal citations, version numbers, prices. If the model states a number or a name, verify it.

You can lower the rate. Supply the source material so it does not lean on training data. Ask it to flag what it is unsure about. Give it a way to answer with nothing: a prompt that demands three findings gets three findings whether or not they exist. Retrieval, covered under rag, goes after the same problem from the data side.

Where this comes up

Prompts, configs and tutorials in the library that touch this term.