Esc

Temperature

A sampling setting that decides how much randomness goes into picking each next token.

At temperature 0 the model takes the likeliest token every time, so the same input gives nearly the same output. Raise it and unlikely tokens get a real chance. The text varies more and gets harder to predict.

I keep it between 0 and 0.3 for extraction, classification and code, and for anything I will run twice and expect to match. Around 0.7 works for drafting and brainstorming. Above 1 you mostly get noise, not creativity. If the output feels stale, fix the prompt before touching the dial.

Temperature interacts with top-p. Change both at once and you will not know which one did what, so tune one.

Where this comes up

Prompts, configs and tutorials in the library that touch this term.