Esc

Fine-tuning

More training for an existing model on your own examples. It changes how the model behaves, not what it knows.

Fine-tuning keeps training a pretrained model on a dataset of your input and output pairs. It works for teaching a steady format, a house style or a narrow classification task, and it can let a small model match a large one on that single job at far lower cost.

It is a bad way to add facts. Knowledge baked in that way cannot be updated without retraining, and the model cannot cite it. Use rag for facts.

Try prompting first and push it hard. A few worked examples in the prompt, covered under few-shot-prompting, fix a surprising number of the problems that send people to fine-tuning, and they need no training run and no dataset to maintain.

Where this comes up

Prompts, configs and tutorials in the library that touch this term.