Mistral AI Runs locally

Mistral

Mistral models are fast and cheap for classification, extraction and short generation. They reward tight prompts: a short role line, the rule set, and the input. Long rambling context tends to hurt rather than help.

0
Prompts
1
Configs
Modelfile
Config file
Yes
Runs locally

Models

Mistral Large Mistral Small

Configuration files

All 1

Guides

Common questions

Where do you put standing rules for Mistral?
In Modelfile. It is read on every session, so anything you would otherwise paste into each message belongs there rather than in the conversation.
Do Mistral prompts work on other models?
Usually with changes. Every resource here records where it was tested and what to adjust elsewhere, and portable ones are filed under Universal.
Can Mistral run on my own machine?
Yes. Memory is the constraint: a 4-bit quantised model needs roughly 0.6 GB per billion parameters plus room for the context window.

Other systems