0
Prompts
Meta Runs locally
Llama
You run Llama on your own machine through Ollama, llama.cpp or LM Studio, which is why it gets picked for private data and offline work. The small quantised variants lose track of multi-part instructions more often than hosted models do. Split long prompts into single tasks and keep the output format plain. Parameters sit in a Modelfile, outside the prompt.
2
Configs
Modelfile
Config file
Yes
Runs locally
Models
Llama 3.2 8B
Llama 3.3 70B
Configuration files
All 2- Llama
Modelfile for a consistent local persona
A Modelfile that fixes the system prompt and sampling parameters of a local model, so the same behaviour holds in every session and you stop retyping…
- LlamaMistral
Ollama Modelfile for a local code assistant
A Modelfile with a system prompt and parameters tuned for short, correct code answers on a local model.
Guides
- LlamaMistral
Running a model on your own machine
What local models are genuinely good for, what hardware you need, and what to change in prompts that came from a hosted model.
Common questions
Where do you put standing rules for Llama?
In Modelfile. It is read on every session, so anything you would otherwise paste into each message belongs there rather than in the conversation.
Do Llama prompts work on other models?
Usually with changes. Every resource here records where it was tested and what to adjust elsewhere, and portable ones are filed under Universal.
Can Llama run on my own machine?
Yes. Memory is the constraint: a 4-bit quantised model needs roughly 0.6 GB per billion parameters plus room for the context window.