local models
Running models on your own hardware.
5 tagged items
- CheatsheetLlama
Ollama commands worth knowing
The subset of the CLI you actually use, plus the two flags that fix the problems everybody hits.
Tested on Llama 3.3 70B · May 2026
- Local setupLlama
Running your first local model
Ollama on a normal laptop, from install to a model answering in about ten minutes, plus how to work out which size actually fits before you download…
Tested on Llama 3.2 8B · May 2026
LM Studio
A desktop app for downloading, running and comparing local models without a terminal. Best tool for deciding which quantisation is good enough before…
Tested on Llama 3.2 8B · May 2026
Ollama
The simplest way to get a local model answering on your own machine. One command to install, one to pull a model, and an API on localhost that most…
Tested on Llama 3.3 70B · May 2026
- GuideLlamaMistral
Running a model on your own machine
What local models are genuinely good for, what hardware you need, and what to change in prompts that came from a hosted model.
- GuideUniversal
Choosing a model for the job
A practical comparison of what to reach for when, based on the shape of the task rather than benchmark scores.
- ConfigLlamaMistral
Ollama Modelfile for a local code assistant
A Modelfile with a system prompt and parameters tuned for short, correct code answers on a local model.
Related terms
Inference
Running a trained model to produce output - what happens every time you send a prompt.
Quantisation
Storing a model with lower-precision numbers so it fits in less memory and runs on ordinary hardware.