3 lessons
Course
Going local
How to stop paying for an API: the hardware maths, the install, and the two tools that matter.
-
Local setup
Running your first local model
Do this first, the rest makes no sense otherwise.
-
Tool
Ollama
The tool most people settle on.
-
Tool
LM Studio
Use it to pick a quantisation, then go back to Ollama.