Hosted services
Somebody else runs it and you pay for that.
Replicate
Run thousands of community-published models, image, audio, video and language, behind one API without hosting any of them yourself.
Tested on GPT-5 · Jun 2026
Groq Cloud
Hosted inference on custom LPU hardware, built for speed. Open-weight models answer at a token rate that makes streaming feel close to instant.
Tested on Llama 3.3 70B · Jun 2026
OpenRouter
One API and one bill for dozens of hosted models from different providers. Use it to compare models or to route each task to whichever is cheapest or…
Tested on GPT-5 · Jun 2026
Together AI
Hosted inference for open-weight models such as Llama, Mixtral and Qwen, plus fine-tuning, at a lower price than most proprietary-model APIs.
Tested on Llama 3.3 70B · Jun 2026