News
Announcements, reviews and editorials on LLM hosting plans and models.
Why we track hosting plans and models separately
The same model can cost and behave very differently depending on the plan you run it on.
Per token or per GPU-hour? Choose the billing model that fits your traffic
Spiky, low-volume traffic favours per-token plans. Steady, high-volume traffic often doesn't.
Review: RunPod Serverless for open models
Flexible and inexpensive at low volume, but you own the container and the cold starts.
Review: Together AI Serverless Inference
A broad catalogue behind an OpenAI-compatible API makes this an easy place to start.
gpt-oss-120b is available on several serverless hosts
OpenAI's open-weight model can be called per token without running your own GPUs.