Together AI Serverless Inference
Shared, pay-as-you-go endpoints for a large catalogue of open models behind one API.
| Hosting type | Serverless API |
|---|---|
| LLM models | Llama 3.3 70B Instruct, Llama 3.1 8B Instruct, Qwen2.5 72B Instruct, DeepSeek-V3, gpt-oss-120b |
| Pricing range | |
| Pricing model | Pay per token |
| Free tier available | Yes |
| Data center location | |
| Hardware / GPU options | Shared GPU fleet managed by the provider. |
| VRAM & memory | |
| Maximum model size | |
| OpenAI-compatible API | Yes |
News about Together AI
All news →Why we track hosting plans and models separately
The same model can cost and behave very differently depending on the plan you run it on.
Per token or per GPU-hour? Choose the billing model that fits your traffic
Spiky, low-volume traffic favours per-token plans. Steady, high-volume traffic often doesn't.
Review: Together AI Serverless Inference
A broad catalogue behind an OpenAI-compatible API makes this an easy place to start.
gpt-oss-120b is available on several serverless hosts
OpenAI's open-weight model can be called per token without running your own GPUs.