Fireworks AI Serverless
Fast shared inference for popular open models, with structured output and function calling.
| Hosting type | Serverless API |
|---|---|
| LLM models | Llama 3.3 70B Instruct, Llama 3.1 8B Instruct, DeepSeek-V3, gpt-oss-120b |
| Pricing range | |
| Pricing model | Pay per token |
| Free tier available | Yes |
| Data center location | |
| Hardware / GPU options | Shared GPU fleet managed by the provider. |
| VRAM & memory | |
| Maximum model size | |
| OpenAI-compatible API | Yes |
News about Fireworks AI
All news →Per token or per GPU-hour? Choose the billing model that fits your traffic
Spiky, low-volume traffic favours per-token plans. Steady, high-volume traffic often doesn't.
gpt-oss-120b is available on several serverless hosts
OpenAI's open-weight model can be called per token without running your own GPUs.