Llama 3.3 70B Instruct
A general-purpose instruction-tuned model and a common default for open-weight chat workloads.
Where it fits
A general-purpose instruction-tuned model and a common default for open-weight chat workloads.
Use the hosting plans listed on this page to compare where you can run it.
Editor's note: this is sample content. Check names, prices and specs against the provider before publishing, then edit or replace it in the admin.
Where to host it
All plans →RunPod GPU Pods
Rent GPU machines by the hour and run any serving stack you like.
PricingPer GPU-hour
GroqCloud Developer Tier
Very fast token generation on Groq's LPU hardware, with a free tier to start.
PricingPay per token
Fireworks AI On-Demand Deployments
Private deployments on reserved GPUs with no per-token rate limits.
PricingPer GPU-hour, Per second of GPU time
Fireworks AI Serverless
Fast shared inference for popular open models, with structured output and function calling.
PricingPay per token
Together AI Dedicated Endpoints
Reserved GPUs running the model you choose, for steady latency and throughput.
PricingPer GPU-hour
Together AI Serverless Inference
Shared, pay-as-you-go endpoints for a large catalogue of open models behind one API.
PricingPay per token
RunPod Serverless
Run your own container or a ready-made vLLM worker on GPUs that scale with requests.
PricingPer second of GPU time
News about this model
All news →Why we track hosting plans and models separately
The same model can cost and behave very differently depending on the plan you run it on.
Review: Together AI Serverless Inference
A broad catalogue behind an OpenAI-compatible API makes this an easy place to start.