Llama 3.1 8B Instruct
A small, fast model for classification, extraction and high-volume, low-cost tasks.
Where it fits
A small, fast model for classification, extraction and high-volume, low-cost tasks.
Use the hosting plans listed on this page to compare where you can run it.
Editor's note: this is sample content. Check names, prices and specs against the provider before publishing, then edit or replace it in the admin.
Where to host it
All plans →RunPod Serverless
Run your own container or a ready-made vLLM worker on GPUs that scale with requests.
PricingPer second of GPU time
RunPod GPU Pods
Rent GPU machines by the hour and run any serving stack you like.
PricingPer GPU-hour
GroqCloud Developer Tier
Very fast token generation on Groq's LPU hardware, with a free tier to start.
PricingPay per token
Fireworks AI Serverless
Fast shared inference for popular open models, with structured output and function calling.
PricingPay per token
Together AI Serverless Inference
Shared, pay-as-you-go endpoints for a large catalogue of open models behind one API.
PricingPay per token
Together AI Dedicated Endpoints
Reserved GPUs running the model you choose, for steady latency and throughput.
PricingPer GPU-hour
News about this model
All news →Review: RunPod Serverless for open models
Flexible and inexpensive at low volume, but you own the container and the cold starts.