Llama 3.3 70B Instruct
A 70B model that performs close to Llama 3.1 405B at a fraction of the cost.
Overview
Llama 3.3 70B Instruct is Meta's 70B text model that performs close to the much larger Llama 3.1 405B at a fraction of the cost. It supports a 128K-token context window and eight languages. It's one of the most widely offered open models across LLM hosting providers.
| Weights | Open |
|---|---|
| Parameters | 70B |
| Context window | 128K tokens |
| Licence | Llama Community |
| Commercial use | With conditions |
LLM hosts that offer Llama 3.3 70B Instruct
All hosts →| LLM host | Hosting plan | Hosting type | Pricing |
|---|---|---|---|
| Amazon AWS | Amazon Bedrock | Serverless API | From US$0.04Pay per token, Reserved or committed capacity |
| Amazon AWS | Amazon SageMaker | Dedicated endpoint | From US$0.736Per GPU-hour, Reserved or committed capacity |
| Amazon AWS | Amazon EC2 | GPU cloud | From US$0.526Per GPU-hour, Reserved or committed capacity |
| Google Cloud | Model Garden | Serverless API | From US$0.07Pay per token, Per GPU-hour |
| Google Cloud | Google Kubernetes Engine (GKE) | GPU cloud | From US$0.35Per GPU-hour, Reserved or committed capacity |
| Google Cloud | Compute Engine | GPU cloud | From US$0.35Per GPU-hour, Reserved or committed capacity |
| Microsoft Azure | Azure AI Foundry | Serverless API | From US$0.15Pay per token, Reserved or committed capacity |
| Microsoft Azure | Azure Machine Learning | Dedicated endpoint | From US$0.526Per GPU-hour, Reserved or committed capacity |
| Microsoft Azure | Azure Kubernetes Service (AKS) | GPU cloud | From US$0.526Per GPU-hour, Reserved or committed capacity |
| Microsoft Azure | Azure GPU Virtual Machines | GPU cloud | From US$0.526Per GPU-hour, Reserved or committed capacity |