Gemma 2 9B
A compact Gemma 2 model for single-GPU use.
Overview
Gemma 2 9B is a compact model from Google's Gemma 2 family, built from the same research as Gemini. It's small enough to run on a single consumer GPU while still handling chat, summarisation and simple reasoning well. It suits lightweight, low-cost deployments.
| Weights | Open |
|---|---|
| Parameters | 9B |
| Context window | 8K tokens |
| Licence | Custom |
| Commercial use | With conditions |
LLM hosts that offer Gemma 2 9B
All hosts →| LLM host | Hosting plan | Hosting type | Pricing |
|---|---|---|---|
| Amazon AWS | Amazon EC2 | GPU cloud | From US$0.526Per GPU-hour, Reserved or committed capacity |
| Amazon AWS | Amazon SageMaker | Dedicated endpoint | From US$0.736Per GPU-hour, Reserved or committed capacity |
| Google Cloud | Model Garden | Serverless API | From US$0.07Pay per token, Per GPU-hour |
| Google Cloud | Google Kubernetes Engine (GKE) | GPU cloud | From US$0.35Per GPU-hour, Reserved or committed capacity |
| Google Cloud | Compute Engine | GPU cloud | From US$0.35Per GPU-hour, Reserved or committed capacity |
| Microsoft Azure | Azure Machine Learning | Dedicated endpoint | From US$0.526Per GPU-hour, Reserved or committed capacity |
| Microsoft Azure | Azure Kubernetes Service (AKS) | GPU cloud | From US$0.526Per GPU-hour, Reserved or committed capacity |
| Microsoft Azure | Azure GPU Virtual Machines | GPU cloud | From US$0.526Per GPU-hour, Reserved or committed capacity |