How do I self-host Google Gemma 2?

Google Gemma 2 can be deployed using Docker Compose. The AltStack provides a production-ready configuration that you can deploy on your own server. Simply copy the configuration and run it on any machine with Docker installed.

What are the system requirements for self-hosting Google Gemma 2?

The recommended hardware for Google Gemma 2 is: 8GB VRAM (9B), 24GB+ VRAM (27B). Actual requirements may vary based on usage volume and data size.

Is Google Gemma 2 free to self-host?

Yes, Google Gemma 2 is open source under the Gemma License and free to self-host. Your only costs are the server infrastructure. A basic cloud VPS starts at around $5-10/month.

What programming language is Google Gemma 2 built with?

Google Gemma 2 is built with Python. It has 20,000 stars on GitHub, indicating strong community adoption and support.

Back to Self-Hosted Stacks

Deploy Google Gemma 2

Google's open-weight models (9B, 27B) with class-leading performance and efficient architecture.

Quick Start

Create a directory

mkdir gemma-self-hosted && cd gemma-self-hosted

Create config file

Copy the content from the Config tab below into a file named docker-compose.yml

Deploy

docker compose up -d

Fast Track

Deploy Google Gemma 2 in Minutes

Use our optimized Docker templates to deploy Google Gemma 2 on any cloud provider. Get $200 in free credit to start on DigitalOcean.

Start with free creditDeploy on DigitalOcean

$200

Metadata

License

Gemma License

Language

Python

Last Updated

Configuration

yaml

services:
  ollama:
    image: ollama/ollama:latest
    container_name: ollama-gemma
    restart: unless-stopped
    ports:
      - "11434:11434"
    volumes:
      - ollama_data:/root/.ollama
    # Uncomment for GPU support:
    # deploy:
    #   resources:
    #     reservations:
    #       devices:
    #         - driver: nvidia
    #           count: all
    #           capabilities: [gpu]
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:11434"]
      interval: 30s
      timeout: 10s
      retries: 3
    entrypoint: ["/bin/sh", "-c", "ollama serve & sleep 5 && ollama pull gemma2 && wait"]

volumes:
  ollama_data:

Community Notes

Help others by adding context, corrections, or warnings about this tool. Sign in to contribute.

No community notes yet. Be the first to add context.