How do I self-host Mistral Large 2?

Mistral Large 2 can be deployed using Docker Compose. The AltStack provides a production-ready configuration that you can deploy on your own server. Simply copy the configuration and run it on any machine with Docker installed.

What are the system requirements for self-hosting Mistral Large 2?

The recommended hardware for Mistral Large 2 is: 80GB+ VRAM (FP16), 40GB+ (8-bit). Actual requirements may vary based on usage volume and data size.

Is Mistral Large 2 free to self-host?

Yes, Mistral Large 2 is open source under the Apache-2.0 and free to self-host. Your only costs are the server infrastructure. A basic cloud VPS starts at around $5-10/month.

What programming language is Mistral Large 2 built with?

Mistral Large 2 is built with Jupyter Notebook. It has 10,823 stars on GitHub, indicating strong community adoption and support.

Back to Self-Hosted Stacks

Deploy Mistral Large 2

Flagship 123B model from Mistral AI. Optimized for multilingual, reasoning, and coding tasks.

Quick Start

Create a directory

mkdir mistral-self-hosted && cd mistral-self-hosted

Create config file

Copy the content from the Config tab below into a file named docker-compose.yml

Deploy

docker compose up -d

Fast Track

Deploy Mistral Large 2 in Minutes

Use our optimized Docker templates to deploy Mistral Large 2 on any cloud provider. Get $200 in free credit to start on DigitalOcean.

Start with free creditDeploy on DigitalOcean

$200

Metadata

License

Apache-2.0

Language

Jupyter Notebook

Last Updated

6/16/2026

Configuration

yaml

services:
  ollama:
    image: ollama/ollama:latest
    container_name: ollama-mistral
    restart: unless-stopped
    ports:
      - "11434:11434"
    volumes:
      - ollama_data:/root/.ollama
    # Uncomment for GPU support:
    # deploy:
    #   resources:
    #     reservations:
    #       devices:
    #         - driver: nvidia
    #           count: all
    #           capabilities: [gpu]
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:11434"]
      interval: 30s
      timeout: 10s
      retries: 3
    entrypoint: ["/bin/sh", "-c", "ollama serve & sleep 5 && ollama pull mistral-large && wait"]

volumes:
  ollama_data:

Community Notes

Help others by adding context, corrections, or warnings about this tool. Sign in to contribute.

No community notes yet. Be the first to add context.