How do I self-host LocalAI?

LocalAI can be deployed using Docker Compose. The AltStack provides a production-ready configuration that you can deploy on your own server. Simply copy the configuration and run it on any machine with Docker installed.

Is LocalAI free to self-host?

Yes, LocalAI is open source under the MIT and free to self-host. Your only costs are the server infrastructure. A basic cloud VPS starts at around $5-10/month.

What programming language is LocalAI built with?

LocalAI is built with Go. It has 49,518 stars on GitHub, indicating strong community adoption and support.

Back to Self-Hosted Stacks

Deploy LocalAI

The specific build of LocalAI, the free, Open Source OpenAI alternative. Drop-in replacement for OpenAI API.

Quick Start

Create a directory

mkdir localai-self-hosted && cd localai-self-hosted

Create config file

Copy the content from the Config tab below into a file named docker-compose.yml

Deploy

docker compose up -d

Fast Track

Deploy LocalAI in Minutes

Use our optimized Docker templates to deploy LocalAI on any cloud provider. Get $200 in free credit to start on DigitalOcean.

Start with free creditDeploy on DigitalOcean

$200

Metadata

License

MIT

Language

Last Updated

10/14/2026

Configuration

yaml



# -------------------------------------------------------------------------
# 🚀 Created and distributed by The AltStack
# 🌍 https://thealtstack.com
# -------------------------------------------------------------------------

version: '3.8'

services:
  localai:
    image: mudler/localai:latest
    container_name: localai
    restart: unless-stopped
    ports:
      - "8080:8080"

Community Notes

Help others by adding context, corrections, or warnings about this tool. Sign in to contribute.

No community notes yet. Be the first to add context.