SSelfHostAlts

vLLM

High-throughput server for running open language models on GPUs behind an OpenAI-compatible API

★ Stars94.1k94,126 on GitHub
Last commit19 Oct 2026
LicenceApache-2.0SPDX, from the repository
View on GitHub ↗

From GitHub, fetched 19 Oct 2026.

Visit vllm.ai ↗

vLLM is an inference server built for serving many users at once from your own GPUs. It supports most popular open models, batches requests efficiently and exposes an OpenAI-compatible API, which makes it the usual choice when a team outgrows a single-user runner.

Self-hosting requirements

Runs withDocker, Python
DockerYes
The project's docs describe running it with Docker.

Sources: docs.vllm.ai/en/latest/deployment/docker, checked 19 Oct 2026. “Runs with” is from this listing. Blank means we haven't found it in official docs yet, not that it's unsupported.

Self-hosted alternative to

In collections

Related tools

llama.cpp

Generative Artificial Intelligence (GenAI)

Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API

Stars
★ 132k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT, OpenAI API

LiteLLM

Generative Artificial Intelligence (GenAI)

Self-hosted AI gateway that puts 100+ model providers behind one OpenAI-style API

Stars
★ 61.6k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API

SGLang

Generative Artificial Intelligence (GenAI)

Fast GPU serving framework for large language and vision models

Stars
★ 37.4k
Licence
Apache-2.0
Updated
  • Docker

Alternative to OpenAI API

Speaches

Generative Artificial Intelligence (GenAI)

OpenAI-compatible speech server for transcription and text-to-speech

Stars
★ 3.7k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API, ElevenLabs

RamaLama

Generative Artificial Intelligence (GenAI)

Runs AI models in Podman or Docker containers with one command

Stars
★ 3.1k
Licence
MIT
Updated
  • Docker

Alternative to OpenAI API

Ollama

Generative Artificial Intelligence (GenAI)

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Stars
★ 184k
Licence
MIT
Updated
  • Docker

Alternative to ChatGPT