Local AI model runners

Run open language models on your own machine or GPU server, often behind an OpenAI-compatible API.

Ollama

Generative Artificial Intelligence (GenAI)

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Stars: ★ 184k
Licence: MIT
Updated: yesterday

Docker

Alternative to ChatGPT

llama.cpp

Generative Artificial Intelligence (GenAI)

Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API

Stars: ★ 132k
Licence: MIT
Updated: today

Docker

Alternative to ChatGPT, OpenAI API

vLLM

Generative Artificial Intelligence (GenAI)

High-throughput server for running open language models on GPUs behind an OpenAI-compatible API

Stars: ★ 94.1k
Licence: Apache-2.0
Updated: today

Docker

Alternative to OpenAI API

LocalAI

Generative Artificial Intelligence (GenAI)

Run your AI models locally and generate images and audio (alternative to OpenAI and Claude).

Stars: ★ 49.6k
Licence: MIT
Updated: today

Docker

text-generation-webui

Generative Artificial Intelligence (GenAI)

Browser interface for running local language models with many back-ends and fine-grained controls

Stars: ★ 47.7k
Licence: AGPL-3.0
Updated: 2 months ago

Alternative to ChatGPT

Jan

Generative Artificial Intelligence (GenAI)

Open-source desktop ChatGPT alternative that runs models fully offline

Stars: ★ 45k
Licence: Apache-2.0
Updated: today

Alternative to ChatGPT

SGLang

Generative Artificial Intelligence (GenAI)

Fast GPU serving framework for large language and vision models

Stars: ★ 37.4k
Licence: Apache-2.0
Updated: today

Docker

Alternative to OpenAI API

llamafile

Generative Artificial Intelligence (GenAI)

Mozilla project that packs an AI model and its runner into a single file you can run anywhere

Stars: ★ 26.4k
Licence: Apache-2.0
Updated: 7 days ago

Alternative to ChatGPT

KoboldCpp

Generative Artificial Intelligence (GenAI)

Single-file local AI runner with a built-in story-writing and chat interface

Stars: ★ 12k
Licence: AGPL-3.0
Updated: today

Docker

Alternative to ChatGPT

RamaLama

Generative Artificial Intelligence (GenAI)

Runs AI models in Podman or Docker containers with one command

Stars: ★ 3.1k
Licence: MIT
Updated: today

Docker

Alternative to OpenAI API

More collections

Runs on ARM or a Raspberry Pi9 tools

Apps whose own docs say they run on ARM64 or a Raspberry Pi.

Ready to run with Docker101 tools

Apps that awesome-selfhosted lists with Docker as a way to deploy them.

Leave Google15 tools

Self-hosted replacements for Google Photos, Google Drive, Google Sheets and Google Analytics.

Run your own AI chat17 tools

Self-hosted alternatives to ChatGPT, to run models on your own hardware or connect your own API keys.

Team chat you host3 tools

Self-hosted alternatives to Slack, Discord and Microsoft Teams.

Recently updated125 tools

Apps with a commit in the last 30 days, as of the last stats fetch.

AI chat interfaces7 tools

Self-hosted chat apps that talk to local models or the APIs you choose.

Chat with your documents9 tools

Ask questions across your files, notes and company knowledge, with cited answers.

AI search and research3 tools

Self-hosted answer engines that search the web and write cited answers.

AI image generation4 tools

Generate and edit images (and some video) with open models on your own GPU.

Speech, voice and translation9 tools

Transcription, text-to-speech, voice cloning and machine translation you run yourself.

AI coding assistants3 tools

Code completion, chat and coding agents that work with self-hosted models.

AI agents and workflow builders3 tools

Visual builders for AI agents and automated AI workflows.

AI gateways and observability2 tools

Control, route and monitor model usage across your apps.