llama.cpp
Generative Artificial Intelligence (GenAI)Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API
- Stars
- ★ 132k
- Licence
- MIT
- Updated
- Docker
Alternative to ChatGPT, OpenAI API

OpenAI-compatible speech server for transcription and text-to-speech
From GitHub, fetched 19 Oct 2026.
Speaches (formerly faster-whisper-server) is a server that offers OpenAI-compatible speech-to-text and text-to-speech endpoints using faster-whisper, Piper and Kokoro models. Point Open WebUI, Home Assistant or your own apps at it instead of OpenAI's audio API.
| Runs with | Docker, Python |
|---|---|
| Docker | Yes The project README documents running it with Docker. |
Sources: github.com/speaches-ai/speaches, checked 19 Oct 2026. “Runs with” is from this listing. Blank means we haven't found it in official docs yet, not that it's unsupported.
Fast C/C++ engine that runs open AI models on ordinary CPUs and GPUs, with a built-in chat page and OpenAI-style API
Alternative to ChatGPT, OpenAI API
High-throughput server for running open language models on GPUs behind an OpenAI-compatible API
Alternative to OpenAI API
Voice cloning and text-to-speech from a few seconds to a minute of sample audio
Alternative to ElevenLabs
Self-hosted AI gateway that puts 100+ model providers behind one OpenAI-style API
Alternative to OpenAI API
Fast GPU serving framework for large language and vision models
Alternative to OpenAI API
Fast, lightweight local text-to-speech that even runs on a Raspberry Pi
Alternative to ElevenLabs