Open-source alternatives to OpenAI API
8 open-source projects that do what OpenAI API does. Picked or featured by Willet; numbers are from GitHub.
Last updated
| Project | What it does | Stars | License | Last commit | Self-hostable |
|---|---|---|---|---|---|
| Download and run open language models on your own computer with one command | 184k | MIT | Yes | ||
| C/C++ engine for running large language models on local hardware | 132k | MIT | Yes | ||
| Self-hosted engine serving local LLMs, image, voice and video models | 49.8k | MIT | Yes | ||
| Python library for fast Whisper speech transcription on CPU or GPU | 26k | MIT | No | ||
| Python framework for building tool-using agents on Qwen models | 17.2k | Apache-2.0 | No | ||
| Local voice agent pipeline chaining VAD, speech recognition, LLM and TTS | 13.5k | Apache-2.0 | Yes | ||
| Full-duplex speech-to-speech model with prompt-set roles and voices | 11.2k | MIT | Yes | ||
| Self-hosted inference server running many open models behind one API | 3.4k | Apache-2.0 | Yes |
