• Picks
  • Discover
  • Alternatives
  • About

© 2026 Willet

  • Newsletter
  • About
  • FAQ
  • Terms
  • Privacy & Cookies
Join the Discord (opens in a new tab)
Tashfeen avatar

FreeLLMAPI

Self-hosted gateway that pools free LLM API tiers behind one endpoint

  • AI models and runtimes
  • Self-hosted alternatives
View on GitHub
Website

What it is

FreeLLMAPI gathers the free tiers of dozens of model providers, along with any self-supplied endpoint that speaks the OpenAI format, and serves them through a single /v1 API. It stores provider keys encrypted, routes each request to an available model, fails over when a provider hits its rate limit, and tracks per-key usage against free-tier caps. Hobbyists and tinkerers run it locally or in Docker to point coding agents and OpenAI client libraries at free inference for personal experiments. Desktop and mobile apps are also available.

Images

Facts

Stars
38,093 GitHub stars.
38,093

Forks
5,134
Commits
951
Contributors
99
Language
TypeScript
License
MIT
Last commit
Oct 20, 2026
On GitHub since
April 2026
First release
June 2026
Platforms
web, macOS, Windows, Linux, iOS, Android, self-hosted
Self-hostable
Yes
Alternative to
OpenRouter
Author
Tashfeen
Tags
  • llm-inference
  • llm-gateway
  • proxy

Last synced from GitHub on Oct 20, 2026

The 10 best overlooked open-source projects, every Monday.

Share and more

Comments

No comments yet. Start the conversation.

Similar projects

  • Diego Rodrigues de Sa e Souza avatar

    OmniRoute

    Self-hosted AI gateway routing coding tools to hundreds of LLM providers

    78.8k
  • Chenyme avatar

    Grok2API

    Self-hosted gateway pooling Grok accounts behind OpenAI-style APIs

    7.8k
  • Wesley Liddick avatar

    Claude Relay Service

    Self-hosted relay that pools Claude, OpenAI and Gemini subscriptions

    12.7k

What people are saying

Updated Oct 21, 2026
  • Hacker NewsFree LLM API – every free model behind one keyAug 15, 2026 · 4 points · 0 comments (opens Hacker News in a new tab)
  • Bluesky“FreeLLMAPI bundles free tiers from multiple AI providers into one OpenAI-compatible API. Add your keys, then it handles routing, rate limits, fallback, and…”Jun 6, 2026 · 4 likes · 0 replies (opens Bluesky in a new tab)
  • Hacker NewsFreeLLMAPI – One OpenAI-Compatible API for Multiple Free LLM ProvidersOct 7, 2026 · 1 point · 1 comment (opens Hacker News in a new tab)
  • Bluesky“Free LLM API — 820 models across 48 providers, behind one OpenAI-compatible key. 7.4 billion free tokens per month, tracked in one live catalog.”Sep 26, 2026 · 1 like · 0 replies (opens Bluesky in a new tab)
  • Bluesky“FreeLLMAPI aggregates the free tiers of 18 LLM providers into a single OpenAI-compatible /v1 endpoint, then leans on per-key rate tracking and automatic…”Jul 27, 2026 · 1 like · 0 replies (opens Bluesky in a new tab)
  • Bluesky“FreeLLMAPI routes requests across 34 free LLM providers behind a single OpenAI-compatible endpoint so you avoid juggling API keys.”Sep 23, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“9. AI Reliance Threatens Long-Term Developer Expertise LINK 10. Freellmapi provides unified OpenAI-compatible proxy for 28 free LLM tiers LINK”Aug 25, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)
  • Bluesky“📦 Runs anywhere Node 20+ runs — Linux, Raspberry Pi included — at ~40 MB RSS idle. MIT licensed. Personal experimentation only: no SLA, no frontier models. 🌐”Aug 23, 2026 · 0 likes · 0 replies (opens Bluesky in a new tab)