Discover
Every project in the index. Underrated first: good projects that haven’t been noticed yet.
1.3k
- 2.7k
TokenSpeed
LLM serving engine tuned for agentic workloads on datacenter GPUs
- Antoine2.3k
forge
Reliability layer that makes local LLM tool calls succeed more often
6.2k
- andy6.8k
whichllm
Command-line tool that ranks local LLMs that will run on your hardware
9k
- 10.3k
DeepEP
GPU communication kernels for expert-parallel MoE training and inference
- 13.1k
FlashMLA
Optimized attention kernels for DeepSeek model inference on GPUs and NPUs
- Tashfeen38.1k
FreeLLMAPI
Self-hosted gateway that pools free LLM API tiers behind one endpoint
- Ettore Di Giacinto49.8k
LocalAI
Self-hosted engine serving local LLMs, image, voice and video models
- 132k
llama.cpp
C/C++ engine for running large language models on local hardware
184kOllama
Download and run open language models on your own computer with one command
- Salvatore Sanfilippo24k
DwarfStar
Native C inference engine for running a few large open models locally
- 33.8k
tinygrad
Small, readable deep learning framework with its own kernel compiler
- Alex Jones38.2k
llmfit
Terminal tool that matches local LLMs to your CPU, RAM, and GPU
- Andrej58.8k
nanochat
Minimal codebase for training a small chat LLM end to end on one GPU node
- 11.2k
PersonaPlex
Full-duplex speech-to-speech model with prompt-set roles and voices
- 105k
DeepSeek-V3
Open-weight 671B Mixture-of-Experts language model with 128K context
- 22.1k
ONNX Runtime
Cross-platform engine for running and training ONNX machine learning models
- 54.9k
VibeVoice
Open speech recognition and text-to-speech models from Microsoft
41.2k