Discover
Every project in the index. Underrated first: good projects that haven’t been noticed yet.
- 2.7k
TokenSpeed
LLM serving engine tuned for agentic workloads on datacenter GPUs
- Antoine2.3k
forge
Reliability layer that makes local LLM tool calls succeed more often
- 3.4k
SIE
Self-hosted inference server running many open models behind one API
AI models and runtimesAgent frameworks and toolsServers and infrastructure
6.2k
- 7.3k
vllm-omni
Serving engine for multimodal, diffusion, speech, and action models
- 7.6k
ODS
Installer that sets up a complete private local AI stack on your own machine
- andy6.8k
whichllm
Command-line tool that ranks local LLMs that will run on your hardware
- 12.1k
LMCache
KV cache layer that stores and reuses LLM attention state across engines
- 13.5k
Speech To Speech
Local voice agent pipeline chaining VAD, speech recognition, LLM and TTS
- 5.4k
NVIDIA Model Optimizer
Python library for quantizing, pruning, and distilling models for inference
- 19.6k
KTransformers
CPU-GPU hybrid inference and fine-tuning for large MoE language models
- 78.3k
Unsloth
Desktop and web app for running and fine-tuning local LLMs and diffusion models
- 33.8k
tinygrad
Small, readable deep learning framework with its own kernel compiler
- Andrej58.8k
nanochat
Minimal codebase for training a small chat LLM end to end on one GPU node
- 11.2k
PersonaPlex
Full-duplex speech-to-speech model with prompt-set roles and voices
52.2k
- 105k
DeepSeek-V3
Open-weight 671B Mixture-of-Experts language model with 128K context
- 54.9k
VibeVoice
Open speech recognition and text-to-speech models from Microsoft