Discover
Every project in the index. Underrated first: good projects that haven’t been noticed yet.
- 2.7k
TokenSpeed
LLM serving engine tuned for agentic workloads on datacenter GPUs
- Antoine2.3k
forge
Reliability layer that makes local LLM tool calls succeed more often
- 3.4k
SIE
Self-hosted inference server running many open models behind one API
AI models and runtimesAgent frameworks and toolsServers and infrastructure
- Maziyar Panahi5.7k
OpenMed
Clinical entity extraction and PII de-identification on local hardware
AI models and runtimesHealth and fitnessPrivacy and security
- az5.7k
RLM
Inference library letting language models recursively call themselves via a REPL
6.2k
Prince Canuma5.6k
- 7.3k
vllm-omni
Serving engine for multimodal, diffusion, speech, and action models
- 8.2k
TabPFN
Pretrained transformer for classification and regression on tables
- 12.1k
LMCache
KV cache layer that stores and reuses LLM attention state across engines
- 13.5k
Speech To Speech
Local voice agent pipeline chaining VAD, speech recognition, LLM and TTS
- 16k
Outlines
Python library that constrains LLM generation to schemas and grammars
- 5.4k
NVIDIA Model Optimizer
Python library for quantizing, pruning, and distilling models for inference
- 19.6k
KTransformers
CPU-GPU hybrid inference and fine-tuning for large MoE language models
- 78.3k
Unsloth
Desktop and web app for running and fine-tuning local LLMs and diffusion models
- 168k
Hugging Face Transformers
Python library defining pretrained models for text, vision, and audio
- 26.9k
MiniCPM-V
Open multimodal models for images, video, documents and speech on-device
- 33.8k
tinygrad
Small, readable deep learning framework with its own kernel compiler
- 54.9k
VibeVoice
Open speech recognition and text-to-speech models from Microsoft