Discover
Every project in the index. Underrated first: good projects that haven’t been noticed yet.
1.3k
- 2.7k
TokenSpeed
LLM serving engine tuned for agentic workloads on datacenter GPUs
- Antoine2.3k
forge
Reliability layer that makes local LLM tool calls succeed more often
- 3.4k
SIE
Self-hosted inference server running many open models behind one API
AI models and runtimesAgent frameworks and toolsServers and infrastructure
- 3.5k
LiteRT
On-device runtime for running ML and generative AI models on edge hardware
- Maziyar Panahi5.7k
OpenMed
Clinical entity extraction and PII de-identification on local hardware
AI models and runtimesHealth and fitnessPrivacy and security
- az5.7k
RLM
Inference library letting language models recursively call themselves via a REPL
6.2k
6.7k
Prince Canuma5.6k
- 7.3k
vllm-omni
Serving engine for multimodal, diffusion, speech, and action models
- 8.2k
TabPFN
Pretrained transformer for classification and regression on tables
9k
- 10.3k
DeepEP
GPU communication kernels for expert-parallel MoE training and inference
- 12.1k
LMCache
KV cache layer that stores and reuses LLM attention state across engines
- 13.1k
FlashMLA
Optimized attention kernels for DeepSeek model inference on GPUs and NPUs
- 13.5k
Speech To Speech
Local voice agent pipeline chaining VAD, speech recognition, LLM and TTS
- 15.5k
ggml
Dependency-free C/C++ tensor library for running ML models anywhere
- 16k
Outlines
Python library that constrains LLM generation to schemas and grammars
- 5.4k
NVIDIA Model Optimizer
Python library for quantizing, pruning, and distilling models for inference
- 19.6k
KTransformers
CPU-GPU hybrid inference and fine-tuning for large MoE language models
- 24.1k
Paddle
Deep learning framework for training and deploying neural networks at scale
- 37.3k
MediaPipe
On-device ML framework and ready-made tasks for vision, audio, and text
- 78.3k
Unsloth
Desktop and web app for running and fine-tuning local LLMs and diffusion models