Discover
Every project in the index. Underrated first: good projects that haven’t been noticed yet.
29 projects
Remove filter #model-optimization1.3k
- 2.7k
TokenSpeed
LLM serving engine tuned for agentic workloads on datacenter GPUs
3.4k
- 3.5k
LiteRT
On-device runtime for running ML and generative AI models on edge hardware
6.2k
Prince Canuma5.6k
7.2k
- Keller Jordan6k
Modded-NanoGPT
Community speedrun for training a GPT-2-scale model as fast as possible
- Prince Canuma8.1k
MLX-Audio
Speech synthesis, transcription and voice conversion on Apple Silicon
pliny8.9k
- leejet7.7k
stable-diffusion.cpp
C/C++ inference engine for diffusion image and video models
9k
- 12.1k
LMCache
KV cache layer that stores and reuses LLM attention state across engines
- 13.1k
FlashMLA
Optimized attention kernels for DeepSeek model inference on GPUs and NPUs
- 2.8k
LongLive
NVIDIA research code for long video generation and robot world models
- 15.5k
ggml
Dependency-free C/C++ tensor library for running ML models anywhere
- 5.4k
NVIDIA Model Optimizer
Python library for quantizing, pruning, and distilling models for inference
- Ryan Codrai17.4k
turbovec
In-process compressed vector index using TurboQuant quantization
- 9.4k
Sana
Linear diffusion transformer models for fast image and video generation
- 19.6k
KTransformers
CPU-GPU hybrid inference and fine-tuning for large MoE language models
Philipp Emanuel Weidmann36k
Vincenzo Fornaro43k
- 132k
llama.cpp
C/C++ engine for running large language models on local hardware
- Salvatore Sanfilippo24k
DwarfStar
Native C inference engine for running a few large open models locally