Discover
Every project in the index. Underrated first: good projects that haven’t been noticed yet.
1.3k
- 2.7k
TokenSpeed
LLM serving engine tuned for agentic workloads on datacenter GPUs
6.2k
- Keller Jordan6k
Modded-NanoGPT
Community speedrun for training a GPT-2-scale model as fast as possible
- leejet7.7k
stable-diffusion.cpp
C/C++ inference engine for diffusion image and video models
9k
- 13.1k
FlashMLA
Optimized attention kernels for DeepSeek model inference on GPUs and NPUs
- 132k
llama.cpp
C/C++ engine for running large language models on local hardware
- Salvatore Sanfilippo24k
DwarfStar
Native C inference engine for running a few large open models locally
- 26k
faster-whisper
Python library for fast Whisper speech transcription on CPU or GPU
- Alex Jones38.2k
llmfit
Terminal tool that matches local LLMs to your CPU, RAM, and GPU
- 22.1k
ONNX Runtime
Cross-platform engine for running and training ONNX machine learning models
41.2k