Discover

Every project in the index. Underrated first: good projects that haven’t been noticed yet.

14 projects

#model-optimization CLI Clear filters

Bonsai
Setup scripts to run Bonsai 2 low-bit models locally with chat UI
AI models and runtimes
3.4k
DFlash
Block diffusion draft models for faster LLM speculative decoding
AI models and runtimes
6.2k
MLX-VLM
Run and fine-tune vision language models locally on Apple silicon
AI models and runtimes
Prince Canuma5.6k
Magnitude
Local LLM engine that auto-tunes GPU kernels for each model and chip
AI models and runtimes
7.2k
Modded-NanoGPT
Community speedrun for training a GPT-2-scale model as fast as possible
AI models and runtimes Education
Keller Jordan6k
MLX-Audio
Speech synthesis, transcription and voice conversion on Apple Silicon
AI media AI models and runtimes
Prince Canuma8.1k
OBLITERATUS
Toolkit for locating and removing refusal directions in open LLMs
AI models and runtimes
pliny8.9k
stable-diffusion.cpp
C/C++ inference engine for diffusion image and video models
AI models and runtimes AI media
leejet7.7k
Heretic
Automatic abliteration tool that strips refusal behavior from LLMs
AI models and runtimes
Philipp Emanuel Weidmann36k
colibrì
CPU inference engine that streams MoE model experts from disk
AI models and runtimes
Vincenzo Fornaro43k
llama.cpp
C/C++ engine for running large language models on local hardware
AI models and runtimes Self-hosted alternatives
132k
DwarfStar
Native C inference engine for running a few large open models locally
AI models and runtimes AI coding agents
Salvatore Sanfilippo24k
llmfit
Terminal tool that matches local LLMs to your CPU, RAM, and GPU
AI models and runtimes Developer tools
Alex Jones38.2k
BitNet
Inference engine for ternary 1.58-bit language models on CPU and GPU
AI models and runtimes
41.2k